Class KafkaPipelineDestination<T, TRecordKey, TRecordValue>

Namespace

Pipelinez.Kafka.Destination

Assembly

Pipelinez.Kafka.dll

Publishes pipeline records to a Kafka topic.

public class KafkaPipelineDestination<T, TRecordKey, TRecordValue> : PipelineDestination<T>, IPipelineDestination<T>, IFlowDestination<PipelineContainer<T>>, IPipelineExecutionConfigurable, IPipelineRetryConfigurable<T> where T : PipelineRecord where TRecordKey : class where TRecordValue : class

Type Parameters

T

The pipeline record type.

TRecordKey

The Kafka message key type.

TRecordValue

The Kafka message value type.

Inheritance

object

PipelineDestination<T>

KafkaPipelineDestination<T, TRecordKey, TRecordValue>

Implements

IPipelineDestination<T>

IFlowDestination<PipelineContainer<T>>

IPipelineExecutionConfigurable

IPipelineRetryConfigurable<T>

Inherited Members

PipelineDestination<T>.Logger

PipelineDestination<T>.Completion

PipelineDestination<T>.AsTargetBlock()

PipelineDestination<T>.StartAsync(CancellationTokenSource)

PipelineDestination<T>.Initialize(Pipeline<T>)

PipelineDestination<T>.ConfigureExecutionOptions(PipelineExecutionOptions)

PipelineDestination<T>.GetExecutionOptions()

PipelineDestination<T>.ConfigureRetryPolicy(PipelineRetryPolicy<T>)

PipelineDestination<T>.GetRetryPolicy()

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

KafkaPipelineDestination(string, KafkaDestinationOptions, Func<T, Message<TRecordKey, TRecordValue>>)

Initializes a new Kafka pipeline destination for the specified pipeline.

public KafkaPipelineDestination(string pipelineName, KafkaDestinationOptions config, Func<T, Message<TRecordKey, TRecordValue>> messageMapper)

Parameters

pipelineName string

The owning pipeline name.

config KafkaDestinationOptions

The Kafka destination configuration.

messageMapper Func<T, Message<TRecordKey, TRecordValue>>

Maps a pipeline record to the Kafka message to publish.

Methods

ExecuteAsync(T, CancellationToken)

Executes the destination logic for a successfully processed record.

protected override Task ExecuteAsync(T record, CancellationToken cancellationToken)

Parameters

record T

The record to write.

cancellationToken CancellationToken

The cancellation token for the execution.

Returns

Task

Initialize()

Provides an opportunity for the destination to initialize transport-specific state.

protected override void Initialize()