Interface IKNetSourceTask

Namespace

MASES.KNet.Connect

Assembly

MASES.KNet.dll

Helper interface for KNetSourceTask<TTask>

public interface IKNetSourceTask : IKNetTask, ITask, IKNetCommon, IKNetConnectLogging

Inherited Members

IKNetTask.Properties

IKNetTask.Connector

IKNetTask.TaskId

IKNetTask.Start(IReadOnlyDictionary<string, string>)

ITask.Version()

ITask.Start(Map<String, String>)

ITask.Stop()

IKNetCommon.ExecuteOnRemote(string, params object[])

IKNetCommon.ExecuteOnRemote<T>(string, params object[])

IKNetConnectLogging.Name

IKNetConnectLogging.IsTraceEnabled

IKNetConnectLogging.LogTrace(string)

IKNetConnectLogging.LogTrace(string, JVMBridgeException)

IKNetConnectLogging.LogTrace(string, params object[])

IKNetConnectLogging.IsDebugEnabled

IKNetConnectLogging.LogDebug(string)

IKNetConnectLogging.LogDebug(string, JVMBridgeException)

IKNetConnectLogging.LogDebug(string, params object[])

IKNetConnectLogging.IsInfoEnabled

IKNetConnectLogging.LogInfo(string)

IKNetConnectLogging.LogInfo(string, JVMBridgeException)

IKNetConnectLogging.LogInfo(string, params object[])

IKNetConnectLogging.IsWarnEnabled

IKNetConnectLogging.LogWarn(string)

IKNetConnectLogging.LogWarn(string, JVMBridgeException)

IKNetConnectLogging.LogWarn(string, params object[])

IKNetConnectLogging.IsErrorEnabled

IKNetConnectLogging.LogError(string)

IKNetConnectLogging.LogError(string, JVMBridgeException)

IKNetConnectLogging.LogError(string, params object[])

Properties

UseOnlyAsync

Implement the method to declare if out-of-sync feature will be used: it will be set once within KNetSourceTask<TTask> invocation of Start(IReadOnlyDictionary<string, string>)

bool UseOnlyAsync { get; }

Property Value

bool

Returning true will use the out-of-sync feature, otherwise returning false the feature is disabled which is the default behavior.

Remarks

Be aware that returning true from this method will be mutually exclusive between the usage of PushRecordAsync(SourceRecord) and invocation of Poll()

Methods

CreateAndPushRecordAsync<TValue>(string, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TValue>(string topic, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TValue>(string, int?, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TValue>(string topic, int? partition, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKey, TValue>(string, Schema, TKey, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKey, TValue>(string topic, Schema keySchema, TKey key, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKey, TValue>(string, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKey, TValue>(string topic, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, DateTime, Headers, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Headers headers, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

headers Headers

The Headerss; may be null or empty

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKey, TValue>(string, int?, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKey, TValue>(string topic, int? partition, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecordAsync<TKeySource, TOffset, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TKey, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema keySchema, TKey key, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue, DateTime, Headers)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Headers headers)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

headers Headers

The Headerss; may be null or empty

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM in async mode using PushRecordAsync(SourceRecord), i.e. without waiting the invocation of Poll to return back the list of SourceRecord

void CreateAndPushRecordAsync<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TValue>(string, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TValue>(string topic, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TValue>(string, int?, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TValue>(string topic, int? partition, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKey, TValue>(string, Schema, TKey, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKey, TValue>(string topic, Schema keySchema, TKey key, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKey, TValue>(string, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKey, TValue>(string topic, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, DateTime, Headers, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Headers headers, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

headers Headers

The Headerss; may be null or empty

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKey, TValue>(string, int?, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKey, TValue>(string topic, int? partition, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateAndPushRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TKey, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema keySchema, TKey key, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue, DateTime, Headers)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Headers headers)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

headers Headers

The Headerss; may be null or empty

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue> and push it to JVM

void CreateAndPushRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TValue>(string, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<object, TValue> CreateRecord<TValue>(string topic, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<object, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TValue>(string, int?, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<object, TValue> CreateRecord<TValue>(string topic, int? partition, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<object, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKey, TValue>(string, Schema, TKey, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<TKey, TValue> CreateRecord<TKey, TValue>(string topic, Schema keySchema, TKey key, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<TKey, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKey, TValue>(string, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<TKey, TValue> CreateRecord<TKey, TValue>(string topic, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<TKey, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<TKey, TValue> CreateRecord<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<TKey, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, DateTime, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<TKey, TValue> CreateRecord<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<TKey, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKey, TValue>(string, int?, Schema, TKey, Schema, TValue, DateTime, Headers, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<TKey, TValue> CreateRecord<TKey, TValue>(string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Headers headers, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

headers Headers

The Headerss; may be null or empty

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<TKey, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKey, TValue>(string, int?, Schema, TValue, Map<String, object>, Map<String, object>)

Creates a new SourceRecord<TKey, TValue>

SourceRecord<TKey, TValue> CreateRecord<TKey, TValue>(string topic, int? partition, Schema valueSchema, TValue value, Map<String, object> sourcePartition = null, Map<String, object> sourceOffset = null)

Parameters

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

sourcePartition Map<String, object>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, object>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

Returns

SourceRecord<TKey, TValue>

A newvly allocated SourceRecord<TKey, TValue>

Type Parameters

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values).

CreateRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, object, TValue> CreateRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Returns

SourceRecord<TKeySource, TOffset, object, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, object, TValue> CreateRecord<TKeySource, TOffset, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Returns

SourceRecord<TKeySource, TOffset, object, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TKey, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, TKey, TValue> CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema keySchema, TKey key, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Returns

SourceRecord<TKeySource, TOffset, TKey, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, TKey, TValue> CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Returns

SourceRecord<TKeySource, TOffset, TKey, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, TKey, TValue> CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Returns

SourceRecord<TKeySource, TOffset, TKey, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue, DateTime)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, TKey, TValue> CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

Returns

SourceRecord<TKeySource, TOffset, TKey, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TKey, Schema, TValue, DateTime, Headers)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, TKey, TValue> CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema keySchema, TKey key, Schema valueSchema, TValue value, DateTime timestamp, Headers headers)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

keySchema Schema

The schema for the key; may be null

key TKey

The key; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

timestamp DateTime

The timestamp; may be null

headers Headers

The Headerss; may be null or empty

Returns

SourceRecord<TKeySource, TOffset, TKey, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type within Map<K, V> of sourcePartition

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource>, Map<String, TOffset>, string, int?, Schema, TValue)

Creates a new SourceRecord<TKeySource, TOffset, TKey, TValue>

SourceRecord<TKeySource, TOffset, TKey, TValue> CreateRecord<TKeySource, TOffset, TKey, TValue>(Map<String, TKeySource> sourcePartition, Map<String, TOffset> sourceOffset, string topic, int? partition, Schema valueSchema, TValue value)

Parameters

sourcePartition Map<String, TKeySource>

The parameter represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition).

sourceOffset Map<String, TOffset>

The parameter represents a position in that sourcePartition which can be used to resume consumption of data.

topic string

The name of the topic; may be null

partition int?

The partition number for the Kafka topic; may be null

valueSchema Schema

The schema for the value; may be null

value TValue

The value; may be null

Returns

SourceRecord<TKeySource, TOffset, TKey, TValue>

A newvly allocated SourceRecord<TKeySource, TOffset, TKey, TValue>

Type Parameters

TKeySource

The type within Map<K, V> of sourcePartition

TOffset

The type within Map<K, V> of sourceOffset

TKey

The type of the key to be inserted in Kafka

TValue

The type of value to be inserted in Kafka

Remarks

These values can have arbitrary structure and should be represented using Org.Apache.Kafka.Connect.Data.* objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a long containing the timestamp of the row.

PushRecordAsync(SourceRecord)

If UseOnlyAsync is true, each record is accumulated in a list outside the scope of Poll() invocation. The method can be useful in condition where records are generated in parallel, e.g. with async methods, so it becomes less useful to wait the Poll() invocation to move the records within the JVM

void PushRecordAsync(SourceRecord record)

Parameters

record SourceRecord

The SourceRecord to be pushed in async within the JVM queue

Remarks

When the JVM will invoke its internal poll, the invocation of PushRecordAsync(SourceRecord) can be locked waiting for the JVM to return the accumulated SourceRecord