Example configurations for the Kafka Source Connector
Examples
All examples assume a remote Kafka Cluster using a PLAIN listener and access to the given resources, unless mentioned otherwise in the example.
Example 1 - Minimal configuration
Minimal configuration, specifying the remote cluster and topics to read from, the target topic name to write to.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/minimal-config.json[]Example 2 - Minimal configuration using TLS Client certificate
Minimal configuration, specifying the remote cluster and topics to read from, the target topic name to write to.
The remote cluster uses TLS and requires a client certificate to be provided.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/minimal-config-with-tls.json[]Example 3 - Using mapping topic selector
Maps incoming records from two subscribed topics to two different output topics.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/topping-selector-mapping-config.json[]Example 4 - Using source topic selector
Maps incoming records to the same topic name as were they came from.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/topping-selector-source-config.json[]Example 5 - Using prefix topic selector
Maps incoming records to the same topic name as were they came from, but with the specified prefix prepended.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/topping-selector-prefix-config.json[]Example 6 - Forwarding remote metadata
Adds headers to each produced record containing the originating topic, partition, offset and timestamp.
The timestamp type will be appended as a header with -Type appended to the specified timestamp header name.
Using the timestamp header X-Kafka-Original-Timestamp will also create the header X-Kafka-Original-Timestamp-Type.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/metadata-forwarding-config.json[]Example 7 - Using static headers
Two static headers are added to each produced record.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/static-header-config.json[]Example 8 - Prefixing remote headers
Header names of the record from the remote system will be forwarded, with the name prefixed
with Remote- on the record produced to the local system.
Unresolved include directive in modules/ROOT/pages/developer/connect-plugins-catalog/axual/kafka-source/examples.adoc - include::example$/kafka-source/prefix-header-config.json[]