Filter option in Kafka connector

Kafka Connector
1

Is it possible to configure filtering for the source connector as below? if yes, where can I find the document about these configuration look like there is no such an option provide in official link Source Configuration Options | Couchbase Docs

name=couchbase-kafka-connector
connector.class=com.couchbase.kafka.CouchbaseSourceConnector
tasks.max=1

# Connection settings
connection.bucket=your_bucket
connection.cluster_address=your_cluster_address
connection.username=your_username
connection.password=your_password

# Kafka topic
topics=your_topic

# Filtering settings
dcp.message.filter=com.couchbase.kafka.filter.JsonFieldFilter
dcp.message.filter.field=_class
dcp.message.filter.value=your_class_value
2

Event filtering is described in that same documentation

https://docs.couchbase.com/kafka-connector/current/source-configuration-options.html#couchbase.event.filter

3

Hi @Sattha !

Custom Filter, SourceHandler, and SinkHandler components can read config properties by implementing the init() method. Here’s the property reading code in CustomFilter from the kafka-connect-couchbase custom components example project:

Thanks,
David

4

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.