Distributed dcp with couchbase CE and Kafka connect

Hi, currently exploring on Kafka connect and couchbase server community edition. I see that the distributed dcp is only supported in couchbase enterprise version. Also, sync gateway CE cluster can have only one import node which receives dcp stream and updates docs. My question is, if I run Kafka connect in distributed mode and connect to couchbase CE cluster, how the dcp-client works? Will the mutation events be partitioned among all Kafka connect nodes?

Hi @srinath, welcome to the Couchbase Forums.

I see that the distributed dcp is only supported in couchbase enterprise version

I think you may be referring to the Enterprise Edition (EE) vs Community Edition (CE) matrix, where it says “Distributed DCP consumer” is not supported in CE. That statement is referring to the Couchbase Eventing Service, not DCP in general.

Both EE and CE support the DCP protocol used by the Couchbase Kafka connector.

As stated on the Kafka Connector compatibility documentation, the Couchbase Kafka connector is compatible with both EE and CE. It works the same regardless of whether it’s connecting to EE or CE.

Will the mutation events be partitioned among all Kafka connect nodes?

Yes.

Thanks,
David

1 Like

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.