Checking the max batch size option available for sink configurations. My requirement is to check the througput as the data produces 50k at a time. Checking for batch size option as it may increase throughput.

Hi Casavi. Short answer: The Couchbase Kafka Sink Connector does not have a config option for tuning the batch size. Long answer: The Kafka Connect framework sends records to the Couchbase Kafka Sink Connector in batches. The size of these batches is not controlled by the Couchbase connector; if…

Did not see th eoption of couchbase.batch.size.max is sink configuration. Is it not supporting for multiple batch insertions?

Kafka Connector

david.nault June 12, 2023, 4:45pm 9

Hi Vasavi, check out this similar discussion:

Topic		Replies	Views
Kafka-couchbase-connect sink couchbase.remove.document.id=true is not working Kafka Connector	17	2391	November 26, 2022
SinkHandler extension point coming in 4.1 Kafka Connector announcement	0	861	June 25, 2021
[ANN] Kafka Connector 3.3.2 Kafka Connector announcement	0	1392	July 16, 2018
Kafka Sink Connector - Write to multiple bucket with single connector Kafka Connector connector	3	890	November 10, 2022
CouchBase cluster migration and Kafka Source Connector Behavior Kafka Connector kafka , migration	11	315	September 12, 2024

Did not see th eoption of couchbase.batch.size.max is sink configuration. Is it not supporting for multiple batch insertions?

Related topics