Hello,
I have two errors on the connector, the first OOM and the second which bothers me a lot, when I restart the connector it rollback all vbuckets.
The connecor run inside docker, bellow the source config:
CouchbaseSourceTaskConfig values:
02/10/2019 11:06:35 batch.size.max = 2000
02/10/2019 11:06:35 compat.connector_name_in_offsets = true
02/10/2019 11:06:35 connection.bucket = myBucket
02/10/2019 11:06:35 connection.cluster_address = [10.xxxxxxxxxxxxxx, 10.yyyyyyyyyyyy, 10.zzzzzzzzzzzz]
02/10/2019 11:06:35 connection.password = [hidden]
02/10/2019 11:06:35 connection.ssl.enabled = false
02/10/2019 11:06:35 connection.ssl.keystore.location =
02/10/2019 11:06:35 connection.ssl.keystore.password = [hidden]
02/10/2019 11:06:35 connection.timeout.ms = 10000
02/10/2019 11:06:35 connection.username = Administrator
02/10/2019 11:06:35 couchbase.compression = DISABLED
02/10/2019 11:06:35 couchbase.flow_control_buffer = 128m
02/10/2019 11:06:35 couchbase.forceIPv4 = false
02/10/2019 11:06:35 couchbase.log_redaction = NONE
02/10/2019 11:06:35 couchbase.network = auto
02/10/2019 11:06:35 couchbase.persistence_polling_interval = 100ms
02/10/2019 11:06:35 couchbase.stream_from = SAVED_OFFSET_OR_BEGINNING
02/10/2019 11:06:35 dcp.message.converter.class = com.couchbase.connect.kafka.handler.source.RawJsonWithMetadataSourceHandler
02/10/2019 11:06:35 event.filter.class = com.connector.CustomFitlter
The rollback message:
02/10/2019 11:06:36[2019-10-02 09:06:36,969] INFO Selected network: auto -> (com.couchbase.client.dcp.transport.netty.ConfigHandler:120)
02/10/2019 11:06:37[2019-10-02 09:06:37,013] INFO Initializing state from beginning to no end. (com.couchbase.client.dcp.Client:115)
02/10/2019 11:06:37[2019-10-02 09:06:37,021] INFO Resuming from saved offsets for 1024 of 1024 partitions (com.couchbase.connect.kafka.CouchbaseReader:208)
02/10/2019 11:06:37[2019-10-02 09:06:37,098] INFO Connected to Node /10.yyyy.18.43:11210 (com.couchbase.client.dcp.conductor.DcpChannel:120)
02/10/2019 11:06:37[2019-10-02 09:06:37,113] INFO Connected to Node /10.xxxx:11210 (com.couchbase.client.dcp.conductor.DcpChannel:120)
02/10/2019 11:06:37[2019-10-02 09:06:37,486] INFO Connected to Node /10.zzzz:11210 (com.couchbase.client.dcp.conductor.DcpChannel:120)
02/10/2019 11:06:37[2019-10-02 09:06:37,801] INFO Starting to Stream for 1024 partitions (com.couchbase.client.dcp.Client:115)
02/10/2019 11:06:37[2019-10-02 09:06:37,825] WARN Received rollback for vbucket 8 to seqno 0 (com.couchbase.client.dcp.Client:160)
02/10/2019 11:06:37[2019-10-02 09:06:37,825] WARN Rolling back partition 8 to seqno 0 (com.couchbase.connect.kafka.CouchbaseReader:108)
02/10/2019 11:06:37[2019-10-02 09:06:37,828] INFO Stopping to Stream for 1 partitions (com.couchbase.client.dcp.Client:115)
02/10/2019 11:06:37[2019-10-02 09:06:37,829] INFO Starting to Stream for 1 partitions (com.couchbase.client.dcp.Client:115)
02/10/2019 11:06:37[2019-10-02 09:06:37,833] WARN Received rollback for vbucket 16 to seqno 0 (com.couchbase.client.dcp.Client:160)
Thank’s
Samir