How to connect Apache kafka to couchbase by couchbase connector

Kafka Connector
,
1

Hello every one,
I tried to understand this Tutorial but it isn’t clear.
I’m gonna sink kafka with couchbase.

I’ll appreciate if any one assists me.

2

Any specific question? Or do you have any errors in the logs?

3

Thanks, many thanks for quick reply.
I need a more complete document to how to sink Kafka to Couchbase.
that document is very short.
I tired to did that, let me explain:
I tried to use Apache Kafka:

  1. download kafka-connect-couchbase-3.1.3.zip,
  2. copy etc/kafka-connect-couchbase/ files to kafka_2.12-0.11.0.0/config
  3. copy share/java/ files to kafka_2.12-0.11.0.0/libs
    and when tired to run I encountred some error regarding avro.
    actually, I tried that with confluent too:
  4. download confluent-oss-3.2.2-2.11.tar.gz and extract.
  5. copy etc/kafka-connect-couchbase/ files to etc/
  6. copy share/java/ files to /share/java
  7. try: bin/connect-standalone.sh config/connect-standalone.properties config/_
  8. quickstart-couchbase-sink.properties config is:

name=test-couchbase-sink
connector.class=com.couchbase.connect.kafka.CouchbaseSinkConnector
tasks.max=1
topics=testtopic
connection.cluster_address=110.133.96.10
connection.bucket=testbucket
connection.timeout.ms=2000

and I encountred some error those I’m on them. :slight_smile:

4

What are the errors? I set this up just last week and I noticed that some of the paths have changed, but I was able to set it up just fine.

With confluent-3.2.2, here’s the layout I used to conform to their path:

ingenthr-mbp:confluent-3.2.2 ingenthr$ find . -type d -name '*couchbase*' |xargs find
./etc/kafka-connect-couchbase
./etc/kafka-connect-couchbase/connect-distributed.properties
./etc/kafka-connect-couchbase/connect-standalone.properties
./etc/kafka-connect-couchbase/quickstart-couchbase-sink.properties
./etc/kafka-connect-couchbase/quickstart-couchbase.properties
./share/java/kafka-connect-couchbase
./share/java/kafka-connect-couchbase/commons-io-2.5.jar
./share/java/kafka-connect-couchbase/core-io-1.4.5.jar
./share/java/kafka-connect-couchbase/dcp-client-0.10.0.jar
./share/java/kafka-connect-couchbase/java-client-2.4.5.jar
./share/java/kafka-connect-couchbase/kafka-connect-couchbase-3.1.3.jar
./share/java/kafka-connect-couchbase/rxjava-1.2.7.jar
./share/java/kafka-connect-couchbase-3.1.3
./share/java/kafka-connect-couchbase-3.1.3/etc
./share/java/share/doc/kafka-connect-couchbase
./share/java/share/doc/kafka-connect-couchbase/LICENSE
./share/java/share/doc/kafka-connect-couchbase/README.md
5

Sorry, may be I could not explain my issue completely(sorry for my English).
I need a good and complete document, the document that I mentioned at the top, it told you could use Apache Kafka directly, but there is not enough guidance.
on the other hand, when I checked log file, I guessed we need some Avro configuration that did not mention in that Doc.