Hi All,
While creating one index in one of the CB container we are getting waring as “Cannot communicate with Indexer Process” and same is attached to it. The container getting hang also.
Please advise.
Thanks,
Debasis
check indexer.log for errors. Enable ports Couchbase Server Ports | Couchbase Docs cc @varun.velamuri
Hi @Debasis_Mallick ,
Were you able to see any errors in indexer.log file?
Please feel free to upload logs if your query is not resolved.
Uploading logs
I have the same problem with Couchbase 7.1.3 in a local docker container… Here the errors from indexer.log
If I recreate the container from scratch, it works for a while, I can create 1 or 2 indexes, then indexer stops working. After restart it’s random. Sometimes indexes simply stuck in “warmup” state, sometimes indexer crashes, sometimes it works for a while until it crashes.
Couchbase Container was installed this way:
and in the bucket there are only 8 small documents, so no memory problem or so.
2023-03-09T14:55:05.754+00:00 [Error] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 127.0.0.1:9999 Topic MAINT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891. Err projector.topicMissing
2023-03-09T14:55:05.754+00:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 127.0.0.1:9999
2023-03-09T14:55:05.754+00:00 [Error] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 127.0.0.1:9999 Topic INIT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891. Err projector.topicMissing
2023-03-09T14:55:05.754+00:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 127.0.0.1:9999
2023-03-09T14:55:05.795+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_CONFIG_UPDATE elapsed 762.986µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:55:05.813+00:00 [Error] KVSender::sendMutationTopicRequest Projector 127.0.0.1:9999 Topic MAINT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891 content
Unexpected Error feed.feeder
2023-03-09T14:55:05.813+00:00 [Error] KVSender::openMutationStream MAINT_STREAM content Error Received feed.feeder from 127.0.0.1:9999
2023-03-09T14:55:05.822+00:00 [Error] GetMcConn(): MCResponse status=KEY_ENOENT, opcode=0x89, opaque=0, msg:
2023-03-09T14:55:05.823+00:00 [Warn] Indexer::getCurrentKVTs error=MCResponse status=KEY_ENOENT, opcode=0x89, opaque=0, msg: Retrying (1)
2023-03-09T14:55:06.833+00:00 [Error] KVSender::openMutationStream MAINT_STREAM content Error from Projector feed.feeder
2023-03-09T14:55:06.833+00:00 [Error] Indexer::startKeyspaceIdStream Stream MAINT_STREAM KeyspaceId content SessionId 69759. Error from Projector feed.feeder. Retrying 1.
2023-03-09T14:56:07.015+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_SERVICE_MAP elapsed 1.715097ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.015+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_CLIENT_STATS elapsed 5.751µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.030+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_PREPARE_CREATE_INDEX elapsed 101.571µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.049+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_COMMIT_CREATE_INDEX elapsed 18.737615ms len(expediates) 1 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.051+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 1.932047ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.746+00:00 [Error] watcher:ClientAuth cluster Ver (6)/Internal Version () not yet initialised
2023-03-09T14:56:07.748+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_SERVICE_MAP elapsed 1.647418ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.749+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_REPLICA_COUNT elapsed 11.125µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.751+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9100. Error = read tcp 127.0.0.1:47522->127.0.0.1:9100: use of closed network connection. Kill Pipe.
2023-03-09T14:56:07.751+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:47522. Error = EOF. Kill Pipe.
2023-03-09T14:56:08.382+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 10.287325ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.373+00:00 [Error] DATP[->dataport “:9103”] Accept() Error: accept tcp4 0.0.0.0:9103: use of closed network connection
2023-03-09T14:56:09.373+00:00 [Error] receiving packet: read tcp4 127.0.0.1:9103->127.0.0.1:46892: use of closed network connection
2023-03-09T14:56:09.373+00:00 [Error] DATP[->dataport “:9103”] worker “127.0.0.1:46892” exit: read tcp4 127.0.0.1:9103->127.0.0.1:46892: use of closed network connection
2023-03-09T14:56:09.373+00:00 [Error] DATP[->dataport “:9103”] fatal remote “127.0.0.1:46892” already gone
2023-03-09T14:56:09.383+00:00 [Error] KVSender::sendDelKeyspacesRequest Unexpected Error During Del Buckets Request Projector 127.0.0.1:9999 Topic INIT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891 KeyspaceIds [content]. Err genServer.closed
2023-03-09T14:56:09.383+00:00 [Error] KVSender::deleteKeyspacesFromStream INIT_STREAM [content] Error Received genServer.closed from 127.0.0.1:9999
2023-03-09T14:56:09.385+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 10.708742ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.390+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_PREPARE_CREATE_INDEX elapsed 66.836µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.440+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_COMMIT_CREATE_INDEX elapsed 49.303086ms len(expediates) 1 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.442+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 2.170499ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.738+00:00 [Error] watcher:ClientAuth cluster Ver (6)/Internal Version () not yet initialised
2023-03-09T14:56:09.740+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_SERVICE_MAP elapsed 1.735139ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.741+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_REPLICA_COUNT elapsed 9.03µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.742+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9100. Error = read tcp 127.0.0.1:36444->127.0.0.1:9100: use of closed network connection. Kill Pipe.
2023-03-09T14:56:09.742+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:36444. Error = EOF. Kill Pipe.
2023-03-09T14:56:10.729+00:00 [Error] DATP[->dataport “:9103”] Accept() Error: accept tcp4 0.0.0.0:9103: use of closed network connection
2023-03-09T14:56:10.729+00:00 [Error] receiving packet: read tcp4 127.0.0.1:9103->127.0.0.1:45124: use of closed network connection
2023-03-09T14:56:10.729+00:00 [Error] DATP[->dataport “:9103”] worker “127.0.0.1:45124” exit: read tcp4 127.0.0.1:9103->127.0.0.1:45124: use of closed network connection
2023-03-09T14:56:10.732+00:00 [Error] KVSender::sendDelKeyspacesRequest Unexpected Error During Del Buckets Request Projector 127.0.0.1:9999 Topic INIT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891 KeyspaceIds [fts]. Err genServer.closed
2023-03-09T14:56:10.732+00:00 [Error] KVSender::deleteKeyspacesFromStream INIT_STREAM [fts] Error Received genServer.closed from 127.0.0.1:9999
2023-03-09T14:56:10.739+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 10.758309ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:10.744+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_PREPARE_CREATE_INDEX elapsed 70.115µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
The issue got resolved with the help of support Team.
@Debasis_Mallick can you tell us what the problem was? I’m in contact with enterprise support for a few days now, but maybe it’s faster to solve it, if it’s the same problem as you had. Thanks 
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.