Environment: MacOS
K8s Cluster: Kind
Endpoint: localhost:5984
unambiguous timeout | {“InnerError”:{“InnerError”:{“InnerError”:{},“Message”:“unambiguous timeout”}},“OperationID”:“WaitUntilReady”,“Opaque”:“”,"Tim
eObserved":25000583949,“RetryReasons”:[“NOT_READY”],“RetryAttempts”:30,“LastDispatchedTo”:“”,“LastDispatchedFrom”:“”,“LastConnectionID”:“”}
Logs:
GOCB 20:45:53.340471 cluster.go:282: SDK Version: gocbcore/v10.1.5
GOCB 20:45:53.341304 cluster.go:282: Creating new agent group: &{AgentConfig:{BucketName: UserAgent:gocb/v2.5.3 SeedConfig:{HTTPAddrs: MemdAddrs:[localhost:5984]} SecurityConfig:{UseTLS:false TLSRootCAProvider: NoTLSSeedNode:false Auth:0xc000091b70 AuthMechanisms:} CompressionConfig:{Enabled:true DisableDecompression:false MinSize:0 MinRatio:0} ConfigPollerConfig:{HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s} IoConfig:{NetworkType: UseMutationTokens:true UseDurations:true UseOutOfOrderResponses:true DisableXErrorHello:false DisableJSONHello:false DisableSyncReplicationHello:false EnablePITRHello:false UseCollections:true} KVConfig:{ConnectTimeout:1m35s ServerWaitBackoff:0s PoolSize:0 MaxQueueSize:0 ConnectionBufferSize:0} HTTPConfig:{MaxIdleConns:0 MaxIdleConnsPerHost:0 ConnectTimeout:0s IdleConnectionTimeout:0s} DefaultRetryStrategy:0xc000091a50 CircuitBreakerConfig:{Enabled:true VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback: CanaryTimeout:0s} OrphanReporterConfig:{Enabled:true ReportInterval:0s SampleSize:0} TracerConfig:{Tracer:0xc000091a60 NoRootTraceSpans:true} MeterConfig:{Meter:} InternalConfig:{EnableResourceUnitsTrackingHello:false}}}
GOCB 20:45:53.343609 agentgroup.go:30: SDK Version: gocbcore/v10.1.5
GOCB 20:45:53.344159 agentgroup.go:30: Creating new agent: &{BucketName: UserAgent:gocb/v2.5.3 SeedConfig:{HTTPAddrs: MemdAddrs:[localhost:5984]} SecurityConfig:{UseTLS:false TLSRootCAProvider: NoTLSSeedNode:false Auth:0xc000091b70 AuthMechanisms:} CompressionConfig:{Enabled:true DisableDecompression:false MinSize:0 MinRatio:0} ConfigPollerConfig:{HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s} IoConfig:{NetworkType: UseMutationTokens:true UseDurations:true UseOutOfOrderResponses:true DisableXErrorHello:false DisableJSONHello:false DisableSyncReplicationHello:false EnablePITRHello:false UseCollections:true} KVConfig:{ConnectTimeout:1m35s ServerWaitBackoff:0s PoolSize:0 MaxQueueSize:0 ConnectionBufferSize:0} HTTPConfig:{MaxIdleConns:0 MaxIdleConnsPerHost:0 ConnectTimeout:0s IdleConnectionTimeout:0s} DefaultRetryStrategy:0xc000091a50 CircuitBreakerConfig:{Enabled:true VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback: CanaryTimeout:0s} OrphanReporterConfig:{Enabled:true ReportInterval:0s SampleSize:0} TracerConfig:{Tracer:0xc000091a60 NoRootTraceSpans:true} MeterConfig:{Meter:} InternalConfig:{EnableResourceUnitsTrackingHello:false}}
GOCB 20:45:53.345144 agent.go:76: HTTP muxer applying endpoints:
Bucket:
Capi Eps:
Mgmt Eps:
N1ql Eps:
FTS Eps:
CBAS Eps:
Eventing Eps:
GSI Eps:
Backup Eps:
GOCB 20:45:53.345267 agent.go:407: KV muxer applying endpoints:
Bucket:
- localhost:5984
GOCB 20:45:53.345458 agentgroup.go:40: HTTP muxer applying endpoints:
Bucket:
Capi Eps:
Mgmt Eps:
N1ql Eps:
FTS Eps:
CBAS Eps:
Eventing Eps:
GSI Eps:
Backup Eps:
GOCB 20:45:53.345664 ???:0: Pipeline Clientlocalhost:5984/0xc000094540
preparing for new client loop
GOCB 20:45:53.345766 pollercontroller.go:103: CCCP Looper starting.
GOCB 20:45:53.345803 ???:0: Pipeline Clientlocalhost:5984/0xc000094540
retrieving new client connection for parent 0xc000094480
GOCB 20:45:53.345883 cluster.go:288: Initializing transactions: CustomATRLocation:%!s(PANIC=String method: runtime error: invalid memory address or nil pointer dereference) ExpirationTime:0s DurabilityLevel:MAJORITY KeyValueTimeout:2.5s CleanupWindow:0s CleanupClientAttempts:true CleanupLostAttempts:true CleanupQueueSize:0 BucketAgentProvider:0x12d9580 LostCleanupATRLocationProvider:0x12d9600 Internal:{EnableNonFatalGets:false EnableParallelUnstaging:false EnableExplicitATRs:false EnableMutationCaching:false NumATRs:0}
GOCB 20:45:53.346401 ???:0: Starting cleanup for 0xc000096910
GOCB 20:45:53.346562 agentgroup.go:75: SDK Version: gocbcore/v10.1.5
GOCB 20:45:53.346657 ???:0: Lost transactions cf8a276a-f67b-4fc6-a4c4-942cc251231f starting
GOCB 20:45:53.346716 agentgroup.go:75: Creating new agent: &{BucketName:travel-sample UserAgent:gocb/v2.5.3 SeedConfig:{HTTPAddrs: MemdAddrs:[localhost:5984]} SecurityConfig:{UseTLS:false TLSRootCAProvider: NoTLSSeedNode:false Auth:0xc000091b70 AuthMechanisms:} CompressionConfig:{Enabled:true DisableDecompression:false MinSize:0 MinRatio:0} ConfigPollerConfig:{HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s} IoConfig:{NetworkType: UseMutationTokens:true UseDurations:true UseOutOfOrderResponses:true DisableXErrorHello:false DisableJSONHello:false DisableSyncReplicationHello:false EnablePITRHello:false UseCollections:true} KVConfig:{ConnectTimeout:1m35s ServerWaitBackoff:0s PoolSize:0 MaxQueueSize:0 ConnectionBufferSize:0} HTTPConfig:{MaxIdleConns:0 MaxIdleConnsPerHost:0 ConnectTimeout:0s IdleConnectionTimeout:0s} DefaultRetryStrategy:0xc000091a50 CircuitBreakerConfig:{Enabled:true VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback: CanaryTimeout:0s} OrphanReporterConfig:{Enabled:true ReportInterval:0s SampleSize:0} TracerConfig:{Tracer:0xc000091a60 NoRootTraceSpans:true} MeterConfig:{Meter:} InternalConfig:{EnableResourceUnitsTrackingHello:false}}
GOCB 20:45:53.346960 agent.go:76: HTTP muxer applying endpoints:
Bucket:
Capi Eps:
Mgmt Eps:
N1ql Eps:
FTS Eps:
CBAS Eps:
Eventing Eps:
GSI Eps:
Backup Eps:
GOCB 20:45:53.347014 agent.go:407: KV muxer applying endpoints:
Bucket: - localhost:5984
GOCB 20:45:53.347090 client.go:148: Shutting down global level agent
GOCB 20:45:53.347249 ???:0: Pipeline Clientlocalhost:5984/0xc000094b40
preparing for new client loop
GOCB 20:45:53.347329 ???:0: Pipeline Clientlocalhost:5984/0xc000094b40
retrieving new client connection for parent 0xc000094a80
GOCB 20:45:53.347387 cccpcfgcontroller.go:119: CCCPPOLL: CCCP request was cancelled or connection was shutdown: request canceled
GOCB 20:45:53.347452 pollercontroller.go:103: CCCPPOLL: CCCP request was cancelled.
GOCB 20:45:53.347328 kvmux.go:440: Pipeline Clientlocalhost:5984/0xc000094540
received close request
GOCB 20:45:53.347543 kvmux.go:440: Pipeline clientlocalhost:5984/0xc000094540
closing consumer 0x0
GOCB 20:45:53.347262 pollercontroller.go:103: CCCP Looper starting.
GOCB 20:45:53.347642 kvmux.go:692: Failed to connect. check server ports and cluster encryption setting: dial tcp: lookup localhost: operation was canceled
GOCB 20:45:53.347291 ???:0: Bootstrap error found before config seen:
GOCB 20:45:53.347885 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:53.347844 ???:0: Pipeline Clientlocalhost:5984/0xc000094540
preparing for new client loop
GOCB 20:45:53.348168 ???:0: Pipeline Clientlocalhost:5984/0xc000094540
is shutting down
GOCB 20:45:53.348047 asm_amd64.s:1594: Will retry request. Backoff=1ms, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:53.348228 kvmux.go:440: Pipeline Clientlocalhost:5984/0xc000094540
has exited
GOCB 20:45:53.348492 agent.go:424: Draining queue &{address:localhost:5984 getClientFn:0x1294ae0 maxItems:2048 queue:0xc0000c6360 maxClients:1 clients: clientsLock:{state:0 sema:0} isSeedNode:true}
GOCB 20:45:53.349493 ???:0: Bootstrap error found before config seen:
GOCB 20:45:53.349573 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:53.349617 asm_amd64.s:1594: Will retry request. Backoff=10ms, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:53.359342 kvmux.go:692: Memdclientlocalhost:5984/0xc000224000
Fetching cluster client data
GOCB 20:45:53.359573 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0x1f. Opaque=1
GOCB 20:45:53.359804 ???:0: Bootstrap error found before config seen:
GOCB 20:45:53.359879 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:53.359800 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0xfe. Opaque=2
GOCB 20:45:53.359925 asm_amd64.s:1594: Will retry request. Backoff=50ms, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:53.360091 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0x20. Opaque=3
GOCB 20:45:53.360331 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0x21. Opaque=4
GOCB 20:45:53.410470 ???:0: Bootstrap error found before config seen:
GOCB 20:45:53.410598 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:53.410660 asm_amd64.s:1594: Will retry request. Backoff=100ms, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:53.511826 ???:0: Bootstrap error found before config seen:
GOCB 20:45:53.511955 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:53.512017 asm_amd64.s:1594: Will retry request. Backoff=500ms, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:54.012247 ???:0: Bootstrap error found before config seen:
GOCB 20:45:54.012348 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:54.012397 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:55.012767 ???:0: Bootstrap error found before config seen:
GOCB 20:45:55.012898 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:55.015379 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:56.015597 ???:0: Bootstrap error found before config seen:
GOCB 20:45:56.015738 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:56.015788 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:56.347892 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
GOCB 20:45:56.347985 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
GOCB 20:45:57.016483 ???:0: Bootstrap error found before config seen:
GOCB 20:45:57.016641 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:57.016737 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:58.017700 ???:0: Bootstrap error found before config seen:
GOCB 20:45:58.017856 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:58.017921 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:45:59.019042 ???:0: Bootstrap error found before config seen:
GOCB 20:45:59.019152 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:45:59.019193 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:00.020801 ???:0: Bootstrap error found before config seen:
GOCB 20:46:00.020928 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:00.020982 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:01.025423 ???:0: Bootstrap error found before config seen:
GOCB 20:46:01.025540 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:01.025608 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:01.849348 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
GOCB 20:46:01.849560 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
GOCB 20:46:02.026492 ???:0: Bootstrap error found before config seen:
GOCB 20:46:02.026644 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:02.026726 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:03.026884 ???:0: Bootstrap error found before config seen:
GOCB 20:46:03.027065 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:03.027197 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:04.029364 ???:0: Bootstrap error found before config seen:
GOCB 20:46:04.029753 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:04.029864 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:05.030173 ???:0: Bootstrap error found before config seen:
GOCB 20:46:05.030339 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:05.030409 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:06.032042 ???:0: Bootstrap error found before config seen:
GOCB 20:46:06.032200 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:06.032266 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:07.033528 ???:0: Bootstrap error found before config seen:
GOCB 20:46:07.033666 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:07.033889 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:07.351175 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
GOCB 20:46:07.351357 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
GOCB 20:46:08.034927 ???:0: Bootstrap error found before config seen:
GOCB 20:46:08.035096 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:08.035202 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:09.035796 ???:0: Bootstrap error found before config seen:
GOCB 20:46:09.036073 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:09.036306 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:10.036566 ???:0: Bootstrap error found before config seen:
GOCB 20:46:10.038023 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:10.038174 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:11.038622 ???:0: Bootstrap error found before config seen:
GOCB 20:46:11.038735 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:11.038847 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:12.039221 ???:0: Bootstrap error found before config seen:
GOCB 20:46:12.039414 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:12.039655 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:12.853312 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
GOCB 20:46:12.853452 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
GOCB 20:46:13.040395 ???:0: Bootstrap error found before config seen:
GOCB 20:46:13.040617 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:13.040701 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:14.041882 ???:0: Bootstrap error found before config seen:
GOCB 20:46:14.042006 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:14.042067 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:15.042509 ???:0: Bootstrap error found before config seen:
GOCB 20:46:15.042774 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:15.042830 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:16.043225 ???:0: Bootstrap error found before config seen:
GOCB 20:46:16.043335 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:16.043417 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:17.043881 ???:0: Bootstrap error found before config seen:
GOCB 20:46:17.043980 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:17.044035 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
GOCB 20:46:18.044680 ???:0: Bootstrap error found before config seen:
GOCB 20:46:18.044759 ???:0: No config seen yet in kv muxer but no errors found.
GOCB 20:46:18.044796 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
2022/10/07 20:46:18 unambiguous timeout | {“InnerError”:{“InnerError”:{“InnerError”:{},“Message”:“unambiguous timeout”}},“OperationID”:“WaitUntilReady”,“Opaque”:“”,“TimeObserved”:25000081728,“RetryReasons”:[“NOT_READY”],“RetryAttempts”:30,“LastDispatchedTo”:“”,“LastDispatchedFrom”:“”,“LastConnectionID”:“”}