Hi,
We have a cluster with 5 nodes. We had to do the servers restart. So we bought the couchbase service down and the service was started once the servers were started.
We have 2 data buckets configured. We see that after restart, for bucket 1 it shows Nodes as 5, but for bucket 2 it shows the Nodes as 4.
All the 5 server nodes are green.
We see this message under Server Nodes: “Fail Over Warning: Rebalance recommended, some data does not have the desired replicas configuration!”.
But when we try to rebalance, it just hangs and does not complete the rebalancing.
Below are the logs under logs section:
Control connection to memcached on ‘ns_1@172.18.208.33’ disconnected: {{badmatch,
{error,
closed}},
[{mc_client_binary,
cmd_vocal_recv,
5,
[{file,
“src/mc_client_binary.erl”},
{line,
151}]},
{mc_client_binary,
select_bucket,
2,
[{file,
“src/mc_client_binary.erl”},
{line,
346}]},
{ns_memcached,
ensure_bucket,
2,
[{file,
“src/ns_memcached.erl”},
{line,
1269}]},
{ns_memcached,
handle_info,
2,
[{file,
“src/ns_memcached.erl”},
{line,
744}]},
{gen_server,
handle_msg,
5,
[{file,
“gen_server.erl”},
{line,
604}]},
{ns_memcached,
init,
1,
[{file,
“src/ns_memcached.erl”},
{line,
171}]},
{gen_server,
init_it,
6,
[{file,
“gen_server.erl”},
{line,
304}]},
{proc_lib,
init_p_do_apply,
3,
[{file,
“proc_lib.erl”},
{line,
239}]}]}
Attached the server Nodes and data buckets screenshots for reference.
We can attach more logs if required.
Any suggestions on why the nodes show as only 4 and further steps will be greatly appreciated.
