[URGENT] Couchbase server down because indexing sync gateway has frozen

Couchbase Server
1

Earlier today Couchbase server went down and it seems to be because it’s indexing the sync gateway bucket.

When I go to the index tab it shows the warning:

Warning: We are having troubles communicating to the indexer process. The information might be stale.

When I try to stop or restart the server I get the message:

NOTE: shutdown failed
{badrpc,nodedown}

  • Failed to stop couchbase-server

The source of the error appears to be this logged error:

Control connection to memcached on 'ns_1@127.0.0.1' disconnected: {{badmatch,
{error,
timeout}},
[{mc_client_binary,
cmd_vocal_recv,
5,
[{file,
"src/mc_client_binary.erl"},
{line,
156}]},
{mc_client_binary,
select_bucket,
2,
[{file,
"src/mc_client_binary.erl"},
{line,
351}]},
{ns_memcached,
ensure_bucket,
2,
[{file,
"src/ns_memcached.erl"},
{line,
1299}]},
{ns_memcached,
handle_info,
2,
[{file,
"src/ns_memcached.erl"},
{line,
748}]},
{gen_server,
handle_msg,
5,
[{file,
"gen_server.erl"},
{line,
604}]},
{ns_memcached,
init,1,
[{file,
"src/ns_memcached.erl"},
{line,
177}]},
{gen_server,
init_it,
6,
[{file,
"gen_server.erl"},
{line,
304}]},
{proc_lib,
init_p_do_apply,
3,
[{file,
"proc_lib.erl"},
{line,
239}]}]}

The most recent error in the Couchbase server logs is:

/home/couchbase/jenkins/workspace/sherlock-unix/couchdb/src/lhttpc/lhttpc_client.erl"},
                                                                    {line,
                                                                     92}]}]}}},
                                                              [{query_rest,
                                                                send,3,
                                                                [{file,
                                                                  "src/query_rest.erl"},
                                                                 {line,
                                                                  64}]},
                                                               {query_rest,
                                                                do_get_stats,
                                                                0,
                                                                [{file,
                                                                  "src/query_rest.erl"},
                                                                 {line,
                                                                  43}]},
                                                               {base_stats_collector,
                                                                handle_info,
                                                                2,
                                                                [{file,
                                                                  "src/base_stats_collector.erl"},
                                                                 {line,
                                                                  89}]},
                                                               {gen_server,
                                                                handle_msg,
                                                                5,
                                                                [{file,
                                                                  "gen_server.erl"},
                                                                 {line,
                                                                  604}]},
                                                               {proc_lib,
                                                                init_p_do_apply,
                                                                3,
                                                                [{file,
                                                                  "proc_lib.erl"},
                                                                 {line,
                                                                  239}]}]}

I’m using Couchbase server community edition 4.1 and Couchbase server 3.1.1

Thanks for your help!!