CB Restore finishes but no data is restored

Couchbase Server
1

I’m trying to restore using cbrestore
The restore finishes without any error but zero data is restored:


[root@ip-1-1-1-1 2022-02-15T025101Z]# /opt/couchbase/bin/cbrestore -vvv /tmp/2022-02-16T025102Z/2022-02-16T025102Z-full/ http://username:password@localhost:8091 --username username --password password -b default
2022-02-16 13:14:19,533: mt cbrestore...
2022-02-16 13:14:19,533: mt  source : /tmp/2022-02-16T025102Z/2022-02-16T025102Z-full/
2022-02-16 13:14:19,533: mt  sink   : http://username:password@localhost:8091
2022-02-16 13:14:19,533: mt  opts   : {'username': '<xxx>', 'verbose': 3, 'extra': {'max_retry': 10.0, 'rehash': 0.0, 'dcp_consumer_queue_length': 1000.0, 'data_only': 0.0, 'uncompress': 0.0, 'nmv_retry': 1.0, 'conflict_resolve': 1.0, 'cbb_max_mb': 100000.0, 'report': 5.0, 'mcd_compatible': 1.0, 'try_xwm': 1.0, 'backoff_cap': 10.0, 'batch_max_bytes': 400000.0, 'report_full': 2000.0, 'flow_control': 1.0, 'batch_max_size': 1000.0, 'seqno': 0.0, 'design_doc_only': 0.0, 'allow_recovery_vb_remap': 0.0, 'recv_min_bytes': 4096.0}, 'collection': None, 'ssl': False, 'threads': 4, 'to_date': None, 'key': None, 'password': '<xxx>', 'id': None, 'bucket_source': 'default', 'silent': False, 'dry_run': False, 'from_date': None, 'bucket_destination': None, 'add': False, 'vbucket_list': None, 'separator': '::'}
2022-02-16 13:14:19,534: mt source_class: <class 'pump_bfd.BFDSource'>
2022-02-16 13:14:19,534: mt sink_class: <class 'pump_cb.CBSink'>
2022-02-16 13:14:19,537: mt Starting new HTTP connection (1): localhost
2022-02-16 13:14:19,544: mt "GET /pools/default/buckets HTTP/1.1" 200 10392
2022-02-16 13:14:19,546: mt source_bucket: default
2022-02-16 13:14:19,546: mt sink_bucket: default
2022-02-16 13:14:19,546: mt source_buckets: default
2022-02-16 13:14:19,546: mt bucket_source: default
2022-02-16 13:14:19,546: mt source_buckets filtered: default
2022-02-16 13:14:19,546: mt bucket: default
2022-02-16 13:14:19,546: mt  source_nodes: cb1-old.com:8091,cb2-old.com:8091
2022-02-16 13:14:19,547: mt  enqueueing node: cb1-old.com:8091
2022-02-16 13:14:19,547: w0  node: cb1-old.com:8091
2022-02-16 13:14:19,548: w0 sink_bucket: default
2022-02-16 13:14:19,548: mt  enqueueing node: cb2-old.com:8091
2022-02-16 13:14:19,549: w1  node: cb2-old.com:8091
2022-02-16 13:14:19,549: w1 sink_bucket: default
2022-02-16 13:14:19,560: w0   pump (/tmp/2022-02-16T025102Z/2022-02-16T025102Z-full/(default@cb1-old.com:8091)->http://username:password@localhost:8091(default@cb1-old.com:8091)) done.
2022-02-16 13:14:19,560: w0   source : /tmp/2022-02-16T025102Z/2022-02-16T025102Z-full/(default@cb1-old.com:8091)
2022-02-16 13:14:19,560: w0   sink   : http://username:password@localhost:8091(default@cb1-old.com:8091)
2022-02-16 13:14:19,560: w0          :                total |       last |    per sec
2022-02-16 13:14:19,561: w0    batch :                    1 |          1 |       80.1
2022-02-16 13:14:19,561: w0    byte  :                    0 |          0 |        0.0
2022-02-16 13:14:19,561: w0    msg   :                    0 |          0 |        0.0
2022-02-16 13:14:19,561: w1   pump (/tmp/2022-02-16T025102Z/2022-02-16T025102Z-full/(default@cb2-old.com:8091)->http://username:password@localhost:8091(default@cb2-old.com:8091)) done.
2022-02-16 13:14:19,561: w0  node: cb1-old.com:8091, done; rv: 0
2022-02-16 13:14:19,561: w1   source : /tmp/2022-02-16T025102Z/2022-02-16T025102Z-full/(default@cb2-old.com:8091)
2022-02-16 13:14:19,561: w1   sink   : http://username:password@localhost:8091(default@cb2-old.com:8091)
2022-02-16 13:14:19,561: w1          :                total |       last |    per sec
2022-02-16 13:14:19,561: w1    batch :                    1 |          1 |       84.9
2022-02-16 13:14:19,562: w1    byte  :                    0 |          0 |        0.0
2022-02-16 13:14:19,562: w1    msg   :                    0 |          0 |        0.0
2022-02-16 13:14:19,562: w1  node: cb2-old.com:8091, done; rv: 0
.
bucket: default, msgs transferred...
       :                total |       last |    per sec
 batch :                    2 |          2 |       31.4
 byte  :                    0 |          0 |        0.0
 msg   :                    0 |          0 |        0.0
2022-02-16 13:14:19,611: mt design_doc row: {u'controllers': {u'compact': u'/pools/default/buckets/default/ddocs/_design%2Fdev_AllItems/controller/compactView', u'setUpdateMinChanges': u'/pools/default/buckets/default/ddocs/_design%2Fdev_AllItems/controller/setUpdateMinChanges'}, u'doc': {u'json': {u'views': {}}, u'meta': {u'rev': u'4-a3b10bf1', u'id': u'_design/dev_AllItems'}}}
2022-02-16 13:14:19,611: mt design_doc: {"views": {}}
2022-02-16 13:14:19,611: mt design_doc id: _design/dev_AllItems at: /default%2B7c3e9f203c8af34d025d7c635da8cab8/_design/dev_AllItems
2022-02-16 13:14:19,611: mt rest_request: <ud>username</ud>@cb1-new.com:8092/default%2B7c3e9f203c8af34d025d7c635da8cab8/_design/dev_AllItems; reason: consume_design
2022-02-16 13:14:19,615: mt design_doc created at: /default%2B7c3e9f203c8af34d025d7c635da8cab8/_design/dev_AllItems
2022-02-16 13:14:19,616: mt Starting new HTTP connection (1): localhost
2022-02-16 13:14:19,617: mt "GET /pools/default/nodeServices HTTP/1.1" 200 892
2022-02-16 13:14:19,618: mt Starting new HTTP connection (1): cb1-new.com
2022-02-16 13:14:19,687: mt "POST /restoreIndexMetadata?bucket=default HTTP/1.1" 200 18
done
2

Just a couple of FYIs:

  1. Is it possible that conflict resolution during restore is playing a part here? Here’s the doc info on conflict resolution during restore (if the bucket you are restoring to has data/tombstones in it, may need to turn off conflict resolution during restore) https://docs.couchbase.com/server/current/cli/cbtools/cbrestore.html#description

  2. cbbackup/cbrestore was deprecated in 7.0 – should use cbbackupmgr (for both CE and EE) in 7.0+.

3

I used cbbackupmgr and it worked, thanks