Build of Node.js SDK 4.2.6 fail on Debian 11 (bullseye)

Node.js SDK
1

Hi,

We’re experiencing the following failure while building Node.js couchbase SDK 4.2.6 :

npm ci --omit=optional --no-audit
npm ERR! code 1
npm ERR! path /tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase
npm ERR! command failed
npm ERR! command sh -c node ./scripts/install.js
npm ERR! Not searching for unused variables given on the command line.
npm ERR! -- NODEJS_INC_DIR=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/_deps/nodejs_headers-src/include/node;/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-api-headers/include;/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-addon-api
npm ERR! -- NODEJS_LIB=
npm ERR! -- CMake version 3.18.4
npm ERR! -- The CXX compiler identification is GNU 10.2.1
npm ERR! -- The C compiler identification is GNU 10.2.1
npm ERR! -- Detecting CXX compiler ABI info
npm ERR! -- Detecting CXX compiler ABI info - done
npm ERR! -- Check for working CXX compiler: /usr/bin/c++ - skipped
npm ERR! -- Detecting CXX compile features
npm ERR! -- Detecting CXX compile features - done
npm ERR! -- Detecting C compiler ABI info
npm ERR! -- Detecting C compiler ABI info - done
npm ERR! -- Check for working C compiler: /usr/bin/cc - skipped
npm ERR! -- Detecting C compile features
npm ERR! -- Detecting C compile features - done
npm ERR! -- Couchbase C++ client 1.0.0.0
npm ERR! -- CMAKE_SOURCE_DIR=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase
npm ERR! -- CMAKE_BINARY_DIR=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build
npm ERR! -- Looking for backtrace
npm ERR! -- Looking for backtrace - found
npm ERR! -- Looking for dladdr
npm ERR! -- Looking for dladdr - found
npm ERR! -- Looking for pthread.h
npm ERR! -- Looking for pthread.h - found
npm ERR! -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
npm ERR! -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
npm ERR! -- Looking for pthread_create in pthreads
npm ERR! -- Looking for pthread_create in pthreads - not found
npm ERR! -- Looking for pthread_create in pthread
npm ERR! -- Looking for pthread_create in pthread - found
npm ERR! -- Found Threads: TRUE  
npm ERR! -- Adding PEGTL as submodule from external/PEGTL
npm ERR! -- Using std::filesystem
npm ERR! -- Module support is disabled.
npm ERR! -- Version: 8.0.1
npm ERR! -- Build type: Release
npm ERR! -- CXX_STANDARD: 17
npm ERR! -- Performing Test has_std_17_flag
npm ERR! -- Performing Test has_std_17_flag - Success
npm ERR! -- Performing Test has_std_1z_flag
npm ERR! -- Performing Test has_std_1z_flag - Success
npm ERR! -- Performing Test SUPPORTS_USER_DEFINED_LITERALS
npm ERR! -- Performing Test SUPPORTS_USER_DEFINED_LITERALS - Success
npm ERR! -- Performing Test FMT_HAS_VARIANT
npm ERR! -- Performing Test FMT_HAS_VARIANT - Success
npm ERR! -- Required features: cxx_variadic_templates
npm ERR! -- Looking for strtod_l
npm ERR! -- Looking for strtod_l - not found
npm ERR! -- Build spdlog: 1.9.2
npm ERR! -- Build type: Release
npm ERR! -- Check if the system is big endian
npm ERR! -- Searching 16 bit integer
npm ERR! -- Looking for sys/types.h
npm ERR! -- Looking for sys/types.h - found
npm ERR! -- Looking for stdint.h
npm ERR! -- Looking for stdint.h - found
npm ERR! -- Looking for stddef.h
npm ERR! -- Looking for stddef.h - found
npm ERR! -- Check size of unsigned short
npm ERR! -- Check size of unsigned short - done
npm ERR! -- Searching 16 bit integer - Using unsigned short
npm ERR! -- Check if the system is big endian - little endian
npm ERR! -- Looking for sys/mman.h
npm ERR! -- Looking for sys/mman.h - found
npm ERR! -- Looking for sys/resource.h
npm ERR! -- Looking for sys/resource.h - found
npm ERR! -- Looking for sys/time.h
npm ERR! -- Looking for sys/time.h - found
npm ERR! -- Looking for sys/uio.h
npm ERR! -- Looking for sys/uio.h - found
npm ERR! -- Looking for unistd.h
npm ERR! -- Looking for unistd.h - found
npm ERR! -- Looking for windows.h
npm ERR! -- Looking for windows.h - not found
npm ERR! -- Looking for zlibVersion in z
npm ERR! -- Looking for zlibVersion in z - not found
npm ERR! -- Looking for lzo1x_1_15_compress in lzo2
npm ERR! -- Looking for lzo1x_1_15_compress in lzo2 - not found
npm ERR! -- Looking for LZ4_compress_default in lz4
npm ERR! -- Looking for LZ4_compress_default in lz4 - not found
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX - Failed
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX2
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX2 - Failed
npm ERR! -- Performing Test HAVE_CLANG_MAVX
npm ERR! -- Performing Test HAVE_CLANG_MAVX - Success
npm ERR! -- Performing Test HAVE_CLANG_MBMI2
npm ERR! -- Performing Test HAVE_CLANG_MBMI2 - Success
npm ERR! -- Performing Test SNAPPY_HAVE_NO_MISSING_FIELD_INITIALIZERS
npm ERR! -- Performing Test SNAPPY_HAVE_NO_MISSING_FIELD_INITIALIZERS - Success
npm ERR! -- Performing Test HAVE_BUILTIN_EXPECT
npm ERR! -- Performing Test HAVE_BUILTIN_EXPECT - Success
npm ERR! -- Performing Test HAVE_BUILTIN_CTZ
npm ERR! -- Performing Test HAVE_BUILTIN_CTZ - Success
npm ERR! -- Performing Test HAVE_ATTRIBUTE_ALWAYS_INLINE
npm ERR! -- Performing Test HAVE_ATTRIBUTE_ALWAYS_INLINE - Success
npm ERR! -- Performing Test SNAPPY_HAVE_SSSE3
npm ERR! -- Performing Test SNAPPY_HAVE_SSSE3 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_X86_CRC32
npm ERR! -- Performing Test SNAPPY_HAVE_X86_CRC32 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_NEON_CRC32
npm ERR! -- Performing Test SNAPPY_HAVE_NEON_CRC32 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_BMI2
npm ERR! -- Performing Test SNAPPY_HAVE_BMI2 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_NEON
npm ERR! -- Performing Test SNAPPY_HAVE_NEON - Failed
npm ERR! -- Looking for mmap
npm ERR! -- Looking for mmap - found
npm ERR! -- Looking for sysconf
npm ERR! -- Looking for sysconf - found
npm ERR! -- Could NOT find ZLIB (missing: ZLIB_LIBRARY ZLIB_INCLUDE_DIR) 
npm ERR! -- Looking for ceil in m
npm ERR! -- Looking for ceil in m - found
npm ERR! -- Looking for clock_gettime in rt
npm ERR! -- Looking for clock_gettime in rt - found
npm ERR! -- COUCHBASE_CXX_CLIENT_POST_LINKED_OPENSSL is set, assuming OpenSSL headers and symbols are available already
npm ERR! -- Configuring incomplete, errors occurred!
npm ERR! See also "/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/CMakeFiles/CMakeOutput.log".
npm ERR! See also "/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/CMakeFiles/CMakeError.log".
npm ERR! Not searching for unused variables given on the command line.
npm ERR! -- NODEJS_INC_DIR=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/_deps/nodejs_headers-src/include/node;/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-api-headers/include;/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-addon-api
npm ERR! -- NODEJS_LIB=
npm ERR! -- CMake version 3.18.4
npm ERR! -- The CXX compiler identification is GNU 10.2.1
npm ERR! -- The C compiler identification is GNU 10.2.1
npm ERR! -- Detecting CXX compiler ABI info
npm ERR! -- Detecting CXX compiler ABI info - done
npm ERR! -- Check for working CXX compiler: /usr/bin/c++ - skipped
npm ERR! -- Detecting CXX compile features
npm ERR! -- Detecting CXX compile features - done
npm ERR! -- Detecting C compiler ABI info
npm ERR! -- Detecting C compiler ABI info - done
npm ERR! -- Check for working C compiler: /usr/bin/cc - skipped
npm ERR! -- Detecting C compile features
npm ERR! -- Detecting C compile features - done
npm ERR! -- Couchbase C++ client 1.0.0.0
npm ERR! -- CMAKE_SOURCE_DIR=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase
npm ERR! -- CMAKE_BINARY_DIR=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build
npm ERR! -- Looking for backtrace
npm ERR! -- Looking for backtrace - found
npm ERR! -- Looking for dladdr
npm ERR! -- Looking for dladdr - found
npm ERR! -- Looking for pthread.h
npm ERR! -- Looking for pthread.h - found
npm ERR! -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
npm ERR! -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
npm ERR! -- Looking for pthread_create in pthreads
npm ERR! -- Looking for pthread_create in pthreads - not found
npm ERR! -- Looking for pthread_create in pthread
npm ERR! -- Looking for pthread_create in pthread - found
npm ERR! -- Found Threads: TRUE  
npm ERR! -- Adding PEGTL as submodule from external/PEGTL
npm ERR! -- Using std::filesystem
npm ERR! -- Module support is disabled.
npm ERR! -- Version: 8.0.1
npm ERR! -- Build type: Release
npm ERR! -- CXX_STANDARD: 17
npm ERR! -- Performing Test has_std_17_flag
npm ERR! -- Performing Test has_std_17_flag - Success
npm ERR! -- Performing Test has_std_1z_flag
npm ERR! -- Performing Test has_std_1z_flag - Success
npm ERR! -- Performing Test SUPPORTS_USER_DEFINED_LITERALS
npm ERR! -- Performing Test SUPPORTS_USER_DEFINED_LITERALS - Success
npm ERR! -- Performing Test FMT_HAS_VARIANT
npm ERR! -- Performing Test FMT_HAS_VARIANT - Success
npm ERR! -- Required features: cxx_variadic_templates
npm ERR! -- Looking for strtod_l
npm ERR! -- Looking for strtod_l - not found
npm ERR! -- Build spdlog: 1.9.2
npm ERR! -- Build type: Release
npm ERR! -- Check if the system is big endian
npm ERR! -- Searching 16 bit integer
npm ERR! -- Looking for sys/types.h
npm ERR! -- Looking for sys/types.h - found
npm ERR! -- Looking for stdint.h
npm ERR! -- Looking for stdint.h - found
npm ERR! -- Looking for stddef.h
npm ERR! -- Looking for stddef.h - found
npm ERR! -- Check size of unsigned short
npm ERR! -- Check size of unsigned short - done
npm ERR! -- Searching 16 bit integer - Using unsigned short
npm ERR! -- Check if the system is big endian - little endian
npm ERR! -- Looking for sys/mman.h
npm ERR! -- Looking for sys/mman.h - found
npm ERR! -- Looking for sys/resource.h
npm ERR! -- Looking for sys/resource.h - found
npm ERR! -- Looking for sys/time.h
npm ERR! -- Looking for sys/time.h - found
npm ERR! -- Looking for sys/uio.h
npm ERR! -- Looking for sys/uio.h - found
npm ERR! -- Looking for unistd.h
npm ERR! -- Looking for unistd.h - found
npm ERR! -- Looking for windows.h
npm ERR! -- Looking for windows.h - not found
npm ERR! -- Looking for zlibVersion in z
npm ERR! -- Looking for zlibVersion in z - not found
npm ERR! -- Looking for lzo1x_1_15_compress in lzo2
npm ERR! -- Looking for lzo1x_1_15_compress in lzo2 - not found
npm ERR! -- Looking for LZ4_compress_default in lz4
npm ERR! -- Looking for LZ4_compress_default in lz4 - not found
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX - Failed
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX2
npm ERR! -- Performing Test HAVE_VISUAL_STUDIO_ARCH_AVX2 - Failed
npm ERR! -- Performing Test HAVE_CLANG_MAVX
npm ERR! -- Performing Test HAVE_CLANG_MAVX - Success
npm ERR! -- Performing Test HAVE_CLANG_MBMI2
npm ERR! -- Performing Test HAVE_CLANG_MBMI2 - Success
npm ERR! -- Performing Test SNAPPY_HAVE_NO_MISSING_FIELD_INITIALIZERS
npm ERR! -- Performing Test SNAPPY_HAVE_NO_MISSING_FIELD_INITIALIZERS - Success
npm ERR! -- Performing Test HAVE_BUILTIN_EXPECT
npm ERR! -- Performing Test HAVE_BUILTIN_EXPECT - Success
npm ERR! -- Performing Test HAVE_BUILTIN_CTZ
npm ERR! -- Performing Test HAVE_BUILTIN_CTZ - Success
npm ERR! -- Performing Test HAVE_ATTRIBUTE_ALWAYS_INLINE
npm ERR! -- Performing Test HAVE_ATTRIBUTE_ALWAYS_INLINE - Success
npm ERR! -- Performing Test SNAPPY_HAVE_SSSE3
npm ERR! -- Performing Test SNAPPY_HAVE_SSSE3 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_X86_CRC32
npm ERR! -- Performing Test SNAPPY_HAVE_X86_CRC32 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_NEON_CRC32
npm ERR! -- Performing Test SNAPPY_HAVE_NEON_CRC32 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_BMI2
npm ERR! -- Performing Test SNAPPY_HAVE_BMI2 - Failed
npm ERR! -- Performing Test SNAPPY_HAVE_NEON
npm ERR! -- Performing Test SNAPPY_HAVE_NEON - Failed
npm ERR! -- Looking for mmap
npm ERR! -- Looking for mmap - found
npm ERR! -- Looking for sysconf
npm ERR! -- Looking for sysconf - found
npm ERR! -- Could NOT find ZLIB (missing: ZLIB_LIBRARY ZLIB_INCLUDE_DIR) 
npm ERR! -- Looking for ceil in m
npm ERR! -- Looking for ceil in m - found
npm ERR! -- Looking for clock_gettime in rt
npm ERR! -- Looking for clock_gettime in rt - found
npm ERR! -- COUCHBASE_CXX_CLIENT_POST_LINKED_OPENSSL is set, assuming OpenSSL headers and symbols are available already
npm ERR! -- Configuring incomplete, errors occurred!
npm ERR! See also "/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/CMakeFiles/CMakeOutput.log".
npm ERR! See also "/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/CMakeFiles/CMakeError.log".
npm ERR! info TOOL Using Unix Makefiles generator.
npm ERR! info CMD CONFIGURE
npm ERR! info RUN [
npm ERR! info RUN   'cmake',
npm ERR! info RUN   '/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase',
npm ERR! info RUN   '--no-warn-unused-cli',
npm ERR! info RUN   '-G',
npm ERR! info RUN   'Unix Makefiles',
npm ERR! info RUN   '-DCMAKE_JS_VERSION=7.2.1',
npm ERR! info RUN   '-DCMAKE_BUILD_TYPE=Release',
npm ERR! info RUN   '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/Release',
npm ERR! info RUN   '-DCMAKE_MSVC_RUNTIME_LIBRARY=MultiThreaded$<$<CONFIG:Debug>:Debug>',
npm ERR! info RUN   '-DCMAKE_JS_INC=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-api-headers/include;/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-addon-api',
npm ERR! info RUN   '-DCMAKE_JS_SRC=',
npm ERR! info RUN   '-DNODE_RUNTIME=node',
npm ERR! info RUN   '-DNODE_RUNTIMEVERSION=18.17.0',
npm ERR! info RUN   '-DNODE_ARCH=x64',
npm ERR! info RUN   '-DCMAKE_JS_LIB=',
npm ERR! info RUN   '-DCMAKE_CXX_FLAGS=-DBUILDING_NODE_EXTENSION'
npm ERR! info RUN ]
npm ERR! Finding Node.js headers SHA for version: 18.17.0
npm ERR! Using SHA=7c47c07521f8be7693f3b0436d2ef0cb5a490d070d1d9a3606decc55c39c41c4
npm ERR! Downloading Node.js 18.17.0 headers...
npm ERR! Downloaded Node.js 18.17.0 headers to /tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/_deps/nodejs_headers-src
npm ERR! CMake Warning at deps/couchbase-cxx-client/cmake/Cache.cmake:28 (message):
npm ERR!   ccache is enabled but was not found.  Not using it
npm ERR! Call Stack (most recent call first):
npm ERR!   deps/couchbase-cxx-client/CMakeLists.txt:37 (include)
npm ERR! 
npm ERR! 
npm ERR! CMake Error at deps/couchbase-cxx-client/cmake/OpenSSL.cmake:111 (string):
npm ERR!   string sub-command REGEX, mode MATCH needs at least 5 arguments total to
npm ERR!   command.
npm ERR! Call Stack (most recent call first):
npm ERR!   deps/couchbase-cxx-client/CMakeLists.txt:70 (include)
npm ERR! 
npm ERR! 
npm ERR! CMake Error at deps/couchbase-cxx-client/cmake/OpenSSL.cmake:117 (message):
npm ERR!   Failed to extract expected hash from file
npm ERR! Call Stack (most recent call first):
npm ERR!   deps/couchbase-cxx-client/CMakeLists.txt:70 (include)
npm ERR! 
npm ERR! 
npm ERR! info REP Build has been failed, trying to do a full rebuild.
npm ERR! info CMD CLEAN
npm ERR! info RUN [
npm ERR! info RUN   'cmake',
npm ERR! info RUN   '-E',
npm ERR! info RUN   'remove_directory',
npm ERR! info RUN   '/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build'
npm ERR! info RUN ]
npm ERR! info CMD CONFIGURE
npm ERR! info RUN [
npm ERR! info RUN   'cmake',
npm ERR! info RUN   '/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase',
npm ERR! info RUN   '--no-warn-unused-cli',
npm ERR! info RUN   '-G',
npm ERR! info RUN   'Unix Makefiles',
npm ERR! info RUN   '-DCMAKE_JS_VERSION=7.2.1',
npm ERR! info RUN   '-DCMAKE_BUILD_TYPE=Release',
npm ERR! info RUN   '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/Release',
npm ERR! info RUN   '-DCMAKE_MSVC_RUNTIME_LIBRARY=MultiThreaded$<$<CONFIG:Debug>:Debug>',
npm ERR! info RUN   '-DCMAKE_JS_INC=/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-api-headers/include;/tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/node-addon-api',
npm ERR! info RUN   '-DCMAKE_JS_SRC=',
npm ERR! info RUN   '-DNODE_RUNTIME=node',
npm ERR! info RUN   '-DNODE_RUNTIMEVERSION=18.17.0',
npm ERR! info RUN   '-DNODE_ARCH=x64',
npm ERR! info RUN   '-DCMAKE_JS_LIB=',
npm ERR! info RUN   '-DCMAKE_CXX_FLAGS=-DBUILDING_NODE_EXTENSION'
npm ERR! info RUN ]
npm ERR! Finding Node.js headers SHA for version: 18.17.0
npm ERR! Using SHA=7c47c07521f8be7693f3b0436d2ef0cb5a490d070d1d9a3606decc55c39c41c4
npm ERR! Downloading Node.js 18.17.0 headers...
npm ERR! Downloaded Node.js 18.17.0 headers to /tmp/moncompte/mce-moncompte/npm-packages/mce-couchbase/node_modules/couchbase/build/_deps/nodejs_headers-src
npm ERR! CMake Warning at deps/couchbase-cxx-client/cmake/Cache.cmake:28 (message):
npm ERR!   ccache is enabled but was not found.  Not using it
npm ERR! Call Stack (most recent call first):
npm ERR!   deps/couchbase-cxx-client/CMakeLists.txt:37 (include)
npm ERR! 
npm ERR! 
npm ERR! CMake Error at deps/couchbase-cxx-client/cmake/OpenSSL.cmake:111 (string):
npm ERR!   string sub-command REGEX, mode MATCH needs at least 5 arguments total to
npm ERR!   command.
npm ERR! Call Stack (most recent call first):
npm ERR!   deps/couchbase-cxx-client/CMakeLists.txt:70 (include)
npm ERR! 
npm ERR! 
npm ERR! CMake Error at deps/couchbase-cxx-client/cmake/OpenSSL.cmake:117 (message):
npm ERR!   Failed to extract expected hash from file
npm ERR! Call Stack (most recent call first):
npm ERR!   deps/couchbase-cxx-client/CMakeLists.txt:70 (include)
npm ERR! 
npm ERR! 
npm ERR! ERR! OMG Process terminated: 1

Can someone help ?

Regards,

2

Hi @fidgi – looks like the underlying C++ core client is unable to download the Mozilla CA bundle. I think this command will fail w/ the string sub-command REGEX, mode MATCH needs at least 5 arguments total to command. error if the the HASH_FILE_CONTENT is an empty string. Do you know if your CI would have trouble accessing https://curl.se/ca/cacert.pem.sha256? Also, are you wanting to build the SDK’s binary or would you maybe be able to pull it from npm?

3

Hi @jcasey ,

In fact, we’d be pleased if 'npm ci ’ command just triggers the download of the SDK’s binary instead of trying to rebuild it.

I don’t understand why this is not the case

(note: it is possible that our CI can’t access the Mozilla CA bundle since our corporate proxy is a bit too strict)

4

We have the same issue with version 4.2.5 of the SDK but it works with version 4.2.4 .

We’ve noticed the following differences in the package-lock.json

For the version 4.2.4 we have :

    "couchbase": {
      "version": "4.2.4",
      "resolved": "https://nexus.udd.net.intra.xxxx.fr/repository/npm-npmjs-proxy/couchbase/-/couchbase-4.2.4.tgz",
      "integrity": "sha512-XfsIKS7J9dTC5RS+Mk0n6WPWgGToS1qiK6DGhmSBSgqUAmtLf/yHbwMSdzUv8+EReA1+M17U3ppvxFPybJPIOA==",
      "requires": {
        "bindings": "^1.5.0",
        "cmake-js": "^6.3.2",
        "node-addon-api": "^5.0.0",
        "prebuild-install": "^7.1.1"
      }
    },

and for version 4.2.5

    "node_modules/couchbase": {
      "version": "4.2.5",
      "resolved": "https://nexus.udd.net.intra.xxxx.fr/repository/npm-npmjs-proxy/couchbase/-/couchbase-4.2.5.tgz",
      "integrity": "sha512-BEJcc2qZTk7Gr3pbv9EkvV5RfbAtRYZEJ7aA5rK/IKpvWcq4K8rkhx2RnCHkqL+mvawpBHIXtK0HhYCduqIfmA==",
      "hasInstallScript": true,
      "license": "Apache-2.0",
      "dependencies": {
        "cmake-js": "^7.2.0",
        "node-addon-api": "^5.0.0"
      },
      "engines": {
        "node": ">=16"
      },
      "optionalDependencies": {
        "@couchbase/couchbase-darwin-arm64-openssl1": "4.2.5",
        "@couchbase/couchbase-darwin-arm64-openssl3": "4.2.5",
        "@couchbase/couchbase-darwin-x64-openssl1": "4.2.5",
        "@couchbase/couchbase-darwin-x64-openssl3": "4.2.5",
        "@couchbase/couchbase-linux-arm64-openssl1": "4.2.5",
        "@couchbase/couchbase-linux-arm64-openssl3": "4.2.5",
        "@couchbase/couchbase-linux-x64-openssl1": "4.2.5",
        "@couchbase/couchbase-linux-x64-openssl3": "4.2.5",
        "@couchbase/couchbase-linuxmusl-x64-openssl1": "4.2.5",
        "@couchbase/couchbase-linuxmusl-x64-openssl3": "4.2.5",
        "@couchbase/couchbase-win32-x64-openssl1": "4.2.5",
        "@couchbase/couchbase-win32-x64-openssl3": "4.2.5"
      }
    },

So the question is whether we should include optional dependencies when installing via npm ci in our CI/CD environment ?

Today we don’t

5

Following some tests, We can confirm that the optional dependencies are required.

So we changed ‘npm ci --omit=optional --no-audit’ to ‘npm ci --no-audit’ and it works.

Hope this topic will help those that face the same issue

6

Hi @fidgi – You are correct, the 4.2.5 release changed how we published out prebuilds (this was due to many factors, but supporting Node.js v18 was the major determining factor) and they are now optional dependencies.

In the event you (or others looking on the forums) need to omit optional dependencies, you can use the dockerfile below as an example on how to obtain a prebuild from the npm repository w/o needing to build it from source.

FROM --platform=linux/amd64 node:18

# Platforms:
#   - darwin
#   - linux
#   - linuxmusl
#   - win32 [don't be confused by the 32 :)]
ARG PLAT=linux
# Architectures:
#   - x64
#   - arm64 (only for darwin and linux platforms)
ARG ARCH=x64
# Node.js Versions:
#   - Node.js < v18 = openssl1
#   - Node.js >= v18 = openssl3
ARG SSL=openssl3
# Couchbase Node.js SDK version
#   should be >= 4.2.5 to use this example of accessing prebuilds
ARG NODEJS_SDK_VERSION=4.2.6

# do this so we can use $WORKDIR later
ARG WORKDIR=/usr/src/app
# Create app directory
WORKDIR $WORKDIR

# this is what one might typically do, but for example purposes we
# will just init the app directory
COPY package*.json ./

# Couchbase Node.js SDK >= 4.2.5 provides prebuilt binaries as optional dependencies.  These prebuilds are 
# published to the npm repository (prior to the 4.2.5 release, prebuilds were published to Github). If the 
# SDK needs to be installed in an environment where optional dependencies should be omitted, then the prebuild 
# for your system can be installed via the following steps:
#   1. npm pack <prebuild needed for your plat + arch + Node.js version>
#       - format: @couchbase/couchbase-<platform>-<architecture>-<openssl version>
#       - see above for available platforms, architectures and Nodes.js version (translates to openssl version)
#   2. unpack the tarball
#   3. create a directory to store the prebuild
#   4. move the prebuild (the *.node file) from #2 to the directory created in #3
#   5. create a .npmrc file with the following key-value pair:
#       - couchbase_local_prebuilds=<path to dir from #3>

# Example of steps described above
# <1>
RUN npm pack @couchbase/couchbase-$PLAT-$ARCH-$SSL@$NODEJS_SDK_VERSION
# <2>
RUN tar -xvzf couchbase-couchbase-$PLAT-$ARCH-$SSL-$NODEJS_SDK_VERSION.tgz
# Unpacking the tarball should provide a directory (named `package` by default) w/ the following contents:
#   1. prebuilt binary (ends in `.node`)
#   2. README.md
#   3. index.js
#   4. package.json

# <3>
RUN mkdir prebuilds
# <4>
RUN mv package/*.node prebuilds
# <5>
RUN echo "couchbase_local_prebuilds=$WORKDIR/prebuilds" >> .npmrc

# the install step should be quick since the SDK should find the local prebuild which means it does not
# need to build the binary
RUN npm ci --omit=dev --omit=optional

# quick test, if this works the local prebuild has been installed correctly
RUN node -p "JSON.parse(require('couchbase').cbppMetadata)"

# cleanup
RUN rm -rf package
RUN rm couchbase-couchbase-$PLAT-$ARCH-$SSL-$NODEJS_SDK_VERSION.tgz
7

Thx @jcasey for this detailed recipe.

Just a quick note: we are using Node.js 18 on Debian 11 which ships with openssl 1.x
Since it works, I assume this is also a valid combination.

Regards,

8

Hi @fidgi – Happy to help!

To your note, while OpenSSL 1.x might be on the Debian 11 box, Node.js “bakes” in OpenSSL and uses OpenSSL 3.x for >= v18 (see some of the details here). So, if pulling the binary from npm (i.e. omitting optional dependencies) do make sure you have the openssl3 version (if using Nodes.j >= v18). If you are going the route of allowing optional dependencies, you can run npm list --depth=1 and you should see the SDK picked up the openssl3 version.

9

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.