I am using the latest .NET SDK.
I am following the example here:
The method signature in the SDK I am using is this:
public static VectorSearch Create(VectorQuery vectorQuery, VectorSearchOptions? options = null)
There is no way for me to set my search parameter, what am I missing here?
From other APIs, I would expect parameters go in either the VectorSearchOptions or the SearchOptions. It’s unfortunate that is not demonstrated in the examples.
Looks like it is a fluent interface now, I found it:
var vectorQuery = new VectorQuery("embeddings").WithVector(embedding);
I do not think i have seen much in the way of fluent interfaces with your SDK’s so I was not expecting it.
Hi @engineering
Apologies, the example does seem to be incorrect there. I’ve filed a docs ticket for this.
Glad you were able to figure it out anyway.
You can also static create methods (here).
Thanks for the response.
I have a multi-tenant architecture and I need to implement Vector Search but I need to make sure I only get results that have a specific tenantid.
I assumed combining FTS and VectorSearch would solve this, here is my code that seems not to work:
public async Task<PagedResult<Product>> VectorSearch(string organizationId, float[] embedding, int pageNumber, int pageSize)
{
var vectorQuery = new VectorQuery("embeddings",new VectorQueryOptions().WithNumCandidates((uint)100)).WithVector(embedding);
var vectorSearch = Couchbase.Search.Queries.Vector.VectorSearch.Create(vectorQuery, new VectorSearchOptions(VectorQueryCombination.And));
var searchRequest = SearchRequest.Create(vectorSearch).WithSearchQuery(new TermQuery(organizationId));
var skip = (pageNumber - 1) * pageSize;
var searchOptions = new SearchOptions().Fields("*").Skip(skip).Limit(pageSize);
var searchResult = await _productRepository._scope.SearchAsync("products-vector-index", searchRequest,searchOptions);
var products = MapSearchHitsToProducts(searchResult.Hits);
return new PagedResult<Product>(products, searchResult.MetaData.TotalHits, pageNumber, pageSize);
}
Here is my index definition for OrganizationId that is my tenantid:
I get results across all tenants, what am I missing here?
So I can see a couple of options, and perhaps @abhinav has other alternatives:
Have each tenant’s in a separate collection (may be the case already), and create a separate FTS index for each.
Wait for support for the FTS prefiltering option to be fully rolled out across SDKs (it’s being actively worked on currently), which will give you the behaviour you’re looking for.
Ahh, any ideas when the pre-filtering will be available in the .Net SDK?
Managing collections and indexes for each tenant seems pretty unwieldy to me personally.
At least I now know it is not something I am doing wrong.
Agree with the options laid out by @graham.pople ^.
Couchbase version 7.6.4+ comes with support for pre-filtering alongside post filtering. What your usecase demands here is prefiltering - Pre-filtering Vector Searches | Couchbase Docs
@graham.pople we can recommend users to take advantage of the raw JSON option with any of our SDKs to ship in the search request payload directly - yes? We must have some documentation on how the syntax would look for it.
Glad to use the JSON option, any documentation on how to actually use that JSON document with the .Net SDK?
The raw option is a backdoor essentially (so is not heavily documented), and I wouldn’t recommend it here, as you’ll need to construct the full FTS JSON request. It’s also an untested workaround for this specific case of providing pre-filtering - it may or may not work, and YMMV.
I would really recommend the two approaches above instead.
But if you do want to give it a go, then these resources will get you started:
