Viewing a single comment thread. View all comments

extracoffeeplease t1_j8nqdl8 wrote

So IIUC this searches text first, then adds that to the prompt as input to the LLM. Now for the text search, why do vector searching and not Elasticsearch, or both? Reason I'm asking is I've seen vector search issues pop up when your data is uncommon and hence badly embedded, for example searching for a unique name or a weird token ( for example, P5.22.a.03), whereas classic text search can find that exact token.

1

Jesse_marqo t1_j8oy1lc wrote

Good question! You can use either or both if you want. In the article you can see that switching between embedding based and lexical search is easy.

2