michaelthwan_ai
michaelthwan_ai OP t1_jctv2tm wrote
Reply to comment by Tostino in [P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github) by michaelthwan_ai
Thank you.
Due to people close to me and my googling, my choices of indexer is like this
pyterrier -> faiss -> native embedding
Then I found llama-index, but it currently won't give extra values to me so I didn't adopt.
I have stories on pros/cons on those lib...
michaelthwan_ai OP t1_jcturwz wrote
Reply to comment by KingsmanVince in [P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github) by michaelthwan_ai
I believe it is a frontend problem. We are not frontend developers thus but we think that Gradio is too plain to show the result, thus we built a minimal UI.
That markdown (``` <code> ```) is currently not supported to pretty print like ChatGPT one.
michaelthwan_ai OP t1_jctooa2 wrote
Reply to comment by squareOfTwo in [P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github) by michaelthwan_ai
Of course we do! Open-source projects are cool
michaelthwan_ai OP t1_jcthy7x wrote
Reply to comment by taci7c0ff33 in [P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github) by michaelthwan_ai
Thank you! :D
michaelthwan_ai OP t1_jct4sdj wrote
Reply to [P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github) by michaelthwan_ai
Demo page: https://searchgpt-demo.herokuapp.com/
Github : https://github.com/michaelthwan/searchGPT
searchGPT is a search engine or question-answer bot based on LLM to give natural language answers. You may see the footnote which is the reference of sources from the web. Below there is a explainability view to show how the response is related to the sources.
Why Grounded though?
Because it is impossible for the LLM to learn everything during the training, thus real-time factual information is needed for reference.
This project tried to reproduce work like Bing and perplexity AI which have external references to support the answer of LLM.
Some examples of good grounded answer from searchGPT and wrong ungrounded answer from ChatGPT is mentioned in the github.
[P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github)Submitted by michaelthwan_ai t3_11vi82q in MachineLearning
michaelthwan_ai OP t1_jctvcas wrote
Reply to comment by rowleboat in [P] searchGPT - a bing-like LLM-based Grounded Search Engine (with Demo, github) by michaelthwan_ai
Theoretically yes but in exact the objective you want to do is crucial.
SQL database don't support similarity/elastic search, which is very useful in natural language. It may limit what you can do or make your product less good.