Our clients are requesting privacy for their enterprise/proprietary documents&data. Is it possible to create a custom node that does RAG with local DB and a local LLM?
Hey @GumL00P2 - Yes this should be possible.
Also, If your use-case works with the current nodes by the way you can use your own API key for the LLM models and the data would routed through that rather than Gumloop’s API.
How do I call a RAG vector database that is local?
You’d need an intermediary for that. Would recommend checking out Chroma: Client Server Mode - Chroma Docs
This topic was solved and automatically closed 60 minutes after the last reply. New replies are no longer allowed.