LLM Gateway
An OpenAI-compatible API gateway with semantic caching, RAG and token authentication.
The Linkredibles take
Why it's worth knowing.
Add caching, retrieval and authentication to LLM API traffic.
Topics
#llm#gateway#rag#caching#qdrant#openai
Open source repository
Explore the source behind LLM Gateway.
Read the source, explore the project, and see how it is being developed on GitHub.
Keep exploring