Portway
A self-hosted gateway that routes and meters traffic across local LLMs behind an OpenAI-compatible API.
The Linkredibles take
Why it's worth knowing.
Expose multiple local inference servers through one metered API.
Topics
#llm#gateway#vllm#llama-cpp#openai#routing
Open source repository
Explore the source behind Portway.
Read the source, explore the project, and see how it is being developed on GitHub.
Keep exploring
You might also like.
ai→
MiroFish
A Simple and Universal Swarm Intelligence Engine, Predicting Anything. 简洁通用的群体智能引擎，预测万物
★ 74,570Python
productivity→
Actual Budget
A local-first personal finance app focused on giving you control over your financial data.
★ 29,139TypeScript
ai→
ag2
AG2 (formerly AutoGen): The Open-Source AgentOS.Join us at: https://discord.gg/sNGSwQME3x
★ 4,955Python