Linkredibles

Category

APIs & Backend

Open-source tools, frameworks, and services for APIs, backend systems, and server applications.

Projects

37 projects

Agent Router

An OpenAI-compatible gateway for hosted models, self-hosted inference, tools, and MCP servers.

#ai-gateway#llm#mcp#routing#openai-compatible#envoy
★ 2,427476 forksGo

Agentgateway

An open-source proxy for agent-to-LLM, agent-to-tool, and agent-to-agent communication.

#ai-gateway#mcp#a2a#llm#routing#observability
★ 6,3401,125 forksRust

Atlas

A self-hosted LLM inference platform exposing Anthropic- and OpenAI-compatible APIs over multiple inference engines.

#llm#inference#vllm#sglang#llama-cpp#mlx
★ 41 forksGo

BentoML

An open-source platform for serving and deploying AI and machine learning models.

#model-serving#inference#deployment#python#production
★ 8,9441,065 forksPython

Cloudflare Skills

A collection of Agent Skills for building on Cloudflare, including Workers, the Agents SDK, Durable Objects, and the wider Cloudflare Developer Platform.

#ai-agents#agent-skills#cloudflare#workers#agents-sdk#durable-objects#serverless#cloud
★ 3,421357 forksShell

Convex Agent Plugins

Official Convex plugins for AI coding agents, providing reusable rules, skills, agents, and MCP integrations for building Convex applications.

#ai-agents#agent-skills#convex#mcp#backend#database#typescript#react
★ 11713 forksShell

Directus

The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, auth & more. - directus/directus

#open-source#github#api
★ 38,6124,996 forksTypeScript

FastMCP

A Python framework for building MCP servers and clients with a developer-friendly API.

#mcp#python#ai-tools#api#agents
★ 28,6972,635 forksPython

Firecrawl

An open-source web crawling and scraping platform designed for AI applications.

#web-crawler#scraping#rag#llm#agents#api
★ 205,65510,756 forksTypeScript

Freeport

A self-hosted OpenAI-compatible LLM gateway with multi-provider routing, fallback, caching and guardrails.

#llm#gateway#openai#groq#routing#caching
★ 31 forksTypeScript

Homepage

A highly customizable homepage (or startpage / application dashboard) with Docker and service API integrations. - gethomepage/homepage

#open-source#github#api
★ 33,7692,178 forksJavaScript

Inference Gateway

An open-source gateway that unifies multiple LLM providers behind an OpenAI-compatible API.

#llm#gateway#groq#openai#mcp#routing
★ 21046 forksGo

InferenceMesh

An OpenAI-compatible LLM router that selects providers based on cost, capability, privacy and health.

#llm#router#groq#openai#failover#routing
★ 11 forksTypeScript

Instructor

A Python library for extracting structured data from LLM responses using typed schemas.

#structured-output#pydantic#llm#python#extraction
★ 14,1301,400 forksPython

Jellyfin

The Free Software Media System - Server Backend & API - jellyfin/jellyfin

#open-source#github#api
★ 59,5995,838 forksC#

LangServe

A tool for deploying LangChain applications as APIs.

#langchain#api#llm#deployment#python
★ 2,321267 forksJavaScript

LiteLLM

A unified interface and proxy for calling hundreds of LLM providers through an OpenAI-compatible API.

#llm#gateway#openai#groq#proxy#routing
★ 63,64613,441 forksPython

llama-cpp-python

Python bindings for llama.cpp with APIs for running and serving local language models.

#llama-cpp#local-llm#python#inference#gguf
★ 10,6911,489 forksPython

LLM Gateway

An OpenAI-compatible API gateway with semantic caching, RAG and token authentication.

#llm#gateway#rag#caching#qdrant#openai
★ 21 forksGo

LLM Relay

A self-hosted LLM gateway and model router supporting OpenAI and Anthropic APIs.

#llm#gateway#router#openai#anthropic#groq
★ 100 forksGo

LunarGate

A self-hosted AI gateway with OpenAI-compatible APIs, routing, retries and streaming.

#llm#gateway#openai#routing#ollama#go
★ 252 forksGo

mcp-agent

A framework for building agents and workflows using the Model Context Protocol.

#mcp#ai-agent-skills#python#tools#workflows#llm
★ 8,591903 forksPython

MCP Proxy

A proxy for Model Context Protocol servers and clients.

#mcp#proxy#gateway#python#automation
★ 2,834282 forksPython

Meilisearch

A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications. - meilisearch/meilisearch

#open-source#github#api#ai
★ 59,9512,797 forksRust

Microsoft MCP Gateway

A reverse proxy and management layer for MCP servers with routing and lifecycle management.

#mcp#gateway#kubernetes#routing#microsoft#ai-infrastructure
★ 92597 forksC#

Outlines

A framework for structured generation from language models.

#llm#structured-output#json#generation#python
★ 16,017918 forksPython

Portkey AI Gateway

An open-source AI gateway for routing requests across large numbers of language and multimodal models.

#ai-gateway#llm#routing#fallbacks#providers#openai-compatible
★ 13,4241,392 forksTypeScript

Portway

A self-hosted gateway that routes and meters traffic across local LLMs behind an OpenAI-compatible API.

#llm#gateway#vllm#llama-cpp#openai#routing
★ 20 forksPython

Pydantic AI

A Python agent framework from the Pydantic team for building production-grade AI applications with type-safe tools, structured outputs, dependency injection, and model integrations.

#ai-agents#python#pydantic#type-safe#structured-output#llm#mcp#production
★ 21,3243,228 forksPython

Routerly

A self-hosted LLM gateway with intelligent routing, cost tracking and budget enforcement.

#llm#gateway#routing#budget#openai#anthropic
★ 11117 forksTypeScript

Routiium

A self-hosted OpenAI-compatible LLM gateway with policy routing, rate limits and analytics.

#llm#gateway#routing#mcp#authentication#analytics
★ 254 forksRust

Strapi

🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first. - strapi/strapi

#open-source#github#api
★ 73,5319,963 forksTypeScript

Stripe AI Skills

Stripe's collection of AI tools, SDKs, agent skills, and integrations for building AI-powered products and businesses with Stripe.

#ai-agents#agent-skills#stripe#payments#billing#api#mcp#llm
★ 2,076385 forksTypeScript

Triton Inference Server

NVIDIA's open-source inference server for deploying machine learning models.

#inference#nvidia#gpu#model-serving#production
★ 11,1561,875 forksPython

Tuenel

A self-hosted identity-aware AI gateway for OpenAI-compatible inference and authorized MCP access.

#llm#gateway#mcp#security#openai#self-hosted
★ 10 forksRust

Xinference

An open-source inference platform for language, speech and multimodal models with OpenAI-compatible APIs.

#inference#llm#multimodal#openai#gpu#python
★ 9,666901 forksPython

Zep

A memory and context infrastructure platform for AI agents and applications.

#ai-memory#agents#context#llm#knowledge
★ 5,011659 forksPython