tokens&
For enterprises
Submit a resource
tokens&

Find tools, check provider offers, save a build plan, and share your work when you’re ready.

For buildersFor enterprises

For builders

  • Startup credits and perks
  • Agent Skills
  • Publish a project

For enterprises

  • Start free company workspace
  • Submit a tool, product, or perk

Community

  • Community
  • Newsletter
  • Events
Xin

© 2026 tokensand, LLC. All rights reserved.

  • Terms
  • Privacy
  • Security
  • Data Processing
  • Status
  1. Home
  2. Alternatives
  3. Alternatives to Envoy AI Gateway
Envoy AI Gateway logo

Best Alternatives to Envoy AI Gateway

LLM Providers · 8 alternatives ranked of 14 in the category

Looking for alternatives to Envoy AI Gateway? These are the llm providers tools that score highest on adoption, reviews, benchmarks, and public code, with what separates each one from Envoy AI Gateway.

vLLM logo
vLLM

LLM Providers· docs.vllm.ai

Open source

High-throughput open-source inference and serving engine for LLMs with OpenAI-compatible APIs and production deployment patterns.

93,049
Open source

How each alternative differs from Envoy AI Gateway

Ranked by adoption, review, benchmark, and repository signals. Each note below is drawn from the two products’ own catalog records, so a product with nothing to separate it from Envoy AI Gateway carries no note.

  1. 1

    vLLM

    vLLM carries 93k GitHub stars to Envoy AI Gateway's 2.2k.

  2. 2

    Replicate

    Replicate is not listed as open source, while Envoy AI Gateway is and is freemium against Envoy AI Gateway's open source model.

  3. 3

    Mistral AI

    Mistral AI is freemium against Envoy AI Gateway's open source model.

  4. 4

    OpenAI API

    OpenAI API is not listed as open source, while Envoy AI Gateway is, is freemium against Envoy AI Gateway's open source model, and shows 10 recorded adoptions against Envoy AI Gateway's 0.

  5. 5

    llama.cpp

    llama.cpp carries 129k GitHub stars to Envoy AI Gateway's 2.2k.

Replicate logo
Replicate

LLM Providers· replicate.com

Freemium

Cloud API and hosting platform for running, fine-tuning, and deploying open and custom AI models without managing GPU infrastructure.

598
API available
Mistral AI logo
Mistral AI

LLM Providers· mistral.ai

Freemium

Open and commercial model APIs for efficient inference.

Open source
OpenAI API logo
OpenAI API

LLM Providers· platform.openai.com

Freemium

Model APIs for assistants, embeddings, retrieval, and production AI apps.

API available
llama.cpp logo
llama.cpp

LLM Providers· github.com

Open source

C and C++ runtime for local LLM inference, quantized model serving, and edge deployment workflows.

129,244
Open source
Ollama logo
Ollama

LLM Providers· ollama.com

Open source

Local model runtime and API for downloading, running, and serving open LLMs on developer machines and private infrastructure.

181,556
Open source
LiteLLM logo
LiteLLM

LLM Providers· litellm.ai

Open source

Open-source LLM gateway and SDK that standardizes access to 100+ model providers with routing, logging, guardrails, and spend controls.

59,890
Open source
SGLang logo
SGLang

LLM Providers· docs.sglang.io

Open source

Fast open-source serving framework for LLM and vision-language model programs with structured generation and runtime optimization.

36,707
Open source
6

Ollama

Ollama carries 182k GitHub stars to Envoy AI Gateway's 2.2k.

  • 7

    LiteLLM

    LiteLLM carries 60k GitHub stars to Envoy AI Gateway's 2.2k.

  • 8

    SGLang

    SGLang carries 37k GitHub stars to Envoy AI Gateway's 2.2k.