Demo library GA 4.13.4
← All demos

Keep LiteLLM, govern it with Gravitee

A team can keep LiteLLM and still govern it with Gravitee, by federating its models and virtual keys in or by putting the LLM proxy in front of it

Pre-release build Internal only

Say while it plays

  1. If you're already running LiteLLM and don't want to replace it, Gravitee can federate it in like any other provider, bringing its models in and minting virtual keys you can revoke straight from Gravitee.
  2. Revoking a federated LiteLLM subscription in Gravitee actually blocks the underlying virtual key, so the caller gets a genuine 401 rather than just losing visibility in Gravitee's console.
  3. Alternatively, you can put Gravitee's LLM proxy in front of LiteLLM as its own entry point and get richer guardrails, token limiting and cost control at the gateway while LiteLLM still does the downstream model routing.

Chapters

  • Federating LightLLM via Gateway Agents
  • Routing LightLLM Traffic with the LLM Proxy

Run it live

Open the live demo in the runbook

URLs, whether it is up right now, and the gotchas.

Related demos