Demo library GA 4.13.4
← All demos

Federating AI gateways behind one agent

Multiple AI gateways federate behind one reusable agent

Recorded on 4.11, now 4.13 Internal only

Made for ITV

Say while it plays

  1. A lightweight WebSocket agent built outside Gravitee speaks each third-party gateway's own protocol for discovery, subscribe and unsubscribe, so the federation pattern used for API gateways now also works for Kong, LiteLLM, Databricks, Apigee AI, Azure AI Foundry and OpenRouter.
  2. Subscribing through the console mints a real credential on the far side, a LiteLLM key or an Azure Entra ID identity, and unsubscribing genuinely revokes it rather than just hiding the tile in Gravitee.
  3. All six gateways, including OpenRouter's catalogue of over three hundred models trimmed down for the demo, surface into the same single Gravitee control plane, and a real call through OpenRouter shows genuine token usage coming back.

Don't claim

  • Don't claim this federation pattern is shipped or available in the Gamma console: the recording says it's running locally on Docker on 4.12, not in Gamma yet.
  • Don't claim six-gateway federation is a committed roadmap item: the recording calls it Sam's own prototype built to explore a customer POC, with whether it becomes 'proper functionality' still an open conversation.

Chapters

  • Introduction to federating AI gateways
  • WebSocket agent pattern and console UI integration
  • Live demo of multiple AI gateways in Gravitee

Related demos