Demo library GA 4.13.4
← All demos

Metering and auditing every LLM, MCP and agent call

One gateway meters, budgets, guardrails and audits every LLM, MCP and agent call without any app-level code

Pre-release build Customer safe

Pre-release, cleared for customers: Nightly image, but only GA functionality is shown; confirmed by Sam on 22 Sep

Say while it plays

  1. A consumer finds a resource in the developer portal, subscribes with a click, a human approves the pending request, and an API key is issued automatically, without a ticket sitting in someone's backlog.
  2. Cost rate limiting, prompt guardrails, PII filtering and semantic caching chain together on one LLM proxy in a deliberate order, so a consumer who breaches their budget gets blocked while every other consumer on the same plan keeps getting 200s.
  3. An external Azure AI Foundry agent calling a Gravitee-registered tool gets its own identity rather than inheriting its author's, and a risky call stops for human approval before the request is authorised, metered and logged at the gateway.

Don't claim

  • Don't claim Gravitee has native billing: the recording says Gravitee doesn't bill itself, and invoicing runs through a separately wired Stripe MCP server instead.

Chapters

  • Introduction and problem statement
  • Self‑service access subscription flow
  • LLM proxy policies, cost control, and observability
  • Agent integration with Azure AI Foundry
  • Conclusion and compliance summary

Related demos