Metering and auditing every LLM, MCP and agent call
One gateway meters, budgets, guardrails and audits every LLM, MCP and agent call without any app-level code
Pre-release buildCustomer safe
Pre-release, cleared for customers: Nightly image, but only GA functionality is shown; confirmed by Sam on 22 Sep
Say while it plays
A consumer finds a resource in the developer portal, subscribes with a click, a human approves the pending request, and an API key is issued automatically, without a ticket sitting in someone's backlog.
Cost rate limiting, prompt guardrails, PII filtering and semantic caching chain together on one LLM proxy in a deliberate order, so a consumer who breaches their budget gets blocked while every other consumer on the same plan keeps getting 200s.
An external Azure AI Foundry agent calling a Gravitee-registered tool gets its own identity rather than inheriting its author's, and a risky call stops for human approval before the request is authorised, metered and logged at the gateway.
Don't claim
Don't claim Gravitee has native billing: the recording says Gravitee doesn't bill itself, and invoicing runs through a separately wired Stripe MCP server instead.
Chapters
Introduction and problem statement
Self‑service access subscription flow
LLM proxy policies, cost control, and observability