Inference gateway

A service that sits between the client (or an agent) and the model: it routes requests, applies policies (rate limiting, authentication, redaction) and can switch providers without the client noticing. For an LLM agent, a redaction gateway is the one that redacts outgoing secrets before calling the provider.