Session: Moving from LLM Gateways to a Single Agent Origin
AI gateways were designed for LLMs, but agents demand more – executing actions like trip planning or web searches, not just autocompleting text. Block/goose, built with LLMs and Model Context Protocol (MCP), delivers flexible, action-driven results. Envoy AI Gateway, co-founded by Bloomberg and Tetrate, evolved from LLM abstraction to power Tetrate Agent Router Service (TARS), now a key goose LLM provider.
Since June 2025, MCP’s growth has integrated SaaS tools like GitHub, Postman, Context7, PGA, and Kiwi.
This talk reveals how we designed the gateway’s agent layer and tested it with Goose recipes for robust end-to-end workflows. We’ll cover tricky technical areas around authorization, as well what sort of features a gateway provides, to help make your agents more robust.
Key Takeaways:
- How to use a single origin for LLM and MCP calls, and what that gives you
- Reuse multi-step workflows with Goose recipes.
- Recent shifts in the agentic landscape and how Agent Client Protocol (ACP) changes things
