3 posts tagged with "infrastructure"

Gateways · AI News

Pfizer runs an AI gateway — the single service every internal tool talks to when it wants a model. During a routine upgrade check, its throughput fell by half. No errors. No failed requests. Nothing wrong on any dashboard.

They published what they found together with the LiteLLM team, and the cause is small enough to fit in a paragraph: someone wrote a setting that said don't encrypt this connection, and the system encrypted it anyway.

Protocols · AI News

The MCP maintainers' current roadmap names a problem most people building agents have felt without measuring: a server's tool catalogue is charged to the model before anyone asks a question. Under Improved primitives, the post is blunt about it — "Connecting to a server with a hundred tools means the model pays for that entire surface before the user has asked a single question, and tool selection tends to get worse as the list grows."

What makes this worth reading is not the roadmap. It's that the fix is already written down, in the client documentation, alongside a warning that it can cost more than the problem it solves — and that warning gets far less attention than the fix it qualifies.

Protocols · AI News

The Model Context Protocol just had its biggest revision since launch. The 2026-07-28 specification doesn't add a feature — it rewrites how every MCP server talks to every client. If you've deployed an MCP server anywhere past "runs on my laptop," this one touches your infrastructure, not just your changelog.