Sucheta Dhiman·23h agoLLM Routing Explained: Weight, Latency, and Priority-Based StrategiesWhen an application sends a prompt to a large language model, something has to decide which model actually answers. In the simplest setups…
Radicalbit·2d agoGoverning the AI-Driven SDLC: Costs, Identities, and Permissions of AI AgentsA managed environment for the AI-Driven SDLC (Software Development Life Cycle), the entire software development lifecycle driven by AI, is…
Masato Takada·Nov 5Cortex AI Gateway Is Now GA: Testing What Changed Since the PreviewI work at Snowflake, but the views expressed in this article are my own and do not represent the official views of my employer.A response icon1A response icon1
Yusuke Shibui·Nov 5Tracing Claude Code with Cortex AI Gateway: Observability for snow ai claudeThe author is a Snowflake employee, but the views expressed in this article are personal and do not represent the official position of…A response icon1A response icon1
Mofesola Babalola·Nov 4AI-Aware Traffic Management: Scaling Inference with Istio Ambient MeshHow to route LLM traffic by KV cache instead of by luck, what breaks when you put the model pods in ambient, and what I’m fixing upstream.
Arshathimran·Nov 4Why is an LLM Gateway the Ultimate Need of Our Time?Understanding the gateway concept
Gurdeep Dhillon·Nov 3One API for Every Model: How an LLM Gateway Unifies ProvidersPerhaps the single most valuable thing an LLM gateway does is also the simplest to describe: it gives you one API for every model. That…
InGoogle Cloud - CommunitybyDaniel Strebel·Nov 3Building a LiteLLM Enterprise Gateway for AntigravityWhen an individual developer or small startup wants to use an agentic AI coding harness like Antigravity, they can just install it, run…
Shamen·Nov 1Experimenting with Declarative AI Governance: One of the Best Ways to Govern Databricks Unity AI…How we combined declarative Team YAMLs, native Terraform, Unity Catalog ABAC, and a REST API bridge to automate multi-team LLM routing…A response icon1A response icon1