Adaptive Model Routing in Fabric Gateway: Cutting LLM Costs 50–80% on Most Workloads
How adaptive model routing in Fabric Gateway classifies each request once and routes it to a cheap, medium or strong model tier, cutting LLM costs 50–80% for a 1–3 point quality drop, with benchmark results for OpenAI and Anthropic.