Databricks launches Unity Gateway Insights to find wasted AI tokens
Databricks introduced Unity Gateway Insights, a feature that uses its Genie assistant to analyze agent traces alongside a customer's business data and ontology, surfacing where tokens are wasted. The company says the tool flags recurring MCP errors, routine tasks routed to expensive frontier models, and workflows repeated across sessions that could become shared skills, ranking each finding by cost. Customers with traffic already running through Unity Gateway can open AI Gateway, then Observability, then Insights to generate a report for the past day, 7 days, or 30 days, and can add up to 10 custom questions. Databricks reports that its own trace analysis found an estimated $1.2M in annual savings from fixing seven MCP server bugs. Traces are stored in a governed Delta table in Unity Catalog.
Sources
- PrimaryDatabricks
Written by AIToolMaps from the source above and checked against it sentence by sentence.