Databricks launches tools to scale AI agents to production

Databricks has launched a suite of new tools designed to help organisations move AI agents from pilot to production with greater confidence, even for mission-critical applications.

The data and AI company said it developed the solutions in response to challenges faced by enterprises deploying generative AI.

Its research on unlocking AI suggests 85 per cent of global companies now use the technology but struggle with business-specific accuracy and governance.

"Many enterprises still struggle to deploy AI agents in high-value use cases due to concerns around accuracy, governance, and security," Craig Wiley, senior director of product for AI/ML, Databricks, said.

"For these organisations, it's confidence, not just technology, that presents the biggest hurdle to extracting the full data intelligence benefits of generative AI," Wiley added.

The new offerings include centralised governance for all AI models through the Mosaic AI Gateway with support for custom LLM providers, providing unified monitoring and integration across both open source and commercial models.

Databricks has also introduced simplified integration capabilities with the AI/BI Genie Conversational API suite.

This allows developers to embed natural language chatbots directly into custom applications or tools like Microsoft Teams, SharePoint, and Slack.

The application programming interface (API) retains context across multiple follow-up questions within conversation threads, enabling more natural interactions.

An upgraded Agent Evaluation Review App streamlines human-in-the-loop workflows, making it easier for domain experts to provide targeted feedback and customise evaluation criteria without needing spreadsheets or custom applications.

Provision-Less Batch Inference was also introduced by Databricks, allowing users to run batch inference using a single structured query language query, eliminating infrastructure provisioning needs while enabling seamless unstructured data integration.

All four tools are now available in public preview.