You can now read a change data feed from a materialized view created in a Lakeflow pipeline or in Databricks SQL, using Databricks Runtime 18 LTS or above. Use this to replicate materialized view changes to destinations outside Databricks, or to keep a history of materialized view changes for auditing and reporting. Materialized views use automatic change data feed, so the change data feed is avai…
The ai_search() SQL function retrieves information from one or more AI Search indexes configured as knowledge sources. Given a natural-language query, the function generates optimized search queries, retrieves and deduplicates results across sources, reranks them by relevance, and returns the most relevant documents. By default, it also synthesizes a grounded natural-language answer over those doc…
Tag automations are now in Beta. A tag automation assigns or removes governed tags on the Unity Catalog tables or volumes that match conditions you define, so tags stay accurate as your data and metadata change. Use them to certify trusted data, deprecate stale data, roll up column sensitivity to a table-level tier, flag assets that are missing required tags, and clean up outdated tags. You can bu…
Model Serving now supports Kimi K3 as a Databricks-hosted model. This 2.8-trillion-parameter mixture of experts (MoE) model has native vision capabilities, supports a 1 million token context window, and is designed for long-horizon coding, knowledge work, and reasoning. You can access this model using Foundation Model APIs.
Package Scala or Java code as a JAR and run it as a task in a Lakeflow Job on serverless compute. Your JAR must match the Scala, Java Development Kit (JDK), and Databricks Connect versions of your serverless environment version. See Create and run JARs on serverless compute.
All Databricks-managed MCP connectors for Genie One and Genie Code have migrated to the Unity AI Gateway. This brings Databricks-managed connectors under Unity AI Gateway, enabling centralized governance, access controls, and visibility alongside your other MCP servers and tools. Users must reauthenticate their connectors to continue using them with Genie One and Genie Code. A notification in Geni…
Genie Code can now search the public web to answer questions that need current information. Web search is disabled by default during the beta for eligible workspaces and must be turned on from the Previews page. See Search the web.
Markdown tables in Agent mode APIs (Beta): In the Agent mode APIs, table visualizations now return as markdown instead of table visualization attachments, which improves readability. See Parse the report. Longer agent descriptions: Genie Agents now show more of an agent's description by default, so you can see the purpose of each agent at a glance. Comment on answers from Genie One: You can now ad…
Rich text in widget titles and descriptions: Visualization widget titles and descriptions now support rich text formatting. Click a widget's title or description to open a formatting toolbar, where you can apply text styling, links, and tables, or enter Markdown text directly. See Format widget titles and descriptions. Hide pivot table column headers: Dashboard authors can now hide the column head…
Upload PDF files to a conversation (Beta): You can now upload PDF files to a Genie One conversation alongside CSV and Excel files. Genie One parses PDFs asynchronously. See Upload a file. Mention workspace users in document comments: In a document, you can now mention workspace users in a comment. Genie Ontology enabled by default (Public Preview): The ontology is a unified context layer that give…
Lakebase is now available by default for workspaces with the compliance security profile enabled and either HIPAA, C5, or TISAX controls selected, and for workspaces with the compliance security profile enabled without a compliance standard. See Data protection.
Package Scala or Java code as a JAR and run it as a task in a Lakeflow Job on serverless compute, without provisioning or managing clusters. See Create and run JARs on serverless compute.
You can now search and replace text across files in a Databricks Git folder or Declarative Automation Bundles project from the Search pane. See Search and replace across files.
REPLACE USING flows are now available in Lakeflow pipelines in Beta. Use a REPLACE USING flow when your source is a series of partial snapshots keyed by column. On each update, the flow replaces all rows that match the specified key columns and leaves all other rows unchanged. A SEQUENCE BY column orders the updates, so the highest sequence for a key always wins, even when updates arrive out of or…
You can now use Genie One directly in the Databricks Excel Add-in. Query your governed Databricks data in natural language and import the results into Microsoft Excel as native rows and columns. See Use Genie in Microsoft Excel.
You can now use Genie One directly in the Databricks Connector for Google Sheets. Query your governed Databricks data in natural language and import the results into Google Sheets as native rows and columns. See Use Genie in Google Sheets.
Window measures in metric views support a unitless numeric offset and numeric trailing and leading ranges on a consecutive integer order column. Use a numeric index to compare along a business period that is not a calendar date, such as a fiscal week or a 4-4-5 accounting period. See Window measures on a numeric index column.
Visualization widget titles and descriptions support rich text formatting. Click a widget's title or description to open a formatting toolbar, where you can apply text styling, links, and tables, or type markdown directly. See Format widget titles and descriptions.
Sharing Delta tables with deletion vectors or column mapping enabled is now generally available. See Add tables with deletion vectors or column mapping to a share.
Sharing Delta tables with Iceberg reads enabled is now generally available. See Delta Lake feature support matrix.
New maintenance updates are available for supported Databricks Runtime versions. These updates include bug fixes, security patches, and performance improvements. For details, see: Databricks Runtime 18 LTS Databricks Runtime 18.2 Databricks Runtime 18.1 Databricks Runtime 17.3 LTS Databricks Runtime 16.4 LTS Databricks Runtime 15.4 LTS Databricks Runtime 14.3 LTS Databricks Runtime 13.3 LTS
The Google Drive connector in Lakeflow Connect is now Generally Available. See Google Drive connector.
The SharePoint connector in Lakeflow Connect is now Generally Available. See SharePoint connector.
Full page Genie Code is now generally available. Full page Genie Code is a command center experience where the active chat is shown prominently, notebooks and files open as tabs alongside it, and you can run multiple chats in parallel. Start work directly from Genie Code, and personalize how it works with skills, instructions, and MCP servers. See Full page Genie Code.
The managed PagerDuty connector in Lakeflow Connect is now available in Beta. The connector ingests incident, on-call, service, and audit data from PagerDuty into Databricks. See PagerDuty connector.
Unity AI Gateway is now generally available. Unity AI Gateway is the Databricks governance solution for enterprise AI, part of Unity Catalog. With Unity AI Gateway you can: Control which AI services teams can use. Route and manage AI traffic across providers. Govern MCP servers to control access and costs. Monitor usage, cost, access, and lineage from one place. Some capabilities, including servic…
Serverless compute access control is now generally available. Workspace admins can govern who runs serverless workloads through two built-in serverless compute objects: Default Interactive Compute (governs access to notebooks and Databricks Connect) and Default Automated Compute (governs access to jobs and Spark Declarative Pipelines on Lakeflow). All workspace users have Can Use on both objects b…
Secrets in Unity Catalog is now generally available. You can store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace (catalog.schema.secret) and is governed by Unity Catalog privileges, so you can apply the same access controls and auditing that you use for other data assets. See Secrets in Unity Catalog.
The MANAGE privilege no longer requires a usage privilege (USE CATALOG or USE SCHEMA) on the object where MANAGE is granted. This change makes MANAGE behave more consistently with object ownership. Previously, MANAGE on a catalog or schema took effect only if you also held the appropriate usage privileges on that object. You still need usage privileges on any parent containers: MANAGE on a catalog…
You can now refresh a pipeline-managed materialized view or streaming table even when the pipeline owner or run-as identity is subject to an attribute-based access control (ABAC) policy. Previously, refreshing a materialized view or streaming table managed by a pipeline required the pipeline owner or run-as identity to be exempt from any applicable ABAC policy. That limitation has been removed. Wh…