Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...

Databricks Inc. today introduced two new products, LakeFlow and AI/BI, that promise to ease several of the tasks involved in analyzing business information for useful patterns. LakeFlow is designed to ...

Lakeflow Designer and Agent Bricks technology unveilings for building data pipeline workflows and AI agents, respectively, are on tap at Wednesday’s Databricks Data + Summit. With new technologies for ...

The name of Databricks' annual conference has gone from "Spark Summit" to "Spark + AI Summit" and now to "Data + AI Summit." The evolution of the event name tracks Databricks' own transition from the ...

Building robust, reliable, and highly performant data pipelines is critical for ensuring downstream analytics and AI success. Despite this need, many organizations struggle on the pipeline front, ...