Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

The no-code ETL tool works by combining a generative AI assistant for pipeline creation and Unity Catalog for governance. Databricks showcased a new no-code data management tool, powered by a ...

Databricks Inc. is using its Data + AI Summit today in San Francisco to unveil a new data architecture designed to eliminate one of enterprise computing’s oldest bottlenecks: the separation between ...

The launch of Genie Code, analysts say, signals Databricks’ growing ambition to turn its lakehouse platform into the environment where enterprise AI systems build, run, and manage data workflows.

Head of data reliability engineering Dheeraj Puli told the Databricks Data+AI Summit in San Francisco that the bank is standardising on Spark Declarative Pipelines (SDP) across more than 1600 data ...