Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

Lakeflow Designer and Agent Bricks technology unveilings for building data pipeline workflows and AI agents, respectively, are on tap at Wednesday’s Databricks Data + Summit. With new technologies for ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Who needs rewrites? This metadata-powered architecture fuses AI and ETL so smoothly, it turns pipelines into self-evolving engines of insight. In the fast-evolving landscape of enterprise data ...

The no-code ETL tool works by combining a generative AI assistant for pipeline creation and Unity Catalog for governance. Databricks showcased a new no-code data management tool, powered by a ...

Databricks has announced a launch that signals a shift from generative AI experimentation to production-scale deployment – anchored by two new tools, Lakeflow Designer and Agent Bricks. Both are aimed ...

Confluent CEO Jay Kreps said that the partnership will allow businesses to use real-time data to build AI applications for their most critical use cases. Confluent continues to deliver solid results ...

Databricks, which has traditionally appealed to coding-savvy data scientists and data engineers, is making a play to broaden its base of users with new products unveiled this week at the company’s ...

Tevogen.AI’s model drastically reduces target analysis and has the potential to generate billions in cost savings across the healthcare system by streamlining early-stage drug discovery, reducing wet ...