Bauplan Engineering Blog

Data Infrastructure, AI Agents, and Serverless Pipelines

Grit beats talent (if the infrastructure lets you fail)

Full warehouse migration in a single prompt forty-minute task with safe iteration on production data.

Introducing Bauplan Skills: Safe automation for AI on your data

Let AI agents ship data safely.

Trustworthy AI in the Agentic Lakehouse: from Concurrency to Governance

Solving infrastructure first: git-for-data branching and concurrency for AI agents

Schema Annotations in Bauplan 0.3.x

An overview of the new SDK: how to write typed pipelines and what Bauplan validates for you.

October 29, 2026

Colin Marc

Announcements

DevEx for developers who don't write code

Bauplan 0.3 is coming soon

October 20, 2026

Ciro Greco and Jacopo Tagliabue

Announcements

Bauplan at VLDB 2026

Where is the data world heading, according to its pioneers?

September 8, 2026

Jacopo Tagliabue

Announcements

Skill Issues

Evals and optimization for data engineering workflows

August 3, 2026

Jacopo Tagliabue, Giacomo Piccinini, feat. Nicole Rose Schneider and Davide Ghilardi

Open Source

Bauplan at AI Council 2026

Git-for-everything, semantic layer and open source

July 22, 2026

Jacopo Tagliabue

Announcements

GitLake: Git-for-data for the agentic lakehouse

Preprint of the paper accepted at DASHSys, VLDB 2026, Boston, USA, in collaboration with Columbia University, University of Wisconsin-Madison, Carnegie Mellon University

July 10, 2026

Jacopo Tagliabue

Research

Give Claude your data (on a branch)

How to give agents safe access to production through branch, write, validate, merge

July 2, 2026

Ciro Greco

Engineering

How Bauplan Works With the Systems You Already Use

How data moves in and out of Bauplan

June 25, 2026

Tvisha Modi

Product Announcement

How Data Teams Use Bauplan and Claude to Answer Stakeholder Requests Without Losing Governance

An automated loop from executive question to reviewed pipeline, using Bauplan, Claude and Linear.

June 23, 2026

Carlos Leyson and Giacomo Piccinini

Engineering

Agents Just Want To Have... Branches

The state of OLAP branching: Part 1

June 23, 2026

Jacopo Tagliabue, Giacomo Piccinini, feat. Elaine Ang and Sam Weldon (Columbia University)

Case Study

From Humans to Agents: Field Notes from the SAO Workshop

AI Agents and Data Systems at the ACM Conference on AI and Agentic Systems (CAIS), May 26, 2026

June 10, 2026

Ciro Greco

Announcements

Estuary + Bauplan: CDC with branches

Building a robust CDC pipeline into an Iceberg lakehouse

April 1, 2026

Ciro Greco

Engineering

Building a Correct-by-Design Lakehouse

Pre-print on Arxiv

March 19, 2026

Weiming Sheng, Jinlang Wang, Manuel Barros, Aldrin Montana, Jacopo Tagliabue, Luca Bigon

Research

AI for Distributed Systems Design: Scalable Cloud Optimization Through Repeated LLMs Sampling And Simulators

Presented at AAAI 26

March 19, 2026

Jacopo Tagliabue

Research

Querying Everything Everywhere All at Once: Supervaluationism for the Agentic Lakehouse

Pre-print on Arxiv

March 19, 2026

Jacopo Tagliabue

Reference

We solved trust for AI Agents in 1973 (we just forgot)

What SQL databases already know about isolation, concurrency, and trust

January 15, 2026

Ciro Greco, Jacopo Tagliabue and Federico Bianchi (Together AI)

AI Agents

Engineering

Bauplan. A year in review

And our (Bau)plan for the next one

December 30, 2025

Ciro Greco, Jacopo Tagliabue and Mattia Pavoni

Announcements

Rethinking Data Pipelines in Python

Eliminating cross-runtime complexity in your data stacks

December 5, 2025

Ciro Greco

Engineering

Safe, Untrusted Agents for Big Data Infrastructures

Our newly accepted paper at S2AI@BigData 2025

November 20, 2025

Jacopo Tagliabue, Ciro Greco

Research

Duck Hunt: moving Bauplan from DuckDB to DataFusion

Arrow-Native and Community-Driven: Why We Are Excited to Be Part of the DataFusion Ecosystem

November 5, 2025

Jacopo Tagliabue

Engineering

Shift left with Iceberg - Bauplan & Trust & Will

A lakehouse migration story

October 30, 2025

Ciro Greco

Case Study

Git-for-data: Formal Semantics Part 2: Branching, Merging, and Rollbacks

Bringing Database-level Guarantees to the Lakehouse

October 24, 2025

Ciro Greco

Engineering

Your First Lakehouse

When a platform becomes inevitable

October 1, 2025

Ciro Greco

Engineering

Data Engineering is Becoming Software Engineering (And that’s a good thing)

How AI-driven applications are forcing data teams to adopt software engineering best practices in data engineering

September 24, 2025

Bauplan Team

Engineering

Write‑Audit‑Publish: Ship Data Safely, Move Faster

Bring Git Workflows to Your Data

September 24, 2025

Bauplan Team

Engineering

Data Engineering and Automation in the Era of Agents

How Git-for-data branching and unified APIs enable AI agents to safely automate the repetitive mechanics of data engineering

September 15, 2025

Ciro Greco

AI Agents

Bauplan’s MCP Server

The First Step Towards the Agentic Lakehouse

August 25, 2025

Ciro Greco

Announcements

Git for Data: Formal Semantics of Branching, Merging, and Rollbacks (Part 1)

How formal methods help ensure safe, reproducible workflows in data lakehouses

July 17, 2025

Ciro Greco and Jacopo Tagliabue

Engineering

Data engineer agents

From Prompt to Pipeline: Cloud-Native Agents for Data Transformation and ETL

July 4, 2025

Ciro Greco, Jacopo Tagliabue and Federico Bianchi

AI Agents

From Postgres to your first data lakehouse

From transactional database to analytics powerhouse: A practical guide to CDC and Iceberg

June 17, 2025

Ciro Greco

Case Study

Everything-as-Python

From notebook to prod with Bauplan and marimo

June 11, 2025

Ciro Greco

Engineering

Eudoxia: a FaaS scheduling simulator for the composable lakehouse

Proceedings of Workshops at the 51st International Conference on Very Large Data Bases (VLDB 2025)

May 19, 2025

Ciro Greco, Jacopo Tagliabue and Tapan Srivastava

Research

Zerrow: True Zero-Copy Arrow Pipelines in Bauplan

Pre-print on Arxiv

May 13, 2025

Yifan Dai, Jacopo Tagliabue, Andrea Arpaci-Dusseau, Remzi Arpaci-Dusseau, Tyler R. Caraza-Harter

Research

Python Over Data Lakes

Functions, Declarative Environments, Data Management And Other Things With Feathers

May 5, 2025

Ciro Greco

Engineering

Hello Bauplan

Bauplan is a serverless data platform that treats pipelines, models, and tables like software — versioned, testable, and ready for agents.

April 16, 2025

Ciro Greco

Engineering

Announcing Bauplan's seed round

Announcing $7.5M seed round led by Innovation Endeavors

April 16, 2025

Bauplan Team

Announcements

Trading Airflow+EMR for Temporal+Bauplan: The Mediaset Tale

From legacy sprawl to lightning-fast pipelines: how Mediaset rebuilt their data stack with Bauplan and Temporal—and cut dashboard refresh times from 60 minutes to 5.

April 9, 2025

Jacopo Tagliabue and Marco Reni

Case Study