Bauplan blog

Lessons learned crafting a Serverless Lakehouse from spare parts

Full-stack recommender system with Bauplan for data preparation and training, and MongoDB Atlas for real-time inference.

Paper presented at WoSC10 2024. In collaboration with The University of Wisconsin.

Making the experience of running data workflow in the cloud indistinguishable from doing it locally.

DAG planning using an in-memory graph database. In collaboration with Kùzu

Paper presented at DEMAI@IEEE Big Data 2024.

A reference implementation to implement a Write-Audit-Publish (WAP) pattern with Bauplan and Prefect 3.0.

Find the right balance between cost control and fast startup time for your Spark clusters.

An open source implementation of WAP using Apache Iceberg, Lambdas, and Nessie all running entirely Python.

Paper presented at SIGMOD/PODS 2024. Awarded best paper DEEM@SIGMOD.

Working on production data is the only way to know whether our applications will work.

Why production cloud environment are too slow and hard to develop in them.

The greatest invention since sliced Virtual Machines.

Paper presented at VLDB 2023.

An open-source implementation of a Data Lake with DuckDB and AWS Lambdas.