DuckLake

DuckLake delivers advanced data lake features without traditional lakehouse complexity by using Parquet files and your SQL database. It's an open, standalone format from the DuckDB team.

DuckLake uses a database system to manage your metadata for the catalog. All you need to run your own data warehouse is a database system and storage for Parquet files.

Key features:

• Data lake operations: DuckLake supports snapshots, time travel queries, schema evolution and partitioning.
• Lightweight snapshots: You can have as many snapshots as you want without frequent compacting steps!
• ACID transactions: DuckLake allows concurrent access with ACID transactional guarantees over multi-table operations.
• Performance-oriented: DuckLake uses statistics for filter pushdown, enabling fast queries even on large datasets.