Documentation

How opendatastack is put together: the conventions every asset follows, the decisions behind them, and how to work on the project.

Conventions and decisions

• Lake Layout and Naming Convention
• Table Format: Delta Lake vs Apache Iceberg
• Required Asset Metadata
• Notebook Access to the Lake
• dbt Models in the Lake
• Spark Jobs

Proposals

• Working Alongside Databricks and Snowflake

Development

• Running the Tests

Placeholders

• AI in the Platform