Getting Started

open-dapro is the data orchestration and pipelining tool for the German Energy System built with Dagster, dbt, PostGIS, and GeoServer. Its purpose is the collection and combination of data from different sources. The data pipelines can be scheduled regularly to keep the database up to date.

Use open-dapro if you want to

• Have a local database of houses, electricity producers, ... on your server which updates automatically.
• Extend existing pipelines with the datasets you need.

Installation

1. Clone the repository git.fortiss.org/ASCI-public/energy-dagster and open it in a terminal.
2. Make sure you have docker and docker-compose installed by running

   docker --version
   docker-compose --version
   

3. Run docker-compose up and go to localhost:3000 to see the dagster UI. A documentation of the dagster UI can be found here.
4. Start exploring the data pipelines

For an alternative setup you can also follow the instructions in the Setup for development.