Dagster's asset functionality sits on top of a general orchestration engine that can be used for tasks other than creating and maintaining assets.
By the end of this tutorial, you will:
To complete this tutorial, you'll need to install Dagster, Dagit, and the requests library:
pip install dagster dagit requests
This installs a few packages:
- Dagster. The core programming model and abstraction stack; stateless, single-node, single-process and multi-process execution engines; and a CLI tool for driving those engines. Refer to the Dagster installation guide for more info, including how to ensure your environment is set up correctly.
- Dagit: The web-based UI for developing and operating Dagster jobs, including a DAG browser, a type-aware config editor, and a live execution interface.
- Requests: While not a part of Dagster, we'll use this in the tutorial to download data from the internet.
When you've fulfilled all the prerequisites for the tutorial, you can get started creating your first asset.