Dagster is an orchestration platform for the development, production, and observation of data assets.
Dagster as a productivity platform: With Dagster, you can focus on running tasks, or you can identify the key assets you need to create using a declarative approach. Embrace CI/CD best practices from the get-go: build reusable components, spot data quality issues, and flag bugs early.
Dagster as a robust orchestration engine: Put your pipelines into production with a robust multi-tenant, multi-tool engine that scales technically and organizationally.
Dagster as a unified control plane: The ‘single plane of glass’ data teams love to use. Rein in the chaos and maintain control over your data as the complexity scales. Centralize your metadata in one tool with built-in observability, diagnostics, cataloging, and lineage. Spot any issues and identify performance improvement opportunities.
Features
- Manage your data assets with code
- A single pane of glass for your data platform
- Monitor runs across all your jobs in one place with the run timeline view
- Zoom into a run to pin down issues with surgical precision with the run details view
- See each asset’s context and update it, all in one place - materializations, lineage, owner, schema, schedule, partitions, and more
- Launch and monitor backfills over every partition of your data