This repository provides a command-line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally. The CLI builds a Docker container image locally that’s similar to an MWAA production image. This allows you to run a local Apache Airflow environment to develop and test DAGs, custom plugins, and dependencies before deploying to MWAA. To stop the local environment, Ctrl+C on the terminal and wait till the local runner and the postgres containers are stopped. You can setup the local Airflow's boto with the intended execution role to test your DAGs with AWS operators before uploading to your Amazon S3 bucket.
Features
- Build the Docker container image
- Run Apache Airflow using database backends
- Test execution role permissions using this repository
- Build a Docker container image locally
- Run a local Apache Airflow environment to develop and test DAGs
License
MIT LicenseFollow aws-mwaa-local-runner
Other Useful Business Software
Train ML Models With SQL You Already Know
Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of aws-mwaa-local-runner!