Project: airflow-with-podcasts
Sample solutions demonstrated by my airflow-with-podcasts project. You can find the source code here on Github. Check out some of my other projects here.
Run Distributed Tasks Using Airflow
Airflow makes it easy to manage complicated data pipelines and run them in a distributed cluster. Airflow does this by letting users create DAGs that run and track batch jobs as they run across multiple stages. In this demo, I hook up Airflow running on a Docker container to my podcast analysis tool. View on Github