Apache Airflow (incubating) Documentation — Airflow Documentation

This looks really interesting and would be worth keeping an eye on. I like that it’s in the Apache world.

Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed.