Apache Airflow Pros and Cons

Apache Airflow handles dependency management well, an advantage over typical ETL monitoring tools. The User Interface of Airflow is excellent and offers a lot of tasks, such as monitoring runs and logging quickly. Review collected by and hosted on G2.com.

Apache Airflow is not directly compatible with Windows operating system. There are ways to overcome this limitation, but it can be challenging for new data engineers. Review collected by and hosted on G2.com.

A handy tool for creating a fast and quick DAG utility for a GCP. Works well to parallelize spark jobs. Review collected by and hosted on G2.com.

It would be nicer if the DAG GUI could be improved with functionality to add logs from the tasks. Also the error handling and restart from the point of failure like azure adf. Review collected by and hosted on G2.com.

DAGs allow to run of scripts in the logical task flow. It ability to show logs and emails Review collected by and hosted on G2.com.

Little bit of issue in setting up for production environment Review collected by and hosted on G2.com.

Using Apache airflow reduces so many manual efforts which are required in project data pipelines, and it is best tool since its come with so many features such as custom operators and many more Review collected by and hosted on G2.com.

Airflow should work on dag versioning so that we can manage its versions more effectively Review collected by and hosted on G2.com.

It's relatively smooth comparatively with ease of using the features which impressed due to the reason that others aren't providing them Review collected by and hosted on G2.com.

The optimisation is lacking along with processing speed compared to other similar platforms. Review collected by and hosted on G2.com.

Handles dependency management like a charm. From dataflow to conplex branching, task retry, catchup runs etc., It has everything Review collected by and hosted on G2.com.

Data processing is not very intuitive even after using it for a while and tedious to understand for someone who is new to it Review collected by and hosted on G2.com.

The UI with multiple views and the option to run each job without going into debug mode. Review collected by and hosted on G2.com.

There is no option to change the code in the UI. Review collected by and hosted on G2.com.

Web UI and transparency, It has been the most preferred tool to automate Jobs or Workflows Review collected by and hosted on G2.com.

After run of every job we may face some errors and to check the logs we don't have keyword search filter. Review collected by and hosted on G2.com.

It is an open-source tool that provides users to schedule a task and automate the process. It provides the option to run jobs individually without using debug mode. It is easy to use and fun. Moreover, it is easy to understand. Review collected by and hosted on G2.com.

UI glitches sometimes. Apart from that, modifying a deployed pipeline is complex. Therefore, usually, users need to create a new pipeline instead of making changes to the existing one. Review collected by and hosted on G2.com.

Ease of creating dags, communication b/w tasks, retries, multiple connectors etc Review collected by and hosted on G2.com.

Inhouse setup fo airflow can be tedeious, also not knowing why tasks are in scheduled state Review collected by and hosted on G2.com.