Reseñas y detalles del producto de AWS Data Pipeline

It has made possible to connect multiple data sources and workloads and analyze data especially AWS Redshift and AWS Glue service. Reseña recopilada por y alojada en G2.com.

It requires lot's of configuration between multiple AWS data services to use and analyze data Reseña recopilada por y alojada en G2.com.

Easy to run a spark job as a step in the pipeline. AWS console has drag and drop UI to build the pipeline schema, and ir works very well. Reseña recopilada por y alojada en G2.com.

There are some missing features. I was unable to run a job on demand, than a schedule. Does not support multiple versions of the same pipeline Reseña recopilada por y alojada en G2.com.

A pretty straightforward way to run batch jobs, whether that's ETLs, or some sort of other CRON based job. The tool is quite customizable with what can be done (arbitrary shell scripts) and integrates well with S3 and EC2 Reseña recopilada por y alojada en G2.com.

There are times when something that should just work is very difficult. For example, the default EC2 instance AMI was very very old and thus, the tools installed on it have to all be upgraded before being used (like the AWS CLI). Everything can be customized, however, including the image, but this takes a little bit of time to get working and can be confusing when just getting started. This particular example has been resolved, but there are other that are similar. Reseña recopilada por y alojada en G2.com.

servicio gestionado por Amazon para mover datos de una fuente a otra muy rápidamente y de manera automatizada con alta disponibilidad de manera confiable. podemos modificar o establecer a qué hora necesitamos ejecutar esto y solo se nos cobra cuando lo usamos, muy buen servicio gestionado por Amazon, muy confiable, flexible y de bajo costo para usar. Reseña recopilada por y alojada en G2.com.

A veces, el pipeline se queda atascado esperando dependencias, por lo demás, todo está muy bien en este servicio proporcionado por AWS. Reseña recopilada por y alojada en G2.com.

I like the way AWS easily createS complex data processing workloads that are fault tolerant, repeatable, and highly available. You don’t have to worry about ensuring resource availability, managing inter-task dependencies, retrying transient failures or timeouts in individual tasks, or creating a failure notification system. AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premises data silos. Reseña recopilada por y alojada en G2.com.

Data Pipeline is sometimes difficult to utilize.The most difficult part of the AWS Data Pipeline uses are the Error messages which occur very easily. I do not like the fact that there are no time notifications which makes it difficult to fully utilize some of the features. Sometimes, it's impossible to understand exactly what the issues are in this program. and it is difficult to understand what exactly failed since it is an amazon service. Reseña recopilada por y alojada en G2.com.

Its a very good and managed service provided by amazon to move the data from one source to another with high availability and reliable process. We can set it on data sources and can be modified at what time of interval we need to run this, it automatically works and send the data.It is very simple, easy to use, flexible, reliable services and having low cost. Reseña recopilada por y alojada en G2.com.

it has all advantages but sometime pipeline stuck with waiting on dependency component. Otherwise it is very useful and very good service. Reseña recopilada por y alojada en G2.com.

facilidad de uso con la interfaz de usuario y el arrastrar y soltar Reseña recopilada por y alojada en G2.com.

ETL personalizado difícil de gestionar e implicaba mucho arrastrar y soltar. Reseña recopilada por y alojada en G2.com.

Data Pipeline integrates really well with EMR, and it's easy to deploy pipelines via cloudformation making automation possible. We use it to manage complex map-reduce workflows and it usually works pretty smoothly. Reseña recopilada por y alojada en G2.com.

The fact that it is in maintenance mode means that bugs and feature requests aren't addressed in a timely manner. Reseña recopilada por y alojada en G2.com.

AWS Data Pipeline es un servicio muy bien gestionado y confiable que nos ayuda a resolver el servicio de datos de una fuente a otra y a resolver problemas de filtrado de datos, estamos utilizando problemas de fuente de datos y es un servicio muy útil. Reseña recopilada por y alojada en G2.com.

Su principal desagrado es el costo y, a veces, los datos se atascan en la tubería. Reseña recopilada por y alojada en G2.com.

AWS Data Pipeline has GUI based designing tool which makes it very easy to understand the workflow and configure some of the complex workflow easily Reseña recopilada por y alojada en G2.com.

Resource take bit more time to setup from data pipeline that directly. In my case i use Amazon EMR cluster in join with a Lambda function. Lambda runs quickly but EMR takes a lot of time to setup, even after the resources are provisioned and cluster is read to accept jobs the first job arrive to cluster very late. almost 9-10 min late. Reseña recopilada por y alojada en G2.com.