Save to My Lists
Paid
Claimed
Optimized for quick response

Pepperdata Capacity Optimizer Reviews & Product Details - Page 3

Pepperdata Capacity Optimizer Overview

What is Pepperdata Capacity Optimizer?

Pepperdata Capacity Optimizer is the only real-time, automated cost optimization solution for Spark workloads that can immediately save you up to 47%. By instructing the scheduler to consider the actual resource utilization instead of allocated resources, Capacity Optimizer reclaims waste, maximizes resources utilization, and optimizes autoscaling in the cloud. It operates autonomously, continuously, and in real time to reclaim application waste.

Pepperdata Capacity Optimizer Details
Product Website
Languages Supported
English
Show LessShow More
Product Description

Pepperdata automatically optimizes system resources while providing a detailed, correlated understanding of each application using hundreds of application and infrastructure metrics collected in real-time. It highlights applications that need attention, automatically identifies bottlenecks, and alerts on duration, failure conditions, and resource usage. In the cloud or on-premises, this automated approach gives you complete observability and insight into your big data stack

How do you position yourself against your competitors?

Pepperdata is the only solution that delivers up to 47% greater efficiency on Amazon EMR and EKS with no code changes, recommendations, or manual tuning. Our customers include the largest, most complex, highly-scaled clusters in the world, including those from Fortune 5 companies. In addition, Pepperdata’s Cloud Migration and Savings Reports help companies moving to the cloud inform and accelerate their migration.


Seller Details
Company Website
Year Founded
2012
HQ Location
Sunnyvale, US
Twitter
@pepperdata
706 Twitter followers
LinkedIn® Page
www.linkedin.com
44 employees on LinkedIn®
Description

Pepperdata is a technology vendor specializing in performance optimization and management solutions for big data applications. Their platform provides real-time insights and analytics to enhance the efficiency of data processing workloads across various environments, including on-premises and cloud infrastructures. By leveraging advanced machine learning algorithms, Pepperdata helps organizations improve resource utilization, reduce costs, and ensure optimal performance of their data-driven operations. For more information, visit their website at [pepperdata.com](https://www.pepperdata.com/).


Tom N.
TN
Overview Provided by:

Recent Pepperdata Capacity Optimizer Reviews

Verified User
E
Verified UserEnterprise (> 1000 emp.)
5.0 out of 5
"Sr Director, Big Data"
Capacity Optimizer and APM insight. Product provides great value insight and cost savings to the point where it pays for itself within months or...
Rahul C.
RC
Rahul C.Enterprise (> 1000 emp.)
5.0 out of 5
"Saved 75% cost on EMR"
The capacity optimizer helped us to reduce the wastage on EMR clusters and increased the efficiency. For one of the clusters - the savings was as b...
Verified User
A
Verified UserEnterprise (> 1000 emp.)
4.5 out of 5
"Great Easy to use Product. A must for ETL and Big Data"
Capacity Optimizer is a simple easy to implement - easy to use application that will save you money right from the get go. Right out of the box yo...
Security Badge
This seller hasn't added their security information yet. Let them know that you'd like them to add it.
0 people requested security information

Pepperdata Capacity Optimizer Media

Pepperdata Capacity Optimizer Demo - Pepperdata Capacity Optimizer
Get recommendations for optimization, automatic tuning, and alerting. Pepperdata Capacity Optimizer visualizes real-time and historical information about your clusters including system demand, abusive users, and wasteful applications.
Pepperdata Capacity Optimizer Demo - Autoscaling Before and After
First chart shows cluster growing to 100 nodes for runtime duration. Second chart shows each node running a single task, and then zero tasks, for runtime duration.
Pepperdata Capacity Optimizer for Amazon EMR operates dynamically in real time to optimize performance without the need to model your workloads ahead of time, change application code, or platform settings.
Play Pepperdata Capacity Optimizer Video
Pepperdata Capacity Optimizer for Amazon EMR operates dynamically in real time to optimize performance without the need to model your workloads ahead of time, change application code, or platform settings.
In order for Autodesk to achieve their goals for application scaling and reducing their cloud costs, they installed Pepperdata Capacity Optimizer's autonomous, continuous, intelligent real-time optimization software.
Play Pepperdata Capacity Optimizer Video
In order for Autodesk to achieve their goals for application scaling and reducing their cloud costs, they installed Pepperdata Capacity Optimizer's autonomous, continuous, intelligent real-time optimization software.
Watch Ben Smith, VP Technical Operations at Extole, discuss how he discovered that there's around 30% of application waste within every running app, and how Extole went about saving that wasted capacity.
Play Pepperdata Capacity Optimizer Video
Watch Ben Smith, VP Technical Operations at Extole, discuss how he discovered that there's around 30% of application waste within every running app, and how Extole went about saving that wasted capacity.
Through either our own website or the AWS Marketplace, you have multiple options and ways you can get Pepperdata Capacity Optimizer into your big data stack without any code changes or without manual tuning.
Play Pepperdata Capacity Optimizer Video
Through either our own website or the AWS Marketplace, you have multiple options and ways you can get Pepperdata Capacity Optimizer into your big data stack without any code changes or without manual tuning.

Official Downloads

Answer a few questions to help the Pepperdata Capacity Optimizer community
Have you used Pepperdata Capacity Optimizer before?
Yes

39 Pepperdata Capacity Optimizer Reviews

4.6 out of 5
The next elements are filters and will change the displayed results once they are selected.
Search reviews
Popular Mentions
The next elements are radio elements and sort the displayed results by the item selected and will update the results displayed.
Hide FiltersMore Filters
The next elements are filters and will change the displayed results once they are selected.
The next elements are filters and will change the displayed results once they are selected.
39 Pepperdata Capacity Optimizer Reviews
4.6 out of 5
39 Pepperdata Capacity Optimizer Reviews
4.6 out of 5

Pepperdata Capacity Optimizer Pros and Cons

How are these determined?Information
Pros and Cons are compiled from review feedback and grouped into themes to provide an easy-to-understand summary of user reviews.
Pros
Cons

Overall Review Sentiment for Pepperdata Capacity OptimizerQuestion

Time to Implement
<1 day
>12 months
Return on Investment
<6 months
48+ months
Ease of Setup
0 (Difficult)
10 (Easy)
Log In
Want to see more insights from verified reviewers?
Log in to view review sentiment.
G2 reviews are authentic and verified.
CE
Consultant
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

Its easy to go through the UI and get the stats of the tasks and see the errors and optimize them accordingly. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

Nothing to my knowledge. It helps us decoding the root cause while monitoring the application tasks very well. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

It helps us with debugging our daily hadoop tasks running on HDP. Review collected by and hosted on G2.com.

Response from Ashish Sahu of Pepperdata Capacity Optimizer

Thank you for the review. We are pleased to hear that the UI is easy for you to use and that Pepperdata has been useful for your root cause analysis.

Trupal P.
TP
Sr. Software Engineer , Cloud Infrastructure
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

easy to navigate for all metrics related to spark job, capture all yarn-related metrics. we can search by application id easily. multiple realm is also useful for EMR spark Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

while setting up pepper data autoscaling first time without pepper data support was made EMR autoscaling aggressive because we have to found working autoscaling config for our clusters Review collected by and hosted on G2.com.

Recommendations to others considering Pepperdata Capacity Optimizer:

none Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

Pepperdata provides optimization suggestion on spark application, and also provide bottlenecks why jobs have not performed well. easy to find yarn level error on application Review collected by and hosted on G2.com.

Verified User in Retail
UR
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

Being able to see the memory, cpu, io and other cluster metrics help us to appropriately size the clusters and tune our jobs. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

The UI has a learning curve when dealing with large-scale ephemeral clusters, but after a while the filtering and drill-down become familiar. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

Cluster sizing, application tuning Review collected by and hosted on G2.com.

Response from Ashish Sahu of Pepperdata Capacity Optimizer

Thank you for the review. We love that you're able to tune your ephemeral cluster workloads using Pepperdata. We understand that the UI can take some getting used to, but we're happy to hear that it has now become familiar. To add, we include user training for all our new enterprise customers if you’d like to learn more about the product’s capabilities.

Verified User in Financial Services
AF
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: G2 invite on behalf of seller
Incentivized Review
(Original )Information
What do you like best about Pepperdata Capacity Optimizer?

Great enterprise solution for optimizing big data workloads. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

I have not had negative experiences with Pepperdata. It's a great solution to meeting my needs. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

Pepperdata supports a number of important infrastructure monitoring tasks and is very beneficial with respect to productivity. Review collected by and hosted on G2.com.

Uddipan M.
UM
Engineering Manager
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

Pepperdata provides insightful details and helpful metrics to monitor cluster performance. The user-friendly interface helps to navigate several details like CPU, Memory, Storage usage, I/O etc.

Pepperdata also helps to optimize the cluster settings to ensure enhanced resource management.

App spotlight feature helps to figure out slow jobs or any data skew scenarios Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

Pepperdata can integrate automated alerting in case of any cluster parameter shows alarming behavior. It can also provide features like AI-based detection of resource containment and alert accordingly.

It will be good if Pepperdata can integrate workflow managers like Oozie in the monitored services and map Oozie coordinator/Job Ids to spark Application ids. This will help in easy mapping between interfaces and will result in quicker root cause analysis of issues. Review collected by and hosted on G2.com.

Recommendations to others considering Pepperdata Capacity Optimizer:

Pepperdata is a helpful spark cluster monitoring tool, which provides all relevant metrics of a cluster in a centralized portal. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

1) Automated Spark cluster optimization

2) Root cause analysis of any issues with Spark jobs

3) Detecting data skew scenarios Review collected by and hosted on G2.com.

Response from Andy Gremett of Pepperdata Capacity Optimizer

Hi Uddipan! Thank you for your feedback. Regarding alerting, we have alarms and alerts like what you describe, and here’s the help documentation:

https://help.pepperdata.com/nav-pd-if/08-alarms-alerts/

Regarding workflows, we have a way of assigning workflow IDs that you might find helpful. There’s a way to assign IDs that show as workflows in the Pepperdata interface.

https://help.pepperdata.com/v6-4/admin-guide/reports/05-assigning-workflow-ids/

I have shared your feedback with our product team for review.

PD
Associate Director - Data Scientist
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

I like that Pepperdata allows me to identify various jobs in my ETL architecture to isolate each job and provide a breakdown of: computational time used, memory required, wasted resources, estimated costs. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

While Pepperdata provides a wealth of information which can be used to troubleshoot and improve the efficiency of ETL architectures; I have found that it is difficult to build and create a dashboard specific to my own needs. For example, the default dashboards made available to the Enterprise work well at an Enterprise level from the perspective of the person paying the bill, but there seems to be little to no instruction on how I can create a suite of dashboards to focus on my specific subset of the Enterprise jobs running. Review collected by and hosted on G2.com.

Recommendations to others considering Pepperdata Capacity Optimizer:

Use Pepperdata if you are paying the costs of compute. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

The problem that I have found most relevant to solve with Pepperdata is specifically in identifying bottlenecks and inefficiencies in the ETL architecture I have set up. Given that our ETL's as part of the Enterprise are written by a team of people, such monitoring allows me to not only identify jobs and ETL's which are inefficient and could be tightened, but also acts as a means of identifying members on the team who could use upskilling as a result of consistently running inefficient and poorly optimized jobs. Considering a portion of the Enterprise setup also takes into account forecasting of load demand to plan for capacity; we can also use Pepperdata to track and plan the amount of resources that will be needed by the cluster down the road. Review collected by and hosted on G2.com.

Response from Andy Gremett of Pepperdata Capacity Optimizer

Hi,

Thank you for your feedback. We do offer custom dashboards and if you are looking for something different, we’d be curious to understand your request/requirements.

https://help.pepperdata.com/plat-spot/04-working-with-custom-dashboards/

We’d like to talk to you more about what you’d like to see.

Please contact Info@pepperdata.com and let us know how to reach you.

SM
Mr
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

The visualization on the data collected from the server logs. With verities of options to create your own customized dashboards. Also can create customized alerts in case of any threshold breaches. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

Multiple metrics are available and it is bit difficult to identify the suitable metric. Also the log filters are not so efficient when it comes to analyzing huge logs with number of metrices involved. Initial configuration of the pepper data is challenging due to technical difficulties, but once the configurations are completed the handling of the tool is much simple. Review collected by and hosted on G2.com.

Recommendations to others considering Pepperdata Capacity Optimizer:

The visualization on the data collected from the server logs. With verities of options to create your own customized dashboards. Also can create customized alerts in case of any threshold breaches. It helped us a lot on resolving performance issues and analyze the server performance. Also to visualize the reports which can be presented to stakeholders. Create custom charts with available metrics to understand the data (or) performance trends for longer period of time. Multiple metrics are available and it is bit difficult to identify the suitable metric. Also the log filters are not so efficient when it comes to analyzing huge logs with number of metrices involved. Initial configuration of the pepper data is challenging due to technical difficulties, but once the configurations are completed the handling of the tool is much simple. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

It helped us a lot on resolving performance issues and analyze the server performance. Also to visualize the reports which can be presented to stakeholders. Create custom charts with available metrics to understand the data (or) performance trends for longer period of time. Review collected by and hosted on G2.com.

Response from Andy Gremett of Pepperdata Capacity Optimizer

Hi Surendar,

We are glad to hear from you. Regarding metrics, we do offer many metrics, which can be challenging but gives you lots of flexibility and choices. Would it help to add a better description of these metrics?

We would like to better understand what “log filters” you are referring to. Please contact us at Info@pepperdata.com and let us know the best way to reach you if you are willing to discuss further.

We are at work on simplifying the initial installation of Pepperdata, particularly for cloud installations like EMR clusters.

I have shared your feedback with our product team for review.

PA
Senior cloud administrator
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

Amount of metrics provided by PD along with recommendations to tune the job Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

The recommendations tab should also include ways to implement the suggestions ex. spark submit command Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

Performance optimization of EMR clusters to reduce the uptime Review collected by and hosted on G2.com.

MB
Senior Technical Systems Analyst
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

Pepper Data provides quite detailed analysis about your cluster health. It provides visualization of CPU Resources, memory utilization, Storage, RAM and other important details. For each visualization you can see more details for a specific range of time and for a specific user. You can switch between chart and table display modes. In addition to this it provides detailed information about Queues and Application Status. Apart from the cluster overall details, you can see the Resource Usage of a Spark App as well by using the yarn application id, which is very useful for improving performance and scaling the processes. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

I wish that they provided more info, when hovered on column names, in tabular format/mode, so that it is more easily readable and understandable. Review collected by and hosted on G2.com.

Recommendations to others considering Pepperdata Capacity Optimizer:

Very good tool if you are into Hadoop or Spark and are going to use it extensively for Performance monitoring. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

We are using it to monitor our hadoop clusters in all our environments that is Dev, UAT and Prod. We use it to view and analyze our Spark Application by using the yarn application id. which is very useful for improving performance and scaling the processes. Review collected by and hosted on G2.com.

Response from Andy Gremett of Pepperdata Capacity Optimizer

Minhaj,

Thank you for your question. Can you clarify which tables you’re referring to you which don’t have descriptive enough titles? We looked at several of our top tables and didn’t see this.

Please contact us at Info@pepperdata.com and let us know the best way to reach you.

Verified User in Financial Services
UF
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: G2 invite on behalf of seller
Incentivized Review
What do you like best about Pepperdata Capacity Optimizer?

it has YARN resource visualization, which is pretty intuitive. The UI looks good. Also it has some suggestion on resource usage. Review collected by and hosted on G2.com.

What do you dislike about Pepperdata Capacity Optimizer?

1. Sometimes it has some delay on data collection and I have to wait until the job is done.

2. Too expensive to purchase the service

3. Need some effort to adapt the vendor solution to existed system.

4. It lacks of data security options Review collected by and hosted on G2.com.

Recommendations to others considering Pepperdata Capacity Optimizer:

1. it can provide customized sdk , api or metrics I can use in my spark application, So I can gain more in sighted from application point of view.

2. It can support code level profiling, which can be used in different use cases.

3. it can support alarming config so I can get notification if the resource is out of quote. Review collected by and hosted on G2.com.

What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?

I use it to debug out of memory issue of Spark job and done some troubleshooting. Overall it's great.

It saves a lot of YARN resource and speed up my proformance tuning.

It provides my visualization to explain the actual question to management team to gain better understanding of how much spent in computation resource. Review collected by and hosted on G2.com.

Response from Andy Gremett of Pepperdata Capacity Optimizer

Hi,

We’re sorry to hear you had problems adapting issues into Pepperdata. What specific issues did you encounter?

We see that you are a user in financial services, so we understand the need for security options. What data security options would you like to see?

Regarding your positive comment about debugging Spark applications, we’re glad the details help you debug your apps. We’d love to hear any feedback you might have on how we can continue to improve our Spark recommendations.

Please contact us at Info@pepperdata.com if you are willing to discuss further. Your input is much appreciated!