# Pepperdata Capacity Optimizer Reviews **Vendor:** Pepperdata **Category:** [Cloud Cost Management Tools](https://www.g2.com/categories/cloud-cost-management) **Average Rating:** 4.6/5.0 **Total Reviews:** 39 ## About Pepperdata Capacity Optimizer Pepperdata Capacity Optimizer is the only real-time, automated cost optimization solution for Spark workloads that can immediately save you up to 47%. By instructing the scheduler to consider the actual resource utilization instead of allocated resources, Capacity Optimizer reclaims waste, maximizes resources utilization, and optimizes autoscaling in the cloud. It operates autonomously, continuously, and in real time to reclaim application waste. ## Pepperdata Capacity Optimizer Pros & Cons **What users like:** - Users value the **enhanced performance** of Pepperdata Capacity Optimizer, achieving significant cost savings and efficiency improvements. (4 reviews) - Users highlight the **significant cost savings** with Pepperdata Capacity Optimizer, achieving up to 75% reductions in cluster wastage. (2 reviews) - Users value the **effective resource management** of Pepperdata Capacity Optimizer, achieving significant savings and improved efficiency. (2 reviews) - Users experience significant **cost savings** with Pepperdata, often seeing rapid ROI and enhanced cluster efficiency. (2 reviews) - Users value the **detailed analytics** provided by Pepperdata Capacity Optimizer for job performance and resource utilization. (1 reviews) - Users highlight the **cost-effectiveness** of Pepperdata Capacity Optimizer, delivering savings that often cover its cost quickly. (1 reviews) - Cost Reduction (1 reviews) - Users commend the **exceptional customer support** of Pepperdata, enhancing their experience and successful migration to EKS. (1 reviews) - Customizability (1 reviews) - Users appreciate the **clear and customizable dashboards** of Pepperdata Capacity Optimizer for effective performance management. (1 reviews) **What users dislike:** - Users feel the lack of **automation** in settings adjustment leads to frequent fine-tuning, missing helpful recommendations for workloads. (1 reviews) - Users face a **steep learning curve** , making it hard for developers to utilize tuning recommendations effectively. (1 reviews) - Users highlight the **learning difficulty** as many developers struggle to utilize tuning recommendations effectively. (1 reviews) - Users find the **limited availability of supported tools** frustrating, despite the overall great cloud performance. (1 reviews) - Users find the **limited functionality** of Pepperdata Capacity Optimizer restrictive due to minimal supported tools and products. (1 reviews) - Limited Reporting (1 reviews) - Poor Recommendations (1 reviews) ## Pepperdata Capacity Optimizer Reviews ### 1. PepperData- a tool for performance **Rating:** 5.0/5.0 stars **Reviewed by:** akash v. | Technical Lead, Enterprise (> 1000 emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Pepper data is great tool for reviewing all spark job's statuses and manage from the application. These days we are also using tool to check and enhance performance of our jobs , It is a great tool to work with! It has the graphs, charts and metrics which helps you a lot to check the performance of the the jobs. It also tells you the utilization of queue, CPU, Cores, and server. you can create/customize your own dashboard and Alarms. It also has the feature the create and publish the analytic reports for further investigation. **What do you dislike about Pepperdata Capacity Optimizer?** It should provides detailed error logs and the recommended fix whether code needs to be fix or configuration needs to me tweaked. More utilization insights if possible. Live Customer service via chat in the future if possible. It should have the email notification service which can be triggered everytime when there is any Alarm. **Recommendations to others considering Pepperdata Capacity Optimizer:** It is currently being used across a department with access to a certain set of applications and is used to see the performance of the Jobs. I highly recommend to explore this tool if not using already. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** All jobs can be monitored from one dashboard, we know which job is taking longer time and the CPU/Memory consumption. Hence we can change to code to improve the performance. With metric trend graphs, public status pages, dashboards and side-by-side comparisons Pepperdata helps you clearly visualize performance data and compel action. It also helps us to manage our servers and their configuration. **Official Response from Andy Gremett:** > Akash, Thanks for the great suggestions. Could you please specify which utilization insights you would like to see in the future? Please contact Info@pepperdata.com if you are willing to discuss further and let us know how to reach you. Regarding email alerts, we have alarms and alerts like what you describe, here’s the help documentation: https://help.pepperdata.com/nav-pd-if/08-alarms-alerts/ Thank you for the suggestion about the logs. We don’t have anything right now at that level. I have shared your feedback with our product team for review. ### 2. Great Easy to use Product. A must for ETL and Big Data **Rating:** 4.5/5.0 stars **Reviewed by:** Verified User in Banking | Enterprise (> 1000 emp.) **Reviewed Date:** August 12, 2024 **What do you like best about Pepperdata Capacity Optimizer?** Capacity Optimizer is a simple easy to implement - easy to use application that will save you money right from the get go. Right out of the box you will see a 10 to 15 % savings. The support is top notch - they go above and beyond in getting the most out of the product. This is a no brainer for any Big Data workload. **What do you dislike about Pepperdata Capacity Optimizer?** The Pepperdata team works closely with you to answer and problems you may have. I have not had any serious problem that would make me not use it **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Cost Savings - We have seen a significant cost savings Visiblity - We have more visiblity than what AWS gives us with Pepperdata ### 3. Saves a lot of money in hardware. Helps find bottlenecks. **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Information Technology and Services | Enterprise (> 1000 emp.) **Reviewed Date:** February 17, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Capacity optimizer fits more containers on the cluster than would normally run without it. Custom alarms allow us to trap and notify problem users and processes in Spark/Yarn. The dedicated support we get from Pepperdata is top notch. **What do you dislike about Pepperdata Capacity Optimizer?** A lot of our developers are not advanced enough to take advantage of spark tuning recommendations. Or are not given the time to tune their applications **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Delayed hardware purchases. Proactive impala problem monitoring. Proactive notification to users about problematic apps. Suggestions on how to fix. Recently, Capacity Optimizer helped me find a new (and problematic) application on the cluster. We were able to throttle it down so it did not impact others. **Official Response from Andy Gremett:** > Hi, If you are interested in more detail, we can point you to some of our webinars on Spark tuning and Spark recommendations. https://www.pepperdata.com/technical-webinars/ ### 4. Saved 75% cost on EMR **Rating:** 5.0/5.0 stars **Reviewed by:** Rahul C. | Senior Director, Enterprise (> 1000 emp.) **Reviewed Date:** May 23, 2024 **What do you like best about Pepperdata Capacity Optimizer?** The capacity optimizer helped us to reduce the wastage on EMR clusters and increased the efficiency. For one of the clusters - the savings was as big as 75%. For others we are seeing atleast 30% savings. **What do you dislike about Pepperdata Capacity Optimizer?** Needs fine tuning multiple times, I would love to see some automated feedback in place to recommend the right set of settings based on the workloads. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Cost optimization ### 5. Sr Director, Big Data **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Health, Wellness and Fitness | Enterprise (> 1000 emp.) **Reviewed Date:** August 22, 2022 **What do you like best about Pepperdata Capacity Optimizer?** Capacity Optimizer and APM insight. Product provides great value insight and cost savings to the point where it pays for itself within months or sooner for some. **What do you dislike about Pepperdata Capacity Optimizer?** Cloud performance is great, however the number of tools/products that are supported are limited. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Cost optimization and code optimizations. Allows for wasted capacity to be leveraged. **Official Response from Ashish Sahu:** > Thank you for the review. We're ecstatic to hear about your cost savings and how the Capacity Optimizer is practically paying for itself! One of the main goals of our platform is helping you realize a reduction in cloud costs, and we’re happy to have satisfied that. We also appreciate your feedback about the limited support for the number of tools — we are expanding our product offerings and plan to share updates shortly. ### 6. Improves spark report performance and saves overall compute spend. **Rating:** 5.0/5.0 stars **Reviewed by:** Benjamin S. | VP Technical Operations, Mid-Market (51-1000 emp.) **Reviewed Date:** August 12, 2024 **What do you like best about Pepperdata Capacity Optimizer?** The ease of installation, great dashboards for cost and capacity visibility. **What do you dislike about Pepperdata Capacity Optimizer?** Wish we could use it on our other applications! **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Lowering our overall cost. ### 7. Save money on your big data workloads **Rating:** 5.0/5.0 stars **Reviewed by:** Lee G. | Video Course Creator, Mid-Market (51-1000 emp.) **Reviewed Date:** February 13, 2024 **What do you like best about Pepperdata Capacity Optimizer?** The capacity optimizer has been proven to save a lot of money. What I like best about the product, though, is the support we have received throughout our journey of migrating our EMR clusters from EC2 to EKS. **What do you dislike about Pepperdata Capacity Optimizer?** There are still some features that need to be worked out for EMR on EKS and EMR Notebooks, but the Pepperdata team is actively working on these. These are relatively new offerings, so it's not surprising that there is still some work that needs to be done. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** The optimizer's main benefit is cost savings on compute, specifically with workloads running on EMR. ### 8. Good for visualization. Need more details and understanding 9f.how the optimization works **Rating:** 3.0/5.0 stars **Reviewed by:** Nachiket K. | Senior Software Engineer - DevOps, Enterprise (> 1000 emp.) **Reviewed Date:** February 13, 2024 **What do you like best about Pepperdata Capacity Optimizer?** The visualization is good with clear uncluttered dashboards and metrics analyser **What do you dislike about Pepperdata Capacity Optimizer?** Optimizer does not work always. Details on how the optimizer works is not so clear. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Optimizing kubernetes resource usage for data pipeline infrastructure ### 9. Pepperdata review **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Banking | Enterprise (> 1000 emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** I like the fact that Pepperdata has hundreds of metrics which are highly customizable. At the same time you can create your own metrics. Moreover, it provides valuable information about the jobs being run. **What do you dislike about Pepperdata Capacity Optimizer?** Cant think of any downsides at the moment **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** It really helps with identifying jobs that are wasting memory and helps us reduce the cluster size without affecting the jobs, hence reducing overall cost **Official Response from Andy Gremett:** > Thank you for taking the time to share your review. ### 10. Pepper data actually provides a good graphical view of your infra capacity **Rating:** 4.5/5.0 stars **Reviewed by:** Ajith S. | Lead Site Reliability Enginner, Enterprise (> 1000 emp.) **Reviewed Date:** February 13, 2024 **What do you like best about Pepperdata Capacity Optimizer?** It's used in our company and best recommended **What do you dislike about Pepperdata Capacity Optimizer?** For now - No disadvantage has been identified **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** It can re- scale the pods based on capacity ### 11. Helps understand the performance of ETL Jobs on EMR and EKS clusters **Rating:** 4.0/5.0 stars **Reviewed by:** Verified User in Computer Software | Small-Business (50 or fewer emp.) **Reviewed Date:** March 10, 2023 **What do you like best about Pepperdata Capacity Optimizer?** Helps understand the performance of emr cluster and ETL jobs and optimize performance **What do you dislike about Pepperdata Capacity Optimizer?** Some UX could be better in some areas like switching across clusters **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Helps in tuning performance of ETL Jobs. We are able to identify the bottlenecks and tune spark parameters accordingly, leading to faster processing and lower costs ### 12. Great experience with it for Platform and Job Monitoring **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Financial Services | Enterprise (> 1000 emp.) **Reviewed Date:** February 13, 2023 **What do you like best about Pepperdata Capacity Optimizer?** Pepper data has been a leader in cloud performance for our enterprise. We specifically enable our tenants to use it for job time performance monitoring and to enable them to get accurate metrics on how well their jobs are performing and some metadata around those jobs. It functionally works very well and has a slick dashboard for drill down. **What do you dislike about Pepperdata Capacity Optimizer?** One of the major downsides we've had with the product has been around accuracy at higher intervals of time. For example, the metrics over a given week are pretty quick to load but if we should expand to a month or 6 months, the time to load is extremely long. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Pepperdata is helping to enable us chart application performance and get actionable metrics on user jobs and queries. We can see where the lags and hold ups are as well as get actionable cluster metadata. ### 13. It’s a best CPU and Memory Optimizer I have used **Rating:** 5.0/5.0 stars **Reviewed by:** Pooja B. | QA Engineer, Mid-Market (51-1000 emp.) **Reviewed Date:** February 13, 2024 **What do you like best about Pepperdata Capacity Optimizer?** It's best optimizes the CPu Memory Storage and our HDFs usage **What do you dislike about Pepperdata Capacity Optimizer?** The dashboard view of pepperdata and our HDFs usage **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Infrastructure Capacity ### 14. Almost 10 years of experience making the most out of capacity optimizer! **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Health, Wellness and Fitness | Enterprise (> 1000 emp.) **Reviewed Date:** July 26, 2023 **What do you like best about Pepperdata Capacity Optimizer?** Capacity optimist has been one of my companies best investments. Product pays for itself and maximizes hardware capacity. **What do you dislike about Pepperdata Capacity Optimizer?** Nothing. Best product for Hadoop and is already in great need of for K8. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** It automatically optimized code and resource requests. Instead of being stuck with a reservation system in Yarn and other schedulers, it automatically gives bad the extra resources that would otherwise not be available for other jobs decreasing performance greatly and ruining the ability to run so many jobs in parallel. ### 15. Gives more inside overlook **Rating:** 5.0/5.0 stars **Reviewed by:** Naga Ashok Reddy B. | Enterprise (> 1000 emp.) **Reviewed Date:** February 13, 2023 **What do you like best about Pepperdata Capacity Optimizer?** I like how it pulls data and logs from clusters and present it in dashboards. **What do you dislike about Pepperdata Capacity Optimizer?** There isn't much i think of that is disliking about pepperdata **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** I can easily look at the application performance and see the configs. ### 16. Capacity Optimizer helps Pepperdata Pay for Itself **Rating:** 4.5/5.0 stars **Reviewed by:** Verified User in Marketing and Advertising | Mid-Market (51-1000 emp.) **Reviewed Date:** July 26, 2023 **What do you like best about Pepperdata Capacity Optimizer?** Upsides are that if its working correctly it can justify the cost of running Pepperdata. Pepperdata provides Capacity Optimizer data and reporting so you can keep tabs on its effectivness. **What do you dislike about Pepperdata Capacity Optimizer?** Not sure I have any specific dislikes as it tends to just run itself and needs little to no care and feeding from our side. Will be interested to see how or if we get similar results in saving with our spark workloads on kubernetes. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Its allowing us to best utlize the compute we have available for our workloads. ### 17. Nice data analysis of our platform **Rating:** 5.0/5.0 stars **Reviewed by:** Bin Y. | Small-Business (50 or fewer emp.) **Reviewed Date:** February 23, 2023 **What do you like best about Pepperdata Capacity Optimizer?** The data show-up is pretty realtime. And helped us a lot in analyzing our current platform performance. It has several analysis categories for infrastructure and application metrics. **What do you dislike about Pepperdata Capacity Optimizer?** So far, I don't see anything which I dislike. It works well at this moment. And we expect new features and new releases coming out soon to service customers better. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** It showed up our platform performance data very logically. and help us find out the bottle neck of our current configuration, guides us how to do the performance tuning. ### 18. Pepperdata & Big Data Positives **Rating:** 4.0/5.0 stars **Reviewed by:** Dalton W. | Associate Software Engineer, Mid-Market (51-1000 emp.) **Reviewed Date:** August 23, 2022 **What do you like best about Pepperdata Capacity Optimizer?** Pepperdata has been essential for my team. We use Apache data aggregation tools at scale; Pepperdata helps us to monitor memory and CPU usage with easy-to-read visualizations, warnings, and metrics. **What do you dislike about Pepperdata Capacity Optimizer?** Pepperdata can be difficult to setup on new nodes attached to our cloud infrastructure. When my team wanted to add a new server to perform computations, we would have had to go through quite a process to get Pepperdata-backed Jarfiles installed which would allow services to communicate and send info to the monitor. We ultimately chose to use in-house monitoring tools for the new installation. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Pepperdata keeps performance and usage of on-prem resources in check by throwing warnings for apps which exceed configurable resource limits, and can track usage stats per-application. **Official Response from Ashish Sahu:** > Thank you for your review. We recently spent a lot of time working on improving our cloud installation procedures to simplify the process. We offer bootstrap scripts for all of our supported cloud technologies: Most cluster administrators choose this option and can add Pepperdata to an existing bootstrap script in five minutes or less. ### 19. It was very useful **Rating:** 4.5/5.0 stars **Reviewed by:** Verified User in Banking | Enterprise (> 1000 emp.) **Reviewed Date:** August 22, 2022 **What do you like best about Pepperdata Capacity Optimizer?** Stats are the best in pepper data and they are useful **What do you dislike about Pepperdata Capacity Optimizer?** was bit slow sometimes. So will need to retry couple of times **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Get the stats quickly without much techinical knowledge **Official Response from Ashish Sahu:** > Thank you for the review. We are pleased to hear that the metrics from Pepperdata proved to be very useful! We’re sorry to hear about the occasional slow performance you experienced — that’s not common for our product dashboards. Should you encounter slow speeds again, please let our Technical Support team know so we can permanently resolve that issue. ### 20. Solid Solution for Cluster monitoring **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Insurance | Enterprise (> 1000 emp.) **Reviewed Date:** August 25, 2022 **What do you like best about Pepperdata Capacity Optimizer?** I love the easy-to-use interface to see various cluster metrics like Top CPU-Cost Apps and Top Memory-Cost Apps as you can use these to make informed decisions for the cluster and applications. **What do you dislike about Pepperdata Capacity Optimizer?** Looking up specific metrics takes a little digging around. It would be nice if some of the most relevant fields floated to the top for easy selection. Right now you have to choose a category and then dig further into subcategories for what you're looking for. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Pepperdata helps us make informed decisions on application/query performance and this helps us to get to the destination state much faster. The great dashboard visuals make it very easy to understand the data and metrics. **Official Response from Ashish Sahu:** > Thank you for the review. It’s great to hear that you are utilizing our Top Apps sections for actionable insights! We understand that browsing through our metrics can be cumbersome when trying to identify a specific field. With that said, Pepperdata’s UI lets you prioritize your key metrics by allowing customized dashboards to fit your exact use case. ### 21. Pepperdata helps us in optimizing our day to day tasks. **Rating:** 5.0/5.0 stars **Reviewed by:** Chiranjeevi E. | Consultant, Enterprise (> 1000 emp.) **Reviewed Date:** August 26, 2022 **What do you like best about Pepperdata Capacity Optimizer?** Its easy to go through the UI and get the stats of the tasks and see the errors and optimize them accordingly. **What do you dislike about Pepperdata Capacity Optimizer?** Nothing to my knowledge. It helps us decoding the root cause while monitoring the application tasks very well. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** It helps us with debugging our daily hadoop tasks running on HDP. **Official Response from Ashish Sahu:** > Thank you for the review. We are pleased to hear that the UI is easy for you to use and that Pepperdata has been useful for your root cause analysis. ### 22. best for spark application monitor **Rating:** 5.0/5.0 stars **Reviewed by:** Trupal P. | Sr. Software Engineer , Cloud Infrastructure, Mid-Market (51-1000 emp.) **Reviewed Date:** April 25, 2022 **What do you like best about Pepperdata Capacity Optimizer?** easy to navigate for all metrics related to spark job, capture all yarn-related metrics. we can search by application id easily. multiple realm is also useful for EMR spark **What do you dislike about Pepperdata Capacity Optimizer?** while setting up pepper data autoscaling first time without pepper data support was made EMR autoscaling aggressive because we have to found working autoscaling config for our clusters **Recommendations to others considering Pepperdata Capacity Optimizer:** none **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Pepperdata provides optimization suggestion on spark application, and also provide bottlenecks why jobs have not performed well. easy to find yarn level error on application ### 23. Pepperdata lets us see inside our ephemeral clusters even after they've been deleted. **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Retail | Enterprise (> 1000 emp.) **Reviewed Date:** August 25, 2022 **What do you like best about Pepperdata Capacity Optimizer?** Being able to see the memory, cpu, io and other cluster metrics help us to appropriately size the clusters and tune our jobs. **What do you dislike about Pepperdata Capacity Optimizer?** The UI has a learning curve when dealing with large-scale ephemeral clusters, but after a while the filtering and drill-down become familiar. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Cluster sizing, application tuning **Official Response from Ashish Sahu:** > Thank you for the review. We love that you're able to tune your ephemeral cluster workloads using Pepperdata. We understand that the UI can take some getting used to, but we're happy to hear that it has now become familiar. To add, we include user training for all our new enterprise customers if you’d like to learn more about the product’s capabilities. ### 24. Great enterprise solution **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Financial Services | Enterprise (> 1000 emp.) **Reviewed Date:** May 01, 2022 **What do you like best about Pepperdata Capacity Optimizer?** Great enterprise solution for optimizing big data workloads. **What do you dislike about Pepperdata Capacity Optimizer?** I have not had negative experiences with Pepperdata. It's a great solution to meeting my needs. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Pepperdata supports a number of important infrastructure monitoring tasks and is very beneficial with respect to productivity. ### 25. Pepperdata - Complete Spark Cluster performance monitoring **Rating:** 4.5/5.0 stars **Reviewed by:** Uddipan M. | Engineering Manager, Enterprise (> 1000 emp.) **Reviewed Date:** February 19, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Pepperdata provides insightful details and helpful metrics to monitor cluster performance. The user-friendly interface helps to navigate several details like CPU, Memory, Storage usage, I/O etc. Pepperdata also helps to optimize the cluster settings to ensure enhanced resource management. App spotlight feature helps to figure out slow jobs or any data skew scenarios **What do you dislike about Pepperdata Capacity Optimizer?** Pepperdata can integrate automated alerting in case of any cluster parameter shows alarming behavior. It can also provide features like AI-based detection of resource containment and alert accordingly. It will be good if Pepperdata can integrate workflow managers like Oozie in the monitored services and map Oozie coordinator/Job Ids to spark Application ids. This will help in easy mapping between interfaces and will result in quicker root cause analysis of issues. **Recommendations to others considering Pepperdata Capacity Optimizer:** Pepperdata is a helpful spark cluster monitoring tool, which provides all relevant metrics of a cluster in a centralized portal. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** 1) Automated Spark cluster optimization 2) Root cause analysis of any issues with Spark jobs 3) Detecting data skew scenarios **Official Response from Andy Gremett:** > Hi Uddipan! Thank you for your feedback. Regarding alerting, we have alarms and alerts like what you describe, and here’s the help documentation: https://help.pepperdata.com/nav-pd-if/08-alarms-alerts/ Regarding workflows, we have a way of assigning workflow IDs that you might find helpful. There’s a way to assign IDs that show as workflows in the Pepperdata interface. https://help.pepperdata.com/v6-4/admin-guide/reports/05-assigning-workflow-ids/ I have shared your feedback with our product team for review. ### 26. Pepperdata Helps Identify Cost Savings **Rating:** 4.0/5.0 stars **Reviewed by:** Pepper D. | Associate Director - Data Scientist, Enterprise (> 1000 emp.) **Reviewed Date:** February 16, 2021 **What do you like best about Pepperdata Capacity Optimizer?** I like that Pepperdata allows me to identify various jobs in my ETL architecture to isolate each job and provide a breakdown of: computational time used, memory required, wasted resources, estimated costs. **What do you dislike about Pepperdata Capacity Optimizer?** While Pepperdata provides a wealth of information which can be used to troubleshoot and improve the efficiency of ETL architectures; I have found that it is difficult to build and create a dashboard specific to my own needs. For example, the default dashboards made available to the Enterprise work well at an Enterprise level from the perspective of the person paying the bill, but there seems to be little to no instruction on how I can create a suite of dashboards to focus on my specific subset of the Enterprise jobs running. **Recommendations to others considering Pepperdata Capacity Optimizer:** Use Pepperdata if you are paying the costs of compute. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** The problem that I have found most relevant to solve with Pepperdata is specifically in identifying bottlenecks and inefficiencies in the ETL architecture I have set up. Given that our ETL's as part of the Enterprise are written by a team of people, such monitoring allows me to not only identify jobs and ETL's which are inefficient and could be tightened, but also acts as a means of identifying members on the team who could use upskilling as a result of consistently running inefficient and poorly optimized jobs. Considering a portion of the Enterprise setup also takes into account forecasting of load demand to plan for capacity; we can also use Pepperdata to track and plan the amount of resources that will be needed by the cluster down the road. **Official Response from Andy Gremett:** > Hi, Thank you for your feedback. We do offer custom dashboards and if you are looking for something different, we’d be curious to understand your request/requirements. https://help.pepperdata.com/plat-spot/04-working-with-custom-dashboards/ We’d like to talk to you more about what you’d like to see. Please contact Info@pepperdata.com and let us know how to reach you. ### 27. Pepperdata - Perfect tool to monitor the production servers **Rating:** 4.5/5.0 stars **Reviewed by:** Surendar M. | Mr, Enterprise (> 1000 emp.) **Reviewed Date:** February 16, 2021 **What do you like best about Pepperdata Capacity Optimizer?** The visualization on the data collected from the server logs. With verities of options to create your own customized dashboards. Also can create customized alerts in case of any threshold breaches. **What do you dislike about Pepperdata Capacity Optimizer?** Multiple metrics are available and it is bit difficult to identify the suitable metric. Also the log filters are not so efficient when it comes to analyzing huge logs with number of metrices involved. Initial configuration of the pepper data is challenging due to technical difficulties, but once the configurations are completed the handling of the tool is much simple. **Recommendations to others considering Pepperdata Capacity Optimizer:** The visualization on the data collected from the server logs. With verities of options to create your own customized dashboards. Also can create customized alerts in case of any threshold breaches. It helped us a lot on resolving performance issues and analyze the server performance. Also to visualize the reports which can be presented to stakeholders. Create custom charts with available metrics to understand the data (or) performance trends for longer period of time. Multiple metrics are available and it is bit difficult to identify the suitable metric. Also the log filters are not so efficient when it comes to analyzing huge logs with number of metrices involved. Initial configuration of the pepper data is challenging due to technical difficulties, but once the configurations are completed the handling of the tool is much simple. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** It helped us a lot on resolving performance issues and analyze the server performance. Also to visualize the reports which can be presented to stakeholders. Create custom charts with available metrics to understand the data (or) performance trends for longer period of time. **Official Response from Andy Gremett:** > Hi Surendar, We are glad to hear from you. Regarding metrics, we do offer many metrics, which can be challenging but gives you lots of flexibility and choices. Would it help to add a better description of these metrics? We would like to better understand what “log filters” you are referring to. Please contact us at Info@pepperdata.com and let us know the best way to reach you if you are willing to discuss further. We are at work on simplifying the initial installation of Pepperdata, particularly for cloud installations like EMR clusters. I have shared your feedback with our product team for review. ### 28. Big data insights using PD **Rating:** 5.0/5.0 stars **Reviewed by:** Pervej A. | Senior cloud administrator, Enterprise (> 1000 emp.) **Reviewed Date:** October 21, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Amount of metrics provided by PD along with recommendations to tune the job **What do you dislike about Pepperdata Capacity Optimizer?** The recommendations tab should also include ways to implement the suggestions ex. spark submit command **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Performance optimization of EMR clusters to reduce the uptime ### 29. Very good for hadoop cluster analysis **Rating:** 4.5/5.0 stars **Reviewed by:** Minhaj B. | Senior Technical Systems Analyst, Enterprise (> 1000 emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Pepper Data provides quite detailed analysis about your cluster health. It provides visualization of CPU Resources, memory utilization, Storage, RAM and other important details. For each visualization you can see more details for a specific range of time and for a specific user. You can switch between chart and table display modes. In addition to this it provides detailed information about Queues and Application Status. Apart from the cluster overall details, you can see the Resource Usage of a Spark App as well by using the yarn application id, which is very useful for improving performance and scaling the processes. **What do you dislike about Pepperdata Capacity Optimizer?** I wish that they provided more info, when hovered on column names, in tabular format/mode, so that it is more easily readable and understandable. **Recommendations to others considering Pepperdata Capacity Optimizer:** Very good tool if you are into Hadoop or Spark and are going to use it extensively for Performance monitoring. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** We are using it to monitor our hadoop clusters in all our environments that is Dev, UAT and Prod. We use it to view and analyze our Spark Application by using the yarn application id. which is very useful for improving performance and scaling the processes. **Official Response from Andy Gremett:** > Minhaj, Thank you for your question. Can you clarify which tables you’re referring to you which don’t have descriptive enough titles? We looked at several of our top tables and didn’t see this. Please contact us at Info@pepperdata.com and let us know the best way to reach you. ### 30. Peperdata is pretty handy to profile spark/hadoop job in terms of CPU, memory ussage and disk. **Rating:** 4.0/5.0 stars **Reviewed by:** Verified User in Financial Services | Enterprise (> 1000 emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** it has YARN resource visualization, which is pretty intuitive. The UI looks good. Also it has some suggestion on resource usage. **What do you dislike about Pepperdata Capacity Optimizer?** 1. Sometimes it has some delay on data collection and I have to wait until the job is done. 2. Too expensive to purchase the service 3. Need some effort to adapt the vendor solution to existed system. 4. It lacks of data security options **Recommendations to others considering Pepperdata Capacity Optimizer:** 1. it can provide customized sdk , api or metrics I can use in my spark application, So I can gain more in sighted from application point of view. 2. It can support code level profiling, which can be used in different use cases. 3. it can support alarming config so I can get notification if the resource is out of quote. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** I use it to debug out of memory issue of Spark job and done some troubleshooting. Overall it's great. It saves a lot of YARN resource and speed up my proformance tuning. It provides my visualization to explain the actual question to management team to gain better understanding of how much spent in computation resource. **Official Response from Andy Gremett:** > Hi, We’re sorry to hear you had problems adapting issues into Pepperdata. What specific issues did you encounter? We see that you are a user in financial services, so we understand the need for security options. What data security options would you like to see? Regarding your positive comment about debugging Spark applications, we’re glad the details help you debug your apps. We’d love to hear any feedback you might have on how we can continue to improve our Spark recommendations. Please contact us at Info@pepperdata.com if you are willing to discuss further. Your input is much appreciated! ### 31. Pepperdata - great for cluster optimization, decent for app level monitoring **Rating:** 3.0/5.0 stars **Reviewed by:** Roshan A. | Engineering Manager, Enterprise (> 1000 emp.) **Reviewed Date:** March 03, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Pepperdata's Capacity optimizer is very effective in packing containers onto nodes, thereby reducing the cost of the underlying compute. **What do you dislike about Pepperdata Capacity Optimizer?** It's not easy to calculate the value that you gain form having Pepperdata, which makes it tough to justify the cost of Pepperdata to upper management **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Our main problem was troubleshooting and tuning Spark jobs which we previously had very little visibility on. With Pepperdata, we certainly do get a much better picture of the cluster, nodes and individual jobs. Pepperdata alarms have helped us get alerted to issues related to capacity allocations for jobs or clusters **Official Response from Andy Gremett:** > Hi Roshan! Thank you for your comment about Capacity Optimizer. Are you referring to the value Capacity Optimizer provides? What would be your ideal report for demonstrating this to your management team? We are working on adding a report about the value of Capacity Optimizer to our dashboard, please stay tuned. Please contact us at Info@pepperdata.com for more information. ### 32. PD exp with AWS EMR **Rating:** 4.0/5.0 stars **Reviewed by:** Verified User in Information Technology and Services | Enterprise (> 1000 emp.) **Reviewed Date:** October 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Dynamic capacity optimizer. Ability to intercept aws scaling requests **What do you dislike about Pepperdata Capacity Optimizer?** Complicated installation process wherein static components are involved **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** cost optimization ### 33. awesome monitoring tool **Rating:** 4.5/5.0 stars **Reviewed by:** Shyam G. | H, Small-Business (50 or fewer emp.) **Reviewed Date:** May 13, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Spark logs on the screen, small files alerts and recoomendations about the job. **What do you dislike about Pepperdata Capacity Optimizer?** Nothing dislike, we liked all the features in pepper data. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Spark application problems mostly. ### 34. Very helpful application to monitor the cost and usage of Hadoop resources **Rating:** 5.0/5.0 stars **Reviewed by:** Dhanya J. | Senior Data Scientist, Enterprise (> 1000 emp.) **Reviewed Date:** March 02, 2021 **What do you like best about Pepperdata Capacity Optimizer?** usage report cost summary user interface **What do you dislike about Pepperdata Capacity Optimizer?** once the cost was inflated but it was an error that was fixed later **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** monitor my usage regularly **Official Response from Andy Gremett:** > Hi Dhanya! We are sorry you had the experience with the incorrect cost but hope it’s working out for you now. I have shared your feedback with our product team for review. Please contact us if you need further help. ### 35. PROMPT SERVICE & CUSTOMER FOCUS **Rating:** 4.0/5.0 stars **Reviewed by:** Tom T. | Engineer, Small-Business (50 or fewer emp.) **Reviewed Date:** March 02, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Ease of root cause identification of cluster issue, responsive & knowledgeable support, ability to tune spark workloads. **What do you dislike about Pepperdata Capacity Optimizer?** Missing MapR specific metrics & feedback being vague. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Super easy and self managed ability to monitor production load in spark jobs effectively. Another advantage is the ability to regulate job scheduling parameters to optimize resources **Official Response from Andy Gremett:** > Hi Tom! Thank you for taking the time to share your review. ### 36. Good Monitoring tool for Biga Data **Rating:** 4.5/5.0 stars **Reviewed by:** Naresh B. | D, Enterprise (> 1000 emp.) **Reviewed Date:** March 02, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Capacity optimizer is the best service we have used in Pepper Data. **What do you dislike about Pepperdata Capacity Optimizer?** Integration with monitoring tools like Service Now, Slack etc is not yet fully implemented. **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Cost and optimization **Official Response from Andy Gremett:** > Naresh, this is really interesting, we have implemented a basic Slack integration (under the gear icon of your dashboard). Please contact us at Info@pepperdata.com so we can better understand your use cases for ServiceNow and Slack integration. We’d love to help you make this happen. ### 37. Very solid application **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Banking | Enterprise (> 1000 emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Nearly real time dashboard information for end client to see the performance data **What do you dislike about Pepperdata Capacity Optimizer?** Trouble-shooting the issue looks like more time consuming **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Security key configuration issue. The software setting is very important. **Official Response from Andy Gremett:** > Hi, We are sorry you ran into issues. Please contact us at Info@pepperdata.com so we can better understand why it’s taking more time. ### 38. Its good but could be great **Rating:** 3.0/5.0 stars **Reviewed by:** Verified User in Staffing and Recruiting | Small-Business (50 or fewer emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** really liked Metrics data and analytics **What do you dislike about Pepperdata Capacity Optimizer?** the only challenge is the user interface is less friendly **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** Memory and data usage **Official Response from Andy Gremett:** > Hi, We would like to understand the parts that aren’t user-friendly for you so we can improve on them. Please contact us at Info@pepperdata.com and let us know how we can reach you if you are willing to discuss further. I have also passed this information on to our product team. ### 39. Excellent service **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Information Technology and Services | Enterprise (> 1000 emp.) **Reviewed Date:** February 18, 2021 **What do you like best about Pepperdata Capacity Optimizer?** Quick response times. Excellent customer service. **What do you dislike about Pepperdata Capacity Optimizer?** Too many emails. I do not like receiving too many emails **What problems is Pepperdata Capacity Optimizer solving and how is that benefiting you?** All the problems **Official Response from Andy Gremett:** > Hi, Which emails are you referring to? Are these alarms emails? Or marketing emails? Please contact us at Info@pepperdata.com and let us know how we can contact you so we can help you with this challenge. ## Pepperdata Capacity Optimizer Discussions - [What is Pepperdata Cloud Performance used for?](https://www.g2.com/discussions/what-is-pepperdata-cloud-performance-used-for) - [View Pepperdata Capacity Optimizer pricing details and edition comparison](https://www.g2.com/products/pepperdata-capacity-optimizer/reviews?section=pricing&secure%5Bexpires_at%5D=2026-05-15+04%3A41%3A02+-0500&secure%5Bsession_id%5D=443d5886-d1a0-43ec-a3bb-2080f6c3ecfc&secure%5Btoken%5D=34625541174d36fc60994b03ceeb37c6419964b8c2dacbbc80cd6eacf8f00b7f&format=llm_user) ## Pepperdata Capacity Optimizer Features **Operations** - Automation - Multi-Cloud Management - Usage Monitoring **Functionality** - Cloud Consolidation - Cloud Orchestration - Cloud Optimization **Assessment ** - IT Infrastructure - Cost Benefit - Applications **Automated resource scaling** - Automatic resource discovery - Smart scaling **Agentic AI - AWS Marketplace** - Autonomous Task Execution - Multi-step Planning - Cross-system Integration **Cost Optimization** - Spend Forecasting and Optimization - Recommendations - Spend Tracking **Management** - Cloud Cost Analytics - Cloud Security - Cloud Resource Management - Cloud Backup and Recovery **Scaling strategies** - Pre-defined optimization strategies - Predictive scaling **Administration** - Reporting - Dashboards and Visualizations - Compliance **Visualization** - Unified scaling - Dashboard **Agentic AI - Cloud Management Platforms** - Autonomous Task Execution - Cross-system Integration - Decision Making **Agentic AI - Cloud Cost Management** - Autonomous Task Execution - Proactive Assistance - Decision Making ## Top Pepperdata Capacity Optimizer Alternatives - [Datadog](https://www.g2.com/products/datadog/reviews) - 4.4/5.0 (689 reviews) - [Amazon CloudWatch](https://www.g2.com/products/amazon-cloudwatch/reviews) - 4.3/5.0 (360 reviews) - [Google Compute Engine](https://www.g2.com/products/google-compute-engine/reviews) - 4.5/5.0 (875 reviews)