# ABsmartly Reviews **Vendor:** AB Smartly **Category:** [A/B Testing Tools](https://www.g2.com/categories/a-b-testing-tools) **Average Rating:** 4.6/5.0 **Total Reviews:** 14 ## About ABsmartly Unlimited seats, metrics and experiments so you A/B test confidently and scale experimentation. ABsmartly is a leading experimentation platform designed for trustworthy A/B testing on web,email, app environments and more, both server-side, edge and client-side. The platform caters to various testing scenarios, including feature flags, split testing, multi-variant, multi-page, multi-platform, SEO tests, cross-device testing, among others to accelerate product growth. The ABsmartly platform is designed for product teams and experimentation teams outgrowing more mainstream tools and want the features, seats and real-time insights to scale experimentation and build better products. They might be considering building their own tool but don’t want the hassle, cost and maintenance of an in-house tool. Only GST engine on the market: Our Group Sequential Testing engine runs A/B tests 80% faster than any other A/B testing tool on the market. We also offer Fixed Horizon testing for those situations. Unlimited Everything: Run infinite experiments, add users, set goals, and more without limitations. Flexible, events-based pricing. Scale Experimentation: share, collaborate and democratise experimentation across the organisation Seamless Full-Stack Integration: API-first gets you up and running in 2 hours. Our lightweight SDKs simplify the integration process. Maintenance-Free Solution: A tool as powerful and flexible as in-house, we handle the upkeep so you can focus on your core business. Real-time Reports: Revolutionise product development with access to insistent insights and with live, up-to-the-minute reporting. Interaction Detection: Comprehensive detection across all tests, offering full factorial insights, surpassing typical multivariate methods. Powerful Data Analysis: Harness robust analytical tools to make trustworthy, strategic decisions. Data Deep Dives: Segment without restrictions. Dive deep into your data for granular insights. Private Cloud Hosting: Ensure top-notch security and performance with on-prem, dedicated cloud infrastructure. ## ABsmartly Pros & Cons **What users like:** - Users value the **growing collaboration space** in ABsmartly, enhancing teamwork and efficiency in experimentation. (1 reviews) - Users value the **comprehensive solutions** of ABsmartly, facilitating easy integration and insightful data without performance issues. (1 reviews) - Users highlight the **great customer service** of ABsmartly, enhancing their overall experience and support. (1 reviews) - Users appreciate the **development ease** of ABsmartly, finding it quick and simple to implement and integrate. (1 reviews) - Users appreciate the **ease of use** of ABsmartly, benefiting from its quick implementation and reliable performance. (1 reviews) - Easy Setup (1 reviews) - Experimentation (1 reviews) - Features (1 reviews) - Filtering Features (1 reviews) - Implementation Ease (1 reviews) **What users dislike:** - Users express concerns over **inaccurate reporting** , highlighting a need for more advanced features in ABsmartly. (1 reviews) - Users note the **inadequate reporting** features of ABsmartly, but improvements are anticipated in the future. (1 reviews) - Users have noted **integration issues** with Slack and Email, impacting seamless collaboration within ABsmartly. (1 reviews) - Users are concerned about the **poor management** of ABsmartly, especially with reporting and integration features. (1 reviews) - Users express concern over **poor reporting** , though they eagerly await upcoming improvements to the program. (1 reviews) ## ABsmartly Reviews ### 1. Great tool driving your experimentation culture! **Rating:** 5.0/5.0 stars **Reviewed by:** Karol W. | Product Operations Manager, Mid-Market (51-1000 emp.) **Reviewed Date:** October 29, 2024 **What do you like best about ABsmartly?** - Translating advanced statistics into easy to read results - Very reliable engine, without any impact on your product performance - Quick and Easy platform - Growing collaboration space - Quickly developing new features - Great Customer Service - We were able to grow experimentation without high Data Analysts involvement - Easy to implement and integrate with your products - We have tenths of people logging into the platform every day **What do you dislike about ABsmartly?** - Lack of advanced program reporting (however that's coming soon - super excited!) - Collaboration and integration with Slack/Email could be improved **What problems is ABsmartly solving and how is that benefiting you?** It's has fully automated our AB Testing and Experimentation practice. ### 2. Great scalable source-code oriented tool for A/B Testing **Rating:** 4.0/5.0 stars **Reviewed by:** David R. | Software Engineer, Mid-Market (51-1000 emp.) **Reviewed Date:** August 31, 2022 **What do you like best about ABsmartly?** It scales for many experiments and goals/metrics, in isolated environments. The SDK is easy to work with (frontend and backend), and the Full-on mode saves time for winning experiments. **What do you dislike about ABsmartly?** Missing tools to export data. But the A/B Smartly guys are always present to assist us with the business requirements. **What problems is ABsmartly solving and how is that benefiting you?** We are running A/B tests to improve conversion channels and increase monetization. Data collected by the platform helps us to make better decisions. The easiness to implement experiments from the backend and frontend allows us to reduce development time. ### 3. Excellent tool for getting valuable insights **Rating:** 5.0/5.0 stars **Reviewed by:** Vince V. | UX Designer, Mid-Market (51-1000 emp.) **Reviewed Date:** August 17, 2022 **What do you like best about ABsmartly?** A/B Smartly is easy to configure; It has a great dashboard that offers valuable insights at a glance. **What do you dislike about ABsmartly?** Not a dislike, but it would be nice if the platform offered even more articles/training. **What problems is ABsmartly solving and how is that benefiting you?** It helps me quickly set A/B experiments and get timely feedback on our hypothesis. ### 4. Comprehensive experimentation **Rating:** 4.5/5.0 stars **Reviewed by:** Peter C. | Sr. Director of Engineering, Mid-Market (51-1000 emp.) **Reviewed Date:** January 11, 2022 **What do you like best about ABsmartly?** There's a lot to like about AB smartly; if I had to name it, it is optimized for high throughput: many experiments, many goals, multi-variant. The product covers everything I need to do currently without needing to solve anything myself or find ways of getting around it. It doesn't take a lot to get going and the team is extremely helpful. **What do you dislike about ABsmartly?** Not sure what you're supposed to write here when you like a product and haven't had issues with it. We experienced a minor bug around restarts that got fixed in under 24 hours, and the bug itself had a low impact. **What problems is ABsmartly solving and how is that benefiting you?** Optimizing our website's customer experience resulting in greater conversions and margin. We have realized that whatever we thought we knew about customers and customer behavior wasn't always the case. Experiments that we thought would be a sure win haven't gone that way, whereas 50/50 bets have become significant winners. Essentially using an objective experimentation framework is the only way I could recommend putting time and resources into optimizing a website's customer experience. "Common sense" is no competitor to objective data comparing customer behavior when presented with features. Similarly, we have also learned to test everything. New hardware? Experiment. A big refactor? Experiment. New affiliate pixel partner? Experiment. Any change to the website is valuable to experiment upon as there is no way of knowing slow burn negative effects outside of experimentation. ### 5. A great platform for A/B testing our product features **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Automotive | Enterprise (> 1000 emp.) **Reviewed Date:** August 16, 2022 **What do you like best about ABsmartly?** The interface is awesome. We can see our results in real-time. They provide a great way to test in lower environments. **What do you dislike about ABsmartly?** I don't think there is anything to dislike. **What problems is ABsmartly solving and how is that benefiting you?** A/B smartly is helping us to test our product features with our customers before fully launching them. We can understand how our customers treat a particular feature ### 6. Great Enterprise AB Testing Platform **Rating:** 4.5/5.0 stars **Reviewed by:** Verified User in Automotive | Enterprise (> 1000 emp.) **Reviewed Date:** August 16, 2022 **What do you like best about ABsmartly?** You own your data with A/B Smartly and it gives the flexibility to integrate tests at any layer of the stack we choose. **What do you dislike about ABsmartly?** The platform is still maturing but I would take that trade-off as their immediate support makes up for any issues. **What problems is ABsmartly solving and how is that benefiting you?** A/B experimentation at speed and scale ### 7. Easy to use and the folks at ab smartly are very proactive when it comes to answering any questions **Rating:** 4.5/5.0 stars **Reviewed by:** Verified User in Automotive | Mid-Market (51-1000 emp.) **Reviewed Date:** September 06, 2022 **What do you like best about ABsmartly?** The fact that we can track multiple metrics and define primary and secondary metrics we care about the most that's specific to that test **What do you dislike about ABsmartly?** It sometimes is hard to read and distinguish between each field in the metric table. **What problems is ABsmartly solving and how is that benefiting you?** We run a ton of a/b tests and have different metrics we want to track, it's just super convenient to run multiple tests at once and come back for results ### 8. We love ABSmartly ! **Rating:** 5.0/5.0 stars **Reviewed by:** Verified User in Automotive | Enterprise (> 1000 emp.) **Reviewed Date:** December 16, 2021 **What do you like best about ABsmartly?** The team at ABSmartly was super helpful and engaging to help us to onboard and teach us how to use their platform to its full potential. Any issues we raise, they immediately jump in to help us resolve the issue no matter what the issue is, could be on our integration side, configuration, or bug on their side. They even helped us with custom development work to enable us to run some custom AB tests. Speaking to the platform itself, it is very intuitive and easy to use out the box. Once the initial setup is complete, running AB tests is as simple as 1,2,3 and all the metrics we setup initially is all plug and play. Currently, it is satisfying our needs and helping us to iterate and optimize our features quickly. **What do you dislike about ABsmartly?** For a small company, they are doing all they can do ! Nothing to highlight at this point but I'm sure as they pick up more customers, they'll have to build out more support to help other companies in various industries. Keep up the good work ! **What problems is ABsmartly solving and how is that benefiting you?** We were using Google Optimize initially and while it did satisfy our initial goals of starting to AB test, it was lacking some features to better help us assess our AB tests and decide winners to roll out. This is where we started talking to AB Smartly to help us with some of our asks. One great benefit to call out immediately is how all the metrics we setup gets visualized out the box which provides us with more data to make better informed decisions regarding our AB tests. ### 9. A great platform for streamlined AB testing **Rating:** 4.5/5.0 stars **Reviewed by:** Kyle P. | Senior Software Engineer, Mid-Market (51-1000 emp.) **Reviewed Date:** December 16, 2021 **What do you like best about ABsmartly?** A/B Smartly helped clean up our AB testing process in many ways. It reduced the number of tools we used and gave us a simple SDK to consume within our applications. **What do you dislike about ABsmartly?** The UI could use a few improvements. Sometimes updates don't automatically show, and metrics can initially look weird. I have heard they are working on a redesign, so I'm happy to hear they are making improvements. **What problems is ABsmartly solving and how is that benefiting you?** Through A/B Smartly we've been able to run dozens of tests with more rolling out every day. We've been able to improve UI/UX, increase attachment and revenue, and learn more about our customers through experimentation. ### 10. Great Ideas and Team: still needs execution **Rating:** 3.0/5.0 stars **Reviewed by:** Verified User in Accounting | Enterprise (> 1000 emp.) **Reviewed Date:** December 17, 2021 **What do you like best about ABsmartly?** I like getting to work with the team at ABSmartly. They are responsive and helpful in answering both technical and statistical questions. There is also tremendous potential for growth in what ABSmartly can offer, which is not the case with larger A/B Testing Platforms. **What do you dislike about ABsmartly?** The UI is very confusing, especially to new users. Some numbers (like time to convert metrics) are misreported. We also had some trouble integrating ABSmartly fully into our codebase (especially getting which user was in which variant). Other features are still not implemented, so we cannot fully use ABSmartly to meet our experimentation needs. **What problems is ABsmartly solving and how is that benefiting you?** We've been using ABSmartly to run many of our A/B tests. With this, we are able to save time pulling simple aggregates and testing for significance and now can spend our time analyzing deeper patterns from our A/B tests. ## ABsmartly Discussions - [What is A/B Smartly used for?](https://www.g2.com/discussions/what-is-a-b-smartly-used-for) - 1 comment - [View ABsmartly pricing details and edition comparison](https://www.g2.com/products/absmartly/reviews/absmartly-review-5218081?section=pricing&secure%5Bexpires_at%5D=2026-05-31+11%3A49%3A54+-0500&secure%5Bsession_id%5D=0bc1d044-dbdc-4cf6-b4bd-dc9ff0210193&secure%5Btoken%5D=f598d3bbec920949294f5a240ffa46b6af916c7828da416100cb5996b3860e81&format=llm_user) ## ABsmartly Features **Management** - Flag Management - Rollout & Rollback Control - Monitoring **Functionality** - Multi-Environment Control - Feature Testing **Experimental Design** - Concurrent Testing - Mobile Testing **Analytics** - Reporting and Analytics **Agentic AI - A/B Testing** - Autonomous Task Execution - Cross-system Integration - Adaptive Learning - Proactive Assistance **Variation Testing** - A/B Testing - Conversion Goal - Percentage of Traffic - Confidence Level - Multivariant Testing **Reporting** - Segmentation - Reports and Dashboards **Personalization** - Standard Targeting - Custom Targeting - Data Segmentation **Administration** - API / Integrations - QA Testing - Performance and Reliability - User, Role, and Access Management ## Top ABsmartly Alternatives - [AB Tasty](https://www.g2.com/products/ab-tasty/reviews) - 4.4/5.0 (404 reviews) - [VWO Testing](https://www.g2.com/products/wingify-vwo-testing/reviews) - 4.4/5.0 (914 reviews) - [Optimizely Web Experimentation](https://www.g2.com/products/optimizely-web-experimentation/reviews) - 4.2/5.0 (401 reviews)