Best Software for 2025 is now live!
Show rating breakdown
Save to My Lists
Claimed
Claimed

ABsmartly Reviews & Product Details

Kyle P.
KP
Senior Software Engineer
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

A/B Smartly helped clean up our AB testing process in many ways. It reduced the number of tools we used and gave us a simple SDK to consume within our applications. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

The UI could use a few improvements. Sometimes updates don't automatically show, and metrics can initially look weird. I have heard they are working on a redesign, so I'm happy to hear they are making improvements. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

Through A/B Smartly we've been able to run dozens of tests with more rolling out every day. We've been able to improve UI/UX, increase attachment and revenue, and learn more about our customers through experimentation. Review collected by and hosted on G2.com.

ABsmartly Overview

What is ABsmartly?

Unlimited seats, metrics and experiments so you A/B test confidently and scale experimentation. ABsmartly is a leading experimentation platform designed for trustworthy A/B testing on web,email, app environments and more, both server-side, edge and client-side. The platform caters to various testing scenarios, including feature flags, split testing, multi-variant, multi-page, multi-platform, SEO tests, cross-device testing, among others to accelerate product growth. The ABsmartly platform is designed for product teams and experimentation teams outgrowing more mainstream tools and want the features, seats and real-time insights to scale experimentation and build better products. They might be considering building their own tool but don’t want the hassle, cost and maintenance of an in-house tool. Only GST engine on the market: Our Group Sequential Testing engine runs A/B tests 80% faster than any other A/B testing tool on the market. We also offer Fixed Horizon testing for those situations. Unlimited Everything: Run infinite experiments, add users, set goals, and more without limitations. Flexible, events-based pricing. Scale Experimentation: share, collaborate and democratise experimentation across the organisation Seamless Full-Stack Integration: API-first gets you up and running in 2 hours. Our lightweight SDKs simplify the integration process. Maintenance-Free Solution: A tool as powerful and flexible as in-house, we handle the upkeep so you can focus on your core business. Real-time Reports: Revolutionise product development with access to insistent insights and with live, up-to-the-minute reporting. Interaction Detection: Comprehensive detection across all tests, offering full factorial insights, surpassing typical multivariate methods. Powerful Data Analysis: Harness robust analytical tools to make trustworthy, strategic decisions. Data Deep Dives: Segment without restrictions. Dive deep into your data for granular insights. Private Cloud Hosting: Ensure top-notch security and performance with on-prem, dedicated cloud infrastructure.

ABsmartly Details
Product Website
Languages Supported
English
Show LessShow More
Product Description

AB Smartly is a complete, end-to-end experimentation solution that allows teams, across the organization, to test with velocity at scale.


Seller Details
Year Founded
2019
HQ Location
Amsterdam, NL
Twitter
@absmartly
30 Twitter followers
LinkedIn® Page
www.linkedin.com
19 employees on LinkedIn®

Jonas A.
JA
Overview Provided by:
Co-Founder & CEO at ABsmartly - ex Experimentation at Booking.com

Recent ABsmartly Reviews

Karol W.
KW
Karol W.Mid-Market (51-1000 emp.)
5.0 out of 5
"Great tool driving your experimentation culture!"
- Translating advanced statistics into easy to read results - Very reliable engine, without any impact on your product performance - Quick and Ea...
Verified User
U
Verified UserMid-Market (51-1000 emp.)
4.5 out of 5
"Easy to use and the folks at ab smartly are very proactive when it comes to answering any questions"
The fact that we can track multiple metrics and define primary and secondary metrics we care about the most that's specific to that test
David R.
DR
David R.Mid-Market (51-1000 emp.)
4.0 out of 5
"Great scalable source-code oriented tool for A/B Testing"
It scales for many experiments and goals/metrics, in isolated environments. The SDK is easy to work with (frontend and backend), and the Full-on mo...
Security Badge
This seller hasn't added their security information yet. Let them know that you'd like them to add it.
0 people requested security information

ABsmartly Media

ABsmartly Demo - ABsmartly Group Sequential Testing engine time savings
We are the only ones in the market to offer a Group Sequential Testing (GST) engine, allowing experimenters to stop or ship an A/B test early - up to 80% faster - when there is a large effect, while also retaining the ability to detect smaller effects within a reasonable timeframe.
ABsmartly Demo - ABsmartly experimentation health checks
The health checks section allows you to see the status of the various checks that ABsmartly runs on your experiments to generate the alerts mentioned above. When an experiment has reached a point where a decision can be made, a recommended action will pop up, telling you what the best action t...
ABsmartly Demo - ABsmartly Feature Flag creation
Feature flags allow you to easily turn features on and off within the ABsmartly platform, without having to go through the entire experiment creation process. This is useful for testing new or error-prone features.
ABsmartly Demo - ABsmartly experiment template
Templates are indispensable for frequent experiments, streamlining setup and reducing errors, especially with complex audiences. They save time by pre-filling fields with predefined parameters, ensuring standardisation across teams and experiments. This boosts consistency, crucial for hig...
ABsmartly Demo - ABsmartly Interaction Detection
ABsmartly's unique interaction detection feature for A/B testing identifies interactions between variables that could impact experiment outcomes. By automatically detecting these interactions, it ensures more accurate results, allowing teams to uncover hidden dependencies between elements and opt...
ABsmartly Demo - ABsmartly experiment list
Dashboard of active experiments in ABsmartly's platform. Each experiment displays key details like name, status (running or stopped), analysis type, impact, confidence level, progress towards sample size, and participant count. The layout highlights progress tracking, with visual indicators for s...
Answer a few questions to help the ABsmartly community
Have you used ABsmartly before?
Yes

13 out of 14 Total Reviews for ABsmartly

4.6 out of 5
The next elements are filters and will change the displayed results once they are selected.
Search reviews
Popular Mentions
The next elements are radio elements and sort the displayed results by the item selected and will update the results displayed.
Hide FiltersMore Filters
The next elements are filters and will change the displayed results once they are selected.
The next elements are filters and will change the displayed results once they are selected.
13 out of 14 Total Reviews for ABsmartly
4.6 out of 5
13 out of 14 Total Reviews for ABsmartly
4.6 out of 5

ABsmartly Pros and Cons

How are these determined?Information
Pros and Cons are compiled from review feedback and grouped into themes to provide an easy-to-understand summary of user reviews.
Pros
Cons
G2 reviews are authentic and verified.
Karol W.
KW
Product Operations Manager
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

- Translating advanced statistics into easy to read results

- Very reliable engine, without any impact on your product performance

- Quick and Easy platform

- Growing collaboration space

- Quickly developing new features

- Great Customer Service

- We were able to grow experimentation without high Data Analysts involvement

- Easy to implement and integrate with your products

- We have tenths of people logging into the platform every day Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

- Lack of advanced program reporting (however that's coming soon - super excited!)

- Collaboration and integration with Slack/Email could be improved Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

It's has fully automated our AB Testing and Experimentation practice. Review collected by and hosted on G2.com.

David R.
DR
Software Engineer
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

It scales for many experiments and goals/metrics, in isolated environments. The SDK is easy to work with (frontend and backend), and the Full-on mode saves time for winning experiments. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

Missing tools to export data. But the A/B Smartly guys are always present to assist us with the business requirements. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

We are running A/B tests to improve conversion channels and increase monetization. Data collected by the platform helps us to make better decisions. The easiness to implement experiments from the backend and frontend allows us to reduce development time. Review collected by and hosted on G2.com.

Vince V.
VV
UX Designer
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

A/B Smartly is easy to configure;

It has a great dashboard that offers valuable insights at a glance. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

Not a dislike, but it would be nice if the platform offered even more articles/training. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

It helps me quickly set A/B experiments and get timely feedback on our hypothesis. Review collected by and hosted on G2.com.

Peter C.
PC
Sr. Director of Engineering
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

There's a lot to like about AB smartly; if I had to name it, it is optimized for high throughput: many experiments, many goals, multi-variant. The product covers everything I need to do currently without needing to solve anything myself or find ways of getting around it. It doesn't take a lot to get going and the team is extremely helpful. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

Not sure what you're supposed to write here when you like a product and haven't had issues with it. We experienced a minor bug around restarts that got fixed in under 24 hours, and the bug itself had a low impact. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

Optimizing our website's customer experience resulting in greater conversions and margin. We have realized that whatever we thought we knew about customers and customer behavior wasn't always the case. Experiments that we thought would be a sure win haven't gone that way, whereas 50/50 bets have become significant winners. Essentially using an objective experimentation framework is the only way I could recommend putting time and resources into optimizing a website's customer experience. "Common sense" is no competitor to objective data comparing customer behavior when presented with features. Similarly, we have also learned to test everything. New hardware? Experiment. A big refactor? Experiment. New affiliate pixel partner? Experiment. Any change to the website is valuable to experiment upon as there is no way of knowing slow burn negative effects outside of experimentation. Review collected by and hosted on G2.com.

Verified User in Automotive
UA
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

The interface is awesome. We can see our results in real-time. They provide a great way to test in lower environments. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

I don't think there is anything to dislike. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

A/B smartly is helping us to test our product features with our customers before fully launching them. We can understand how our customers treat a particular feature Review collected by and hosted on G2.com.

Verified User in Automotive
EA
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

You own your data with A/B Smartly and it gives the flexibility to integrate tests at any layer of the stack we choose. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

The platform is still maturing but I would take that trade-off as their immediate support makes up for any issues. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

A/B experimentation at speed and scale Review collected by and hosted on G2.com.

Verified User in Automotive
UA
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Review source: Organic
What do you like best about ABsmartly?

The fact that we can track multiple metrics and define primary and secondary metrics we care about the most that's specific to that test Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

It sometimes is hard to read and distinguish between each field in the metric table. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

We run a ton of a/b tests and have different metrics we want to track, it's just super convenient to run multiple tests at once and come back for results Review collected by and hosted on G2.com.

Verified User in Automotive
UA
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

The team at ABSmartly was super helpful and engaging to help us to onboard and teach us how to use their platform to its full potential. Any issues we raise, they immediately jump in to help us resolve the issue no matter what the issue is, could be on our integration side, configuration, or bug on their side. They even helped us with custom development work to enable us to run some custom AB tests. Speaking to the platform itself, it is very intuitive and easy to use out the box. Once the initial setup is complete, running AB tests is as simple as 1,2,3 and all the metrics we setup initially is all plug and play. Currently, it is satisfying our needs and helping us to iterate and optimize our features quickly. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

For a small company, they are doing all they can do ! Nothing to highlight at this point but I'm sure as they pick up more customers, they'll have to build out more support to help other companies in various industries. Keep up the good work ! Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

We were using Google Optimize initially and while it did satisfy our initial goals of starting to AB test, it was lacking some features to better help us assess our AB tests and decide winners to roll out. This is where we started talking to AB Smartly to help us with some of our asks. One great benefit to call out immediately is how all the metrics we setup gets visualized out the box which provides us with more data to make better informed decisions regarding our AB tests. Review collected by and hosted on G2.com.

Verified User in Accounting
UA
Enterprise(> 1000 emp.)
More Options
Validated Reviewer
Verified Current User
Review source: Organic
What do you like best about ABsmartly?

I like getting to work with the team at ABSmartly. They are responsive and helpful in answering both technical and statistical questions. There is also tremendous potential for growth in what ABSmartly can offer, which is not the case with larger A/B Testing Platforms. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

The UI is very confusing, especially to new users. Some numbers (like time to convert metrics) are misreported. We also had some trouble integrating ABSmartly fully into our codebase (especially getting which user was in which variant). Other features are still not implemented, so we cannot fully use ABSmartly to meet our experimentation needs. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

We've been using ABSmartly to run many of our A/B tests. With this, we are able to save time pulling simple aggregates and testing for significance and now can spend our time analyzing deeper patterns from our A/B tests. Review collected by and hosted on G2.com.

Sander O.
SO
Head of Marketing & Technology
Mid-Market(51-1000 emp.)
More Options
Validated Reviewer
Review source: Organic
What do you like best about ABsmartly?

Very versityle tool to setup and use. It combines all the needed A/B testing features you need and allows for enough freedom to make the tool an integral part of the team Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

You need to be willing to invest a bit of time to run A/B Smartly on you own cloud instance. In that regard turnkey solutions like Google Optimize are quicker to setup. However, that additional effort is worth it considering why it's smarter to set it up like that. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

We have succesfully scaled up the amount of experiments we run, the type and acuracy of events we can set a goals and the speed at which we can rollout new experiments. This resulted in a higher full-on rate and higher increase in net-revenue based on these experiments. Review collected by and hosted on G2.com.

ABsmartly