Statsig provides all of the tools necessary for rapid experimentation. Their Holdouts, A/B/N Experiments, Dynamic Configs & Targeting tools are all well designed & implemented so you can experiment & learn quickly. Their team is super smart & eager to help with direct Slack channel connections. Review collected by and hosted on G2.com.
With great power comes great responsibility. For Statsig, this means you need to invest time to learn the system to unlock the most value from the platform. While their docs & support team are incredibly helpful, I'd like to see future iterations of the platform include turn-key templates for more complicated setups such as multi-site/tenant. Review collected by and hosted on G2.com.
108 out of 109 Total Reviews for Statsig
Overall Review Sentiment for Statsig
Log in to view review sentiment.
The most important features are very useful and well thought, and I've never faced a moment where Statsig wasn't able to perform a specific test I wanted to. I also like how the app is very nice and intuitive and how the documentation is very deeply explanatory in case of doubt. Review collected by and hosted on G2.com.
I don't like how they put all primary metrics in all new experiments. Some experiments are very different from each other and I want to watch very different metrics. In particular, I believe that if I create an experiment based on a template or if I clone an experiment, I expect it's primary metrics to come just like the source, and not to be all repopulated again. Review collected by and hosted on G2.com.
The Statsig process was great. We booked a call and walked through the introduction of the platform. As the process progressed, I was able to ask more technical quetstions to the solutions engineer during each of our calls. Statsig has a series of YouTube videos that, while a bit out of date, can get a team up to speed relatively quickly.
Once we signed contracts, Statsig offered an a la carte learning solution for each of the various cohorts who would be using the platform. We're only using it for feature flagging and experimentation, but it's easy to get up to speed with those feature sets and setup was easy to integrate into our system using the Ruby SDK and a custom wrapper.
Turning on an experiment, and seeing those results come in, is relatively straight forward, and data (which we send to Statsig via a third-party connection) generally updates every day or so, but sometimes more frequently. It's easy to see clear winners and losers, and you're able to filter for specific things like custom analytics values. The team also integrates directly into Slack as a first line of communication. Review collected by and hosted on G2.com.
It takes some time to wrap your head around what the platform is doing and how you're supposed to set things up. The idea of Layers took some time to process, along with how to register analytics events for more granular visibility in an experiment. I think it's just the price of learning new software. Statsig employees were available to answer questions, and documentation is generally good. Review collected by and hosted on G2.com.
Statsig makes it very easy to analyze the results. The graphs they provide are easy to read and you can click on each metric for additional insights, charting and statistical significance. At a quick glance you can see what is going on with the experiment Review collected by and hosted on G2.com.
I find some of the features when submitting an experiment to be quite confusing. For example the allocation duration, cohort duration and total experiment time fields are not clear. Additionally, most of our experiments we analyze one week after allocation and there is no option to do this in Statsig Review collected by and hosted on G2.com.
Statsig has wildly exceeded my expectations! Our company had never had any sort of testing before, and when we were looking through platforms, it was hard to know what we needed. But the StatSig team was super willing to work with us on contract price and help us through setup and implementation. They're super responsive to any questions we have, whether it's a technical implementation question or a question on how to explain something tricky to a stakeholder. The tool itself has been great - it's straightforward to use, which has really helped with adoption amongst the team and to start building more of a testing culture at our company. Their team is also really responsive to feature requests and actually implements feedback into their roadmap - a lot of companies say they'll do this during the sales process but then never follow through. I'd recommend StatSig for any company starting out with experimentation and testing! Review collected by and hosted on G2.com.
The only downside I can think of is that it's just an experimentation platform, so I do have to use it separately from our other product analytics tools. But that hasn't been a real pain point! Review collected by and hosted on G2.com.
+ It works and is relibable.
+ It is well documented
+ Plenty of adapters (React/Vanilla JS, HTML, etc...)
+ Experiments feature is super nice
+ Integration is super easy Review collected by and hosted on G2.com.
- SDK Documentation is wrong (It says "env" instead of StatSig env) - caused a bug on our side.
- Can't add desription to feature gates - when a company grows and works on multiple things, Devs might not know what other people are working on.
- Can't bulk delete feature gates - You must enter into gates one-by-one and delete them.
- The SDK does not support lazy initialization, or refreshing. Review collected by and hosted on G2.com.
As a data scientist, Statsig makes it incredibly easy to handle everything from metric breakdowns to performance tracking and experiment setup. I'm truly impressed by how it allows me to analyze all experiments in one place, with just the click of a button.
What's even more helpful is that Statsig doesn't just support setting up and analyzing experiments—it also lets you import and analyze experiments run outside the platform. This feature is a game-changer, making it seamless to get insights from experiments, no matter where they were conducted. Review collected by and hosted on G2.com.
The UI could be improved. For first-time users, it can be a bit challenging to understand why certain actions aren't working as expected. For example, some buttons are greyed out on certain screens, and it's not always clear how to proceed. It feels a bit like a trial-and-error process. Review collected by and hosted on G2.com.
I've used other experimentation platforms before from Meta's "Deltoid" platform to one I built myself in python... Statsig far surpasses the other platforms out there in terms of both ease of use and flexibility. It has been a game changer for experimentation across my company. The whole process is now seamless, from adding new metric sources & metrics, setting up scorecards for new experiments, and diving into more detailed analysis with things like days-since-first-exposure view & metric results split by user dimensions. Review collected by and hosted on G2.com.
There are a lot of options to pick from for metric types, experiment settings, etc. This provides a TON of flexibility in how you analyze experiments, which is great. But the number of choices can be a bit daunting when you are newly onboarding! So definitely ask questions to the Statsig support team, and they will promptly give you advice to help you with any choice you are making. Review collected by and hosted on G2.com.
Statsig is a very powerful tool for collecting metrics necessary to make informed decisions having to do with A/b testing. It had pretty much everything you would need from an analytics suite as well - our team finds it much easier to build dashboards and pull information from than something liek google analytics.
Support is top notch and the discord channel is very active. Review collected by and hosted on G2.com.
It would be nice if event properties could be arrays/objects, right now we're stuck with strings/integers - so if we wanted to return more complex properties to the event it limited.
I get around this by passing back json strings and then filter with string contains. Review collected by and hosted on G2.com.
It needs to improve the details of how to do the integration, including some sample codes and making it clearer how the logs part works, separated from the development and production environments.
In addition to recommendations or tips on how to create logs focused on user journeys. Review collected by and hosted on G2.com.
So far, it's been difficult to learn without having to consult the documentation, so that it's not a very technical tool. We're migrating from Mixpanel, and there it's a certain ease of doing things that we haven't found yet in this migration. But there could be an examples tab or something like that, without having to leave the dashboard and that would be quick to consult, like short videos. Review collected by and hosted on G2.com.
Statsig was very easy for my team to transition to from our old experiment platform, and the transition was immediately worth it as I was blown away by the performance increases, both in the user interface and in how quickly exposures were resolved. The user interface is beautiful and makes me look forward to setting up and checking the status of my experiments, and some of the easter eggs like the musical graphs feature show how much attention to detail the team has spent on making this the friendliest possible dashboard. It is easy for me to set up experiments and feature gates on their portal, as well as easy to implement them in my codebase. I find myself using Statsig as often as I can now. Review collected by and hosted on G2.com.
Even though the transition was easy, there were some things that took getting used to when coming from our old experiment platform, and we needed to deal with some quirks during the transition time when we were using two experiment platforms at the same time as we were transitioning. Review collected by and hosted on G2.com.
