Statsig Reviews & Product Details - Page 11

Statsig's product focus is exactly what my company wanted when we looked for a new experimentation platform. The features make sense and almost all of them add value for my company. The docs are great and they are very responsive on their slack. I like that the code for their SDK's is open source so if I have questions after hours that aren't answered in the docs I can look around myself. They work seamlessly with Segment which was a must have. The custom metrics are really powerful and have worked very well for us. Review collected by and hosted on G2.com.

I dislike that feature gates and dynamic configs are different concepts. Same with Layers and Experiments. Layers aren't very useful for us because we typically need to leave targeting on when we ship, which permanently takes up some of the audience directed to a layer. Also, I wish the SDKs refreshed with the latest rules more often by default; instead we have to implement our own refreshes by calling updateUser all the time, which is kind of annoying. Review collected by and hosted on G2.com.

I love how easy it is to quickly see and understand the results of an experiment. I love being able to drill to the daily level of the trends, run reports using the metadata, and having control over metric aggregations as well as how our events are propagated. Review collected by and hosted on G2.com.

I have heard feedback from the less technical users that the UI can be confusing, but many improvements have been made in this area. In particular, it was not obvious to users to hover over the delta report result to drill in to a particular metric, so more signals around that may help. Review collected by and hosted on G2.com.

Former Facebook / Meta employees created it.

It had a substantial impact on the quality thanks to the strong experimentation culture of this digital giant.

It is well-born and still getting better and better very quickly. The roadmap and the responsiveness of the team are impressive.

We are impressed by the product, and I think we only use a small part of the tool's features (we are currently using it for experimentation and not for feature flipping or to mitigate risks related to feature delivery). Review collected by and hosted on G2.com.

Hard to tell. Usually, when we have an issue, or something is missing, the product is updated quickly.

I think competitors will have many more reasons to dislike Statsig than users :-) Review collected by and hosted on G2.com.

I love Statsig UX. Setting up experiments is straightforward. The advanced options are powerful, and we defined experiments with custom exclusion criteria and mutually exclusive tests. The results view sums up everything essential to decide the best variant to ship. The real-time debugging panel is a friendly tool for ensuring everything is set up correctly. Review collected by and hosted on G2.com.

User data takes some hours/a day to be in the summaries. This delay also affects the health checks on the experiment setup page. Getting the Stable IDs to override experiments for functional testing purposes is cumbersome. Review collected by and hosted on G2.com.

Statsig enables our entire product development team to easily understand the results of hypothesis tests without a data scientist/analyst needing to interpret, negates the danger of peeking, and makes it easy to double click on interesting results. It makes our process faster, more trustworthy, more collaborative, and more thorough. Review collected by and hosted on G2.com.

We don't use the SDK, we ingest from our warehouse, and setting up those data pulls & associating metrics is nontrivial. Once you're up the learning curve it gets easier but the first time we were definitely glad to have access to their Slack space. Review collected by and hosted on G2.com.

Statsig has enabled Numan to move and test at a lightning pace. We greatly appreciate their sequential analysis engine and BigQuery ingestion that allow us to create a full view of how our new features are benefiting the lives of our patients and help us ship high impact features without waiting for full test durations. Review collected by and hosted on G2.com.

It can be complex to understand the results tab and the initial setup can be daunting without coding or statistical knowledge. But once it's setup you don't need to worry about it again. Review collected by and hosted on G2.com.

The most helpful aspect of Statsig is that rather than complicating and diluting their platform by attempting to solve every development problem, they've focused on one widespread pain point in software development and created a comprehensive, intuitive solution that simplifies the process of feature access management.

Additionally, their team is very responsive to feedback and constantly builds tools to improve the developer experience of their customers. Review collected by and hosted on G2.com.

There isn't a whole lot to dislike about Statsig, but I would like to be able to see more granular analytics and history on the activity of specific feature gates. Review collected by and hosted on G2.com.

The UI is intuitive and straightforward, and the documentation answered my questions. The prompts for an experiment force you (and your management) to think through what success and failure mean. Review collected by and hosted on G2.com.

I haven't encountered any major pain points, but there are 1 or 2 nitpicks. The "Layers" section can be challenging to locate if you don't know where it is. Initially, I expected that section to be in the sidebar next to "Feature Gates" and "Experiments."

The documentation explains how to use Statsig and comprehensively answers our questions about an initial implementation. However, I would have loved thorough API documentation for more fine-grained technical questions (what are all of the methods on this object, an explanation of what each argument on a method does, etc.) Review collected by and hosted on G2.com.

I like how feature-rich the product is. I mainly use Statsig for feature gates, experiments, and dynamic configs, making deploying easier and the code cleaner. The UI is easy to use and provides easy ways for us to manage all of our configurations. The experimentation framework is instrumental in letting us target the right users and providing insights to help make a decision afterward. Review collected by and hosted on G2.com.

While using Statsig, some features we wanted were missing regarding metrics, but the team was very responsive via Slack to answer questions and later on deliver the requested features. As the Statsig product matures, it seems like the team is quickly building out more and more features. Review collected by and hosted on G2.com.

Very easy to create custom metrics. I wish we were able to backfill them though, I'm not sure why we can't.

Great and responsive customer service. Great pieces of the tool for clustering and hold out groups. Review collected by and hosted on G2.com.

It probably needs a bit more onboarding for a team that doesn't have experimentation experience. The tools aren't super intuitive. A big question in experimentation is picking a big enough sample and the tool takes that for granted.

Some features like funneling and aggregated metrics are lackluster. Review collected by and hosted on G2.com.