
It's actually a great Open-source and cheap Platform for tracking different LLM usage, and can also create alerts on LLM responses. It supports multiple LLMs, including open-source ones. You'll get 100,000 free token uses. It's easy to implement and also offers great customer support. I use it more to integrate it into my projects. Review collected by and hosted on G2.com.
The issue is that there are numerous alternatives, and implementing a custom LLM proxy on a framework like Axflow is challenging. The Experiment features are yet to be introduced, so we'll have to wait and see how go it is. Review collected by and hosted on G2.com.