Automated Testing Software

You cannot affectively use the camera on Browserstack devices. For my applications, I frequently have to test if the camera/microphone is working correctly. Most of the times I can not use the camer and some parts of my testing are not complete. They should figure out a way to give me access to the device's real camera. Review collected by and hosted on G2.com.

Identifying Browser & OS Compatibility issues: I use Browserstack to check and validate any potential issues when my web-app is used across different combinations of browsers and OSes.

Debugging one-off issues: When a customer reaches out saying something specific is not working on their phone/laptop, Browserstack is the first palce we go to check and reproduce the issue. Once reproducted, the debugging tools allow us to find the exact issue and help resolve it. Review collected by and hosted on G2.com.

I did encounter some challenges, particularly on mobile. Apple Pay Support and GPS Location were unavailable, limiting certain testing scenarios. Switching between mobile browsers felt cumbersome, and I experienced URL loss on iPhone when switching between browsers, which disrupted workflow. Additionally, I received an error message when trying to Mark as Bug due to a credential issue, which impacted efficiency. Finally, local testing didn’t activate in desktop mode as expected, which was a setback for some tests. Overall, LambdaTest offers powerful features for comprehensive testing, but addressing these mobile-specific and bug creation issues would make it an even stronger tool. Review collected by and hosted on G2.com.

I like that LambdaTest has the ability to run tests on real devices, emulate various network conditions, and mimic geographic locations. It helps improving testing accuracy, and helps ensure a higher-quality product for the end users. Review collected by and hosted on G2.com.

Nothing as such. Segments and Release features can be simplified. Review collected by and hosted on G2.com.

I'd point out two major problems that LD solves for my case,

1. We don't need to think about beta release to a small portion of customers. Just need to put the feature behind LD flag and control the flag from LD dashboard. That's it.

2. When we launch a new feature, we always put that feature behind LD flags. So that if something goes wrong, we don't need rollback anything in a hurry. Just toggle the LD flag by a single click. That would do the job. Review collected by and hosted on G2.com.

I don't like that in the web version when I merge with another branch the changes are passed to both branches, this is usually counterproductive. Review collected by and hosted on G2.com.

Previously we did not have a CD/CI with which we could deploy our projects automatically, with GitHub we were able to solve this. Review collected by and hosted on G2.com.

First of all, I am as a User frustated with searching capabilities of GitLab. For instance, when I am searching for snippet of code across tens of projects, it can't provide easy yet effective searching mechanism. Also, there is a bit of learning curve in terms of user interface, so it might be an obstacle for newcomers. Review collected by and hosted on G2.com.

Majority of my work time is devoted to code review, therefore it's paramount to have a platform to review the MRs in easy and accessable way for me, especially when code changes affecting several classes/items. With GitLab, it's super easy to request reviews, leave comments, and collaborate with your teammates. GitLab's CI/CD pipelines are also one of the benefits of using GitLab - you just push your code to your branch, and everything else is automated (except for the bugs - this is on your side). Review collected by and hosted on G2.com.

To imporve, the inactive time till Tuskr logs you out it way too short. If you have test cases which take like 45min to test then you already have to newly log-in and with the 2-factor-authentication this can get annoying.

Also it would be helpful to export the "Spent Time" values per test case.

Another point which could be improved, is the editing of test cases. If you have to edit a test case, where you detect a mistake in the run, you basically have to edit it in the run and in the library, in order to be prepared for future runs. Review collected by and hosted on G2.com.

Tuskr for us did replace a shared excel file; further with the possiblity to attach screenshots and comments within one test case was very benificial for us. Review collected by and hosted on G2.com.

After using it for a couple of years now, the only thing that comes to mind is not having a history of changes for your workflows (if using the hosted yml file) option. Sure, you can always add the configuration file to your own repo, but in that case it can be a bit tiresome to update workflows, copy/paste the configuration into your yml file and pushing the changes. Review collected by and hosted on G2.com.

Bitrise is doing all the heavy lifting around making builds of our Android app, based on set triggers. Currently we have a couple of types of builds and conditions set when they need to be run, and Bitrise works like a charm. Not to mention actually pushing the builds to Firebase App Distribution for QA testing and finally creating releases on Google Play. Review collected by and hosted on G2.com.

I'm looking forward to additional reporting capabilities being added to the portal. Review collected by and hosted on G2.com.

Providing end-to-end test coverage in a highly scalable platform that allows us to release more often with higher confidence. Review collected by and hosted on G2.com.

I didn't face any issues using TestFirst, but it doesn't have Mac support and some of our applications require to be tested on MacOS, so it's a limitation. Review collected by and hosted on G2.com.

We use Jira-integrated TestFirst and link all our testing tasks with respective test cases. That helped to identify the areas lacking coverage because of the well-organized structure in TestFirst. Review collected by and hosted on G2.com.

There is not much to dislike in Postman, but few are: 1.) I can add only limited member in a team with a basic/free plan. 2.) Sometimes, I get 429 for repeated API calls. 3.) Sometimes I also feel like Postman should also allow the user to manage workspace as code blocks rather limiting it to endpoints only. Review collected by and hosted on G2.com.

It provides various features that solve common problems faced during API development and interaction:

1.) Simplifies API Testing and Debugging : Simplifies API testing by providing a visual interface for interacting with APIs, making it easy for developers and testers to debug requests and responses.

2.) Collaborative API Development : Increases productivity by providing a shared environment for developers, testers, and stakeholders to collaborate on APIs.

3.) Comprehensive API Documentation : Saves time by generating real-time documentation and provides a clear reference for developers using or consuming the API. Review collected by and hosted on G2.com.

As with anything Metadata api based in Salesforce the system has to work around the complexities of the SalesForce object architecture. The data dictionary does take us a long way to getting past this however. Review collected by and hosted on G2.com.

It gives us exact visibility into our customers Salesforce Orgs and helps us find the inflection points for our implementations. One example is an implementation that was hung up for 3 days on a problem, within 15 minutes of connecting sonar we worked past it. Its a lifesaver as is Brad and Kevin from their team. Review collected by and hosted on G2.com.

While AutoRABIT is feature-rich, the initial setup and implementation can be somewhat complex, especially for organizations with less technical expertise. The user interface, though functional, could benefit from a more modern and intuitive design. At times, the platform's performance can be sluggish, particularly when dealing with large data sets or complex environments using Dataloader. Lastly, the pricing might be a bit steep for smaller teams or organizations with limited budgets, making it more suitable for mid to large-sized enterprises. Review collected by and hosted on G2.com.

AutoRABIT addresses several key challenges in our Salesforce development lifecycle. Firstly, it simplifies and automates the deployment process, reducing the risk of manual errors and significantly speeding up release cycles. This has enabled our team to deploy changes more frequently and with greater confidence. Secondly, AutoRABIT's version control system ensures that all changes are tracked, making it easier to manage code conflicts and rollbacks if necessary. The platform’s robust backup and recovery features protect our data, ensuring business continuity even in the event of unexpected issues. Overall, AutoRABIT has streamlined our DevOps operations, improved efficiency, and enhanced the security of our Salesforce environment. Review collected by and hosted on G2.com.

New users may experience difficulty learning the platform quickly and fully utilizing all its capabilities, thus prompting more comprehensive tutorials or user guides would aid greatly in quickly understanding all its capabilities. Review collected by and hosted on G2.com.

ContextQA has simplified our regression and API testing significantly by automating them - saving us both manual effort and errors while speeding up release cycles through its AI-powered auto-healing and visual regression testing features. This has made a big impactful statement about their commitment to high software quality with faster release cycles! Review collected by and hosted on G2.com.

While Qase.io is an excellent tool overall, one challenge we faced was that it didn’t work out of the box with our Robot Framework in combination with CumulusCI due to conflicting dependencies. This required additional troubleshooting and configuration, unlike some other tools we’ve used, which integrated seamlessly right from the start. Qase.io could consider supporting the direct ingestion of Robot Framework's native reports, which would unlock a wider range of existing workflows. Review collected by and hosted on G2.com.

For us, Qase.io solves the problem of centralized test management in a cost-efficient way, offering a tool that is both easy to use and highly effective. It brings all our test cases, runs, and results into one platform, streamlining the entire process without the complexity or high costs of other solutions. Review collected by and hosted on G2.com.

Sometimes they are slow to update the programming language versions in their OS images.

At one point the bump of a minor Ruby version took almost a week in their Ubuntu image and we couldn't upgrade our app without having the CI with the exact same Ruby version.

Also, lately they had some sort of bug in their platform that caused you to log out from Semaphore every day, and you thus you needed to log in back every morning. That was frustrating. Review collected by and hosted on G2.com.

Every sreious engineer needs a CI/CD platform nowadays, you just can't live without one. Shipping code continuosly and getting feedback from the CI every time is incredibly valuable for us developers.

I would choose Semaphore for:

- it's ease of use

- it's good looking UI

- it's amazing customer care support Review collected by and hosted on G2.com.

While Testomat.io is powerful, one of the areas for improvement could be the learning curve. Some of the advanced features may take time to get familiar with, especially for new users. Review collected by and hosted on G2.com.

Testomat.io addresses the challenge of reporting and transparency in testing processes. Its robust reporting features ensure that all stakeholders, from manual testers to automation engineers, can easily track progress, results, and issues in real-time. This transparency improves communication and collaboration within the team, leading to more efficient testing cycles and higher-quality software releases. Review collected by and hosted on G2.com.

I'm yet to come across any issues at all and therefore can't honestly find fault with the app. Review collected by and hosted on G2.com.

Keeping track of changes and ensuring everything that gets sent to the production server is all built and ready is a pain without any tool like this and DeployHQ does it really well. Review collected by and hosted on G2.com.

Though Jenkins is definitely a useful and adaptable tool, there are some parts that I find problematic. Its high level of complexity in installation and configuration is the most significant disadvantage. The newbies might be confused by numerous options and plug-ins that are available in Jenkins. Review collected by and hosted on G2.com.

Jenkins has played a very important role in solving several crucial challenges that are present in our SDLC mainly in the aspects of CI/CD. All of it was manual before Jenkins and we used to have many times human errors because the build and deployment was done manually, hence the release delay and an irregular build quality. Jenkins has changed this a lot by actually automating the chain and code integration and deployment. Review collected by and hosted on G2.com.

The main downside comes not from Flosum itself, but from the architectural fact that it is in the end hosted on Salesforce platform itself, meaning that it also needs to adher all Salesforce platform limits, sometimes causing performance issues. However, solutions to these bottlenecks are already being developed afaik. Review collected by and hosted on G2.com.

Very heterogeneous level of knowledge across the team.

Complex, multi-org architecture and release landscape.

Faster, but also more reliable and scalable deployment processes. Review collected by and hosted on G2.com.

Probably its complexity and the steep learning curve of it. While it offers extensive features, navigagating and setting up especially for new users or small businesses/organizations. I find the interface a bit cluttered and not as intuitive as they'd like. Review collected by and hosted on G2.com.

With Salesforce, we've made communication and operations between our company and bus companies way more efficient. The centralized portal that we have in Salesforce means no more back-and-forth emails, and everything's tracked in one place. Plus, it provides real-time updates so there's always full transparency and accountability. It helps us manage tasks and keeps all the data organized, so we (our company, bus companies and the client) can respond faster and stay on top of requests. It reduces errors and speeds things up. Review collected by and hosted on G2.com.