We performed a comparison between Sauce Labs and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Allows us to do JIRA Cloud and BambooHR Integration."
"Running tests in parallel."
"Before implementing Sauce Labs, we tested physical devices that team members had to share. It was more feasible when we were all located in one office, but we couldn't leverage our offshore capacity. With this solution, we can do everything remotely, which is essential now that most of us work from home."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"It provides zero maintenance browser instances."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"TestComplete has strong reporting capabilities. The reports they generate are really good."
"It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
"TestComplete is simple, it's a very easy-to-use tool."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"Runs in different remote machines. We have multiple versions of the software being tested."
"The product has many features."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"Better and programmatic controls on request/response recordings and sharing with developers."
"I would like to see improved network connectivity and it should allow playback for native apps."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"It should provide more examples of script code."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
"There could be API interfaces with this tool."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
Sauce Labs is ranked 13th in Test Automation Tools with 113 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. Sauce Labs is rated 8.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Bitbar and Tricentis Tosca, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish. See our Sauce Labs vs. SmartBear TestComplete report.
See our list of best Test Automation Tools vendors, best Functional Testing Tools vendors, and best Regression Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
