We performed a comparison between Ranorex Studio and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Easy integration with CI Tools like Jenkins, TFS, and TeamCity."
"I'm from a UFT background, so Ranorex Studio has a similar feel in terms of how it handles objects. It just felt familiar even though I'd never seen it before. However, it doesn't have all the bells and whistles of UFT, but it's a pretty good start, and it's cost-effective."
"The scalability is very good. It's probably one of the better tools I've seen on the market."
"Support is very quick. You can write to them and on the same day, they will respond. This is one of the best features."
"The most valuable feature of Ranorex Studio is the capture and replay tool. You don't need to do script testing. When you launch any application from Ranorex Studio it automatically captures these test case steps. The next time you can replay the tool the flow automatically happens again. For example, when you do the logging and all the activity will be captured by the tool, and re-execute the same step by using automatization."
"I like the recording function and Ranorex Spy."
"The solution is fast and includes built-in libraries that record and playback."
"Data security was prime for us. Being able to download and run tests on our local machines was a big plus. The flexibility Ranorex offers in terms of customization is outstanding."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"You can record your actions and play them back later."
"The solution is mainly stable."
"I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"The automation of the SAP application could perhaps be improved to make it much simpler."
"We are mainly working for manufacturing OEMs but the integration is not available. It would be a benefit if they built one integration tool for all the Teamcenter home servers and software as the main PLM data source. It is a simple process at this time, the integration could be made easier."
"Ranorex is used in Windows while other solutions, for example, Katalon Studio, are cross-platform. (But in my opinion, overall, Ranorex is better)."
"One of the areas the service could be improved would be to have the training in Italian."
"If there are many queries on the web page, Ranorex will not render the page correctly. I had about 1,000 queries on the page, and the solution was not able to handle it."
"Binding to other sources is very good but the object recognition in .NET desktop applications often doesn't work."
"I would like to be able to customize the data grids. They are currently written in Visual Basic and we are unable to get down to the cell level without hard-code."
"When we have updated the solution in the past there have been issues with the libraries. They need to make it clear that the libraries need to be upgraded too."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
"It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing)."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
Ranorex Studio is ranked 9th in Test Automation Tools with 46 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 71 reviews. Ranorex Studio is rated 8.0, while SmartBear TestComplete is rated 7.6. The top reviewer of Ranorex Studio writes "Good data security, allowing local installations to prevent data from going to the internet". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Ranorex Studio is most compared with Tricentis Tosca, Katalon Studio, froglogic Squish, OpenText UFT One and Selenium HQ, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, OpenText UFT One, froglogic Squish and Eggplant Test. See our Ranorex Studio vs. SmartBear TestComplete report.
See our list of best Test Automation Tools vendors, best Functional Testing Tools vendors, and best Regression Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
All of these solutions are based on scripts and face the associated limitations. Test data management, parameterization, dynamic TBOMs, BPCA, SolMan integration and script maintenance all pose potential issues. I'd recommend looking at Tricentis Tosca or Worksoft, both of which provide scriptless automation for SAP GUI. Tosca also supports Fiori and NWBC natively as well as over 30 different UI and API technologies.
[FULL DISCLOSURE: I work for Tricentis, so obviously biased, but we serve many SAP clients]
Have used HPE UFT and SAP TAO for testing SAP applications. SAP TAO is more oriented towards the use of SAP by the Technical Users, while you can structure your tests in HPE UFT to be more business oriented and UX-driven. The limitations for these tools are as have been iterated above the use of the Scripting Language and more times the use of 'Record and Play' methods to automate the tests.
As mentioned above integration with HP ALM (and BPT) makes the whole process easier to comprehend and work on from a Business viewpoint, and when your end users are basically Business users with limited Technical use. That said, you can try the latest SAP testing with the TOSCA tool also, which now provides the majority of the SAP 'modules' (aka objects) out of the box. This is a scriptless tool and with v9.x has the ability to do record and play and actual 'Exploratory' testing wherein the user can just switch it ON and record and later these steps are translated back into Test Case steps (much like TAO).
TestComplete is also good, but you need C# knowledge for most of the scripting work, otherwise it is a cheaper option to any of the other tools available. Again, you need to be mindful that someone needs to create the initial framework and then users can work on it. This tool is more helpful when doing some Unit Tests.
I am not sure of Ranorex, as have not used it.
It's been a while since I have used SmartBear, but I do know with HP & Ranorex that you will need to have more a development background for both your test logic and object recognition. If your testers are more developers, then you'll be ok. Will be happy to share other options to look at.
Please checkout the following links for HP solutions:
resultspositive.com
www8.hp.com
www.techvalidate.com
Thanks,
-PL
Hi,
I tested SAP with HPE UFT including BPT with a high level of success. The major difference between TAO and UFT is that UFT approaches testing from a user/business perspective while TAO is more oriented towards technical part by accessing individually each transaction. We were in System and later Acceptance Test so UFT was the tool of choice. HPE UFT detected objects ok, we could access all transactions and compose whatever scenarios crossed our minds. In order to do that we integrated with HP ALM who offered BPT which made the work a lot easier. We knew the tool so no training was necessary but the cost of licenses was quiet high.
Hope it helps
Victor
UFT will support or Tricentis TOSCA .