Appium vs SmartBear TestComplete comparison

Cancel
You must select at least 2 products to compare!
Appium Logo
2,255 views|1,759 comparisons
96% willing to recommend
SmartBear Logo
5,376 views|3,792 comparisons
86% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Appium and SmartBear TestComplete based on real PeerSpot user reviews.

Find out in this report how the two Regression Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Appium vs. SmartBear TestComplete Report (Updated: March 2024).
770,428 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Appium's best feature is that it supports multiple frameworks.""The solution is easy to use.""It runs completely flawlessly and seamlessly every day.""We do not need to pay for the solution. It’s free.""The best feature of Appium is that it allows you to inspect the element. With the Appium Inspector, you don't have to install another application to do the inspection. I also like that Appium has Android device connectivity. Currently, most people use Appium as automation software, and I haven't found any other tool that's more powerful than Appium.""It has great documentation and excellent community support.""The way Appium server interacts with mobile apps is fantastic. It provides all the information about the elements inside the app, Android as well as iOS. I can interact with the element quickly, just type some text or get some text values from the element - whether it's a drop-down, or web text, or a native element.""The most valuable feature of Appium is it supports iOS and AOS and is open-source."

More Appium Pros →

"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.""It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows.""The reporting is ready to use and doesn't require any setup.""Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution.""TestComplete is simple, it's a very easy-to-use tool.""Runs in different remote machines. We have multiple versions of the software being tested.""The product has many features.""The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."

More SmartBear TestComplete Pros →

Cons
"Configuration-wise, there is a lot of room for improvement.""We haven't been able to fully leverage Appium for multiple reasons. I think number one is just that the tests take a long time to run. We have had some issues around just the results themselves and how predictable they are, but those are not issues with Appium directly.""There is always a concern about the amount of code that is required to enhance the automation process. The idea of having less code or no code is what we would like to see in future updates.""We need some bug fixes for nested elements.""I rarely use Appium nowadays because I'm now at the managerial level, but the last time I used it, whenever I selected and clicked on an element, Appium was very slow. I tried to debug it, but I still couldn't find the problem, so this is an area for improvement in the solution. Another area for improvement lies with the connector and server. For example, the effort to get into the local machine sometimes causes the emulator to become slow, which then leads to failure in testing, and this is the usual issue I've encountered from Appium. An additional feature I'd like added to Appium in its next release is being able to do automation in iOS without using XPath and the name of the element. In Xcode, you can use previous UI tests for detecting elements, but in Appium, you have to use Xpath and the element name instead of being able to directly put the X-UiPath, which is what you can do in Xcode. In iOS as well, sometimes the element doesn't have a name or a path. Sometimes, there's also no element.""It needs to accommodate applications that use React.js and AngularJS.""Appium can improve when the case fails, there should be a feature where you can generate the report from Appium. Once you're on a test case, automatically the screenshot should be captured which would avoid manual intervention. These features would be beneficial to migrate to Appium.""Appium has problems with automated validations following iOS updates, causing us to have to validate manually."

More Appium Cons →

"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS.""Product is not stable enough and it crashes often.""SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra.""There could be API interfaces with this tool.""The artificial intelligence needs to be improved.""At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors.""The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS.""In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."

More SmartBear TestComplete Cons →

Pricing and Cost Advice
  • "This is an open source solution so it does not cost anything for licensing or otherwise."
  • "Appian is open-source, which is not licensed."
  • "The pricing of Appium is fine."
  • "The solution is free."
  • "Appium is free and open-source."
  • "As far as I know, Appium is a free solution. It's not for commercial use."
  • "We found out that we could explore features of the solution for 30 days trial. We can switch to a permanent license later if we want."
  • "I'm unsure if there's any cost associated with Appium. I got the free package which includes the server GUI application and the inspector application, and it was free to download, and that's all I need to get my work done. I'm not aware of any additional costs associated with the tool."
  • More Appium Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
    770,428 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interface… more »
    Top Answer:Appium helps me to do as much as much as I want to.
    Top Answer:The price is good for people to be able to make a favorable decision for the value.
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual price is around four thousand five hundred plus per user, whereas UiPath is only… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced the Optical Character Recognition (OCR) capability. This introduction has… more »
    Ranking
    5th
    Views
    2,255
    Comparisons
    1,759
    Reviews
    17
    Average Words per Review
    510
    Rating
    8.0
    6th
    Views
    5,376
    Comparisons
    3,792
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    Comparisons
    Learn More
    Overview

    Appium is an open-source mobile application development tool that is designed to give users complete control of their application development process. It enables them to optimize the development process when the need calls for it, and create the applications that they want in the most efficient manner they can.

    Appium Benefits

    Some of the benefits that come from using Appium include:

    • Ease of deployment. Appium is fairly simple for users to set up for the first time. Developers can download Appium and launch it with only a couple of clicks.
    • Easily track the results of application tests. Appium automatically creates reports when developers run application tests. These reports can give users insights into every aspect of the tests that they just ran. They can include detailed test results, screenshots of the test as it took place, and videos showing the test while it was in progress. Developers can also recall these reports with ease so that the information that was gathered is always at their disposal.
    • Gain deep insights into your application. Users can easily gain insight into the way that their application is running and how it might be improved. The reports that the system produces can provide developers with all of the data and insight that they need to improve their applications and make informed decisions.

    Appium Features

    When users choose to employ Appium’s mobile development solution, they gain access to many different capabilities. These features include:

    • Remote testing capability. Teams that are spread across the globe can collaborate and run tests from wherever they happen to be at the time. They can connect to Appium’s cloud testing feature and always have access to the latest iteration of the project they are working on.
    • Customizable test reporting capability. Appium enables users to customize the way that information from their tests is reported. They can create the kinds of reports that best reflect their objectives and needs. When specific information is needed, the reports can be formatted to show that particular aspect when the solution generates it.
    • Parallel testing capabilities. Developers who use Appium can run multiple application tests at the same time. This enables them to save time and resources while still accounting for every scenario that their applications might experience. Users can run all of the tests necessary to ensure that their applications are successful while spending the minimum amount of time doing so.

    Reviews from Real Users

    Appium is a solution that has a great deal to offer its users. It is a very complete mobile development solution that gives users the capabilities that they need to design their mobile applications with the greatest level of ease possible. Users can scale their application scripts to meet their needs. Additionally, developers can automate testing protocols, which reduces the amount of time and other resources that need to be devoted to the testing process. These two features make Appium a leader in the field of mobile application development.

    Jayanta K., automation and nft manager at a computer software company, writes, “The interface for mobile automation is helpful for scripting and execution. It's scalable and there are many testers who would like to automate. In terms of scripting, scalability is very good.

    The head of solutions delivery (systems) at a wellness & fitness company writes, “Obviously, because of automation, it reduces manual testing efforts.

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Sample Customers
    Nuvizz, Coupa Software, Eventbrite, Evernote
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Top Industries
    REVIEWERS
    Financial Services Firm40%
    Computer Software Company20%
    Wellness & Fitness Company10%
    Manufacturing Company10%
    VISITORS READING REVIEWS
    Computer Software Company16%
    Financial Services Firm16%
    Manufacturing Company9%
    Insurance Company6%
    REVIEWERS
    Computer Software Company31%
    Manufacturing Company13%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    Company Size
    REVIEWERS
    Small Business15%
    Midsize Enterprise23%
    Large Enterprise62%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise14%
    Large Enterprise65%
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise62%
    Buyer's Guide
    Appium vs. SmartBear TestComplete
    March 2024
    Find out what your peers are saying about Appium vs. SmartBear TestComplete and other solutions. Updated: March 2024.
    770,428 professionals have used our research since 2012.

    Appium is ranked 5th in Regression Testing Tools with 25 reviews while SmartBear TestComplete is ranked 6th in Regression Testing Tools with 71 reviews. Appium is rated 8.0, while SmartBear TestComplete is rated 7.6. The top reviewer of Appium writes "It's easy to launch applications". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Appium is most compared with Tricentis Tosca, Katalon Studio, Perfecto, Xamarin Platform and Eggplant Performance, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and LEAPWORK. See our Appium vs. SmartBear TestComplete report.

    See our list of best Regression Testing Tools vendors.

    We monitor all Regression Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.