SmartBear TestComplete vs TFS comparison

Cancel
You must select at least 2 products to compare!
SmartBear Logo
6,927 views|4,860 comparisons
86% willing to recommend
Microsoft Logo
Read 93 TFS reviews
2,136 views|1,253 comparisons
87% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between SmartBear TestComplete and TFS based on real PeerSpot user reviews.

Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed SmartBear TestComplete vs. TFS Report (Updated: July 2020).
772,649 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It allows us to test both desktop and web applications.""It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.""The most valuable feature is the integration with Azure DevOps.""The database checkpoints detect problems which are difficult for a human resource to find.""Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well.""I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers.""It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows.""It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."

More SmartBear TestComplete Pros →

"The interface is easy to navigate.""The initial setup is fairly easy.""I feel that the test plan and test tools are more manageable in TFS.""It's user friendly. We haven't had any issues so far. It's flexible. If we need something, we can always contact the owner in our headquarters to make a configuration.""The most valuable features are the dashboard and task-selection capability.""For what I need TFS for, I have never run into any limitation.""I like its MTM (Microsoft Test Manager) section which gives us options to create various test plans and add test cases into it.""The most valuable feature from my point of view is project management, which includes user stories as well as task management."

More TFS Pros →

Cons
"One notable drawback is the absence of native integration with Git.""The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.""The test object repository needs to be improved. The hierarchy and the way we identify the objects in different applications, irrespective of technology, needs adjustments. The located and test objects are not as flexible compared to other commercial tools.""SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra.""The initial setup of SmartBear TestComplete was complex.""TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services.""It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing).""The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."

More SmartBear TestComplete Cons →

"Its pricing could be improved.""Integration from Visual Studio could be improved.""The manageability and performance of the product are areas of concern where improvements are required.""The test management interface is not very handy.""Currently, we are looking for a solution with which we can incorporate third-party development sites or third-party project teams into the system. Because it is on-premise, it is a bit problematic because we need to have a VPN or something else in the system. A cloud-based solution would be better for us, and that's what we are looking for. Our biggest problem is the external connection, which, of course, is limited by our own IT. It would be good to have some kind of publishing service for this external connection. It might be there, and it might be that our IT is making it impossible for us. Its template editor could be easier to use. Currently, customizing the project templates according to your needs requires some work.""There are many things that I cannot do, and I have a lot of bugs.""The overall reports in TFS could improve. Additionally, there should be an easier way to migrate from an older version to a newer one.""I'm looking for specific options that aren't currently available, such as active status, new status, or what's currently in progress."

More TFS Cons →

Pricing and Cost Advice
  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

  • "It's just as expensive as HPE ALM, without many of the features, best used for development tool only to avoid higher costs."
  • "TFS is on the higher side, but if you intend to use the tool as a complete ALM tool, it will reduce your costs in the long run."
  • "Use the Microsoft recommended “seat-based” licensing model. This allows a single developer with multiple machines to consume only one client license."
  • "If running TFS on-premise is expensive, maybe you could consider moving to the Cloud and use the Visual Studio Team Services."
  • "It is pretty expensive compared to other project management tools."
  • "The pricing is reasonable at this time."
  • "TFS is more competitively priced than some other solutions."
  • "We pay subscription fees on a yearly basis and the price is reasonable."
  • More TFS Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    772,649 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:TestComplete has strong reporting capabilities. The reports they generate are really good.
    Top Answer:It's comparable to other similar tools, perhaps a bit less expensive than some of its competitors. So, the pricing is pretty reasonable.
    Top Answer:Headless testing would be a big improvement. For example, when we run our regression suite, we need to start a virtual machine and run the tests interactively. There isn't a way to run the tests… more »
    Top Answer:TFS and Azure DevOps are different in many ways. TFS was designed for admins, and only offers incremental improvements. In addition, TFS seems complicated to use and I don’t think it has a very… more »
    Top Answer:Microsoft's technical team is supportive.
    Top Answer:There is a yearly licensing fee that needs to be paid.
    Ranking
    7th
    Views
    6,927
    Comparisons
    4,860
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    3rd
    Views
    2,136
    Comparisons
    1,253
    Reviews
    25
    Average Words per Review
    377
    Rating
    8.0
    Comparisons
    Also Known As
    Team Foundation Server
    Learn More
    Overview

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Visual Studio’s Team Foundation Server (TFS) is a powerful application development lifecycle management solution. It aids developers in managing every aspect of their DevOps and application creation. TFS combines many different types of solutions into a single powerful platform.

    Visual Studio TFS Benefits

    Some of the ways that organizations can benefit by choosing to deploy TFS include:

    • Build automation. TFS enables users to create definitions that can easily automate any and all tasks that are critical to the development of their applications. Businesses can utilize features that are built into TFS to accomplish preset tasks that can help them create the application of their choice. This can include enabling them to run automated tests when the need arises. Additionally, users can create custom tasks that will run automatically and allow users to focus their attention on the areas that most demand their focus.
    • Security. TFS is designed with the security of a user’s DevOps in mind. It enables an organization to restrict user permissions so that only developers that are meant to have access to particular parts of the development process can perform tasks related to those sections. It segments the development process to reduce the possibility of sensitive data being stolen.
    • Enables product rollbacks. TFS keeps copies of past versions of the organization’s application. Users can sift through the different versions that are available and can redeploy the version that best fits their needs should it ever become necessary to do so.

    Visual Studio TFS Features

    • Source code management. TFS comes with all of the tools that developers need to completely manage their source code. They can share their code so that multiple developers can work on the same project. Additionally, TFS enables them to do things like review the history of a particular piece of source code.

    • Project management. Organizations can leverage the wealth of project management features that TFS offers and ensure that their projects run as smoothly as possible. Project managers are able to use TFS to control every aspect of their project, from the planning stage until the application’s development has reached its conclusion.
    • Reporting. TFS enables users to generate reports that leverage critical metrics and provide them with important insights into the applications that they are creating. These comprehensive reports can be secured so that only users with the proper level of clearance can access them.

    Reviews from Real Users

    TFS is a highly effective solution that stands out when compared to many of its competitors. Two major advantages it offers are its source code management capabilities and its powerful integration suite.

    Carl B., the vice president of engineering at Vertex Downhole Ltd, writes, “The most valuable features are related to source code management. Using TFS for source code management and being able to branch and have multiple developers work on the same projects is valuable. We can also branch and merge code back together.”

    Ashish K., the principal consultant at Wipro, says, “I have found almost all of the features valuable because it integrates well with your Microsoft products. If a client is using the entire Microsoft platform, then TFS would be definitely preferable. It integrates with the digital studio development environment as well.”

    Sample Customers
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Vendex KBB IT Services, Info Support, Fujitsu Consulting, TCSC, Airways New Zealand, HP
    Top Industries
    REVIEWERS
    Computer Software Company33%
    Manufacturing Company12%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company12%
    Financial Services Firm11%
    Government7%
    REVIEWERS
    Financial Services Firm26%
    Computer Software Company17%
    Manufacturing Company16%
    Energy/Utilities Company10%
    VISITORS READING REVIEWS
    Educational Organization53%
    Computer Software Company7%
    Manufacturing Company5%
    Financial Services Firm5%
    Company Size
    REVIEWERS
    Small Business29%
    Midsize Enterprise27%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise61%
    REVIEWERS
    Small Business17%
    Midsize Enterprise25%
    Large Enterprise58%
    VISITORS READING REVIEWS
    Small Business9%
    Midsize Enterprise59%
    Large Enterprise32%
    Buyer's Guide
    SmartBear TestComplete vs. TFS
    July 2020
    Find out what your peers are saying about SmartBear TestComplete vs. TFS and other solutions. Updated: July 2020.
    772,649 professionals have used our research since 2012.

    SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews while TFS is ranked 3rd in Test Management Tools with 93 reviews. SmartBear TestComplete is rated 7.6, while TFS is rated 8.0. The top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". On the other hand, the top reviewer of TFS writes "It is helpful for scheduled releases and enforcing rules, but it should be better at merging changes for multiple developers and retaining the historical information". SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish, whereas TFS is most compared with Microsoft Azure DevOps, Jira, Rally Software, TestRail and OpenText ALM / Quality Center. See our SmartBear TestComplete vs. TFS report.

    We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.