We performed a comparison between TestRail and Visual Studio Test Professional based on real PeerSpot user reviews.
Find out in this report how the two Test Management Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."
"I haven't faced any stability issues using the solution. Stability-wise, I rate the solution a ten out of ten."
"Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it."
"This is a user friendly solution."
"The API to support integration of the homemade automated testing tool."
"I use the solution for test management."
"The integration with Jira and the ability for extra configurations are the most valuable features."
"The solution is very stable. We've never had any issues with it."
"Visual Studio Test Professional is a scalable solution."
"Visual Studio is the easiest to use."
"The solution is very stable."
"The solution is very useful for compiling existing projects and developing new projects."
"The most valuable feature has been to store all our packages in one place including SSIS packages, SQL tables, TFS and SSR."
"Its initial setup process is easy."
"The setup is easy and straightforward."
"Easy to use and easily scalable."
"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."
"Better prediction of text."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"Reporting could be more flexible regarding repeating reports."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
"The test suite management has room for improvement as well as better reporting."
"I've encountered at some point, some difficulties on the administration side, but I don't remember exactly what they were."
"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
"The documents on the Microsoft website are not very useful, and they ought to make it easier to find answers."
"In Visual Studio we still don't have anything which can pinpoint memory leaks on a certain code line."
"We would like to be able to easily integrate this solution with our continuous integration tools, such as Jenkins."
"The documentation is limited."
"The service right now is far too expensive. You need to pay per user."
"I would appreciate some enhancements in the interface, maybe adding more color options."
"The solution is quite expensive."
"The solution's documentation could be improved for beginners."
More Visual Studio Test Professional Pricing and Cost Advice →
TestRail is ranked 2nd in Test Management Tools with 21 reviews while Visual Studio Test Professional is ranked 5th in Test Management Tools with 47 reviews. TestRail is rated 8.0, while Visual Studio Test Professional is rated 8.6. The top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". On the other hand, the top reviewer of Visual Studio Test Professional writes "Customization is a key feature as is the ability to integrate with third-party services ". TestRail is most compared with Zephyr Enterprise, Tricentis qTest, TFS, Tricentis Tosca and SpecFlow, whereas Visual Studio Test Professional is most compared with TFS, Apache JMeter, Tricentis NeoLoad, SmartBear TestComplete and Tricentis Tosca. See our TestRail vs. Visual Studio Test Professional report.
See our list of best Test Management Tools vendors.
We monitor all Test Management Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
