We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The solution helps by detecting bottlenecks."
"This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it."
"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."
"The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."
"It gives accurate results and recommendations that we can implement to enhance the performance of websites."
"It is very quick and user-friendly."
"JMeter is a free tool with a large user population, which comes in handy because we have a vast knowledge base to tap into when needed. It's also easier to hire consultants who know JMeter."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
"It is easy for a non-technical person to use and adopt."
"It provides us daily feedback on the status (failing/working) of the core features of our websites."
"User-friendly and a good solution."
"The automation is very fast and you don't need to be overly proficient in coding."
"It is a good tool and provides all the essential features for our business requirements."
"Smart Wait and XPath healing are valuable features."
"The initial setup is pretty straightforward and easy enough to complete."
"The solution is not user-friendly, there is no framework for autocorrelation or parameterization."
"Given that Apache JMeter is a free and open-source tool, documentation improvement may not be a major concern, as it is mostly contributed on a voluntary basis. The essential information is already available. However, in terms of the interface, there are occasional bugs, and the tool may not address them as quickly as some users would like. Fixing defects and bugs might take a considerable amount of time, with users sometimes having to wait for several months or even a year for the next release to address specific issues."
"There could be improvements in terms of memory utilization. We are going to migrate away from JMeter in the near future."
"If JMeter could provide a web version of editing, that would be good."
"The user interface is a little bit tricky."
"There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files."
"The product is comparatively slow."
"I can say that in my company, we struggle a lot with iOS automation."
"I've seen that our clients are not truly aware of the power behind Katalon."
"The product’s regression testing time could be reduced."
"What it lacks is the Selenium Grid capabilities."
"Its stability needs improvement."
"It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.