Amazon SQS vs Apache Kafka comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
6,473 views|5,680 comparisons
86% willing to recommend
Apache Logo
14,664 views|11,157 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary
Updated on Mar 6, 2024

We compared Apache Kafka and Amazon SQS based on our user's reviews in several parameters.

Apache Kafka stands out for its high scalability, fault-tolerant architecture, real-time data handling, stream processing, and data replication support. On the other hand, Amazon SQS is praised for its reliability, scalability, and ability to decouple application components seamlessly. While Apache Kafka offers easy integration with programming languages and frameworks, Amazon SQS provides efficient message handling for large volumes. Overall, Apache Kafka focuses on real-time data processing and stream processing, while Amazon SQS emphasizes reliable message handling and decoupling application components.

Features: Apache Kafka is highly valued for its high scalability, fault-tolerant architecture, and support for real-time data handling. It also offers seamless integration with programming languages and frameworks, and functionalities like stream processing and data replication. On the other hand, Amazon SQS is highly appreciated for its reliability, scalability, and the ability to decouple different components of an application, allowing for seamless integration and flexibility. It efficiently handles large volumes of messages.

Pricing and ROI: The available data did not provide any information about the setup cost for Apache Kafka. There were no details about the pricing, setup cost, and licensing for Amazon SQS from the reviewers., The ROI reviews for Apache Kafka are missing or unavailable, while for Amazon SQS, they are not available.

Room for Improvement: Apache Kafka: No specific feedback is available regarding areas for improvement. Amazon SQS: No specific feedback or suggestions have been provided for improvement.

Deployment and customer support: The given data source does not provide any user feedback specifically about the duration required to establish a new tech solution for Apache Kafka. Similarly, there is no specific information or quotes available regarding the setup time for Amazon SQS., Customer service and support for Apache Kafka cannot be compared as no reviews or feedback are available. Similarly, there are no reviews for customer service of Amazon SQS.

The summary above is based on 46 interviews we conducted recently with Apache Kafka and Amazon SQS users. To access the review's full transcripts, download our report.

To learn more, read our detailed Amazon SQS vs. Apache Kafka Report (Updated: May 2024).
772,649 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It is stable and scalable.""One of the useful features is the ability to schedule a call after a certain number of messages accumulate in the container. For example, if there are ten messages in the container, you can perform a specific action.""With SQS, we can trigger events in various cloud environments. It offers numerous benefits for us.""SQS is very stable, and it has lots of features.""I appreciate that Amazon SQS is fully integrated with Amazon and can be accessed through normal functions or serverless functions, making it very user-friendly. Additionally, the features are comparable to those of other solutions.""The solution is easy to scale and cost-effective.""We use SNS as the publisher, and our procurement service subscribes to those events using SQS. In the past, we relied on time-based or batch-based processes to send data between services on-premises. With SQS, we can trigger actions based on real-time changes in business processes, improving reliability.""I am able to find out what's going on very easily."

More Amazon SQS Pros →

"The open-source version is relatively straightforward to set up and only takes a few minutes.""Deployment is speedy.""It is a useful way to maintain messages and to manage offset from our consumers.""Apache Kafka has good integration capabilities and has plenty of adapters in its ecosystem if you want to build something. There are adapters for many platforms, such as Java, Azure, and Microsoft's ecosystem. Other solutions, such as Pulsar have fewer adapters available.""The most valuable feature is the messaging function and reliability.""It's very easy to keep to install and it's pretty stable.""I like Kafka's flexibility, stability, reliability, and robustness.""With Kafka, events and streaming are persistent, and multiple subscribers can consume the data. This is an advantage of Kafka compared to simple queue-based solutions."

More Apache Kafka Pros →

Cons
"Sending or receiving messages takes some time, and it could be quicker.""There are some issues with SQS's transaction queue regarding knowing if something has been received.""I do not think that this solution is easy to use and the documentation of this solution has a lot of problems and can be improved in the next release. Most of the time, the images in the document are from older versions.""I cannot send a message to multiple people simultaneously. It can only be sent to one recipient.""As a company that uses IBM solutions, it's difficult to compare Amazon SQS to other solutions. We have been using IBM solutions for a long time and they are very mature in integration and queuing. In my role as an integration manager, I can say that Amazon SQS is designed primarily for use within the Amazon ecosystem and does not have the same level of functionality as IBM MQ or other similar products. It has limited connectivity options and does not easily integrate with legacy systems.""The tool needs improvement in user-friendliness and discoverability.""Sometimes, we have to switch to another component similar to SQS because the patching tool for SQS is relatively slow for us.""Be cautious around pay-as-you-use licensing as costs can become expensive."

More Amazon SQS Cons →

"The management overhead is more compared to the messaging system. There are challenges here and there. Like for long usage, it requires restarts and nodes from time to time.""Observability could be improved.""Maintaining and configuring Apache Kafka can be challenging, especially when you want to fine-tune its behavior.""Kafka's interface could also use some work. Some of our products are in C, and we don't have any libraries to use with C. From an interface perspective, we had a library from the readies. And we are streaming some of the products we built to readies. That is one of the requirements. It would be good to have those libraries available in a future release for our C++ clients or public libraries, so we can include them in our product and build on that.""There have been some challenges with monitoring Apache Kafka, as there are currently only a few production-grade solutions available, which are all under enterprise license and therefore not easily accessible. The speaker has not had access to any of these solutions and has instead relied on tools, such as Dynatrace, which do not provide sufficient insight into the Apache Kafka system. While there are other tools available, they do not offer the same level of real-time data as enterprise solutions.""The solution could always add a few more features to enhance its usage.""It's not possible to substitute IBM MQ with Apache Kafka because the JMS part is not very stable.""Too much dependency on the zookeeper and leader selection is still the bottleneck for Kafka implementation."

More Apache Kafka Cons →

Pricing and Cost Advice
  • "Amazon SQS is more affordable compared to other solutions."
  • "The pricing of Amazon SQS is reasonable. The first million requests are free every month, and after, it's cost 40 cents for every million requests. There are not any additional fees."
  • "Amazon SQS is quite expensive and is at the highest price point compared to other solutions."
  • "SQS's pricing is very good - I would rate it nine out of ten."
  • "The pricing model is pay-as-you-use. It depends on your usage and configuration."
  • "Amazon SQS is moderately priced."
  • "It's quite expensive."
  • More Amazon SQS Pricing and Cost Advice →

  • "I would not subscribe to the Confluent platform, but rather stay on the free open source version. The extra cost wasn't justified."
  • "When starting to look at a distributed message system, look for a cloud solution first. It is an easier entry point than an on-premises hardware solution."
  • "It is open source software."
  • "Licensing issues are not applicable. Apache licensing makes it simple with almost zero cost for the software itself."
  • "Apache Kafka is open-source and can be used free of charge."
  • "Kafka is open-source and it is cheaper than any other product."
  • "Kafka is more reasonably priced than IBM MQ."
  • "The solution is open source; it's free to use."
  • More Apache Kafka Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Message Queue (MQ) Software solutions are best for your needs.
    772,649 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:We use it for event-driven messaging and workflows.
    Top Answer:Apache Kafka is open source and can be used for free. It has very good log management and has a way to store the data used for analytics. Apache Kafka is very good if you have a high number of users… more »
    Top Answer:Apache Kafka is an open-source solution that can be used for messaging or event processing.
    Ranking
    Views
    6,473
    Comparisons
    5,680
    Reviews
    12
    Average Words per Review
    378
    Rating
    8.2
    Views
    14,664
    Comparisons
    11,157
    Reviews
    32
    Average Words per Review
    571
    Rating
    8.1
    Comparisons
    Redis logo
    Compared 23% of the time.
    Amazon MQ logo
    Compared 13% of the time.
    Anypoint MQ logo
    Compared 11% of the time.
    ActiveMQ logo
    Compared 8% of the time.
    Learn More
    Overview

    Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. SQS eliminates the complexity and overhead associated with managing and operating message oriented middleware, and empowers developers to focus on differentiating work. Using SQS, you can send, store, and receive messages between software components at any volume, without losing messages or requiring other services to be available. Get started with SQS in minutes using the AWS console, Command Line Interface or SDK of your choice, and three simple commands.

    SQS offers two types of message queues. Standard queues offer maximum throughput, best-effort ordering, and at-least-once delivery. SQS FIFO queues are designed to guarantee that messages are processed exactly once, in the exact order that they are sent.

    Apache Kafka is a highly regarded open-source, distributed event streaming platform and Message Queue (MQ) software solution that is valued and trusted worldwide by many of the top fortune 100 companies. It is considered one of the most reliable Message Queue (MQ) software solutions available in the marketplace today.

    Enterprise organizations rely on streaming platforms and MQ software solutions to process the continuous flow of high-performance data pipelines, mission-critical applications, and data integration. Apache Kafka makes it easy to process and distribute messages from one application to another from multiple environments with super-fast speeds and very high reliability.

    Additionally, in place of the usual command line processes regarding administration and management tasks, Apache Kafka supplies five exemplary core APIs for both Scala and Java:

    • Kafka Streams API can be used to facilitate stream processing applications and microservices. Input is seamlessly read from one or more topics and will initiate output to one or more topics, easily converting the input streams to output streams.
    • Kafka Connect API enables users to develop and run reusable data import/export connectors that are able to read and write streams of events from external operating systems and applications, making integration with Apache Kafka simple and streamlined.
    • Consumer API allows users to subscribe and read one or more topics and to process the stream of events produced to them.
    • Admin API gives users the ability to examine and manage brokers, topics, and various other Kafka topics.
    • Producer API using this core element, users are able to write and publish a stream of events to one or more Kafka topics.

    Apache Kafka Benefits

    Apache Kafka has many valuable benefits. Some of its most valuable benefits include:

    • Load Shifting
    • Scalability
    • Decoupling
    • High Throughput
    • High Availability
    • Safe Permanent Storage
    • Excellent Integration Capabilities
    • Large, Reliable, Open-Source Community
    • Mission Critical
    • Wide Array of Available Learning Opportunities

    Not only is Apache Kafka a robust messaging queue it is also a tremendously durable and reliable streaming platform that is fully capable of securely delivering more than one million messages per second, which amounts to trillions of success delivered messages in one day.

    Reviews from Real Users

    “From my experience with Apache Kafka, one of the most notable advantages is its ability to maintain a comprehensive record of historical data that includes every update, alteration, and version of information, unlike a conventional relational database. This feature allows for seamless tracking and analysis of the progression and transformation of the data over time, enabling users to easily review and analyze the history of the information.” Dimitrios Z., Enterprise Architect at Smals vzw

    “We are currently on a legacy version and have found that the latest version of Kafka has solved many of the issues we were facing, such as sequencing, memory management, and more. Additionally, the fact that it is open source is a major benefit.” Pratul S. Software Engineer at a financial services firm

    “The solution has improved our functionality; it's one of the best streaming platforms I've used.” Sreekar N., Co-Founder at Attaika

    Sample Customers
    EMS, NASA, BMW, Capital One
    Uber, Netflix, Activision, Spotify, Slack, Pinterest
    Top Industries
    REVIEWERS
    Financial Services Firm38%
    Manufacturing Company25%
    University13%
    Computer Software Company13%
    VISITORS READING REVIEWS
    Financial Services Firm19%
    Computer Software Company16%
    Manufacturing Company8%
    Comms Service Provider5%
    REVIEWERS
    Financial Services Firm26%
    Computer Software Company18%
    Retailer15%
    Manufacturing Company8%
    VISITORS READING REVIEWS
    Financial Services Firm29%
    Computer Software Company13%
    Manufacturing Company6%
    Retailer5%
    Company Size
    REVIEWERS
    Small Business27%
    Midsize Enterprise13%
    Large Enterprise60%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise13%
    Large Enterprise67%
    REVIEWERS
    Small Business35%
    Midsize Enterprise15%
    Large Enterprise51%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise11%
    Large Enterprise72%
    Buyer's Guide
    Amazon SQS vs. Apache Kafka
    May 2024
    Find out what your peers are saying about Amazon SQS vs. Apache Kafka and other solutions. Updated: May 2024.
    772,649 professionals have used our research since 2012.

    Amazon SQS is ranked 5th in Message Queue (MQ) Software with 13 reviews while Apache Kafka is ranked 1st in Message Queue (MQ) Software with 78 reviews. Amazon SQS is rated 8.2, while Apache Kafka is rated 8.0. The top reviewer of Amazon SQS writes "Stable, useful interface, and scales well". On the other hand, the top reviewer of Apache Kafka writes "Real-time processing and reliable for data integrity". Amazon SQS is most compared with Redis, Amazon MQ, Anypoint MQ, Oracle Event Hub Cloud Service and ActiveMQ, whereas Apache Kafka is most compared with IBM MQ, Red Hat AMQ, Anypoint MQ, PubSub+ Event Broker and VMware Tanzu Data Services. See our Amazon SQS vs. Apache Kafka report.

    See our list of best Message Queue (MQ) Software vendors.

    We monitor all Message Queue (MQ) Software reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.