Hi, I have a system that needs to process tens of thousands of user events per second.
I've looked at both Kafka and Amazon SNS. Using SNS would mean I can avoid the operational overhead of maintaining Kafka and Zookeeper installations and monitoring. I also wouldn't need to worry about storage and network infrastructure. On the other hand, SNS could be very costly, particularly since I must also use SQS to persist messages until consumed. Has anyone else considered using Amazon SNS instead of Kafka? I would be interested to hear people's opinions on both. Thanks, James