Hi,
I have a system that needs to process tens of thousands of user events per
second.
I've looked at both Kafka and Amazon SNS.
Using SNS would mean I can avoid the operational overhead of maintaining
Kafka and Zookeeper installations and monitoring. I also wouldn't need to
worry about storage
I have a lot of user event data being sent to an apache web server and
written to web logs. Unfortunately I don't control this flow, but do I have
access to the server the logs are being written to.
I need a way to access these events as soon as they have been written to
the log file and send this