If you’re on the AWS bandwagon, you can use Kinesis-Analytics (https://aws.amazon.com/kinesis/analytics/). It’s very easy to use. Kafka is a bit more flexible, but you have to instrument maintain it. You may also want to look at Druid: http://druid.io/ There are some dashboards that you can attach to it. I personally preferred this one: https://docs.imply.io/pivot/index
On 9/27/17, 7:30 PM, "Parth Patel" <ppat...@stevens.edu> wrote: Hi, This is to know more about Kafka and how i can use it in my project. I am trying to learn about Big Data Engineering and came across Kafka. I am trying to develop an application which could take some real time data, filter it and show some visual outputs and would like to know where Kafka could fit and what other technologies should i use. I was thinking about using Spark, Python, Google Cloud. Any help regarding this would be great. Thanks, Parth Patel