EMR is a product optimized for elastic scaling of clusters - using amazon's pre-defined AMIs. Hadoop and Spark work well on this, but not so much Kafka, which isn't so easy to automatically add/remove nodes from. The best bet is still to use EC2 with your own Kafka AMIs or predefined third party ones. Take a look at the AWS Cloudformation product for a handy way to manage a cluster of EC2 images.
On Sun, Jul 10, 2016 at 7:49 PM, Snehalata Nagaje < snehalata.nag...@harbingergroup.com> wrote: > > > > Though it has nothing to do map reduce, I was referingto EMR machines vs > EC2 instance on amaozone? > > We an install other application on aws emr apart from what AWS provides, > isn't it right? > > ----- Original Message ----- > From: r...@chartbeat.com > To: users@kafka.apache.org > Sent: Sunday, July 10, 2016 9:25:30 PM > Subject: Re: Kafka on AWs EMR > > Kafka is in no way related to map reduce, this doesn't really make any > sense. You could have consumers running in Hadoop listening to Kafka topics > - see the Samza project. > > > On Jul 10, 2016, at 11:16 AM, Snehalata Nagaje < > snehalata.nag...@harbingergroup.com> wrote: > > > > > > > > Hi All, > > > > > > I wanted to setup kafka on AWS EMR? > > > > But I could not find any documentation. Can you please help me on this? > > > > Thanks, > > Snehalata >
