S Ahmed, This combination of Kafka and Storm to process streaming data is becoming pretty common. Definitely worth looking at.
The throughput will vary depending on your workload (cpu usage, etc.) and if you're talking to a backend, of course. But it scales very well. -Suren On Mon, Dec 2, 2013 at 5:49 PM, S Ahmed <sahmed1...@gmail.com> wrote: > Interesting. So twitter storm is used to basically process the messages on > kafka? I'll have to read-up on storm b/c I always thought the use case > was a bit different. > > > > On Sun, Dec 1, 2013 at 9:59 PM, Joe Stein <joe.st...@stealth.ly> wrote: > > > Awesome Philip, thanks for sharing! > > > > On Sun, Dec 1, 2013 at 9:17 PM, Philip O'Toole <phi...@loggly.com> > wrote: > > > > > A couple of us here at Loggly recently spoke at AWS reinvent, on how we > > > use Kafka 0.72 in our ingestion pipeline. The slides are at the link > > below, > > > and may be of interest to people on this list. > > > > > > > > > > > > http://www.slideshare.net/AmazonWebServices/infrastructure-at-scale-apache-kafka-twitter-storm-elastic-search-arc303-aws-reinvent-2013 > > > > > > Any questions, let me know, though I can't promise I can answer > > > everything. Can't give the complete game away. :-) > > > > > > As always, Kafka rocks! > > > > > > Philip > > > > > > > > > > > > > > > -- ___________________________________________ Available at these partners: [image: CloudFlare | shopify | Bigcommerce] SUREN HIRAMAN, VP TECHNOLOGY SOCIOCAST Simple. Powerful. Predictions. 96 SPRING STREET, 7TH FLOOR NEW YORK, NY 10012 O: (917) 525-2466 ext. 105 F: 646.349.4063 E: suren.hira...@sociocast.com W: www.sociocast.com Increase Conversion Rates up to 500%. Go to www.sociocast.com and enter your URL for a free trial!
