Re: Kafka Streams and AWS IOPS Credits

2017-05-24 Thread Guozhang Wang
Thanks for sharing Ian! Guozhang On Wed, May 24, 2017 at 3:49 AM, Damian Guy wrote: > Thanks for reporting back Ian. Very useful information. > > Cheers, > Damian > > On Wed, 24 May 2017 at 10:40 Ian Duffy wrote: > > > Hi All, > > > > In the past, we experienced lots of problems with running K

Re: Kafka Streams and AWS IOPS Credits

2017-05-24 Thread Damian Guy
Thanks for reporting back Ian. Very useful information. Cheers, Damian On Wed, 24 May 2017 at 10:40 Ian Duffy wrote: > Hi All, > > In the past, we experienced lots of problems with running Kafka Stream > Applications on AWS. > > We've seen issues with state locking, memory spiking to 100% and t

Kafka Streams and AWS IOPS Credits

2017-05-24 Thread Ian Duffy
Hi All, In the past, we experienced lots of problems with running Kafka Stream Applications on AWS. We've seen issues with state locking, memory spiking to 100% and the instance dying, very slow startup on pulling down initial rocksdbs and so on Today we realised that the instances were expe