Re: [VOTE] 2.0.0 RC0

2018-06-25 Thread Thomas Crayford
+1 (non-binding) Heroku has run our usual set of upgrade and performance tests, and we haven't found any notable issues through that. On Sat, Jun 23, 2018 at 12:30 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > +1 (non-binding) > > Built from source and ran quickstart successfully on

Re: Running kafka in containers

2018-03-22 Thread Thomas Crayford
We (heroku) have run databases in containers since 2012, and kafka works just as well as everything else. So: yes

Re: Kafka in virtualized environments

2017-11-30 Thread Thomas Crayford
We run many thousands of clusters on EC2 without notable issues, and achieve great performance there. The real thing that matters is how good your virtualization layer is and how much of a performance impact it has. E.g. in modern EC2, the performance overhead of using virtualized IO is around 1-5%

Re: Kafka JVM heap limit

2017-11-08 Thread Thomas Crayford
Hi there, There are some cases you may want to consider bigger heaps. Heroku runs some clusters with 20GB heaps now, because said clusters: 1. Use SSL exclusively for connectivity. SSL means message bytes traverse the JVM heap during encryption/etc, which uses more memory 2. Have a high number of

Re: [VOTE] 1.0.0 RC1

2017-10-17 Thread Thomas Crayford
Hi Ghouzang, We have indeed started our performance testing at Heroku for RC1. However, we are more than happy to retest once RC2 is available, especially given larger amounts of time to do so. Thanks Tom Crayford Heroku Kafka On Tue, Oct 17, 2017 at 2:50 AM, Ismael Juma wrote: > If you don't

Re: [VOTE] 1.0.0 RC1

2017-10-16 Thread Thomas Crayford
Hi Guozhang, This says the due date on the testing is October 13th, which was the day this email was sent. Is that accurate, or is it meant to read October 17th, which is next Tuesday? I feel like this short a testing window for a 1.0 RC is a little low, as 1.0 is clearly a big announcement of st

Re: Kafka 0.11.0.0

2017-08-14 Thread Thomas Crayford
0.11.0.0 is a brand new release, with a very large number of changes compared to the previous stable release (0.10.2.1). As a thing that stores data, I would not recommend you switch to it without a very large amount of testing and validation, probably involving running a shadow setup of your produ