Re: Kafka compatibility between 2.2.x to 0.10.0.0

2020-07-25 Thread Vitalii Stoianov
Hi Xingxing Di, Are you going to upgrade clients from 0.10.0.0 to 2.2.x or clients + brokers ? 1. I think so, for more information on what incompatibilities clients may notice when working with an old broker please check this page: https://cwiki.apache.org/confluence/display/KAFKA/Compatibility+M

Re: kafka tuning(vm.max_map_count) and logs retention.

2020-07-23 Thread Vitalii Stoianov
Regards, Vitalii. On Thu, Jul 23, 2020 at 11:53 AM Vitalii Stoianov < vitalii.stoianov...@gmail.com> wrote: > Hi Alexandre, > > According to kafka broker logs it happens even faster each 5-30 sec. > > Regards, > Vitalii. > > On Thu, Jul 23, 2020 at 11:15 AM Al

Re: kafka tuning(vm.max_map_count) and logs retention.

2020-07-23 Thread Vitalii Stoianov
; a écrit : > > > > Hi Vitali, > > When I ran into it it was latest time being very large. Until we could > get > > the messages set right we set segment.ms to maxint so it only rolled > based > > on size. > > Cheers > > William > > > > On

Re: kafka tuning(vm.max_map_count) and logs retention.

2020-07-22 Thread Vitalii Stoianov
s well into the future so every few messages causes a log > roll and you end up with a very large amount of log files. > > *William* > > On Thu, 23 Jul 2020 at 16:22, Vitalii Stoianov < > vitalii.stoianov...@gmail.com> wrote: > > > Hi All, > > > > I also

Re: kafka tuning(vm.max_map_count) and logs retention.

2020-07-22 Thread Vitalii Stoianov
. On Wed, Jul 22, 2020 at 8:15 PM Vitalii Stoianov < vitalii.stoianov...@gmail.com> wrote: > Hi All, > > According to this: https://docs.confluent.io/current/kafka/deployment.html > vm.max_map_count is depend on number of index file: > *find /tmp/kafka_logs -name '*index

kafka tuning(vm.max_map_count) and logs retention.

2020-07-22 Thread Vitalii Stoianov
Hi All, According to this: https://docs.confluent.io/current/kafka/deployment.html vm.max_map_count is depend on number of index file: *find /tmp/kafka_logs -name '*index' | wc -l* In our test lab we have next setup: *Topic:test PartitionCount:256 ReplicationFactor:2 Configs:segment.by

Re: [EXTERNAL] Kafka upgrade from 0.10 to 2.3.x

2019-11-26 Thread Vitalii Stoianov
og format version. > > Thanks > > Get Outlook for Android<https://aka.ms/ghei36> > > > From: Vitalii Stoianov > Sent: Thursday, November 21, 2019 10:31:22 PM > To: users@kafka.apache.org > Subject: [EXTERNAL] Kafka upgrade from 0

Kafka upgrade from 0.10 to 2.3.x

2019-11-21 Thread Vitalii Stoianov
Hi All, All the docs that I was able to find describe the rolling upgrade. But I didn't find any docs that describe how to perform no-rolling upgrade. So if system can afford downtime how in this case to upgrade kafka form version 0.10.0 to 2.3.x. Is it still required to do few restarts or we can

Kafka EOL policy question.

2019-10-30 Thread Vitalii Stoianov
Hi All, I'm trying to understand Kafka EOL policy. As stated in https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan *"""* *What Is Our EOL Policy?Given 3 releases a year and the fact that no one upgrades three times a year, we propose making sure (by testing!) that rollin