Re: Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-05-02 Thread Fares Oueslati
afterwards. Thanks a lot! Fares On Fri, Apr 29, 2022 at 3:24 AM Fares Oueslati wrote: > Thanks for your help! > > I'm not sure how that would help me though. I'm not actually trying to > decommission a Kafka broker. > I would like to move all the data from one disk (log

Re: Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-04-28 Thread Fares Oueslati
60) to > replay the case . > > On Thu, Apr 28, 2022 at 10:33 PM Fares Oueslati > wrote: > >> Hello, >> >> I'm not sure how to report this properly but I didn't get any answer in >> the >> user mailing list. >> >> In order to remo

Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-04-28 Thread Fares Oueslati
ommand, is it possible to create a JIRA to track and eventually fix this? The only option I see to fix it is to keep the modification date before moving the data and applying it manually afterwards for every segment file, touching those files manually doesn't seem very safe imho. Thanks Fares Oueslati

Topics naming convention

2020-04-06 Thread Fares Oueslati
Hello, I'm here to get some advice regarding Kafka topics naming. If I name my topic "users" and I publish Avro events with a schema registry using a given compatibility mode. One day, due to business reasons, I have to break my schema, what would you do? add a new topic (let's call it "users-v1

Re: Question about log flusher real frequency

2020-03-09 Thread Fares Oueslati
ctly *when* your data is on the disk? > > [1] https://www.kernel.org/doc/Documentation/sysctl/vm.txt > > Le lun. 9 mars 2020 à 15:58, Fares Oueslati a > écrit : > > > > Hello, > > > > By default, both log.flush.interval.ms and log.flush.interval.messages >

Question about log flusher real frequency

2020-03-09 Thread Fares Oueslati
Hello, By default, both log.flush.interval.ms and log.flush.interval.messages are set to Long.MAX_VALUE. As I understand, it makes Kafka flush log to disk (fsync) only depends on file system. Is there any simple way to monitor that frequency ? Is there a rule of thumb to estimate that value dep

Re: Mistake in official documentation ?

2020-02-06 Thread Fares Oueslati
ailing list will allow it to be attached. > > It could very well be a mistake. highlight it and send it to > dev@kafka.apache.org and if it is, we'll make a ticket and address it. > > On Thu, Feb 6, 2020 at 10:53 AM Fares Oueslati > wrote: > > > Hello, > > &g

Mistake in official documentation ?

2020-02-06 Thread Fares Oueslati
Hello, While going through the official docs https://kafka.apache.org/documentation/#messageformat If I'm not wrong, I believe there is a mismatch between description of a segment and the diagram illustrating the concept. I pointed out the issue in the attached screenshot. Didn't really know wh