Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
I suggest you practice this thing in some dev or test environment before doing it to prod environment. And copy the data, Not move. On Tue, 18 Jul 2023 at 8:22 PM, sunil chaudhari wrote: > > Better you have a rollback plan. In case the new mountpount has some issue > then you should be able t

Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
Better you have a rollback plan. In case the new mountpount has some issue then you should be able to point to the old fs and restart the broker. On Tue, 18 Jul 2023 at 5:23 PM, Gaurav Pande wrote: > Okay and this process doesn't corrupt the files/file system right? > > And to perform this copy

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
Okay and this process doesn't corrupt the files/file system right? And to perform this copy activity do we need to stop Kafka broker as well? Regards, GP On Tue, 18 Jul, 2023, 16:24 sunil chaudhari, wrote: > Actually the broker refers to the base directory. > Example: > log.paths: /var/log/myk

Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
Actually the broker refers to the base directory. Example: log.paths: /var/log/mykafka/data/ then copy. /data/. to the new path completely and refer it in the server.properties On Tue, 18 Jul 2023 at 1:09 PM, Gaurav Pande wrote: > Okay so the data directory has some files like checkpoints, meta

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
Okay so the data directory has some files like checkpoints, meta.properties in existing file system all of these should also be copied to new disk/file system? Regards, GP On Tue, 18 Jul, 2023, 12:32 sunil chaudhari, wrote: > I think you can copy whole data directory to new one. I dont think th

Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
I think you can copy whole data directory to new one. I dont think there will be loss or corruption On Tue, 18 Jul 2023 at 12:20 PM, Gaurav Pande wrote: > Hi Guys, > > Any help on this query please. > > Regards, > GP > > On Mon, 17 Jul, 2023, 21:00 Gaurav Pande, wrote: > > > Hi Guys, > > > > I

Re: Kafka data directory Move without data loss

2023-07-17 Thread Gaurav Pande
Hi Guys, Any help on this query please. Regards, GP On Mon, 17 Jul, 2023, 21:00 Gaurav Pande, wrote: > Hi Guys, > > I have 3 node Kafka cluster running on version 2.7.0 . On one of the > broker out of three iam noticing data directory getting filled and broker > going down. > > Presently the d