Thanks Peter, I’ll check the logs next week and let you know my findings. Many Thanks Chris
> On 16 Sep 2022, at 7:45 am, Peter Bukowinski <pmb...@gmail.com> wrote: > > The next thing I’d check is the broker logs. The parameters read from the > config should appear in the logs when kafka starts up. Search the logs for > ‘log.dirs’ and ensure the correct configs are loaded. > > -- > Peter > >> On Sep 15, 2022, at 11:10 PM, Chris Peart <ch...@peart.me.uk> wrote: >> >> Hi Peter, >> >> Thanks for your response, we have the following configuration: >> >> Partition count=4 >> Replication factor=3 >> >> All four brokers have topics-partitions in /data/1/kafka/data and are >> receiving data. >> >> Each server has 6 x 2TB disks for kaka data. >> >> Many Thanks, >> Chris >> >>>> On 16 Sep 2022, at 1:56 am, Peter Bukowinski <pmb...@gmail.com> wrote: >>> >>> Hi Chris, >>> >>> Can you share the partition count and replication factor of your >>> partitions? Also, do all four brokers contain topic-partition directories >>> in /data/1/kafka/data or just a single broker? Depending on your topic >>> config, it may be entirely normal that his has happened. >>> >>> >>> — >>> Peter Bukowinski >>> >>>>> On Sep 15, 2022, at 3:35 AM, Chris Peart <ch...@peart.me.uk> wrote: >>>> >>>> >>>> >>>> Hi All, >>>> >>>> I have a 4 node kafka cluster running version 2.8.1, we have started >>>> pushing data to the cluster but can only see one disk being used. >>>> >>>> We had 6 disk configured as non-raid and 1 partition per disk, we have the >>>> following in fstab: >>>> >>>> /dev/mapper/VolGroup01-data /data/1 xfs nodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup02-data /data/2 xfs nodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup03-data /data/3 xfs nodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup04-data /data/4 xfs nodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup05-data /data/5 xfs nodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup06-data /data/6 xfs nodev,noatime,nofail 1 2 >>>> >>>> We configured server.properties to be: >>>> log.dirs=/data/1/kafka/data,/data/2/kafka/data,/data/3/kafka/data,/data/4/kafka/data,/data/5/kafka/data,/data/6/kafka/data >>>> >>>> i can see all our topics in /data/1/kafka/data but don't see anything in >>>> /data/2-5 >>>> >>>> Any help would be appreciated as this is going to production next week? >>>> >>>> Many Thanks, >>>> >>>> Chris >>> >>
