Thanks Peter,
I’ll check the logs next week and let you know my findings. 
Many Thanks 
Chris 

> On 16 Sep 2022, at 7:45 am, Peter Bukowinski <pmb...@gmail.com> wrote:
> 
> The next thing I’d check is the broker logs. The parameters read from the 
> config should appear in the logs when kafka starts up. Search the logs for 
> ‘log.dirs’ and ensure the correct configs are loaded.
> 
> --
> Peter
> 
>> On Sep 15, 2022, at 11:10 PM, Chris Peart <ch...@peart.me.uk> wrote:
>> 
>> Hi Peter,
>> 
>> Thanks for your response, we have the following configuration:
>> 
>> Partition count=4
>> Replication factor=3
>> 
>> All four brokers have topics-partitions in /data/1/kafka/data and are 
>> receiving data. 
>> 
>> Each server has 6 x 2TB disks for kaka data. 
>> 
>> Many Thanks,
>> Chris
>> 
>>>> On 16 Sep 2022, at 1:56 am, Peter Bukowinski <pmb...@gmail.com> wrote:
>>> 
>>> Hi Chris,
>>> 
>>> Can you share the partition count and replication factor of your 
>>> partitions? Also, do all four brokers contain topic-partition directories 
>>> in /data/1/kafka/data or just a single broker? Depending on your topic 
>>> config, it may be entirely normal that his has happened.
>>> 
>>> 
>>> —
>>> Peter Bukowinski 
>>> 
>>>>> On Sep 15, 2022, at 3:35 AM, Chris Peart <ch...@peart.me.uk> wrote:
>>>> 
>>>> 
>>>> 
>>>> Hi All,
>>>> 
>>>> I have a 4 node kafka cluster running version 2.8.1, we have started 
>>>> pushing data to the cluster but can only see one disk being used.
>>>> 
>>>> We had 6 disk configured as non-raid and 1 partition per disk, we have the 
>>>> following in fstab:
>>>> 
>>>> /dev/mapper/VolGroup01-data    /data/1    xfs    nodev,noatime,nofail  1  2
>>>> 
>>>> /dev/mapper/VolGroup02-data    /data/2   xfs    nodev,noatime,nofail  1  2
>>>> 
>>>> /dev/mapper/VolGroup03-data    /data/3    xfs    nodev,noatime,nofail  1  2
>>>> 
>>>> /dev/mapper/VolGroup04-data    /data/4    xfs    nodev,noatime,nofail  1  2
>>>> 
>>>> /dev/mapper/VolGroup05-data    /data/5    xfs    nodev,noatime,nofail  1  2
>>>> 
>>>> /dev/mapper/VolGroup06-data    /data/6    xfs    nodev,noatime,nofail  1  2
>>>> 
>>>> We configured server.properties to be: 
>>>> log.dirs=/data/1/kafka/data,/data/2/kafka/data,/data/3/kafka/data,/data/4/kafka/data,/data/5/kafka/data,/data/6/kafka/data
>>>> 
>>>> i can see all our topics in /data/1/kafka/data but don't see anything in 
>>>> /data/2-5
>>>> 
>>>> Any help would be appreciated as this is going to production next week?
>>>> 
>>>> Many Thanks,
>>>> 
>>>> Chris
>>> 
>> 

Reply via email to