Yes, the leaders are currently speed evenly across five brokers. I also see the
FetchRequestPurgatory.PurgatorySize to be peak as high as ~7.2M and the
suddenly dropping to a couple hundred thousands.
Thanks
Zakee
> On Mar 13, 2015, at 5:27 PM, Joel Koshy <jjkosh...@gmail.com> wrote:
>
> Can you verify that the leaders are evenly spread? and if necessary
> run a preferred leader election?
>
> On Fri, Mar 13, 2015 at 05:10:22PM -0700, Zakee wrote:
>> I have 35 topics spread with total 398 partitions (2 of them are supposed to
>> be very high volume and so allocated 28 partitions to them, others vary
>> between 5 to 14).
>>
>> Thanks
>> Zakee
>>
>>
>>
>>> On Mar 13, 2015, at 3:25 PM, Joel Koshy <jjkosh...@gmail.com> wrote:
>>>
>>> I think what people have observed in the past is that increasing
>>> num-replica-fetcher-threads has diminishing returns fairly quickly.
>>> You may want to instead increase the number of partitions in the topic
>>> you are producing to. (How many do you have right now?)
>>>
>>> On Fri, Mar 13, 2015 at 02:48:17PM -0700, Zakee wrote:
>>>> Hi Mayuresh,
>>>>
>>>> I have currently set this property to 4 and I see from the logs that it
>>>> starts 12 threads on each broker. I will try increasing it further.
>>>>
>>>> Thanks
>>>> Zakee
>>>>
>>>>
>>>>
>>>>> On Mar 13, 2015, at 11:53 AM, Mayuresh Gharat
>>>>> <gharatmayures...@gmail.com> wrote:
>>>>>
>>>>> You might want to increase the number of Replica Fetcher threads by
>>>>> setting
>>>>> this property : *num.replica.fetchers*.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Mayuresh
>>>>>
>>>>> On Thu, Mar 12, 2015 at 10:39 PM, Zakee <kzak...@netzero.net> wrote:
>>>>>
>>>>>> With the producer throughput as large as > 150MB/s to 5 brokers on a
>>>>>> continuous basis, I see a consistently high value for Replica Max Lag (in
>>>>>> millions). Is this normal or there is a way to tune so as to reduce
>>>>>> replica
>>>>>> MaxLag?
>>>>>> As per documentation, replica max lag (in messages) between follower and
>>>>>> leader replicas, should be less than replica.lag.max.messages (currently
>>>>>> set to 5000)
>>>>>>
>>>>>>
>>>>>> Thanks
>>>>>> Zakee
>>>>>>
>>>>>>
>>>>>>
>>>>>> ____________________________________________________________
>>>>>> Old School Yearbook Pics
>>>>>> View Class Yearbooks Online Free. Search by School & Year. Look Now!
>>>>>> http://thirdpartyoffers.netzero.net/TGL3231/550278012ef8378006048st04duc
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> -Regards,
>>>>> Mayuresh R. Gharat
>>>>> (862) 250-7125
>>>>> ____________________________________________________________
>>>>> What's your flood risk?
>>>>> Find flood maps, interactive tools, FAQs, and agents in your area.
>>>>> http://thirdpartyoffers.netzero.net/TGL3255/550336d785c4236d61d0cmp05duc
>>>>
>>>
>>> ____________________________________________________________
>>> The WORST exercise for aging
>>> Avoid this "healthy" exercise to look & feel 5-10 years YOUNGER
>>> http://thirdpartyoffers.netzero.net/TGL3255/550371f12e6ab71f1228amp01duc
>>>
>>
>
> ____________________________________________________________
> 5 WORST exercises for aging
> Avoid these 5 exercises if you want to look and feel 5-10 years YOUNGER
> http://thirdpartyoffers.netzero.net/TGL3255/5503813f7c2f313e64c2mp13duc
>
