HA: how to control assign policy for consumers

2014-05-30 Thread Рябков Алексей Николаевич
Well for my task you are right... I just need to make sure that a producer would connect to as few brokers as possible, and to achieve this you just needs to know the partition assignment map, which exist on any broker's metadata cache But if we try (for example) to rebalance the hole syste

HA: how to control assign policy for consumers

2014-05-29 Thread Рябков Алексей Николаевич
Well may be yes and may no I think that in design we must point out that co-ordinator also must analize connection graph and must map consumers to broker with minimal network overhead... -Исходное сообщение- От: Guozhang Wang [mailto:wangg...@gmail.com] Отправлено: Thursday, May

HA: how to control assign policy for consumers

2014-05-29 Thread Рябков Алексей Николаевич
May be right place to add such optimization within https://cwiki.apache.org/confluence/display/KAFKA/Hierarchical+Topics ? -Исходное сообщение- От: Guozhang Wang [mailto:wangg...@gmail.com] Отправлено: Wednesday, May 28, 2014 8:57 PM Кому: users@kafka.apache.org Тема: Re: how to control