That's still the consumer log, not the broker log.
Thanks,
Jun
On Wed, Sep 11, 2013 at 10:24 PM, prashant amar wrote:
> From the broker log:
>
>
> INFO Reconnect due to socket error: (kafka.consumer.SimpleConsumer)
> java.nio.channels.ClosedChannelException
> at kafka.network.BlockingChannel
I usually get this exception when I define > 2 partitions ..
Current configuration :
Single Topic - 4 partitions
1 Consumers Group - 10 Threads
On Wed, Sep 11, 2013 at 10:24 PM, prashant amar wrote:
> From the broker log:
>
>
> INFO Reconnect due to socket error: (kafka.consumer.SimpleCons
>From the broker log:
INFO Reconnect due to socket error: (kafka.consumer.SimpleConsumer)
java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:89)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:72)
at
kafka.consumer.SimpleConsu
This means the broker somehow closed the socket connection. Anything in the
broker log around the same time?
Thanks,
Jun
On Wed, Sep 11, 2013 at 6:07 PM, prashant amar wrote:
> Also noticed another issue
>
> Specified below is the current configuration
>
> Topic1 -> n Partitions -> 2 Consumer
Also noticed another issue
Specified below is the current configuration
Topic1 -> n Partitions -> 2 Consumer Groups (gr1 and gr2)
Topic2 -> n Partitions -> 2 Consumer Groups (gr1 and gr2)
Notice that I have used the same naming convention on the consumer group
set i.e. 'gr1' and 'gr2' are consum
I think you are hitting this -
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whysomeoftheconsumersinaconsumergroupneverreceiveanymessage%3F
Let us know if we can improve the documentation to make it clearer.
Thanks,
Neha
On Wed, Sep 11, 2013 at 5:28 PM, prashant amar wrote:
> Also
Also attempted another pattern where
1. Created a topic T with 'n' partitions.
2. Created a consumer group process with 'n + 1' threads subscribing from
topic 'T' with a groupID 'y'
3. Added another consumer group process with 'n + 1' threads subscribing
from same topic 'T' with same groupID 'z'
(
A Design Question that needs verification:
1. Created a topic T with 'n' partitions.
2. Created a consumer group process with 'n + 1' threads subscribing from
topic 'T' with a groupID 'y'
3. Added another consumer group process with 'n + 1' threads subscribing
from same topic 'T' with same groupID
