to skip over the uncommitted
records from the previous poll.
Martin
On 31 March 2016 at 16:10, Martin Skøtt
wrote:
> We have recently had great success with committing records in smaller
> batches between poll()'s. Something along these lines:
>
> records = consumer.pol
We have recently had great success with committing records in smaller
batches between poll()'s. Something along these lines:
records = consumer.poll()
foreach record:
process record
On 31 March 2016 at 12:13, Daniel Fanjul
wrote:
> Hi all,
>
> My problem: If the consumer fetches too much da
Hi,
Regarding item 1, the maximum can be configured in the broker by changing
group.max.session.timeout.ms.
Regards,
Martin
On 2 March 2016 at 15:09, Gligor Vanessa wrote:
> Hello,
>
> I am using Kafka higher consumer 0.9.0. I am not using the auto commit for
> the offsets, so after I consume t
> in case we later changed the logic to only permit commits on assigned
partitions
I experienced this yesterday and was wondering why Kafka allows commits to
partitions from other consumers than the assigned one. Does any one know of
the reasoning behind this?
Martin
On 5 Jan 2016 18:29, "Jason G
ion timeout is expiring.
> This shouldn't happen unless there is a delay between successive calls to
> poll which is longer than the session timeout. It might help if you include
> a snippet of your poll loop and your configuration (i.e. any overridden
> settings).
>
> -Jas
oblem remained, but less frequent
Not really sure what is going on, but happy that the problem went away :-)
Martin
On 30 November 2015 at 15:33, Martin Skøtt
wrote:
> Hi Guozhang,
>
> I have done some testing with various values of heartbeat.interval.ms and
> they don't seem to
; if this issue goes away.
>
> At the same time, we have some better error handling fixes in trunk which
> will be included in the next point release.
>
> https://issues.apache.org/jira/browse/KAFKA-2860
>
> Guozhang
>
>
>
> On Wed, Nov 25, 2015 at 6:54 AM, Martin
ibution. I have 13 topics
with two partitions each and a replication factor of 1. I run one producer
and once consumer also on the same machine.
--
Martin Skøtt
8 November 2015 at 19:16, Guozhang Wang wrote:
> Hello Martin,
>
> Could you paste the consumer config values in this thread as well? And is
> the consumer co-located with the broker?
>
> Guozhang
>
> On Wed, Nov 18, 2015 at 7:40 AM, Martin Skøtt <
> martin.sko...@f
va:861)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:829)
Does anyone have any input on what might be happening?
--
Martin Skøtt
10 matches
Mail list logo
