Consumer poll stuck on

2019-03-20 Thread Manu Jacob
Hi, We have a Kafka cluster (version 1.1.1) where one node unexpectedly failed. After that consumers from a couple of consumers are stuck in the poll() API call. Looking at the thread dump, it looks like the consumer is stuck in org.apache.kafka.clients.consumer.internals.AbstractCoordinator.

Kafka connect FieldPartitioner with scheduled rotation

2019-02-03 Thread Manu Jacob
Hi, I want to use s3 connect by portioning with FieldPartitioner and partition.field.name set to a non timestamp based field. I want to commit and flush based on both size and time. I am getting an exception when I use the option "rotate.schedule.interval.ms". Is it possible to rotate it with