Ante B. created KAFKA-8858:
------------------------------
Summary: Kafka Streams - Failed to Rebalance Error and stream
consumer stuck for some reason
Key: KAFKA-8858
URL: https://issues.apache.org/jira/browse/KAFKA-8858
Project: Kafka
Issue Type: Bug
Environment: Apache Kakfa 2.1.1
Reporter: Ante B.
I have a basic Kafka Streams application that reads from a {{topic}}, performs
a rolling aggregate, and performs a join to publish to an {{agg_topic}}. Our
project has the timeout failure after we upgrade to Kafka 2.1.1, and we don't
know the reason yet.
Our stream consumer stuck for some reason.
After we changed our group id to another one it became normal. So seems offset
data for this consumer is corrupted.
Can you help us please to resolve this problem to be able to revert us to the
previous consumer name because we have many inconveniences due to this.
Ping me pls if you will need some additional info.
Our temporary workaround is to disable the {{exactly_once}} config which skips
the initializing transactional state. Also offset reseted for corrupted
partition, with no effect.
Full problem description in log:
{code:java}
[2019-08-30 14:20:02.168] [abc-streamer-StreamThread-21] ERROR
org.apache.kafka.streams.processor.internals.StreamThread:273 - stream-thread
[fds-streamer-StreamThread-21] Error caught during partition assignment, will
abort the current process and re-throw at the end of rebalance: {}
org.apache.kafka.common.errors.TimeoutException: Timeout expired while
initializing transactional state in 60000ms.
[2019-08-30 14:21:35.407] [abc-streamer-StreamThread-14] ERROR
org.apache.kafka.streams.processor.internals.StreamThread:273 - stream-thread
[fds-streamer-StreamThread-14] Error caught during partition assignment, will
abort the current process and re-throw at the end of rebalance: {}
org.apache.kafka.common.errors.TimeoutException: Timeout expired while
initializing transactional state in 60000ms.
[2019-08-30 14:22:58.487] [abc-streamer-StreamThread-13] ERROR
org.apache.kafka.streams.processor.internals.StreamThread:273 - stream-thread
[fds-streamer-StreamThread-13] Error caught during partition assignment, will
abort the current process and re-throw at the end of rebalance: {}
org.apache.kafka.common.errors.TimeoutException: Timeout expired while
initializing transactional state in 60000ms.
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
