xiaochen-zhou commented on code in PR #9598:
URL: https://github.com/apache/seatunnel/pull/9598#discussion_r2241315665
##########
docs/en/connector-v2/source/Kafka.md:
##########
@@ -54,6 +54,7 @@ They can be downloaded via install-plugin.sh or from the
Maven central repositor
| start_mode.timestamp | Long
| No | - | The
time required for consumption mode to be "timestamp".
|
| start_mode.end_timestamp | Long
| No | - |
The end time required for consumption mode to be "timestamp" in batch mode
| partition-discovery.interval-millis | Long
| No | -1 | The
interval for dynamically discovering topics and partitions.
|
+| ignore_no_leader_partition | Boolean
| No | false |
Whether to ignore partitions that have no leader. If set to true, partitions
without a leader will be skipped during partition discovery. If set to false
(default), the connector will include all partitions regardless of leader
status. This is useful when dealing with Kafka clusters that may have temporary
leadership issues.
|
Review Comment:
> we
We need to configure the `partition-discovery.interval-millis` parameter to
allow automatic recovery of read and write operations once the partition is
restored.
When `ignore_no_leader_partition` is set to true, newly discovered
partitions with leader = -1 (unavailable partitions) will be filtered out to
avoid task failures. After the partitions are restored, the dynamic partition
discovery mechanism will automatically detect and include these restored
partitions, making them available for use.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
