[
https://issues.apache.org/jira/browse/BEAM-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754706#comment-16754706
]
Jozef Vilcek commented on BEAM-6466:
------------------------------------
Yes, I agree it can be different ticket. Just wanted to say this out loud. This
ticket was created as someone is trying to use KafkaIO in batch mode through
it's API such as `commitOffsetsInFinalize()` and `withMaxNumRecords()`. It is
important to know that even if this ticket is fixed, one can still be loosing
data with this use case.
> KafkaIO doesn't commit offsets while being used as bounded source
> -----------------------------------------------------------------
>
> Key: BEAM-6466
> URL: https://issues.apache.org/jira/browse/BEAM-6466
> Project: Beam
> Issue Type: Bug
> Components: io-java-kafka
> Affects Versions: 2.9.0
> Reporter: Alexey Romanenko
> Priority: Major
>
> While using KafkaIO as bounded source (with {{withMaxReadTime()}} or
> {{withMaxNumRecords()}}) it seems doesn't commit offsets all the time.
> See the details in [the
> discussion|https://lists.apache.org/thread.html/bcec8a1fb166029a4adf3f3491c407d49843406020b20f203ec3c2d2@%3Cuser.beam.apache.org%3E]
> on user@list.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)