* Wednesday, March 30, 2022 4:44 AM
> *To:* Paul, Souvik [Engineering]
> *Cc:* dev@spark.apache.org
> *Subject:* Re: Probable bug in async commit of Kafka offset in
> DirectKafkaInputDStream
>
>
>
> Hi, Souvik
>
>
>
> Could you file a JIRA issue for that?
>
>
>
Hi Dongjoon,
Raised the JIRA at https://issues.apache.org/jira/browse/SPARK-38824
Thanks,
Souvik
From: Dongjoon Hyun
Sent: Wednesday, March 30, 2022 4:44 AM
To: Paul, Souvik [Engineering]
Cc: dev@spark.apache.org
Subject: Re: Probable bug in async commit of Kafka offset in
Hi, Souvik
Could you file a JIRA issue for that?
Thanks,
Dongjoon
On Thu, Mar 24, 2022 at 11:08 AM Paul, Souvik wrote:
> Hi Dev,
>
> I added a few debug statements at the following lines and found few issues.
>
> 1. At line 254 of override def compute(validTime: Time):
> Option[KafkaRDD[K, V]]
Hi Dev,
I added a few debug statements at the following lines and found few issues.
1. At line 254 of override def compute(validTime: Time): Option[KafkaRDD[K, V]]
in DirectKafkaInputDStream.scala:
System.out.print("Called commitAll at time " + validTime + " " +
commitQu
