Re: Hybrid Source stop processing files after processing 128 SourceFactories

ira/browse/FLINK-27479>?* > > > > And thanks for the original fix. > > > > *From: *Mason Chen > *Date: *Tuesday, July 26, 2022 at 9:57 PM > *To: *Benenson, Michael > *Cc: *user@flink.apache.org , Deshpande, Omkar < > omkar_deshpa...@intuit.com>, Rosenswe

Re: Hybrid Source stop processing files after processing 128 SourceFactories

To: Benenson, Michael Cc: user@flink.apache.org , Deshpande, Omkar , Rosensweig, JD , Sana, Harish Subject: Re: Hybrid Source stop processing files after processing 128 SourceFactories This email is from an external sender. Hi Michael, I'm glad the CPU fix works for you! Regardin

Re: Hybrid Source stop processing files after processing 128 SourceFactories

Hi Michael, I'm glad the CPU fix works for you! Regarding the behavior, HybridSource should only consume from Kafka after it finishes the bounded read of the files. At that time, files will not be read anymore. In addition, there is no limitation where there can only be 128 source factories (the

Hybrid Source stop processing files after processing 128 SourceFactories

Hi, folks I have tried fix FLINK-27479 for Hybrid Source from https://github.com/apache/flink/pull/20215 in Flink 14.3 It works fine, but Flink stops processing files after processing 128 SourceFactories. I have run this program a few times, s