Hi, I'd like FLINK-20079 [1] to be merged into 1.11 and included in 1.11.3.
[1] https://issues.apache.org/jira/browse/FLINK-20079 Regards, Roman On Tue, Nov 10, 2020 at 8:21 AM Xintong Song <tonysong...@gmail.com> wrote: > Thanks for the notice, Dian. > > Thank you~ > > Xintong Song > > > > On Tue, Nov 10, 2020 at 10:19 AM Dian Fu <dian0511...@gmail.com> wrote: > > > Hi Xintong, > > > > I want to bring one more issue to your attention [1]. The test case > > UnalignedCheckpointCompatibilityITCase.test failed several times in the > > last nightly test of release-1.11. We need to figure out if it's just an > > instable test or caused by recent changes. > > > > [1] https://issues.apache.org/jira/browse/FLINK-20065 > > > > > 在 2020年11月10日，上午9:24，Xintong Song <tonysong...@gmail.com> 写道： > > > > > > Thanks for the replies. > > > > > > Thank you~ > > > > > > Xintong Song > > > > > > > > > > > > On Tue, Nov 10, 2020 at 1:09 AM Becket Qin <becket....@gmail.com> > wrote: > > > > > >> Hi Xintong, > > >> > > >> Thanks for driving the release. Just want to sync up on the FLIP-27 > > >> backporting. Stephan and I are still trying to backport a bunch of > > patches > > >> of Source to 1.11.3. Including: > > >> > > >> [FLINK-19698][connector/common] Add a close() method to the > SplitReader. > > >> [FLINK-19717] SourceReaderBase.pollNext may return END_OF_INPUT if > > >> SplitReader.fetch throws > > >> [FLINK-19535] [connector/common] Avoid failing a job multiple times in > > >> SourceCoordinator. > > >> [FLINK-19265] [FLINK-20049][core] Source API final adjustments. > > >> > > >> and a few more fixes. > > >> > > >> We are currently trying to fix them in 1.12 first so it might take a > > little > > >> longer to backport them to 1.11.3. I think it will probably take us a > > few > > >> more days to finish the backport. So that would roughly be the end of > > this > > >> week. > > >> > > >> Thanks, > > >> > > >> Jiangjie (Becket) Qin > > >> > > >> > > >> > > >> > > >> On Mon, Nov 9, 2020 at 9:57 PM Till Rohrmann <trohrm...@apache.org> > > wrote: > > >> > > >>> Yes, I've downgraded FLINK-19816 to critical. > > >>> > > >>> Cheers, > > >>> Till > > >>> > > >>> On Mon, Nov 9, 2020 at 10:19 AM Xintong Song <tonysong...@gmail.com> > > >>> wrote: > > >>> > > >>>> Thanks for the notice, Till. > > >>>> > > >>>> I just checked and found FLINK-20033 is already fixed. Shall we also > > >>>> downgrade FLINK-19816 to `Critical`? > > >>>> > > >>>> Thank you~ > > >>>> > > >>>> Xintong Song > > >>>> > > >>>> > > >>>> > > >>>> On Mon, Nov 9, 2020 at 4:42 PM Till Rohrmann <trohrm...@apache.org> > > >>> wrote: > > >>>> > > >>>>> I would like to bring one more critical issue to your attention > which > > >>> is > > >>>>> FLINK-20033 [1]. I believe that this issue is actually causing what > > >> has > > >>>>> been reported in FLINK-19816 [2]. I hope to have it fixed by the > end > > >> of > > >>>>> today. Once FLINK-20033 is fixed, I think that we don't have to > block > > >>> the > > >>>>> release on FLINK-19816. > > >>>>> > > >>>>> [1] https://issues.apache.org/jira/browse/FLINK-20033 > > >>>>> [2] https://issues.apache.org/jira/browse/FLINK-19816 > > >>>>> > > >>>>> Cheers, > > >>>>> Till > > >>>>> > > >>>>> On Mon, Nov 9, 2020 at 4:05 AM Xintong Song <tonysong...@gmail.com > > > > >>>> wrote: > > >>>>> > > >>>>>> Hi devs, > > >>>>>> > > >>>>>> I'd like to provide an update on the progress of preparing release > > >>>>> 1.11.3. > > >>>>>> > > >>>>>> *Blockers* > > >>>>>> We currently have 3 remaining blockers. (3 resolved and 1 emerged > > >>>>> compared > > >>>>>> to last week) > > >>>>>> > > >>>>>> - [FLINK-19698] Add close() method and onCheckpointComplete() to > > >> the > > >>>>>> Source. > > >>>>>> The issue has been fixed on the master branch. It's currently > > >> blocked > > >>>> on > > >>>>>> the FLIP-27 backportings to backport it to the 1.11 branch. > > >>>>>> > > >>>>>> - [FLINK-19717] SourceReaderBase.pollNext may return END_OF_INPUT > > >> if > > >>>>>> SplitReader.fetch throws > > >>>>>> A PR has been opened and reviewed. From the discussions on the PR, > > >> it > > >>>>> looks > > >>>>>> close to mergeable. > > >>>>>> > > >>>>>> - [FLINK-19816] Flink restored from a wrong checkpoint (a very old > > >>> one > > >>>>> and > > >>>>>> not the last completed one) > > >>>>>> This is a newly emerged blocker and Matthias is working on it. > > >>>>>> > > >>>>>> *Test Instabilities* > > >>>>>> We currently have 27 test instabilities[1]. > > >>>>>> AFAIK, none of them are as serious as to block the 1.11.3 release. > > >>>>>> > > >>>>>> *FLIP-27 Backprotings* > > >>>>>> > > >>>>>> I noticed that there's no jira issues opened on the FLIP-27 > > >>> backporting > > >>>>>> efforts, which is part of the major efforts planned for the 1.11.3 > > >>>>> release, > > >>>>>> making it hard to track the progress. > > >>>>>> > > >>>>>> > > >>>>>> @Stephan and @Becket, could you please share the updates on the > > >>>>> backporting > > >>>>>> efforts? How is the progress and when are the efforts expected to > > >> be > > >>>>>> finished? It would be appreciated and helpful if we can have a > jira > > >>>>> ticket > > >>>>>> to track the backporing progress publicly. > > >>>>>> > > >>>>>> > > >>>>>> Thank you~ > > >>>>>> > > >>>>>> Xintong Song > > >>>>>> > > >>>>>> > > >>>>>> [1] > > >>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://issues.apache.org/jira/browse/FLINK-16908?filter=12348580&jql=project%20%3D%20FLINK%20AND%20resolution%20%3D%20Unresolved%20AND%20affectedVersion%20in%20(1.11.0%2C%201.11.1%2C%201.11.2%2C%201.11.3)%20AND%20labels%20%3D%20test-stability%20ORDER%20BY%20updated%20DESC%2C%20created%20DESC > > >>>>>> > > >>>>>> On Wed, Nov 4, 2020 at 3:58 PM Tzu-Li (Gordon) Tai < > > >>>> tzuli...@apache.org> > > >>>>>> wrote: > > >>>>>> > > >>>>>>> Thanks for the efforts so far with pushing for 1.11.3. > > >>>>>>> > > >>>>>>> I'd like to provide a mid-week update on how we're looking with > > >> all > > >>>> the > > >>>>>>> pending blockers and backports: > > >>>>>>> > > >>>>>>> *Blockers**:* > > >>>>>>> > > >>>>>>> Currently all blockers either have an open PR, or have been > > >> merged. > > >>>>> I'll > > >>>>>>> highlight below the blockers *that still require reviewing > > >> efforts > > >>>> for > > >>>>>> them > > >>>>>>> to move forward:* > > >>>>>>> > > >>>>>>> - [FLINK-19909] Flink application in attach mode could not > > >>> terminate > > >>>>> when > > >>>>>>> the only job is canceled. PR: > > >>>>> https://github.com/apache/flink/pull/13911 > > >>>>>>> - [FLINK-19717] SourceReaderBase.pollNext may return END_OF_INPUT > > >>> if > > >>>>>>> SplitReader.fetch throws. PR: > > >>>>> https://github.com/apache/flink/pull/13776 > > >>>>>>> > > >>>>>>> The above PRs currently have no reviews at all yet. They seem to > > >>>>> already > > >>>>>>> have designated reviewers. > > >>>>>>> > > >>>>>>> > > >>>>>>> *Backports:* > > >>>>>>> - FLIP-27 robustness improvement backports: Stephan is currently > > >>>>> working > > >>>>>> on > > >>>>>>> backporting several FLIP-27 changes. There are no PRs yet for the > > >>>>>>> backported changes. > > >>>>>>> - DataStreamUtils.collect() refactorings backport: Steven Wu > > >>>> mentioned > > >>>>> to > > >>>>>>> backport this, but AFAIK this isn't assigned to anyone yet. > > >>>>>>> > > >>>>>>> *ETAs*: > > >>>>>>> > > >>>>>>> I'd like to request ETAs for the remaining backports, to prevent > > >> a > > >>>>> creep > > >>>>>> in > > >>>>>>> the scope of this bugfix release. > > >>>>>>> > > >>>>>>> We already have Flink users that would benefit from fixes that > > >> have > > >>>>> been > > >>>>>>> merged to release-1.11 already, so technically speaking the > > >>> backports > > >>>>>>> should be considered "nice-to-have" (to the best of my knowledge > > >> of > > >>>> the > > >>>>>>> changes) and could potentially be moved to a follow-up 1.11.4. > > >>>>>>> Most notably, the Stateful Functions project is already waiting > > >> on > > >>>>> Flink > > >>>>>>> 1.11.3 to address critical recovery issues (please see the > > >> StateFun > > >>>>> 2.2.1 > > >>>>>>> release discussion thread [1]). > > >>>>>>> > > >>>>>>> @Stephan Ewen <se...@apache.org> @Becket Qin < > > >> becket....@gmail.com > > >>>> > > >>>>>> could > > >>>>>>> you provide an ETA for the FLIP-27 backports? It would help to > > >> get > > >>> a > > >>>>>> better > > >>>>>>> estimate to decide how we proceed here. > > >>>>>>> > > >>>>>>> Cheers, > > >>>>>>> Gordon > > >>>>>>> > > >>>>>>> [1] > > >>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-StateFun-hotfix-version-2-2-1-td46239.html > > >>>>>>> > > >>>>>>> On Wed, Nov 4, 2020 at 3:16 PM Tzu-Li (Gordon) Tai < > > >>>>> tzuli...@apache.org> > > >>>>>>> wrote: > > >>>>>>> > > >>>>>>>>> The collect() utils can be picked back, I see no issue with > > >>> that > > >>>>> (it > > >>>>>> is > > >>>>>>>> isolated utilities). > > >>>>>>>> > > >>>>>>>> Just checking on all the requested backports mentioned in this > > >>>>> thread, > > >>>>>>> and > > >>>>>>>> figuring out which ones seem to still be unassigned / open. > > >>>>>>>> > > >>>>>>>> Is someone working on backporting > > >>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://github.com/apache/flink/commit/09a7a66b7313fea64817fe960a8da1265b428efc > > >>>>>>>> to release-1.11 at the moment? > > >>>>>>>> > > >>>>>>>> On Wed, Nov 4, 2020 at 1:39 AM Steven Wu <stevenz...@gmail.com > > >>> > > >>>>> wrote: > > >>>>>>>> > > >>>>>>>>> @Stephan Ewen <se...@apache.org> yeah, we can do that. don't > > >>>> worry > > >>>>>>> about > > >>>>>>>>> it. your earlier email had the perfect explanation on why file > > >>>>> source > > >>>>>>>>> shouldn't be backported. > > >>>>>>>>> > > >>>>>>>>> On Tue, Nov 3, 2020 at 3:37 AM Stephan Ewen <se...@apache.org > > >>> > > >>>>> wrote: > > >>>>>>>>> > > >>>>>>>>>> @Steven would it be possible to initially copy some of the > > >>> code > > >>>>> into > > >>>>>>> the > > >>>>>>>>>> iceberg source and later replace it by a dependency on the > > >>> Flink > > >>>>>> file > > >>>>>>>>>> source? > > >>>>>>>>>> > > >>>>>>>>>> On Mon, Nov 2, 2020 at 8:33 PM Steven Wu < > > >>> stevenz...@gmail.com> > > >>>>>>> wrote: > > >>>>>>>>>> > > >>>>>>>>>>> Stephan, thanks a lot for explaining the file connector. > > >>> that > > >>>>>> makes > > >>>>>>>>>> sense. > > >>>>>>>>>>> > > >>>>>>>>>>> I was asking because we were trying to reuse some of the > > >>>>>>>>> implementations > > >>>>>>>>>> in > > >>>>>>>>>>> the file source for Iceberg source. Flink Iceberg source > > >>> lives > > >>>>> in > > >>>>>>> the > > >>>>>>>>>>> Iceberg repo, which is not possible to code against the > > >>> master > > >>>>>>> branch > > >>>>>>>>> of > > >>>>>>>>>>> the Flink code. > > >>>>>>>>>>> > > >>>>>>>>>>> On Mon, Nov 2, 2020 at 3:31 AM Stephan Ewen < > > >>> se...@apache.org > > >>>>> > > >>>>>>> wrote: > > >>>>>>>>>>> > > >>>>>>>>>>>> Hi Steven! > > >>>>>>>>>>>> > > >>>>>>>>>>>> So far there are no plans to pick back the file system > > >>>>> connector > > >>>>>>>>> code. > > >>>>>>>>>>> This > > >>>>>>>>>>>> is still evolving and not finalized for 1.12, so I don't > > >>>> feel > > >>>>> it > > >>>>>>> is > > >>>>>>>>> a > > >>>>>>>>>>> good > > >>>>>>>>>>>> candidate to be backported. > > >>>>>>>>>>>> However, with the base connector changes backported, you > > >>>>> should > > >>>>>> be > > >>>>>>>>> able > > >>>>>>>>>>> to > > >>>>>>>>>>>> run the file connector code from master against 1.11.3. > > >>>>>>>>>>>> > > >>>>>>>>>>>> The collect() utils can be picked back, I see no issue > > >>> with > > >>>>> that > > >>>>>>>>> (it is > > >>>>>>>>>>>> isolated utilities). > > >>>>>>>>>>>> > > >>>>>>>>>>>> Best, > > >>>>>>>>>>>> Stephan > > >>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>> On Mon, Nov 2, 2020 at 3:02 AM Steven Wu < > > >>>>> stevenz...@gmail.com> > > >>>>>>>>> wrote: > > >>>>>>>>>>>> > > >>>>>>>>>>>>> Basically, it would be great to get the latest code in > > >>> the > > >>>>>>>>>>>>> flink-connector-files (FLIP-27). > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> On Sat, Oct 31, 2020 at 9:57 AM Steven Wu < > > >>>>>> stevenz...@gmail.com > > >>>>>>>> > > >>>>>>>>>>> wrote: > > >>>>>>>>>>>>> > > >>>>>>>>>>>>>> Stephan, it will be great if we can also backport > > >> the > > >>>>>>>>>> DataStreamUtils > > >>>>>>>>>>>>>> related commits that help with collecting output > > >> from > > >>>>>>> unbounded > > >>>>>>>>>>>> streams. > > >>>>>>>>>>>>>> e.g. > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://github.com/apache/flink/commit/09a7a66b7313fea64817fe960a8da1265b428efc > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>> I tried to copy and paste the code to unblock > > >> myself. > > >>>> but > > >>>>> it > > >>>>>>>>>> quickly > > >>>>>>>>>>>> got > > >>>>>>>>>>>>>> into the rabbit hole of more and more code. > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>> On Fri, Oct 30, 2020 at 11:02 AM Stephan Ewen < > > >>>>>>> se...@apache.org > > >>>>>>>>>> > > >>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> I have started with backporting the source API > > >>> changes. > > >>>>>> Some > > >>>>>>>>> minor > > >>>>>>>>>>>>>>> conflicts to solve, will need a bit more to finish > > >>>> this. > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> On Fri, Oct 30, 2020 at 7:25 AM Tzu-Li (Gordon) > > >> Tai < > > >>>>>>>>>>>>> tzuli...@apache.org> > > >>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> @Stephan Ewen <se...@apache.org> > > >>>>>>>>>>>>>>>> Are there already plans or ongoing efforts for > > >>>>>> backporting > > >>>>>>>>> the > > >>>>>>>>>>> list > > >>>>>>>>>>>> of > > >>>>>>>>>>>>>>>> FLIP-27 changes that you posted? > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> On Thu, Oct 29, 2020 at 7:08 PM Xintong Song < > > >>>>>>>>>>> tonysong...@gmail.com > > >>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Hi folks, > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Just to provide some updates concerning the > > >> status > > >>>> on > > >>>>>> the > > >>>>>>>>>>>>>>>>> test instabilities. > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Currently, we have 30 unresolved tickets labeled > > >>>> with > > >>>>>>>>> `Affects > > >>>>>>>>>>>>> Version` > > >>>>>>>>>>>>>>>>> 1.11.x. > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://issues.apache.org/jira/browse/FLINK-19775?filter=12348580&jql=project%20%3D%20FLINK%20AND%20resolution%20%3D%20Unresolved%20AND%20affectedVersion%20in%20(1.11.0%2C%201.11.1%2C%201.11.2%2C%201.11.3)%20AND%20labels%20%3D%20test-stability%20ORDER%20BY%20created%20DESC > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Among the 30 tickets, 11 of them are: > > >>>>>>>>>>>>>>>>> - Have occured in the recent 3 months > > >>>>>>>>>>>>>>>>> - Not confirmed to be pure testability issues > > >>>>>>>>>>>>>>>>> - Not confirmed to be rare condition cases > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> It would be nice if someone familiar with these > > >>>>>> components > > >>>>>>>>> can > > >>>>>>>>>>>> take a > > >>>>>>>>>>>>>>> look > > >>>>>>>>>>>>>>>>> into these issues. > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-17159 > > >>>>>> (ES6) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-17912 > > >>>>>>> (Kafka) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-17949 > > >>>>>>> (Kafka) > > >>>>>>>>>>>>>>>>> ⁃ > > >>> https://issues.apache.org/jira/browse/FLINK-18444 > > >>>>>>> (Kafka) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-18634 > > >>>>>>> (Kafka) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-18648 > > >>>>>>> (Kafka) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-18807 > > >>>>>>> (Kafka) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-19369 > > >>>>>>>>>>>> (BlobClientTest) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-19436 > > >>>>>>> (TPCDS) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-19690 > > >>>>>>>>>>>> (Format/Parquet) > > >>>>>>>>>>>>>>>>> - > > >>> https://issues.apache.org/jira/browse/FLINK-19775 > > >>>>>>>>>>>>>>>>> (SystemProcessingTimeServiceTest) > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Thank you~ > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Xintong Song > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> On Thu, Oct 29, 2020 at 10:21 AM Jingsong Li < > > >>>>>>>>>>>> jingsongl...@gmail.com > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> +1 to backport the FLIP-27 adjustments to > > >>> 1.11.x. > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> If possible, that would be great. Many people > > >>> are > > >>>>>>> looking > > >>>>>>>>>>> forward > > >>>>>>>>>>>>> to > > >>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>> FLIP-27 interface, but they don't want to take > > >>> the > > >>>>>> risk > > >>>>>>> to > > >>>>>>>>>>>> upgrade > > >>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>> 1.12 > > >>>>>>>>>>>>>>>>>> (And wait 1.12). After all, 1.11 is a > > >> relatively > > >>>>>> stable > > >>>>>>>>>>> version. > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> Best, > > >>>>>>>>>>>>>>>>>> Jingsong > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> On Thu, Oct 29, 2020 at 1:24 AM Stephan Ewen < > > >>>>>>>>>> se...@apache.org > > >>>>>>>>>>>> > > >>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> Thanks for starting this. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> +1 form my side to backport the FLIP-27 > > >>>>> adjustments > > >>>>>> to > > >>>>>>>>>>> 1.11.x. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> There were quite a few changes, and I think > > >> we > > >>>>> need > > >>>>>> to > > >>>>>>>>>>>>> cherry-pick > > >>>>>>>>>>>>>>>>> them > > >>>>>>>>>>>>>>>>>> all > > >>>>>>>>>>>>>>>>>>> to not get some inconsistent mix of changes > > >>> and > > >>>>> many > > >>>>>>>>> merge > > >>>>>>>>>>>>>>> conflicts. > > >>>>>>>>>>>>>>>>>>> I made a list below of what we need to add > > >> to > > >>>>>>>>>> "release-1.11". > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> *#### Core Source API Changes to backport > > >> (in > > >>>>>> REVERSE > > >>>>>>>>>> order)* > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> (Use: "git log > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>> flink-core/src/main/java/org/apache/flink/api/connector/source") > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 162c072e9265a7b6dd9d6f5459eb7974091c4c4e > > >>>>>>>>>>>>>>>>>>> [FLINK-19492][core] Consolidate Source > > >> Events > > >>>>>> between > > >>>>>>>>>> Source > > >>>>>>>>>>>> API > > >>>>>>>>>>>>>>> and > > >>>>>>>>>>>>>>>>>> Split > > >>>>>>>>>>>>>>>>>>> Reader API > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 428fbbad85379f71a9fbf1a1ab3e3dcfa9006436 > > >>>>>>>>>>>>>>>>>>> [FLINK-19205][core] Add access to > > >>> configuration > > >>>>> and > > >>>>>>>>>> hostname > > >>>>>>>>>>> in > > >>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>> SourceReaderContext > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 723e1790744ddc78d19c7c978442af1383f38d33 > > >>>>>>>>>>>>>>>>>>> [hotfix][core] Add to Source Enumerator > > >>>>> convenience > > >>>>>>>>> methods > > >>>>>>>>>>> to > > >>>>>>>>>>>>>>> assign > > >>>>>>>>>>>>>>>>>>> single split > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> *#### Connector Base Changes to Backport (in > > >>>>> REVERSE > > >>>>>>>>>> order)* > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> (Use: "git log > > >>>>>>> flink-connectors/flink-connector-base") > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 401f56fe9d6b0271260edf9787cdcbfe4d03874d > > >>>>>>>>>>>>>>>>>>> [FLINK-19427][FLINK-19489][tests] Fix test > > >>>>>> conditions > > >>>>>>>>> for > > >>>>>>>>>>>>>>>>>>> > > >>>>>>> 'SplitFetcherTest.testNotifiesWhenGoingIdleConcurrent()' > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 68c5c2ff779d82a1ff81ffaf60d8a1b283797db1 > > >>>>>>>>>>>>>>>>>>> [FLINK-19448][connector base] Explicitly > > >> check > > >>>> for > > >>>>>>>>>>> un-expected > > >>>>>>>>>>>>>>>>> condition > > >>>>>>>>>>>>>>>>>>> that would leave an inconsistent state > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 162c072e9265a7b6dd9d6f5459eb7974091c4c4e > > >>>>>>>>>>>>>>>>>>> [FLINK-19492][core] Consolidate Source > > >> Events > > >>>>>> between > > >>>>>>>>>> Source > > >>>>>>>>>>>> API > > >>>>>>>>>>>>>>> and > > >>>>>>>>>>>>>>>>>> Split > > >>>>>>>>>>>>>>>>>>> Reader API > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> c1ca7a4c7c21ec8868c14cdddd43c559625b794c > > >>>>>>>>>>>>>>>>>>> [refactor][tests] Move some source test > > >> utils > > >>>> from > > >>>>>>>>>>>>>>>>> flink-connector-base > > >>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>> flink-core > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> ee5c4c211c35c70d28252363bbc8400453609977 > > >>>>>>>>>>>>>>>>>>> [FLINK-19251][connectors] Avoid confusing > > >>> queue > > >>>>>>>>> handling in > > >>>>>>>>>>>>>>>>>>> "SplitReader.handleSplitsChanges()" > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 5abef56b2bf85bcac786f6b16b6899b6cced7176 > > >>>>>>>>>>>>>>>>>>> [FLINK-19250][connectors] Fix error > > >>> propagation > > >>>> in > > >>>>>>>>>> connector > > >>>>>>>>>>>> base > > >>>>>>>>>>>>>>>>>>> (SplitFetcherManager). > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 8fcca837c55a9216595ee4c03038b52747098dbb > > >>>>>>>>>>>>>>>>>>> [hotfix][connectors] Improve JavaDocs for > > >>>>>>>>>>>>>>> SingleThreadFetcherManager > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 4700bb5dde3303cbe98882f6beb7379425717b01 > > >>>>>>>>>>>>>>>>>>> [FLINK-19225][connectors] Various small > > >>>>> improvements > > >>>>>>> to > > >>>>>>>>>>>>>>>>> SourceReaderBase > > >>>>>>>>>>>>>>>>>>> (part 2) > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 12261c6b7ed6478a9b9f6a69cb58246b83cab9b7 > > >>>>>>>>>>>>>>>>>>> [FLINK-17393][connectors] (follow-up) Wakeup > > >>> the > > >>>>>>>>>>> SplitFetchers > > >>>>>>>>>>>>> more > > >>>>>>>>>>>>>>>>>>> elegantly. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> c60aaff0249bfd6b5871b7f82e03efc487a54d6b > > >>>>>>>>>>>>>>>>>>> [hotfix][tests] Extend test coverage for > > >>>>>>>>>>>>>>> FutureCompletingBlockingQueue > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> cef8a587d7fd2fe64cc644da5ed095d82e46f631 > > >>>>>>>>>>>>>>>>>>> [FLINK-19245][connectors] Set default > > >> capacity > > >>>> for > > >>>>>>>>>>>>>>>>>>> FutureCompletingBlockingQueue. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 4ea95782b4c6a2538153d4d16ad3f4839c7de0fb > > >>>>>>>>>>>>>>>>>>> [FLINK-19223][connectors] Simplify > > >>> Availability > > >>>>>> Future > > >>>>>>>>>> Model > > >>>>>>>>>>> in > > >>>>>>>>>>>>>>> Base > > >>>>>>>>>>>>>>>>>>> Connector > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 511857049ba30c8ff0ee56da551fa4a479dc583e > > >>>>>>>>>>>>>>>>>>> [FLINK-18128][connectors] Ensure idle split > > >>>>> fetchers > > >>>>>>>>> lead > > >>>>>>>>>> to > > >>>>>>>>>>>>>>>>> availability > > >>>>>>>>>>>>>>>>>>> notifications. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> a8206467af0830dcb89623ea068b5ca3b3450c92 > > >>>>>>>>>>>>>>>>>>> [refactor][core] Eagerly initialize the > > >>>> FetchTask > > >>>>> to > > >>>>>>>>>> support > > >>>>>>>>>>>>> proper > > >>>>>>>>>>>>>>>>> unit > > >>>>>>>>>>>>>>>>>>> testing > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 3b2f54bcb437f98e6137c904045cc51072b5c06b > > >>>>>>>>>>>>>>>>>>> [hotfix][tests] Move constants in > > >>>> SplitFetcherTest > > >>>>>>>>> relevant > > >>>>>>>>>>> to > > >>>>>>>>>>>>> only > > >>>>>>>>>>>>>>>>> one > > >>>>>>>>>>>>>>>>>>> test into test method > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> d7625760a75a508bf05bcddc380bb4d62ee1743e > > >>>>>>>>>>>>>>>>>>> [FLINK-19225][connectors] Various small > > >>>>> improvements > > >>>>>>> to > > >>>>>>>>>>>>>>>>> SourceReaderBase > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> a5b0d3297748c1be47ad579a88f24df2255a8df1 > > >>>>>>>>>>>>>>>>>>> [FLINK-17393][connectors] Wakeup the > > >>>> SplitFetchers > > >>>>>>> more > > >>>>>>>>>>>>> elegantly. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> f42a3ebc3e81a034b7221a803c153636fef34903 > > >>>>>>>>>>>>>>>>>>> [FLINK-18680][connectors] Make connector > > >> base > > >>>>>>>>>>>> RecordsWithSplitIds > > >>>>>>>>>>>>>>> more > > >>>>>>>>>>>>>>>>>>> lightweight. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> e3d273de822b085183d09b275a445879ff94b350 > > >>>>>>>>>>>>>>>>>>> [FLINK-19162][connectors] Add 'recycle()' to > > >>> the > > >>>>>>>>>>>>>>> RecordsWithSplitIds > > >>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>> support reuse of heavy objects. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 8ebc464c2520453a70001cd712abc8dee6ee89e0 > > >>>>>>>>>>>>>>>>>>> [hotfix][testing] Add a set of > > >> parameterizable > > >>>>>> testing > > >>>>>>>>>> mocks > > >>>>>>>>>>>> for > > >>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>> Split > > >>>>>>>>>>>>>>>>>>> Reader API > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> 930a07438be1185388d7150640f294dfe2a5d378 > > >>>>>>>>>>>>>>>>>>> [hotfix][connectors] Add RequestSplitEvent > > >> to > > >>>>>>>>>>>>>>> 'flink-connector-base' > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> commit > > >>> e945ce8a933bc378844782f784ca473c767ca159 > > >>>>>>>>>>>>>>>>>>> [refactor][connectors] Backport of the > > >>>>>> connector-base > > >>>>>>>>>>> exception > > >>>>>>>>>>>>>>>>> handling > > >>>>>>>>>>>>>>>>>>> from the Kafka Connector Pull Request > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> On Wed, Oct 28, 2020 at 5:49 PM Steven Wu < > > >>>>>>>>>>>> stevenz...@gmail.com> > > >>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> I would love to see this FLIP-27 source > > >>>>> interface > > >>>>>>>>>>> improvement > > >>>>>>>>>>>>> [1] > > >>>>>>>>>>>>>>>>> made > > >>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>> 1.11.3. > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> [1] > > >>>>>>> https://issues.apache.org/jira/browse/FLINK-19698 > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> On Wed, Oct 28, 2020 at 12:32 AM Tzu-Li > > >>>> (Gordon) > > >>>>>>> Tai < > > >>>>>>>>>>>>>>>>>>> tzuli...@apache.org> > > >>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> Thanks for the replies so far! > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> Just to provide a brief update on the > > >>> status > > >>>>> of > > >>>>>>>>>> blockers > > >>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>> 1.11.3 > > >>>>>>>>>>>>>>>>>> so > > >>>>>>>>>>>>>>>>>>>> far: > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> *PR opened, pending reviewer*- > > >>> [FLINK-19717] > > >>>>>>>>>>>>>>>>>> SourceReaderBase.pollNext > > >>>>>>>>>>>>>>>>>>>> may > > >>>>>>>>>>>>>>>>>>>>> return END_OF_INPUT if SplitReader.fetch > > >>>>> throws > > >>>>>> ( > > >>>>>>>>>>>>>>>>>>>>> > > >>> https://github.com/apache/flink/pull/13776) > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> *PR opened, reviewed + close to being > > >>>> merged* > > >>>>>>>>>>>>>>>>>>>>> - [FLINK-19741] Timer service should > > >> skip > > >>>>>>> restoring > > >>>>>>>>>> from > > >>>>>>>>>>>> raw > > >>>>>>>>>>>>>>> keyed > > >>>>>>>>>>>>>>>>>>> stream > > >>>>>>>>>>>>>>>>>>>>> if it isn't the writer ( > > >>>>>>>>>>>>>>>>> https://github.com/apache/flink/pull/13761) > > >>>>>>>>>>>>>>>>>>>>> - [FLINK-19748] Raw keyed stream key > > >> group > > >>>>>>> iterator > > >>>>>>>>>>> should > > >>>>>>>>>>>> be > > >>>>>>>>>>>>>>>>>> skipping > > >>>>>>>>>>>>>>>>>>>>> unwritten key groups ( > > >>>>>>>>>>>>>>> https://github.com/apache/flink/pull/13772) > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> *Merged* > > >>>>>>>>>>>>>>>>>>>>> - [FLINK-19154] Application mode deletes > > >>> HA > > >>>>> data > > >>>>>>> in > > >>>>>>>>>> case > > >>>>>>>>>>> of > > >>>>>>>>>>>>>>>>> suspended > > >>>>>>>>>>>>>>>>>>>>> ZooKeeper connection > > >>>>>>>>>>>>>>>>>>>>> - [FLINK-19569] Upgrade ICU4J to 67.1+ > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> Right now as it seems, progress is > > >> mainly > > >>>>>> blocked > > >>>>>>>>> on a > > >>>>>>>>>>>>> reviewer > > >>>>>>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>>>>>> FLINK-19717. > > >>>>>>>>>>>>>>>>>>>>> Meanwhile, Xintong is keeping an eye on > > >>> test > > >>>>>>>>>>> instabilities > > >>>>>>>>>>>>> [1] > > >>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>> see > > >>>>>>>>>>>>>>>>>>> if > > >>>>>>>>>>>>>>>>>>>>> there are any fixes that should be > > >> applied > > >>>> to > > >>>>>>>>>>>> `release-1.11`. > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> This is also a reminder, that if there > > >> are > > >>>>> other > > >>>>>>>>>> blockers > > >>>>>>>>>>>>> that > > >>>>>>>>>>>>>>> we > > >>>>>>>>>>>>>>>>>> need > > >>>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>>> be aware of, or a need to re-establish > > >>>>> estimated > > >>>>>>>>> time > > >>>>>>>>>> for > > >>>>>>>>>>>>>>> getting > > >>>>>>>>>>>>>>>>>> fixes > > >>>>>>>>>>>>>>>>>>>> in > > >>>>>>>>>>>>>>>>>>>>> and delay the RC for 1.11.3, please do > > >> let > > >>>> us > > >>>>>>> know! > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> Cheers, > > >>>>>>>>>>>>>>>>>>>>> Gordon > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> [1] > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20affectedVersion%20in%20(1.11.0%2C%201.11.1%2C%201.11.2)%20AND%20labels%20%3D%20test-stability > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> On Mon, Oct 26, 2020 at 9:43 PM Kostas > > >>>>> Kloudas < > > >>>>>>>>>>>>>>>>> kklou...@apache.org> > > >>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> +1 for releasing Flink 1.11.3 as it > > >>>>> contains a > > >>>>>>>>> number > > >>>>>>>>>>> of > > >>>>>>>>>>>>>>>>> important > > >>>>>>>>>>>>>>>>>>>>>> fixes and thanks Gordon and Xintong > > >> for > > >>>>>>>>> volunteering. > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> Cheers, > > >>>>>>>>>>>>>>>>>>>>>> Kostas > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> On Mon, Oct 26, 2020 at 4:37 AM Yu Li > > >> < > > >>>>>>>>>>> car...@gmail.com> > > >>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> +1 for releasing Flink 1.11.3, and > > >>>> thanks > > >>>>>>> Gordon > > >>>>>>>>>> and > > >>>>>>>>>>>>>>> Xintong > > >>>>>>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>>>>>>>> volunteering as our release > > >> managers. > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> Best Regards, > > >>>>>>>>>>>>>>>>>>>>>>> Yu > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> On Mon, 26 Oct 2020 at 09:45, > > >> Xintong > > >>>>> Song < > > >>>>>>>>>>>>>>>>>> tonysong...@gmail.com> > > >>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> Thanks Gordan for starting this > > >>>>>> discussion. > > >>>>>>>>>>>>>>>>>>>>>>>> My pleasure to help with the > > >> release > > >>>>>>> process. > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> Thank you~ > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> Xintong Song > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> On Fri, Oct 23, 2020 at 11:29 PM > > >>> Till > > >>>>>>>>> Rohrmann < > > >>>>>>>>>>>>>>>>>>>> trohrm...@apache.org > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> Thanks for starting this > > >>> discussion > > >>>>>>> Gordon. > > >>>>>>>>>> There > > >>>>>>>>>>>> are > > >>>>>>>>>>>>>>> over > > >>>>>>>>>>>>>>>>>> 100 > > >>>>>>>>>>>>>>>>>>>>> issues > > >>>>>>>>>>>>>>>>>>>>>>>>> which are fixed for 1.11.3. > > >> Hence > > >>> +1 > > >>>>>> for a > > >>>>>>>>>>> soonish > > >>>>>>>>>>>>>>> 1.11.3 > > >>>>>>>>>>>>>>>>>>>> release. > > >>>>>>>>>>>>>>>>>>>>>> Thanks > > >>>>>>>>>>>>>>>>>>>>>>>>> for volunteering as our release > > >>>>> managers > > >>>>>>>>> Gordon > > >>>>>>>>>>> and > > >>>>>>>>>>>>>>>>> Xintong! > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> Cheers, > > >>>>>>>>>>>>>>>>>>>>>>>>> Till > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Oct 23, 2020 at 5:02 PM > > >>>> Tzu-Li > > >>>>>>>>> (Gordon) > > >>>>>>>>>>>> Tai < > > >>>>>>>>>>>>>>>>>>>>>> tzuli...@apache.org > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Hi, > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Xintong and I would like to > > >>> start a > > >>>>>>>>> discussion > > >>>>>>>>>>> for > > >>>>>>>>>>>>>>>>> releasing > > >>>>>>>>>>>>>>>>>>>> Flink > > >>>>>>>>>>>>>>>>>>>>>>>> 1.11.3 > > >>>>>>>>>>>>>>>>>>>>>>>>>> soon. > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> It seems like we already have a > > >>> few > > >>>>>>>>> pressing > > >>>>>>>>>>>> issues > > >>>>>>>>>>>>>>> that > > >>>>>>>>>>>>>>>>>> needs > > >>>>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>>> be > > >>>>>>>>>>>>>>>>>>>>>>>>>> included in a new hotfix > > >> release: > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> - Heap-based timers’ restore > > >>>>>> behaviour > > >>>>>>>>> is > > >>>>>>>>>>>>> causing a > > >>>>>>>>>>>>>>>>>>> critical > > >>>>>>>>>>>>>>>>>>>>>> recovery > > >>>>>>>>>>>>>>>>>>>>>>>>>> issue for StateFun [1] [2] > > >>> [3]. > > >>>>>>>>>>>>>>>>>>>>>>>>>> - There are several > > >> robustness > > >>>>>> issues > > >>>>>>>>> for > > >>>>>>>>>> the > > >>>>>>>>>>>>>>> FLIP-27 > > >>>>>>>>>>>>>>>>> new > > >>>>>>>>>>>>>>>>>>>>> source > > >>>>>>>>>>>>>>>>>>>>>> API, > > >>>>>>>>>>>>>>>>>>>>>>>>>> such as [4]. We already have > > >>>> some > > >>>>>>> users > > >>>>>>>>>> using > > >>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>> FLIP-27 > > >>>>>>>>>>>>>>>>>>> API > > >>>>>>>>>>>>>>>>>>>>>> with > > >>>>>>>>>>>>>>>>>>>>>>>>>> 1.11.x, > > >>>>>>>>>>>>>>>>>>>>>>>>>> so it would be important to > > >>> get > > >>>>>> those > > >>>>>>>>> fixes > > >>>>>>>>>>> in > > >>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>> 1.11.x > > >>>>>>>>>>>>>>>>>>> as > > >>>>>>>>>>>>>>>>>>>>>> well. > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Apart from the issues that are > > >>>>> already > > >>>>>>>>> marked > > >>>>>>>>>> as > > >>>>>>>>>>>>>>> blocker > > >>>>>>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>>>>>> 1.11.3 > > >>>>>>>>>>>>>>>>>>>>>> in > > >>>>>>>>>>>>>>>>>>>>>>>> our > > >>>>>>>>>>>>>>>>>>>>>>>>>> JIRA [5], please let us know in > > >>>> this > > >>>>>>>>> thread if > > >>>>>>>>>>>> there > > >>>>>>>>>>>>>>> is > > >>>>>>>>>>>>>>>>>>> already > > >>>>>>>>>>>>>>>>>>>>>> ongoing > > >>>>>>>>>>>>>>>>>>>>>>>>>> work for other important fixes > > >>> that > > >>>>> we > > >>>>>>>>> should > > >>>>>>>>>>> try > > >>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>> include. > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Xintong and I would like to > > >>>> volunteer > > >>>>>> for > > >>>>>>>>>>> managing > > >>>>>>>>>>>>>>> this > > >>>>>>>>>>>>>>>>>>> release, > > >>>>>>>>>>>>>>>>>>>>> and > > >>>>>>>>>>>>>>>>>>>>>>>> will > > >>>>>>>>>>>>>>>>>>>>>>>>>> try to communicate the priority > > >>> of > > >>>>>>> pending > > >>>>>>>>>>>> blockers > > >>>>>>>>>>>>>>> over > > >>>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>>> next > > >>>>>>>>>>>>>>>>>>>>>> few > > >>>>>>>>>>>>>>>>>>>>>>>>>> days. > > >>>>>>>>>>>>>>>>>>>>>>>>>> Since the aforementioned issues > > >>> are > > >>>>>> quite > > >>>>>>>>>>>> critical, > > >>>>>>>>>>>>>>> we’d > > >>>>>>>>>>>>>>>>>> like > > >>>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>>> aim > > >>>>>>>>>>>>>>>>>>>>>>>>>> for a *feature > > >>>>>>>>>>>>>>>>>>>>>>>>>> freeze by the end of next week > > >>>> (Oct. > > >>>>>>> 30th)* > > >>>>>>>>>> and > > >>>>>>>>>>>>> start > > >>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>>> release > > >>>>>>>>>>>>>>>>>>>>>> voting > > >>>>>>>>>>>>>>>>>>>>>>>>>> process the week after. > > >>>>>>>>>>>>>>>>>>>>>>>>>> If that is too short of a > > >> notice > > >>>> and > > >>>>>> you > > >>>>>>>>> might > > >>>>>>>>>>>> need > > >>>>>>>>>>>>>>> more > > >>>>>>>>>>>>>>>>>> time, > > >>>>>>>>>>>>>>>>>>>>>> please > > >>>>>>>>>>>>>>>>>>>>>>>> let > > >>>>>>>>>>>>>>>>>>>>>>>>>> us know! > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Cheers, > > >>>>>>>>>>>>>>>>>>>>>>>>>> Gordon > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> [1] > > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-19692 > > >>>>>>>>>>>>>>>>>>>>>>>>>> [2] > > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-19741 > > >>>>>>>>>>>>>>>>>>>>>>>>>> [3] > > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-19748 > > >>>>>>>>>>>>>>>>>>>>>>>>>> [4] > > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-19717 > > >>>>>>>>>>>>>>>>>>>>>>>>>> [5] > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20priority%20%3D%20Blocker%20AND%20fixVersion%20%3D%201.11.3 > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> -- > > >>>>>>>>>>>>>>>>>> Best, Jingsong Lee > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > > > > >
