[jira] [Commented] (FLINK-20114) Fix a few KafkaSource-related bugs

2024-11-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17896853#comment-17896853 ] Jiangjie Qin commented on FLINK-20114: -- {quote}why the _enable.auto.commit_ behavio

[jira] [Commented] (FLINK-16851) Add common metrics to the SourceReader base implementation.

2024-10-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893911#comment-17893911 ] Jiangjie Qin commented on FLINK-16851: -- I think most of the metrics have been added

[jira] [Updated] (FLINK-36585) The SplitFetcherManager.close() can chain the futures in a tight loop.

2024-10-22 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-36585: - Fix Version/s: 2.0.0 > The SplitFetcherManager.close() can chain the futures in a tight loop. >

[jira] [Assigned] (FLINK-36585) The SplitFetcherManager.close() can chain the futures in a tight loop.

2024-10-22 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-36585: Assignee: Jiangjie Qin > The SplitFetcherManager.close() can chain the futures in a tight

[jira] [Created] (FLINK-36585) The SplitFetcherManager.close() can chain the futures in a tight loop.

2024-10-22 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-36585: Summary: The SplitFetcherManager.close() can chain the futures in a tight loop. Key: FLINK-36585 URL: https://issues.apache.org/jira/browse/FLINK-36585 Project: Flink

[jira] [Resolved] (FLINK-36292) SplitFetcherManagerTest.testCloseCleansUpPreviouslyClosedFetcher times out

2024-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-36292. -- Resolution: Fixed Merged to master. cc0a8b3f69b8036534a5f0132bbe8f470d945ca0 > SplitFetcherM

[jira] [Commented] (FLINK-36292) SplitFetcherManagerTest.testCloseCleansUpPreviouslyClosedFetcher times out

2024-09-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883964#comment-17883964 ] Jiangjie Qin commented on FLINK-36292: -- Thanks [~showuon] and [~mapohl] . I was try

[jira] [Commented] (FLINK-36146) NoSuchElement exception from SingleThreadFetcherManager

2024-09-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17881864#comment-17881864 ] Jiangjie Qin commented on FLINK-36146: -- Hi Kim, yes, the ConcurrentHashMap iterator

[jira] [Commented] (FLINK-36146) NoSuchElement exception from SingleThreadFetcherManager

2024-09-13 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17881648#comment-17881648 ] Jiangjie Qin commented on FLINK-36146: -- Yes, this is an apparent race condition.  A

[jira] [Created] (FLINK-36265) List and track the deprecated APIs for the 2.0-preview release.

2024-09-11 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-36265: Summary: List and track the deprecated APIs for the 2.0-preview release. Key: FLINK-36265 URL: https://issues.apache.org/jira/browse/FLINK-36265 Project: Flink

[jira] [Assigned] (FLINK-36265) List and track the deprecated APIs for the 2.0-preview release.

2024-09-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-36265: Assignee: Jiangjie Qin > List and track the deprecated APIs for the 2.0-preview release.

[jira] [Updated] (FLINK-36265) List and track the deprecated APIs for the 2.0-preview release.

2024-09-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-36265: - Fix Version/s: 2.0-preview > List and track the deprecated APIs for the 2.0-preview release. > -

[jira] [Resolved] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2024-08-21 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-33681. -- Fix Version/s: 2.0.0 Release Note: The Source and Sink IO metrics are not reported to the

[jira] [Updated] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2024-08-21 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-33681: - Affects Version/s: 1.19.1 1.20.0 > Display source/sink numRecordsIn/Out &

[jira] [Closed] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-08-06 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-35924. Resolution: Implemented Merged to master: a15bf58da5442deeb07ac2a1795a961a0ec75561 > Improve the

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-35924: - Fix Version/s: 2.0.0 > Improve the SourceReaderBase to support the RecordsWithSplitIds share >

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-35924: - Description: Recently, we saw corrupted {{RecordsWithSplitIds}} in one of our Iceberg source im

[jira] [Assigned] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-35924: Assignee: Jiangjie Qin > Improve the SourceReaderBase to support the RecordsWithSplitIds

[jira] [Created] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-35924: Summary: Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader. Key: FLINK-35924 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Commented] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2024-05-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850176#comment-17850176 ] Jiangjie Qin commented on FLINK-33681: -- [~Zhanghao Chen] Thanks for firing the tick

[jira] [Resolved] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-33733. -- Fix Version/s: 1.19.0 Resolution: Fixed > [FLIP-321] Update the stability docs to add t

[jira] [Commented] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17797081#comment-17797081 ] Jiangjie Qin commented on FLINK-33733: -- Just realized that I forgot to make the PR

[jira] [Assigned] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-03 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-33733: Assignee: Jiangjie Qin > [FLIP-321] Update the stability docs to add the migration period

[jira] [Created] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-03 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-33733: Summary: [FLIP-321] Update the stability docs to add the migration periods. Key: FLINK-33733 URL: https://issues.apache.org/jira/browse/FLINK-33733 Project: Flink

[jira] [Resolved] (FLINK-20767) [FLIP-356] Add nested field support for SupportsFilterPushDown

2023-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-20767. -- Fix Version/s: 1.19.0 Resolution: Implemented PR is merged to master: 5be4688e8b8a055b9

[jira] [Commented] (FLINK-32398) Support Avro SpecificRecord in DataStream and Table conversion.

2023-06-20 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17735328#comment-17735328 ] Jiangjie Qin commented on FLINK-32398: -- [~twalthr] [~jark] If this already works an

[jira] [Created] (FLINK-32398) Support Avro SpecificRecord in DataStream and Table conversion.

2023-06-20 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-32398: Summary: Support Avro SpecificRecord in DataStream and Table conversion. Key: FLINK-32398 URL: https://issues.apache.org/jira/browse/FLINK-32398 Project: Flink

[jira] [Updated] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-31654: - Description: Currently {{DataStreamUtils.reinterpretAsKeyedStream()}} does not work well with b

[jira] [Updated] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-31654: - Fix Version/s: 1.16.2 > DataStreamUtils.reinterpretAsKeyedStream() should not override the user

[jira] [Updated] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-31654: - Fix Version/s: 1.18.0 1.17.1 > DataStreamUtils.reinterpretAsKeyedStream() sho

[jira] [Assigned] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-31654: Assignee: Jiangjie Qin > DataStreamUtils.reinterpretAsKeyedStream() should not override t

[jira] [Created] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-31654: Summary: DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy. Key: FLINK-31654 URL: https://issues.apache.org/jira/browse/FLINK-316

[jira] [Commented] (FLINK-31324) Broken SingleThreadFetcherManager constructor API

2023-03-06 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696756#comment-17696756 ] Jiangjie Qin commented on FLINK-31324: -- I think `SingleThreadFetcherManager` is ind

[jira] [Commented] (FLINK-30935) Add KafkaSerializer deserialize check when using SimpleVersionedSerializer

2023-02-09 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686336#comment-17686336 ] Jiangjie Qin commented on FLINK-30935: -- Sounds good to me. > Add KafkaSerializer d

[jira] [Created] (FLINK-30645) [FLIP-286] The scope/stability annotation in AbstractStreamOperator are inconsistent.

2023-01-12 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-30645: Summary: [FLIP-286] The scope/stability annotation in AbstractStreamOperator are inconsistent. Key: FLINK-30645 URL: https://issues.apache.org/jira/browse/FLINK-30645

[jira] [Resolved] (FLINK-30424) Add source operator restore readerState log to distinguish split is from newPartitions or split state

2022-12-16 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-30424. -- Resolution: Fixed Merged to master: 528186b62da92ecde0fa308f1df0cc6f95495f4d > Add source ope

[jira] [Updated] (FLINK-30424) Add source operator restore readerState log to distinguish split is from newPartitions or split state

2022-12-16 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-30424: - Fix Version/s: 1.17.0 > Add source operator restore readerState log to distinguish split is from

[jira] [Commented] (FLINK-28411) OperatorCoordinator exception may fail Session Cluster

2022-07-05 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17562909#comment-17562909 ] Jiangjie Qin commented on FLINK-28411: -- [~martijnvisser] Yes, I think this is a pro

[jira] [Commented] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-13 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536975#comment-17536975 ] Jiangjie Qin commented on FLINK-27554: -- Thanks for digging into this, [~xtsong]. I

[jira] [Updated] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-27554: - Description: It looks that the ASF website does not build on my laptop with Apple silicon. It e

[jira] [Updated] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-27554: - Description: It looks that the ASF website does not build on my laptop with Apple silicon. It e

[jira] [Created] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-08 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-27554: Summary: The asf-site does not build on Apple Silicon Key: FLINK-27554 URL: https://issues.apache.org/jira/browse/FLINK-27554 Project: Flink Issue Type: Impr

[jira] [Closed] (FLINK-27295) UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint

2022-04-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-27295. Resolution: Duplicate Duplicate of FLINK-27148 > UnalignedCheckpointITCase failed due to Operator

[jira] [Commented] (FLINK-27295) UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint

2022-04-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524679#comment-17524679 ] Jiangjie Qin commented on FLINK-27295: -- It looks a duplicate of FLINK-27148. > Una

[jira] [Resolved] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-26723. -- Fix Version/s: 1.15.0 1.14.4 Resolution: Fixed PR Merged. master: d

[jira] [Assigned] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-26723: Assignee: zoucao > Fix the content of exception in SourceCoordinatorContext > ---

[jira] [Comment Edited] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508760#comment-17508760 ] Jiangjie Qin edited comment on FLINK-26723 at 3/18/22, 12:51 PM: -

[jira] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723 ] Jiangjie Qin deleted comment on FLINK-26723: -- was (Author: becket_qin): Do you want to submit a patch? > Fix the content of exception in SourceCoordinatorContext > -

[jira] [Commented] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508760#comment-17508760 ] Jiangjie Qin commented on FLINK-26723: -- [~zoucao]  yes, we should get the splits fr

[jira] [Commented] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508762#comment-17508762 ] Jiangjie Qin commented on FLINK-26723: -- Do you want to submit a patch? > Fix the c

[jira] [Commented] (FLINK-26394) CheckpointCoordinator.isTriggering can not be reset if a checkpoint expires while the checkpointCoordinator task is queuing in the SourceCoordinator executor.

2022-03-13 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505968#comment-17505968 ] Jiangjie Qin commented on FLINK-26394: -- Good catch. We need to recycle the futures

[jira] [Commented] (FLINK-25256) Savepoints do not work with ExternallyInducedSources

2022-03-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503274#comment-17503274 ] Jiangjie Qin commented on FLINK-25256: -- [~Brian Zhou] I think [~renqs] and [~Leonar

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2022-03-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503240#comment-17503240 ] Jiangjie Qin commented on FLINK-21364: -- [~stevenz3wu] Sorry for the late response.

[jira] [Commented] (FLINK-25256) Savepoints do not work with ExternallyInducedSources

2022-03-02 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500468#comment-17500468 ] Jiangjie Qin commented on FLINK-25256: -- [~dwysakowicz] Pravega essentially uses an

[jira] [Resolved] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-24607. -- Resolution: Fixed > SourceCoordinator may miss to close SplitEnumerator when failover frequent

[jira] [Updated] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24607: - Fix Version/s: 1.13.7 > SourceCoordinator may miss to close SplitEnumerator when failover freque

[jira] [Commented] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497109#comment-17497109 ] Jiangjie Qin commented on FLINK-24607: -- Patch merged. Master: 0f19c2472c54aac97e40

[jira] [Updated] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-22 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24607: - Fix Version/s: (was: 1.13.7) > SourceCoordinator may miss to close SplitEnumerator when fail

[jira] [Commented] (FLINK-24844) CassandraConnectorITCase.testCassandraBatchPojoFormat fails on AZP

2022-02-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492363#comment-17492363 ] Jiangjie Qin commented on FLINK-24844: -- Another failure. https://dev.azure.com/apa

[jira] [Assigned] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-26029: Assignee: Dong Lin > Generalize the checkpoint protocol of OperatorCoordinator. > ---

[jira] [Commented] (FLINK-24439) Introduce CoordinatorStore

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489279#comment-17489279 ] Jiangjie Qin commented on FLINK-24439: -- [~pnowojski] This effectively introduces a

[jira] [Updated] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24607: - Fix Version/s: 1.15.0 1.13.6 1.14.4 > SourceCoordinator ma

[jira] [Assigned] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-24607: Assignee: Jiangjie Qin > SourceCoordinator may miss to close SplitEnumerator when failove

[jira] [Commented] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489273#comment-17489273 ] Jiangjie Qin commented on FLINK-24607: -- [~jark] [~dmvk] Sorry I did not notice the

[jira] [Updated] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-26029: - Labels: extensibility (was: ) > Generalize the checkpoint protocol of OperatorCoordinator. > --

[jira] [Updated] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-26029: - Fix Version/s: 1.16.0 > Generalize the checkpoint protocol of OperatorCoordinator. > ---

[jira] [Created] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-08 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-26029: Summary: Generalize the checkpoint protocol of OperatorCoordinator. Key: FLINK-26029 URL: https://issues.apache.org/jira/browse/FLINK-26029 Project: Flink Is

[jira] [Commented] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-01-12 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475066#comment-17475066 ] Jiangjie Qin commented on FLINK-24607: -- [~dmvk] I am not sure about the exact cause

[jira] [Updated] (FLINK-25152) FLIP-188: Introduce Built-in Dynamic Table Storage

2022-01-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-25152: - Fix Version/s: table-store-0.1.0 (was: 1.15.0) > FLIP-188: Introduce Buil

[jira] [Updated] (FLINK-25152) FLIP-188: Introduce Built-in Dynamic Table Storage

2022-01-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-25152: - Component/s: Table Store > FLIP-188: Introduce Built-in Dynamic Table Storage >

[jira] [Assigned] (FLINK-10737) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint failed on Travis

2021-11-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-10737: Assignee: Qingsheng Ren (was: Jiangjie Qin) > FlinkKafkaProducerITCase.testScaleDownBefo

[jira] [Commented] (FLINK-10737) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint failed on Travis

2021-11-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450837#comment-17450837 ] Jiangjie Qin commented on FLINK-10737: -- [~trohrmann] I probably won't be able to lo

[jira] [Commented] (FLINK-24949) KafkaITCase.testBigRecordJob fails on azure

2021-11-21 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447195#comment-17447195 ] Jiangjie Qin commented on FLINK-24949: -- [~gaoyunhaii] not sure if this is the same

[jira] [Updated] (FLINK-24376) Operator name in OperatorCoordinator should not use chained name

2021-10-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24376: - Fix Version/s: 1.14.1 > Operator name in OperatorCoordinator should not use chained name > -

[jira] [Updated] (FLINK-24376) Operator name in OperatorCoordinator should not use chained name

2021-10-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24376: - Affects Version/s: (was: 1.14.1) > Operator name in OperatorCoordinator should not use chain

[jira] [Resolved] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22915. -- Resolution: Implemented Merged to master: 5ff346ea1a508a00b89759492f09e7330e69baef > FLIP-173

[jira] [Updated] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-22915: - Fix Version/s: 0.1.0 > FLIP-173: Support DAG of algorithms > ---

[jira] [Assigned] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22915: Assignee: Dong Lin > FLIP-173: Support DAG of algorithms > --

[jira] [Resolved] (FLINK-24277) Offset commit should be disabled if consumer group ID is not specified in KafkaSource

2021-09-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-24277. -- Fix Version/s: 1.13.3 1.12.6 Assignee: Qingsheng Ren Resolut

[jira] [Resolved] (FLINK-24059) SourceReaderTestBase should allow NUM_SPLITS to be overridden in implementation

2021-09-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-24059. -- Resolution: Fixed Merged to master: d4c483fadd3df32045fbb2ee117d0a6eeab9276e Cherry-picked to

[jira] [Resolved] (FLINK-23773) KafkaPartitionSplitReader should remove empty splits from fetcher

2021-09-13 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-23773. -- Resolution: Fixed PR merged to master: fe17ca6042c570ce603bf4308775f61db1d515c9 cherry-picked

[jira] [Resolved] (FLINK-23971) PulsarSourceITCase.testIdleReader failed on azure

2021-09-01 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-23971. -- Resolution: Fixed PR merged to master: ad052cc056c7d6e63d8356dbd22d6a98b54743c3 Cherry-picked

[jira] [Assigned] (FLINK-24059) SourceReaderTestBase should allow NUM_SPLITS to be overridden in implementation

2021-08-30 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-24059: Assignee: Brian Zhou > SourceReaderTestBase should allow NUM_SPLITS to be overridden in

[jira] [Resolved] (FLINK-23686) KafkaSource metric "commitsSucceeded" should count per-commit instead of per-partition

2021-08-30 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-23686. -- Resolution: Fixed Merged to master / release-1.14: 62931a1665e6a6976d088ed49375f9fdf00229d9 C

[jira] [Resolved] (FLINK-22702) KafkaSourceITCase.testRedundantParallelism failed

2021-08-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22702. -- Resolution: Fixed Merged to master.  83b9ee8a3afd3e3c5512b4a495f97c01c1be11c2 > KafkaSourceIT

[jira] [Commented] (FLINK-22766) Report metrics of KafkaConsumer in Kafka new source

2021-07-12 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379537#comment-17379537 ] Jiangjie Qin commented on FLINK-22766: -- Merged to release-1.13: 2c455f324b9ec7ef053

[jira] [Commented] (FLINK-16634) The PartitionDiscoverer in FlinkKafkaConsumer should not use the user provided client.id.

2021-07-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377082#comment-17377082 ] Jiangjie Qin commented on FLINK-16634: -- [~liufangliang] Done. > The PartitionDisco

[jira] [Assigned] (FLINK-16634) The PartitionDiscoverer in FlinkKafkaConsumer should not use the user provided client.id.

2021-07-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-16634: Assignee: Fangliang Liu > The PartitionDiscoverer in FlinkKafkaConsumer should not use th

[jira] [Resolved] (FLINK-22766) Report metrics of KafkaConsumer in Kafka new source

2021-07-05 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22766. -- Resolution: Fixed Merged to master: b094a932845db5539fc07b032d49d0bcefd15df2 > Report metrics

[jira] [Assigned] (FLINK-22766) Report metrics of KafkaConsumer in Kafka new source

2021-07-05 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22766: Assignee: Qingsheng Ren > Report metrics of KafkaConsumer in Kafka new source > -

[jira] [Resolved] (FLINK-22147) Refactor Partition Discovery Logic in KafkaSourceEnumerator

2021-06-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22147. -- Fix Version/s: 1.14.0 Resolution: Implemented Merged to master.  1418a1ddd025adb3b502b8

[jira] [Assigned] (FLINK-22147) Refactor Partition Discovery Logic in KafkaSourceEnumerator

2021-06-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22147: Assignee: Qingsheng Ren > Refactor Partition Discovery Logic in KafkaSourceEnumerator > -

[jira] [Assigned] (FLINK-22722) Add Documentation for Kafka New Source

2021-05-31 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22722: Assignee: Qingsheng Ren > Add Documentation for Kafka New Source > --

[jira] [Resolved] (FLINK-22722) Add Documentation for Kafka New Source

2021-05-31 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22722. -- Resolution: Fixed Merged to master:  b582991b8b2b8dadb89e71d5002c4a9cc2055e34 > Add Document

[jira] [Commented] (FLINK-22133) SplitEmumerator does not provide checkpoint id in snapshot

2021-05-06 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340604#comment-17340604 ] Jiangjie Qin commented on FLINK-22133: -- Thanks for the explanation, Thomas. So here

[jira] [Commented] (FLINK-22133) SplitEmumerator does not provide checkpoint id in snapshot

2021-05-06 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340493#comment-17340493 ] Jiangjie Qin commented on FLINK-22133: -- [~thw] I think we only plan to backport som

[jira] [Commented] (FLINK-20114) Test Kafka Source based on the new Source API 

2021-04-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335209#comment-17335209 ] Jiangjie Qin commented on FLINK-20114: -- [~trohrmann] Sorry for the confusion. The t

[jira] [Closed] (FLINK-11681) Add an AbstractMetric to combine the metric definition and metric management.

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-11681. Resolution: Abandoned After some discussion, we have not reached consensus on whether this is nec

[jira] [Commented] (FLINK-10806) Support multiple consuming offsets when discovering a new topic

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335079#comment-17335079 ] Jiangjie Qin commented on FLINK-10806: -- After FLIP-27, the DataStream source allows

[jira] [Assigned] (FLINK-16634) The PartitionDiscoverer in FlinkKafkaConsumer should not use the user provided client.id.

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-16634: Assignee: Qingsheng Ren > The PartitionDiscoverer in FlinkKafkaConsumer should not use th

  1   2   3   4   5   6   >