[jira] [Commented] (FLINK-35564) The topic cannot be distributed on subtask when calculatePartitionOwner returns -1

2024-06-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854929#comment-17854929 ] Yufan Sheng commented on FLINK-35564: - Hi, thanks for mention this. I think this bug

[jira] [Commented] (FLINK-32645) Flink pulsar sink is having poor performance

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837162#comment-17837162 ] Yufan Sheng commented on FLINK-32645: - [~tison] I think we can close this issue now.

[jira] [Commented] (FLINK-33136) Flink Pulsar Connector RoundRobinTopicRouter Generates Invalid Error Message

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837161#comment-17837161 ] Yufan Sheng commented on FLINK-33136: - Yep, I think you are right. We should use mor

[jira] [Commented] (FLINK-33486) Pulsar Client Send Timeout Terminates TaskManager

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837160#comment-17837160 ] Yufan Sheng commented on FLINK-33486: - The retry logic is internally provided by the

[jira] [Commented] (FLINK-33729) Events are getting lost when an exception occurs within a processing function

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837157#comment-17837157 ] Yufan Sheng commented on FLINK-33729: - [~Weijie Guo] Yep, this is a valid ticket. Bu

[jira] [Commented] (FLINK-34091) Flink pulsar connect add automatic failover capability

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837152#comment-17837152 ] Yufan Sheng commented on FLINK-34091: - Since this is a requirement from Pulsar side.

[jira] [Commented] (FLINK-34436) Avro schema evolution and compatibility issues in Pulsar connector

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837148#comment-17837148 ] Yufan Sheng commented on FLINK-34436: - If you want to consume all the messages with

[jira] [Commented] (FLINK-35064) Flink sql connector pulsar/hive com.fasterxml.jackson.annotation.JsonFormat$Value conflict

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837107#comment-17837107 ] Yufan Sheng commented on FLINK-35064: - AFAICS, the {{pulsar-client-all}} should be r

[jira] [Commented] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837080#comment-17837080 ] Yufan Sheng commented on FLINK-34962: - [~Tison] This issue should be marked resolved

[jira] [Commented] (FLINK-34414) EXACTLY_ONCE guarantee doesn't work properly for Flink/Pulsar connector

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837079#comment-17837079 ] Yufan Sheng commented on FLINK-34414: - I don't think this is a issue from my side. F

[jira] [Commented] (FLINK-34436) Avro schema evolution and compatibility issues in Pulsar connector

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837073#comment-17837073 ] Yufan Sheng commented on FLINK-34436: - I think this is not a issue. It's just a desi

[jira] [Commented] (FLINK-35064) Flink sql connector pulsar/hive com.fasterxml.jackson.annotation.JsonFormat$Value conflict

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837068#comment-17837068 ] Yufan Sheng commented on FLINK-35064: - I have made a comment in the related PR. I ju

[jira] [Comment Edited] (FLINK-32645) Flink pulsar sink is having poor performance

2023-07-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746672#comment-17746672 ] Yufan Sheng edited comment on FLINK-32645 at 7/24/23 10:56 PM: ---

[jira] [Commented] (FLINK-32645) Flink pulsar sink is having poor performance

2023-07-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746672#comment-17746672 ] Yufan Sheng commented on FLINK-32645: - Hi [~vbhasvij], can you add the flink-connect

[jira] [Commented] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2023-07-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746235#comment-17746235 ] Yufan Sheng commented on FLINK-24302: - So happy to see this issue can be closed fina

[jira] [Comment Edited] (FLINK-31107) Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0

2023-07-23 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746214#comment-17746214 ] Yufan Sheng edited comment on FLINK-31107 at 7/24/23 6:55 AM:

[jira] [Commented] (FLINK-31107) Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0

2023-07-23 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746214#comment-17746214 ] Yufan Sheng commented on FLINK-31107: - According to the [explain|https://github.com

[jira] [Commented] (FLINK-32645) Flink pulsar sink is having poor performance

2023-07-23 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746213#comment-17746213 ] Yufan Sheng commented on FLINK-32645: - [~vbhasvij] Sorry for the poor performance of

[jira] [Commented] (FLINK-28352) [Umbrella] Make Pulsar connector stable

2023-04-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711921#comment-17711921 ] Yufan Sheng commented on FLINK-28352: - Thanks. The FLINK-24302 will be closed in Pul

[jira] [Commented] (FLINK-25509) FLIP-208: Add RecordEvaluator to dynamically stop source based on de-serialized records

2023-04-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711902#comment-17711902 ] Yufan Sheng commented on FLINK-25509: - [~martijnvisser] I think this breaking change

[jira] [Commented] (FLINK-31371) Support subscribing non-existed topics in Pulsar source

2023-03-19 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702438#comment-17702438 ] Yufan Sheng commented on FLINK-31371: - [~enzodechaene] Support non-existed topic on

[jira] [Commented] (FLINK-31428) Add user callbacks to PulsarSource and PulsarSink

2023-03-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700406#comment-17700406 ] Yufan Sheng commented on FLINK-31428: - Add a `AutoCloseable` do make sense to me. BT

[jira] [Commented] (FLINK-31428) Add user callbacks to PulsarSource and PulsarSink

2023-03-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700323#comment-17700323 ] Yufan Sheng commented on FLINK-31428: - It's better to extend the {{ConsumerIntercept

[jira] [Comment Edited] (FLINK-31428) Add user callbacks to PulsarSource and PulsarSink

2023-03-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700319#comment-17700319 ] Yufan Sheng edited comment on FLINK-31428 at 3/14/23 5:36 PM:

[jira] [Commented] (FLINK-31428) Add user callbacks to PulsarSource and PulsarSink

2023-03-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700319#comment-17700319 ] Yufan Sheng commented on FLINK-31428: - I don't think it's ok to expose the deseriali

[jira] [Commented] (FLINK-31428) Add user callbacks to PulsarSource and PulsarSink

2023-03-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699901#comment-17699901 ] Yufan Sheng commented on FLINK-31428: - I see, the ser/deser issue matters. You want

[jira] [Commented] (FLINK-31371) Stream failure if the topic doesn't exist

2023-03-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699896#comment-17699896 ] Yufan Sheng commented on FLINK-31371: - Can we change this JIRA into a feature reques

[jira] [Created] (FLINK-31427) Pulsar Catalog support with Schema translation

2023-03-13 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31427: --- Summary: Pulsar Catalog support with Schema translation Key: FLINK-31427 URL: https://issues.apache.org/jira/browse/FLINK-31427 Project: Flink Issue Type: Sub-

[jira] [Commented] (FLINK-31371) Stream failure if the topic doesn't exist

2023-03-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699764#comment-17699764 ] Yufan Sheng commented on FLINK-31371: - [~guoweijie] Can you assign this ticket to me

[jira] [Commented] (FLINK-31371) Stream failure if the topic doesn't exist

2023-03-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699762#comment-17699762 ] Yufan Sheng commented on FLINK-31371: - Hi [~enzodechaene], the old fix in https://g

[jira] [Commented] (FLINK-31006) job is not finished when using pipeline mode to run bounded source like kafka/pulsar

2023-03-05 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696546#comment-17696546 ] Yufan Sheng commented on FLINK-31006: - [~lemonjing] Yep, I agree with you. > job is

[jira] [Commented] (FLINK-26203) Support Table API in Pulsar Connector

2023-02-27 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694315#comment-17694315 ] Yufan Sheng commented on FLINK-26203: - [~guoweijie] After discussing with [~affe], I

[jira] [Updated] (FLINK-31107) Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0

2023-02-23 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-31107: Description: This is a ticket for tracking [the known issue|https://github.com/apache/pulsar/issu

[jira] [Commented] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691266#comment-17691266 ] Yufan Sheng commented on FLINK-30938: - [~Weijie Guo] Can you confirm my report is co

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:43 PM:

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:42 PM:

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:41 PM:

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:38 PM:

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:38 PM:

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:31 PM:

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 5:31 PM:

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: Speculative-Execution-timeline.png > Release Testing: Verify FLINK-29766 Adaptive Batc

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 4:59 PM:

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: AdaptiveBatchScheduler-timeline.png > Release Testing: Verify FLINK-29766 Adaptive Bat

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: AdaptiveBatchScheduler-job-graph.png > Release Testing: Verify FLINK-29766 Adaptive Ba

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: (was: image-2023-02-21-00-45-21-712.png) > Release Testing: Verify FLINK-29766 Ada

[jira] [Comment Edited] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng edited comment on FLINK-30938 at 2/20/23 4:47 PM:

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: taskmanager-slots.png > Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler s

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: (was: Screenshot from 2023-02-21 00-06-36.png) > Release Testing: Verify FLINK-297

[jira] [Commented] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691244#comment-17691244 ] Yufan Sheng commented on FLINK-30938: - Thanks for assigning this test task to me. I

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: flink-dashborad-version.png > Release Testing: Verify FLINK-29766 Adaptive Batch Sched

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: Screenshot from 2023-02-21 00-06-36.png > Release Testing: Verify FLINK-29766 Adaptive

[jira] [Updated] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-20 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30938: Attachment: flink-1.17-branch-log.png > Release Testing: Verify FLINK-29766 Adaptive Batch Schedul

[jira] [Commented] (FLINK-30109) Checked exceptions are sneakingly transformed into unchecked exceptions in the Pulsar

2023-02-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17689835#comment-17689835 ] Yufan Sheng commented on FLINK-30109: - [~mapohl] Can we close this issue now? > Che

[jira] [Updated] (FLINK-31107) Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0

2023-02-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-31107: Description: This is a ticket for tracking [the known issue|https://github.com/apache/pulsar/issue

[jira] [Created] (FLINK-31107) Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0

2023-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31107: --- Summary: Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0 Key: FLINK-31107 URL: https://issues.apache.org/jira/browse/FLINK-31107 Project: Flin

[jira] [Created] (FLINK-31101) Replace all the JUnit 5 assertions to AssertJ

2023-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31101: --- Summary: Replace all the JUnit 5 assertions to AssertJ Key: FLINK-31101 URL: https://issues.apache.org/jira/browse/FLINK-31101 Project: Flink Issue Type: Techn

[jira] [Created] (FLINK-31100) Support the short topic pattern subscriber on default tenant and namespace

2023-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31100: --- Summary: Support the short topic pattern subscriber on default tenant and namespace Key: FLINK-31100 URL: https://issues.apache.org/jira/browse/FLINK-31100 Project: Fli

[jira] [Commented] (FLINK-30109) Checked exceptions are sneakingly transformed into unchecked exceptions in the Pulsar

2023-02-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687957#comment-17687957 ] Yufan Sheng commented on FLINK-30109: - I think it's ok to fix the issue only on mast

[jira] [Updated] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2023-02-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-24302: Description: Running the Pulsar connector with multiple split readers on Java 11 could throw {{a 

[jira] [Updated] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2023-02-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-24302: Description: Running the Pulsar connector with multiple split readers on Java 11 could throw {{a 

[jira] [Updated] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2023-02-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-24302: Description: Running the Pulsar connector with multiple split readers on Java 11 could throw {{a 

[jira] [Commented] (FLINK-30489) flink-sql-connector-pulsar doesn't shade all dependencies

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687779#comment-17687779 ] Yufan Sheng commented on FLINK-30489: - [~tison] Can you assign this issue to me? >

[jira] [Commented] (FLINK-30486) Make the config documentation generator available to connector repos

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687681#comment-17687681 ] Yufan Sheng commented on FLINK-30486: - I just copied the code from flink-docs and ex

[jira] [Commented] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687673#comment-17687673 ] Yufan Sheng commented on FLINK-30703: - After debugging with Pulsar developers, we st

[jira] [Commented] (FLINK-31006) job is not finished when using pipeline mode to run bounded source like kafka/pulsar

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687671#comment-17687671 ] Yufan Sheng commented on FLINK-31006: - No more splits is only used in Pulsar connect

[jira] [Comment Edited] (FLINK-28505) Pulsar sink doesn't support topic auto creation

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687669#comment-17687669 ] Yufan Sheng edited comment on FLINK-28505 at 2/13/23 2:25 AM:

[jira] [Commented] (FLINK-28351) Pulsar Sink should support dynamic generated topic from record

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687670#comment-17687670 ] Yufan Sheng commented on FLINK-28351: - [~tison] Where is the release note? I can't s

[jira] [Commented] (FLINK-28505) Pulsar sink doesn't support topic auto creation

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687669#comment-17687669 ] Yufan Sheng commented on FLINK-28505: - [~Tison] Can you help me close this issue? It

[jira] [Commented] (FLINK-31006) job is not finished when using pipeline mode to run bounded source like kafka/pulsar

2023-02-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687666#comment-17687666 ] Yufan Sheng commented on FLINK-31006: - Hi [~jackylau], can you give me a clear repro

[jira] [Commented] (FLINK-30413) Drop Shared and Key_Shared subscription support in Pulsar connector

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677525#comment-17677525 ] Yufan Sheng commented on FLINK-30413: - [~mapohl] Thanks, this really helps. And the

[jira] [Commented] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677477#comment-17677477 ] Yufan Sheng commented on FLINK-30703: - FYI, The related issue on Pulsar: https://gi

[jira] [Commented] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677476#comment-17677476 ] Yufan Sheng commented on FLINK-30703: - I think we can change the mocked Pulsar into

[jira] [Comment Edited] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677472#comment-17677472 ] Yufan Sheng edited comment on FLINK-30703 at 1/16/23 4:59 PM:

[jira] [Commented] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677472#comment-17677472 ] Yufan Sheng commented on FLINK-30703: - [~mapohl] It's wired to see the log that the

[jira] [Comment Edited] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677445#comment-17677445 ] Yufan Sheng edited comment on FLINK-30703 at 1/16/23 3:58 PM:

[jira] [Commented] (FLINK-30703) PulsarOrderedPartitionSplitReaderTest>PulsarPartitionSplitReaderTestBase.consumeMessageCreatedBeforeHandleSplitsChangesAndResetToEarliestPosition fails

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677445#comment-17677445 ] Yufan Sheng commented on FLINK-30703: - I see, I think this issue only occurs in 1.15

[jira] [Commented] (FLINK-30657) Remove Shared and Key_Shared related tests in Pulsar connector

2023-01-16 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677444#comment-17677444 ] Yufan Sheng commented on FLINK-30657: - Thanks. I'll check that issue. > Remove Shar

[jira] [Created] (FLINK-30689) Use auto produce bytes schema in Pulsar sink

2023-01-14 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-30689: --- Summary: Use auto produce bytes schema in Pulsar sink Key: FLINK-30689 URL: https://issues.apache.org/jira/browse/FLINK-30689 Project: Flink Issue Type: Improv

[jira] [Commented] (FLINK-30618) flink-connector-pulsar not retrievable from Apache's Snapshot Maven repository

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676805#comment-17676805 ] Yufan Sheng commented on FLINK-30618: - [~chesnay] I found the document of the extern

[jira] [Comment Edited] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng edited comment on FLINK-30681 at 1/14/23 12:08 AM: ---

[jira] [Comment Edited] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng edited comment on FLINK-30681 at 1/13/23 11:58 PM: ---

[jira] [Comment Edited] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng edited comment on FLINK-30681 at 1/13/23 11:44 PM: ---

[jira] [Comment Edited] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng edited comment on FLINK-30681 at 1/13/23 11:42 PM: ---

[jira] [Comment Edited] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng edited comment on FLINK-30681 at 1/13/23 11:36 PM: ---

[jira] [Comment Edited] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng edited comment on FLINK-30681 at 1/13/23 11:34 PM: ---

[jira] [Commented] (FLINK-30681) Pulsar-Flink connector corrupts its output topic

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676791#comment-17676791 ] Yufan Sheng commented on FLINK-30681: - I have checked your code and understand what

[jira] [Commented] (FLINK-30657) Remove Shared and Key_Shared related tests in Pulsar connector

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676786#comment-17676786 ] Yufan Sheng commented on FLINK-30657: - [~mapohl] Can you help me review these three

[jira] [Commented] (FLINK-30657) Remove Shared and Key_Shared related tests in Pulsar connector

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676775#comment-17676775 ] Yufan Sheng commented on FLINK-30657: - [~mapohl] Thanks for notify. I have seem that

[jira] [Updated] (FLINK-30657) Remove Shared and Key_Shared related tests in Pulsar connector

2023-01-13 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30657: Summary: Remove Shared and Key_Shared related tests in Pulsar connector (was: Disable Shared and

[jira] [Updated] (FLINK-30657) Disable Shared and Key_Shared related tests in Pulsar connector

2023-01-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-30657: Issue Type: Bug (was: Improvement) > Disable Shared and Key_Shared related tests in Pulsar connec

[jira] [Created] (FLINK-30657) Disable Shared and Key_Shared related tests in Pulsar connector

2023-01-12 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-30657: --- Summary: Disable Shared and Key_Shared related tests in Pulsar connector Key: FLINK-30657 URL: https://issues.apache.org/jira/browse/FLINK-30657 Project: Flink

[jira] [Commented] (FLINK-30413) Drop Shared and Key_Shared subscription support in Pulsar connector

2023-01-12 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676384#comment-17676384 ] Yufan Sheng commented on FLINK-30413: - [~mapohl] Can we just drop these tests instea

[jira] [Commented] (FLINK-30618) flink-connector-pulsar not retrievable from Apache's Snapshot Maven repository

2023-01-11 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17675714#comment-17675714 ] Yufan Sheng commented on FLINK-30618: - [~martijnvisser] I found that the Pulsar's {{

[jira] [Comment Edited] (FLINK-30618) flink-connector-pulsar not retrievable from Apache's Snapshot Maven repository

2023-01-10 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656755#comment-17656755 ] Yufan Sheng edited comment on FLINK-30618 at 1/10/23 7:02 PM:

[jira] [Commented] (FLINK-30618) flink-connector-pulsar not retrievable from Apache's Snapshot Maven repository

2023-01-10 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656755#comment-17656755 ] Yufan Sheng commented on FLINK-30618: - Since we have deploy the `4.0-SNAPSHOT`, the

[jira] [Created] (FLINK-30622) Support auto consume schema in Pulsar source

2023-01-10 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-30622: --- Summary: Support auto consume schema in Pulsar source Key: FLINK-30622 URL: https://issues.apache.org/jira/browse/FLINK-30622 Project: Flink Issue Type: New Fe

[jira] [Updated] (FLINK-28959) 504 gateway timeout when consume large number of topics using TopicPatten

2023-01-10 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-28959: Fix Version/s: (was: 1.15.4) > 504 gateway timeout when consume large number of topics using T

[jira] [Commented] (FLINK-30606) Bump Pulsar to 2.11.0

2023-01-10 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656532#comment-17656532 ] Yufan Sheng commented on FLINK-30606: - Pulsar 2.11.0 has been released. https://rep

[jira] [Commented] (FLINK-30616) Don't support batchMessageId when restore from checkpoint

2023-01-10 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656515#comment-17656515 ] Yufan Sheng commented on FLINK-30616: - [~songv] The [backport PR|https://github.com

  1   2   3   4   >