[ 
https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746499#comment-17746499
 ] 

Vijaya Bhaskar V commented on FLINK-32645:
------------------------------------------

We are facing upgrade issues with this connector,  we upgraded to flink 1.17.0, 
still same issues facing. Any help?

 switched from INITIALIZING to FAILED with failure cause: 
java.lang.NoSuchMethodError: 'void 
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.<init>(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue,
 java.util.function.Supplier, org.apache.flink.configuration.Configuration)'
        at 
org.apache.flink.connector.pulsar.source.reader.PulsarSourceFetcherManager.<init>(PulsarSourceFetcherManager.java:71)
        at 
org.apache.flink.connector.pulsar.source.reader.PulsarSourceReader.create(PulsarSourceReader.java:298)
        at 
org.apache.flink.connector.pulsar.source.PulsarSource.createReader(PulsarSource.java:137)

 

> Flink pulsar sink is having poor performance
> --------------------------------------------
>
>                 Key: FLINK-32645
>                 URL: https://issues.apache.org/jira/browse/FLINK-32645
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Pulsar
>    Affects Versions: 1.16.2
>         Environment: !Screenshot 2023-07-22 at 1.59.42 PM.png!!Screenshot 
> 2023-07-22 at 2.03.53 PM.png!
>  
>            Reporter: Vijaya Bhaskar V
>            Priority: Major
>         Attachments: Screenshot 2023-07-22 at 2.03.53 PM.png, Screenshot 
> 2023-07-22 at 2.56.55 PM.png, Screenshot 2023-07-22 at 3.45.21 PM-1.png, 
> Screenshot 2023-07-22 at 3.45.21 PM.png
>
>
> Found following issue with flink pulsar sink:
>  
> Flink pulsar sink is always waiting while enqueueing the message and making 
> the task slot busy no matter how many free slots we provide. Attached the 
> screen shot of the same
> Just sending messages of less rate 8k msg/sec and stand alone flink job with 
> discarding sink is able to receive full rate if 8K msg/sec
> Where as pulsar sink was consuming only upto 2K msg/sec and the sink is 
> always busy waiting. Snapshot of thread dump attached.
> Also snap shot of flink stream graph attached
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to