[
https://issues.apache.org/jira/browse/PULSAR-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Kania updated PULSAR-21:
------------------------------
Description:
I have just upgraded from 1.12.7 to 1.15.0 of Flink. The installation is
currently using the 2.9.2 version of Pulsar. Now, the pulsar client is
generating the following exception:
2022-05-13 02:37:42,674 ERROR
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager [] -
Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 0 received unexpected exception
while polling the records
at
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:150)
~[flink-connector-files-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:105)
[flink-connector-files-1.15.0.jar:1.15.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[?:?]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.io.IOException:
org.apache.pulsar.client.api.PulsarClientException: reconsumeLater method not
support!
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarPartitionSplitReaderBase.fetch(PulsarPartitionSplitReaderBase.java:140)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.fetch(PulsarUnorderedPartitionSplitReader.java:55)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
~[flink-connector-files-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142)
~[flink-connector-files-1.15.0.jar:1.15.0]
... 6 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: reconsumeLater
method not support!
at
org.apache.pulsar.client.impl.ConsumerBase.reconsumeLater(ConsumerBase.java:345)
~[pulsar-client-all-2.9.2.jar:2.9.2]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.lambda$pollMessage$1(PulsarUnorderedPartitionSplitReader.java:109)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.common.utils.PulsarExceptionUtils.sneaky(PulsarExceptionUtils.java:60)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.common.utils.PulsarExceptionUtils.sneakyClient(PulsarExceptionUtils.java:41)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.pollMessage(PulsarUnorderedPartitionSplitReader.java:107)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarPartitionSplitReaderBase.fetch(PulsarPartitionSplitReaderBase.java:115)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.fetch(PulsarUnorderedPartitionSplitReader.java:55)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
I attempted to set the configuration for the PulsarSource through Flink for the
PULSAR_RETRY_ENABLE parameter to true, but that had no effect but I am only
guessing whether that is the related configuration parameter.
was:
I have just upgraded from 1.12.7 to 1.15.0 of Flink. The installation is
currently using the 2.9.2 version of Pulsar. Now, the pulsar client is
generating the following exception:
2022-05-13 02:37:42,674 ERROR
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager [] -
Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 0 received unexpected exception
while polling the records
at
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:150)
~[flink-connector-files-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:105)
[flink-connector-files-1.15.0.jar:1.15.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[?:?]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.io.IOException:
org.apache.pulsar.client.api.PulsarClientException: reconsumeLater method not
support!
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarPartitionSplitReaderBase.fetch(PulsarPartitionSplitReaderBase.java:140)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.fetch(PulsarUnorderedPartitionSplitReader.java:55)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
~[flink-connector-files-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142)
~[flink-connector-files-1.15.0.jar:1.15.0]
... 6 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: reconsumeLater
method not support!
at
org.apache.pulsar.client.impl.ConsumerBase.reconsumeLater(ConsumerBase.java:345)
~[pulsar-client-all-2.9.2.jar:2.9.2]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.lambda$pollMessage$1(PulsarUnorderedPartitionSplitReader.java:109)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.common.utils.PulsarExceptionUtils.sneaky(PulsarExceptionUtils.java:60)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.common.utils.PulsarExceptionUtils.sneakyClient(PulsarExceptionUtils.java:41)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.pollMessage(PulsarUnorderedPartitionSplitReader.java:107)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarPartitionSplitReaderBase.fetch(PulsarPartitionSplitReaderBase.java:115)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
at
org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.fetch(PulsarUnorderedPartitionSplitReader.java:55)
~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> "reconsumeLater method not support" exception using Pulsar client in Flink
> 1.15.0
> ---------------------------------------------------------------------------------
>
> Key: PULSAR-21
> URL: https://issues.apache.org/jira/browse/PULSAR-21
> Project: Pulsar
> Issue Type: Bug
> Environment: Java 11 on Ubuntu 20.04
> Reporter: Jason Kania
> Priority: Major
>
> I have just upgraded from 1.12.7 to 1.15.0 of Flink. The installation is
> currently using the 2.9.2 version of Pulsar. Now, the pulsar client is
> generating the following exception:
>
> 2022-05-13 02:37:42,674 ERROR
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager []
> - Received uncaught exception.
> java.lang.RuntimeException: SplitFetcher thread 0 received unexpected
> exception while polling the records
> at
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:150)
> ~[flink-connector-files-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:105)
> [flink-connector-files-1.15.0.jar:1.15.0]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> [?:?]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> [?:?]
> at java.lang.Thread.run(Thread.java:829) [?:?]
> Caused by: java.io.IOException:
> org.apache.pulsar.client.api.PulsarClientException: reconsumeLater method not
> support!
> at
> org.apache.flink.connector.pulsar.source.reader.split.PulsarPartitionSplitReaderBase.fetch(PulsarPartitionSplitReaderBase.java:140)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.fetch(PulsarUnorderedPartitionSplitReader.java:55)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
> ~[flink-connector-files-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142)
> ~[flink-connector-files-1.15.0.jar:1.15.0]
> ... 6 more
> Caused by: org.apache.pulsar.client.api.PulsarClientException: reconsumeLater
> method not support!
> at
> org.apache.pulsar.client.impl.ConsumerBase.reconsumeLater(ConsumerBase.java:345)
> ~[pulsar-client-all-2.9.2.jar:2.9.2]
> at
> org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.lambda$pollMessage$1(PulsarUnorderedPartitionSplitReader.java:109)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.pulsar.common.utils.PulsarExceptionUtils.sneaky(PulsarExceptionUtils.java:60)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.pulsar.common.utils.PulsarExceptionUtils.sneakyClient(PulsarExceptionUtils.java:41)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.pollMessage(PulsarUnorderedPartitionSplitReader.java:107)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.pulsar.source.reader.split.PulsarPartitionSplitReaderBase.fetch(PulsarPartitionSplitReaderBase.java:115)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
> at
> org.apache.flink.connector.pulsar.source.reader.split.PulsarUnorderedPartitionSplitReader.fetch(PulsarUnorderedPartitionSplitReader.java:55)
> ~[flink-connector-pulsar-1.15.0.jar:1.15.0]
>
> I attempted to set the configuration for the PulsarSource through Flink for
> the PULSAR_RETRY_ENABLE parameter to true, but that had no effect but I am
> only guessing whether that is the related configuration parameter.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
