[
https://issues.apache.org/jira/browse/FLINK-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121389#comment-15121389
]
ASF GitHub Bot commented on FLINK-3295:
---------------------------------------
Github user StephanEwen commented on the pull request:
https://github.com/apache/flink/pull/1555#issuecomment-176175300
I think we have to make this a bit more sophisticated and allow the user to
specify behavior when offsets cannot be fetched:
- FAIL (fail if any offset could not be fetched)
- FALLBACK_ALL (as soon as one cannot be fetched, all follow the
auto-reset behavior)
- FALLBACK_FAILED (only the ones that could not be fetched follow the
auto-reset behavior)
Do we need to implement re-tries, or does the ZooKeeper framework handle
that?
> Flink Kafka consumer fails with NoNodeException if zkConnect string contains
> chroot-path
> ----------------------------------------------------------------------------------------
>
> Key: FLINK-3295
> URL: https://issues.apache.org/jira/browse/FLINK-3295
> Project: Flink
> Issue Type: Bug
> Reporter: Robert Metzger
> Assignee: Robert Metzger
>
> Zookeeper allows since V 3.2 to pass a base path (similar to chroot) with the
> connection string. Flink's {{ZookeeperOffsetHandler}} doesn't show a very
> helpful error message when the base path hasn't been created by the user.
> This is the exception:
> {code}
> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
> NoNode for /consumers
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> at org.apache.curator.utils.ZKPaths.mkdirs(ZKPaths.java:232)
> at
> org.apache.curator.utils.EnsurePath$InitialHelper$1.call(EnsurePath.java:148)
> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> at
> org.apache.curator.utils.EnsurePath$InitialHelper.ensure(EnsurePath.java:141)
> at org.apache.curator.utils.EnsurePath.ensure(EnsurePath.java:99)
> at
> org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler.getOffsetFromZooKeeper(ZookeeperOffsetHandler.java:125)
> at
> org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler.seekFetcherToInitialOffsets(ZookeeperOffsetHandler.java:93)
> at
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08.open(FlinkKafkaConsumer08.java:283)
> at
> org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
> at
> org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:89)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:305)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:227)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:568)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> But the user passed a connection string like: {{host:port/foo/bar}}.
> See also: http://zookeeper.apache.org/doc/trunk/zookeeperProgrammers.html
> (section on "ZooKeeper Sessions").
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
