[
https://issues.apache.org/jira/browse/FLINK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17558274#comment-17558274
]
bianqi edited comment on FLINK-28231 at 6/24/22 2:13 AM:
---------------------------------------------------------
[~prabhujoseph] thank you relpay.
ozone om doesn't have any error log, I submit MapReduce job without any
problem, I can read and write files normally.
If I use hdfs scheme to read and write HDFS data no problem
Flink wordcount use HDFS scheme:
!image-2022-06-24-10-05-42-193.png!
MapReduce: WordCount use ozone ofs scheme
!abc.png!
Flink wordcount use ofs scheme ozone
!image-2022-06-24-10-08-26-010.png!
was (Author: bianqi):
[~prabhujoseph] thank you relpay.
ozone om doesn't have any error log, I submit MapReduce job without any
problem, I can read and write files normally.
If I use hdfs scheme to read and write HDFS data no problem
Flink wordcount user HDFS scheme:
!image-2022-06-24-10-05-42-193.png!
MapReduce: WordCount use ozone ofs scheme
!abc.png!
Flink wordcount ofs ozone
!image-2022-06-24-10-08-26-010.png!
> Support Apache Ozone FileSystem
> -------------------------------
>
> Key: FLINK-28231
> URL: https://issues.apache.org/jira/browse/FLINK-28231
> Project: Flink
> Issue Type: New Feature
> Components: fs
> Affects Versions: 1.12.1
> Environment: * Flink1.12.1
> * Hadoop3.2.2
> * Ozone1.2.1
> Reporter: bianqi
> Priority: Major
> Attachments: abc.png, image-2022-06-24-10-05-42-193.png,
> image-2022-06-24-10-08-26-010.png, mapreduce-webui.png,
> 微信图片_20220623224142.png
>
>
> After the ozone environment is currently configured, mapreduce tasks can be
> submitted to read and write ozone, but flink tasks cannot be submitted
> The error is as follows
> {code:java}
> [root@jykj0 ozone-fs-hadoop]# flink run
> /soft/flink13/examples/batch/WordCount.jar --input
> ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
> ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
> [] - Found Yarn properties file under
> /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
> [] - Found Yarn properties file under
> /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:27,151 INFO
> org.apache.hadoop.io.retry.RetryInvocationHandler [] -
> java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over
> nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1 failover attempts. Trying
> to failover after sleeping for 4000ms.
> 2022-06-23 22:30:31,152 INFO
> org.apache.hadoop.io.retry.RetryInvocationHandler [] -
> java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over
> nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2 failover attempts. Trying
> to failover after sleeping for 6000ms.
> {code}
> Maybe there is something wrong with my configuration，Hope to update the
> documentation
> https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
