[
https://issues.apache.org/jira/browse/FLINK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bianqi updated FLINK-28231:
---------------------------
Description:
After the ozone environment is currently configured, mapreduce tasks can be
submitted to read and write ozone, but flink tasks cannot be submitted
The error is as follows
{code:java}
[root@jykj0 ozone-fs-hadoop]# flink run
/soft/flink13/examples/batch/WordCount.jar --input
ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:27,151 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1
failover attempts. Trying to failover after sleeping for 4000ms.
2022-06-23 22:30:31,152 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2
failover attempts. Trying to failover after sleeping for 6000ms.
{code}
Maybe there is something wrong with my configuration，Hope to update the
documentation
https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/
was:
After the ozone environment is currently configured, mapreduce tasks can be
submitted to read and write ozone, but flink tasks cannot be submitted
The error is as follows
{code:java}
[root@jykj0 ozone-fs-hadoop]# flink run
/soft/flink13/examples/batch/WordCount.jar --input
ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:27,151 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1
failover attempts. Trying to failover after sleeping for 4000ms.
2022-06-23 22:30:31,152 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2
failover attempts. Trying to failover after sleeping for 6000ms. {code}
> Support Apache Ozone FileSystem
> -------------------------------
>
> Key: FLINK-28231
> URL: https://issues.apache.org/jira/browse/FLINK-28231
> Project: Flink
> Issue Type: New Feature
> Components: fs
> Affects Versions: 1.12.1
> Environment: * Flink1.12.1
> * Hadoop3.2.2
> * Ozone1.2.1
> Reporter: bianqi
> Priority: Major
>
> After the ozone environment is currently configured, mapreduce tasks can be
> submitted to read and write ozone, but flink tasks cannot be submitted
> The error is as follows
> {code:java}
> [root@jykj0 ozone-fs-hadoop]# flink run
> /soft/flink13/examples/batch/WordCount.jar --input
> ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
> ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
> [] - Found Yarn properties file under
> /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
> [] - Found Yarn properties file under
> /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:27,151 INFO
> org.apache.hadoop.io.retry.RetryInvocationHandler [] -
> java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over
> nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1 failover attempts. Trying
> to failover after sleeping for 4000ms.
> 2022-06-23 22:30:31,152 INFO
> org.apache.hadoop.io.retry.RetryInvocationHandler [] -
> java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over
> nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2 failover attempts. Trying
> to failover after sleeping for 6000ms.
> {code}
> Maybe there is something wrong with my configuration，Hope to update the
> documentation
> https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
