elon-X opened a new issue, #38503: URL: https://github.com/apache/doris/issues/38503
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version [2.1.5-rc02](https://github.com/apache/doris/releases/tag/2.1.5-rc02) ### What's Wrong? When using doris-2.1.5 to read a hive table (schema: viewfs), an error occurs, this error prevents reading online Hive tables. `Caused by: org.apache.hadoop.fs.FileAlreadyExistsException: Path /result already exists as dir; cannot create link here at org.apache.hadoop.fs.viewfs.InodeTree.createLink(InodeTree.java:400) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.fs.viewfs.InodeTree.<init>(InodeTree.java:670) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.fs.viewfs.ViewFileSystem$1.<init>(ViewFileSystem.java:331) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.fs.viewfs.ViewFileSystem.initialize(ViewFileSystem.java:330) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3611) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:554) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290) ~[hadoop-common-3.3.6.jar:?] at org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:672) ~[hadoop-mapreduce-client-core-3.3.6.jar:?] at org.apache.hadoop.mapred.FileInputFormat.setInputPaths(FileInputFormat.java:470) ~[hadoop-mapreduce-client-core-3.3.6.jar:?] at org.apache.hadoop.mapred.FileInputFormat.setInputPaths(FileInputFormat.java:443) ~[hadoop-mapreduce-client-core-3.3.6.jar:?] at org.apache.doris.datasource.hive.HiveMetaStoreCache.loadFiles(HiveMetaStoreCache.java:412) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.datasource.hive.HiveMetaStoreCache.access$300(HiveMetaStoreCache.java:101) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.datasource.hive.HiveMetaStoreCache$2.load(HiveMetaStoreCache.java:195) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.datasource.hive.HiveMetaStoreCache$2.load(HiveMetaStoreCache.java:187) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.common.util.CacheBulkLoader.lambda$null$0(CacheBulkLoader.java:42) ~[doris-fe.jar:1.2-SNAPSHOT] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_131]` **Root Cause** Doris uses Hadoop version 3.3.6, which has an issue that has been fixed in version 3.4.0. See the Hadoop issue: https://issues.apache.org/jira/browse/HADOOP-18193 Setting the Hadoop version to 3.4.0, then it works. ### What You Expected? Doris can successfully read Hive tables with the schema set to viewfs. ### How to Reproduce? **1.create hive-catalog** `CREATE CATALOG hive_catalog PROPERTIES ( 'type'='hms', 'hive.metastore.uris' = 'thrift://xxx', 'hadoop.username' = 'hive' );` **2.select hive table** `select * from hive_catalog.db.table_xxx;` ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
