[
https://issues.apache.org/jira/browse/FLINK-20230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liu updated FLINK-20230:
------------------------
Summary: INSERT INTO EMPTY VALUES, THROW FileNotFoundException (was:
PARTITIONED TABLE, INSERT INTO EMPTY VALUES, THROW FileNotFoundException)
> INSERT INTO EMPTY VALUES, THROW FileNotFoundException
> ------------------------------------------------------
>
> Key: FLINK-20230
> URL: https://issues.apache.org/jira/browse/FLINK-20230
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, Table SQL / Ecosystem
> Affects Versions: 1.11.0, 1.11.1, 1.11.2
> Environment: TABLE DDL:
> CREATE TABLE IF NOT EXISTS test1 (
> uid string,
> truename string,
> dt string
> )
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY ''
> STORED AS TEXTFILE;
> CREATE TABLE IF NOT EXISTS test2(
> uid string COMMENT 'ID',
> truename string
> )
> PARTITIONED BY ( `dt` string )
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY ''
> STORED AS TEXTFILE;
> # CODE IS:
> EnvironmentSettings settings = EnvironmentSettings.newInstance()
> .useBlinkPlanner()
> .inBatchMode()
> .build();
> TableEnvironment tableEnv = TableEnvironment.create(settings);
> String nowDt = "202011111";
> Table table = tableEnv.sqlQuery(String.format("select \n" +
> "uid,\n" +
> "truename,\n"
> "'%s' as dt\n" +
> "from test1 " +
> "where dt = '%s'", nowDt, nowDt
> ));
> table.executeInsert("test2");
> Reporter: liu
> Priority: Major
> Fix For: 1.12.0
>
>
> table USE SQL "INSERT INTO VALUES", WHEN THE VALUES IS NULL, AND IT WILL
> THROW FileNotFoundException;
>
> *Exception:*
> Caused by: java.lang.Exception: Failed to finalize execution on masterCaused
> by: java.lang.Exception: Failed to finalize execution on master ... 34
> moreCaused by: org.apache.flink.table.api.TableException: Exception in
> finalizeGlobal at
> org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:97)
> at
> org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.finalizeOnMaster(InputOutputFormatVertex.java:132)
> at
> org.apache.flink.runtime.executiongraph.ExecutionGraph.vertexFinished(ExecutionGraph.java:1286)
> ... 33 moreCaused by: java.io.FileNotFoundException: File
> hdfs://nameservice1/user/hive/warehouse/test.db/test2/.staging_1605749732741
> does not exist. at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:901)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:112)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:961)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:958)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:958)
> at
> org.apache.flink.hive.shaded.fs.hdfs.HadoopFileSystem.listStatus(HadoopFileSystem.java:157)
> at
> org.apache.flink.table.filesystem.PartitionTempFileManager.headCheckpoints(PartitionTempFileManager.java:140)
> at
> org.apache.flink.table.filesystem.FileSystemCommitter.commitUpToCheckpoint(FileSystemCommitter.java:98)
> at
> org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:95)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
