Clark Chang created HUDI-1473:
---------------------------------
Summary: Handle empty parquet files
Key: HUDI-1473
URL: https://issues.apache.org/jira/browse/HUDI-1473
Project: Apache Hudi
Issue Type: Improvement
Components: Storage Management
Reporter: Clark Chang
Under occasional situations, Hudi bulk insert generates empty parquet files ( I
cannot consistently reproduce it, however).
The empty parquet files cause subsequent updates fail due to ParquetUtils
trying to read the footer.
In Spark, there is a property: "spark.sql.files.ignoreCorruptFiles" which
handles such a case, would Hudi be able to take in this property?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
