[
https://issues.apache.org/jira/browse/HUDI-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Forward Xu updated HUDI-3845:
-----------------------------
Description:
{code:java}
// code placeholder
4604 [ScalaTest-run-running-TestDeleteTable] WARN
org.apache.hudi.common.config.DFSPropertiesConfiguration - Properties file
file:/etc/hudi/conf/hudi-defaults.conf not found. Ignoring to load props file
5412 [ScalaTest-run-running-TestDeleteTable] WARN
org.apache.hudi.metadata.HoodieBackedTableMetadata - Metadata table was not
found at path
/private/var/folders/9d/qtc20f6x197431jvthgs58zr0000gn/T/spark-ce5c11fc-3e1d-4967-aaba-7c814f503224/h0/.hoodie/metadata
7658 [Executor task launch worker for task 8] WARN
org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration:
tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
20677 [Executor task launch worker for task 106] ERROR
org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader - Got
IOException when reading log file
java.io.FileNotFoundException: File
file:/private/var/folders/9d/qtc20f6x197431jvthgs58zr0000gn/T/spark-ce5c11fc-3e1d-4967-aaba-7c814f503224/h0/2021%252F10%252F01/.a2c7f463-7f0e-48b9-aa66-e56d62847b05-0_20220410194408951.log.1_0-83-88
does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:634)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:860)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:624)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:446)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:146)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
at
org.apache.hudi.common.table.log.HoodieLogFileReader.getFSDataInputStream(HoodieLogFileReader.java:472)
at
org.apache.hudi.common.table.log.HoodieLogFileReader.<init>(HoodieLogFileReader.java:111)
at
org.apache.hudi.common.table.log.HoodieLogFormatReader.<init>(HoodieLogFormatReader.java:70)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scanInternal(AbstractHoodieLogRecordReader.java:218)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scan(AbstractHoodieLogRecordReader.java:191)
at
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.performScan(HoodieMergedLogRecordScanner.java:106)
at
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.<init>(HoodieMergedLogRecordScanner.java:99)
at
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner$Builder.build(HoodieMergedLogRecordScanner.java:317)
at
org.apache.hudi.HoodieMergeOnReadRDD$.scanLog(HoodieMergeOnReadRDD.scala:370)
at
org.apache.hudi.HoodieMergeOnReadRDD$LogFileIterator.<init>(HoodieMergeOnReadRDD.scala:172)
at
org.apache.hudi.HoodieMergeOnReadRDD$RecordMergingFileIterator.<init>(HoodieMergeOnReadRDD.scala:252)
{code}
The partition path has urlencode, so it cannot be found.
was:
{code:java}
// code placeholder
4604 [ScalaTest-run-running-TestDeleteTable] WARN
org.apache.hudi.common.config.DFSPropertiesConfiguration - Properties file
file:/etc/hudi/conf/hudi-defaults.conf not found. Ignoring to load props file
5412 [ScalaTest-run-running-TestDeleteTable] WARN
org.apache.hudi.metadata.HoodieBackedTableMetadata - Metadata table was not
found at path
/private/var/folders/9d/qtc20f6x197431jvthgs58zr0000gn/T/spark-ce5c11fc-3e1d-4967-aaba-7c814f503224/h0/.hoodie/metadata
7658 [Executor task launch worker for task 8] WARN
org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration:
tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
20677 [Executor task launch worker for task 106] ERROR
org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader - Got
IOException when reading log file
java.io.FileNotFoundException: File
file:/private/var/folders/9d/qtc20f6x197431jvthgs58zr0000gn/T/spark-ce5c11fc-3e1d-4967-aaba-7c814f503224/h0/2021%252F10%252F01/.a2c7f463-7f0e-48b9-aa66-e56d62847b05-0_20220410194408951.log.1_0-83-88
does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:634)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:860)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:624)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:446)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:146)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
at
org.apache.hudi.common.table.log.HoodieLogFileReader.getFSDataInputStream(HoodieLogFileReader.java:472)
at
org.apache.hudi.common.table.log.HoodieLogFileReader.<init>(HoodieLogFileReader.java:111)
at
org.apache.hudi.common.table.log.HoodieLogFormatReader.<init>(HoodieLogFormatReader.java:70)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scanInternal(AbstractHoodieLogRecordReader.java:218)
at
org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scan(AbstractHoodieLogRecordReader.java:191)
at
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.performScan(HoodieMergedLogRecordScanner.java:106)
at
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.<init>(HoodieMergedLogRecordScanner.java:99)
at
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner$Builder.build(HoodieMergedLogRecordScanner.java:317)
at
org.apache.hudi.HoodieMergeOnReadRDD$.scanLog(HoodieMergeOnReadRDD.scala:370)
at
org.apache.hudi.HoodieMergeOnReadRDD$LogFileIterator.<init>(HoodieMergeOnReadRDD.scala:172)
at
org.apache.hudi.HoodieMergeOnReadRDD$RecordMergingFileIterator.<init>(HoodieMergeOnReadRDD.scala:252)
{code}
The partition path has urlcode, so it cannot be found
> Fix delete mor table's partition with urlencode's error
> -------------------------------------------------------
>
> Key: HUDI-3845
> URL: https://issues.apache.org/jira/browse/HUDI-3845
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark-sql
> Reporter: Forward Xu
> Assignee: Forward Xu
> Priority: Major
> Labels: pull-request-available
>
> {code:java}
> // code placeholder
> 4604 [ScalaTest-run-running-TestDeleteTable] WARN
> org.apache.hudi.common.config.DFSPropertiesConfiguration - Properties file
> file:/etc/hudi/conf/hudi-defaults.conf not found. Ignoring to load props file
> 5412 [ScalaTest-run-running-TestDeleteTable] WARN
> org.apache.hudi.metadata.HoodieBackedTableMetadata - Metadata table was not
> found at path
> /private/var/folders/9d/qtc20f6x197431jvthgs58zr0000gn/T/spark-ce5c11fc-3e1d-4967-aaba-7c814f503224/h0/.hoodie/metadata
> 7658 [Executor task launch worker for task 8] WARN
> org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration:
> tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
> 20677 [Executor task launch worker for task 106] ERROR
> org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader - Got
> IOException when reading log file
> java.io.FileNotFoundException: File
> file:/private/var/folders/9d/qtc20f6x197431jvthgs58zr0000gn/T/spark-ce5c11fc-3e1d-4967-aaba-7c814f503224/h0/2021%252F10%252F01/.a2c7f463-7f0e-48b9-aa66-e56d62847b05-0_20220410194408951.log.1_0-83-88
> does not exist
> at
> org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:634)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:860)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:624)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:446)
> at
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:146)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
> at
> org.apache.hudi.common.table.log.HoodieLogFileReader.getFSDataInputStream(HoodieLogFileReader.java:472)
> at
> org.apache.hudi.common.table.log.HoodieLogFileReader.<init>(HoodieLogFileReader.java:111)
> at
> org.apache.hudi.common.table.log.HoodieLogFormatReader.<init>(HoodieLogFormatReader.java:70)
> at
> org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scanInternal(AbstractHoodieLogRecordReader.java:218)
> at
> org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scan(AbstractHoodieLogRecordReader.java:191)
> at
> org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.performScan(HoodieMergedLogRecordScanner.java:106)
> at
> org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.<init>(HoodieMergedLogRecordScanner.java:99)
> at
> org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner$Builder.build(HoodieMergedLogRecordScanner.java:317)
> at
> org.apache.hudi.HoodieMergeOnReadRDD$.scanLog(HoodieMergeOnReadRDD.scala:370)
> at
> org.apache.hudi.HoodieMergeOnReadRDD$LogFileIterator.<init>(HoodieMergeOnReadRDD.scala:172)
> at
> org.apache.hudi.HoodieMergeOnReadRDD$RecordMergingFileIterator.<init>(HoodieMergeOnReadRDD.scala:252)
> {code}
> The partition path has urlencode, so it cannot be found.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
