[
https://issues.apache.org/jira/browse/HUDI-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483603#comment-17483603
]
Harsha Teja Kanna edited comment on HUDI-3335 at 1/28/22, 8:34 AM:
-------------------------------------------------------------------
Hi,
1) Yes partitions are of type 'yyyy/mm/dd'. No using wild cards takes a long
time. In fact we switch to only using base path from the suggestion from the
other ticket https://issues.apache.org/jira/browse/HUDI-3066
2) 'metadata list-partitions' shown at the end
3) No delete_partition operations were performed
4) hive_sync disabled intentionally,
5) 'metadata validate-files' is running for all partitions for a while now,
total 389 of them, But I see these below errors for many partitions
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Number of log
files scanned => 7
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner -
MaxMemoryInBytes allowed for compaction => 1073741824
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Number of
entries in MemoryBasedMap in ExternalSpillableMap => 3
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Total size in
bytes of MemoryBasedMap in ExternalSpillableMap => 1800
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Number of
entries in BitCaskDiskMap in ExternalSpillableMap => 0
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Size of file
spilled to disk => 0
1640607 [Spring Shell] INFO org.apache.hudi.metadata.HoodieBackedTableMetadata
- Opened 7 metadata log files (dataset instant=20220126024720121, metadata
instant=20220126024720121) in 3577 ms
1640806 [Spring Shell] INFO org.apache.hadoop.io.compress.CodecPool - Got
brand-new decompressor [.gz]
1640808 [Spring Shell] INFO org.apache.hudi.metadata.HoodieBackedTableMetadata
- Metadata read for 1 keys took [baseFileRead, logMerge] [0, 201] ms
1640809 [Spring Shell] INFO org.apache.hudi.metadata.BaseTableMetadata -
Listed file in partition from metadata: partition=date=2022/01/15, #files=0
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand -
FS and metadata files count not matching for date=2022/01/15. FS files count
19, metadata base files count 0
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
91eeab55-ee54-4285-a493-01d04a237691-0_775-489-15939_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
91eeab55-ee54-4285-a493-01d04a237691-1_775-489-15939_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
96c4d9d1-9de4-4c50-bd9c-f3f6a7bfb40b-0_133-10-6713_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
e266b306-b376-4954-8403-8f858dec34ee-0_134-10-6714_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
399fa917-1198-4c9a-bf63-754f40a5ad09-0_806-501-16124_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
dac6d5d0-ca15-48e2-9b13-f37b4d113e64-0_804-501-16163_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
dde98b16-326c-4890-b100-4548d3161328-0_138-10-6718_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
80cd989e-296c-4dda-ae2d-4c7577fdc351-0_805-501-15994_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
83409360-e1c2-4bd6-ac22-b59e52eaf6ad-0_776-489-16054_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5887f02d-fd66-4678-ac34-fe585e9946a4-0_137-10-6717_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
a03a35be-db55-4a96-a584-42b8007d507c-0_132-10-6712_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
ddd0500e-9434-451b-9066-dfc7c5f6260b-0_777-489-16040_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
dac6d5d0-ca15-48e2-9b13-f37b4d113e64-1_804-501-16163_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
8ff179b4-124e-4076-80bb-d72b40b13bc9-0_135-10-6715_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5cb8182c-b2c2-4d19-ac15-bd6a8aaee9bd-0_136-10-6716_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5491f46c-9340-430a-a8e8-9afe74462724-0_130-10-6710_20220121225020686.parquet
1641314 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
66cdec80-acc8-483f-b901-9984adb04c48-0_807-501-16031_20220122014925413.parquet
1641314 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5e707c93-b524-448f-afc9-ba264cba9e9f-0_131-10-6711_20220121225020686.parquet
1641314 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
cb438d0e-2cfa-4b45-b2bd-3b5be0717223-0_139-10-6719_20220121225020686.parquet
6) 'metadata list-partitions'
║ partition ║
╠═════════════════╣
║ date=2022/01/25 ║
╟─────────────────╢
║ date=2022/01/24 ║
╟─────────────────╢
║ date=2022/01/23 ║
╟─────────────────╢
║ date=2022/01/22 ║
╟─────────────────╢
║ date=2022/01/21 ║
╟─────────────────╢
║ date=2022/01/20 ║
╟─────────────────╢
║ date=2022/01/19 ║
╟─────────────────╢
║ date=2022/01/18 ║
╟─────────────────╢
║ date=2022/01/17 ║
╟─────────────────╢
║ date=2022/01/16 ║
╟─────────────────╢
║ date=2022/01/15 ║
╟─────────────────╢
║ date=2022/01/14 ║
╟─────────────────╢
║ date=2022/01/13 ║
╟─────────────────╢
║ date=2022/01/12 ║
╟─────────────────╢
║ date=2022/01/11 ║
╟─────────────────╢
║ date=2022/01/10 ║
╟─────────────────╢
║ date=2022/01/09 ║
╟─────────────────╢
║ date=2022/01/08 ║
╟─────────────────╢
║ date=2022/01/07 ║
╟─────────────────╢
║ date=2022/01/06 ║
╟─────────────────╢
║ date=2022/01/05 ║
╟─────────────────╢
║ date=2022/01/04 ║
╟─────────────────╢
║ date=2022/01/03 ║
╟─────────────────╢
║ date=2022/01/02 ║
╟─────────────────╢
║ date=2022/01/01 ║
╟─────────────────╢
║ date=2021/12/31 ║
╟─────────────────╢
║ date=2021/12/30 ║
╟─────────────────╢
║ date=2021/12/29 ║
╟─────────────────╢
║ date=2021/12/28 ║
╟─────────────────╢
║ date=2021/12/27 ║
╟─────────────────╢
║ date=2021/12/26 ║
╟─────────────────╢
║ date=2021/12/25 ║
╟─────────────────╢
║ date=2021/12/24 ║
╟─────────────────╢
║ date=2021/12/23 ║
╟─────────────────╢
║ date=2021/12/22 ║
╟─────────────────╢
║ date=2021/12/21 ║
╟─────────────────╢
║ date=2021/12/20 ║
╟─────────────────╢
║ date=2021/12/19 ║
╟─────────────────╢
║ date=2021/12/18 ║
╟─────────────────╢
║ date=2021/12/17 ║
╟─────────────────╢
║ date=2021/12/16 ║
╟─────────────────╢
║ date=2021/12/15 ║
╟─────────────────╢
║ date=2021/12/14 ║
╟─────────────────╢
║ date=2021/12/13 ║
╟─────────────────╢
║ date=2021/12/12 ║
╟─────────────────╢
║ date=2021/12/11 ║
╟─────────────────╢
║ date=2021/12/10 ║
╟─────────────────╢
║ date=2021/12/09 ║
╟─────────────────╢
║ date=2021/12/08 ║
╟─────────────────╢
║ date=2021/12/07 ║
╟─────────────────╢
║ date=2021/12/06 ║
╟─────────────────╢
║ date=2021/12/05 ║
╟─────────────────╢
║ date=2021/12/04 ║
╟─────────────────╢
║ date=2021/12/03 ║
╟─────────────────╢
║ date=2021/12/02 ║
╟─────────────────╢
║ date=2021/12/01 ║
╟─────────────────╢
║ date=2021/11/30 ║
╟─────────────────╢
║ date=2021/11/29 ║
╟─────────────────╢
║ date=2021/11/28 ║
╟─────────────────╢
║ date=2021/11/27 ║
╟─────────────────╢
║ date=2021/11/26 ║
╟─────────────────╢
║ date=2021/11/25 ║
╟─────────────────╢
║ date=2021/11/24 ║
╟─────────────────╢
║ date=2021/11/23 ║
╟─────────────────╢
║ date=2021/11/22 ║
╟─────────────────╢
║ date=2021/11/21 ║
╟─────────────────╢
║ date=2021/11/20 ║
╟─────────────────╢
║ date=2021/11/19 ║
╟─────────────────╢
║ date=2021/11/18 ║
╟─────────────────╢
║ date=2021/11/17 ║
╟─────────────────╢
║ date=2021/11/16 ║
╟─────────────────╢
║ date=2021/11/15 ║
╟─────────────────╢
║ date=2021/11/14 ║
╟─────────────────╢
║ date=2021/11/13 ║
╟─────────────────╢
║ date=2021/11/12 ║
╟─────────────────╢
║ date=2021/11/11 ║
╟─────────────────╢
║ date=2021/11/10 ║
╟─────────────────╢
║ date=2021/11/09 ║
╟─────────────────╢
║ date=2021/11/08 ║
╟─────────────────╢
║ date=2021/11/07 ║
╟─────────────────╢
║ date=2021/11/06 ║
╟─────────────────╢
║ date=2021/11/05 ║
╟─────────────────╢
║ date=2021/11/04 ║
╟─────────────────╢
║ date=2021/11/03 ║
╟─────────────────╢
║ date=2021/11/02 ║
╟─────────────────╢
║ date=2021/11/01 ║
╟─────────────────╢
║ date=2021/10/31 ║
╟─────────────────╢
║ date=2021/10/30 ║
╟─────────────────╢
║ date=2021/10/29 ║
╟─────────────────╢
║ date=2021/10/28 ║
╟─────────────────╢
║ date=2021/10/27 ║
╟─────────────────╢
║ date=2021/10/26 ║
╟─────────────────╢
║ date=2021/10/25 ║
╟─────────────────╢
║ date=2021/10/24 ║
╟─────────────────╢
║ date=2021/10/23 ║
╟─────────────────╢
║ date=2021/10/22 ║
╟─────────────────╢
║ date=2021/10/21 ║
╟─────────────────╢
║ date=2021/10/20 ║
╟─────────────────╢
║ date=2021/10/19 ║
╟─────────────────╢
║ date=2021/10/18 ║
╟─────────────────╢
║ date=2021/10/17 ║
╟─────────────────╢
║ date=2021/10/16 ║
╟─────────────────╢
║ date=2021/10/15 ║
╟─────────────────╢
║ date=2021/10/14 ║
╟─────────────────╢
║ date=2021/10/13 ║
╟─────────────────╢
║ date=2021/10/12 ║
╟─────────────────╢
║ date=2021/10/11 ║
╟─────────────────╢
║ date=2021/10/10 ║
╟─────────────────╢
║ date=2021/10/09 ║
╟─────────────────╢
║ date=2021/10/08 ║
╟─────────────────╢
║ date=2021/10/07 ║
╟─────────────────╢
║ date=2021/10/06 ║
╟─────────────────╢
║ date=2021/10/05 ║
╟─────────────────╢
║ date=2021/10/04 ║
╟─────────────────╢
║ date=2021/10/03 ║
╟─────────────────╢
║ date=2021/10/02 ║
╟─────────────────╢
║ date=2021/10/01 ║
╟─────────────────╢
║ date=2021/09/30 ║
╟─────────────────╢
║ date=2021/09/29 ║
╟─────────────────╢
║ date=2021/09/28 ║
╟─────────────────╢
║ date=2021/09/27 ║
╟─────────────────╢
║ date=2021/09/26 ║
╟─────────────────╢
║ date=2021/09/25 ║
╟─────────────────╢
║ date=2021/09/24 ║
╟─────────────────╢
║ date=2021/09/23 ║
╟─────────────────╢
║ date=2021/09/22 ║
╟─────────────────╢
║ date=2021/09/21 ║
╟─────────────────╢
║ date=2021/09/20 ║
╟─────────────────╢
║ date=2021/09/19 ║
╟─────────────────╢
║ date=2021/09/18 ║
╟─────────────────╢
║ date=2021/09/17 ║
╟─────────────────╢
║ date=2021/09/16 ║
╟─────────────────╢
║ date=2021/09/15 ║
╟─────────────────╢
║ date=2021/09/14 ║
╟─────────────────╢
║ date=2021/09/13 ║
╟─────────────────╢
║ date=2021/09/12 ║
╟─────────────────╢
║ date=2021/09/11 ║
╟─────────────────╢
║ date=2021/09/10 ║
╟─────────────────╢
║ date=2021/09/09 ║
╟─────────────────╢
║ date=2021/09/08 ║
╟─────────────────╢
║ date=2021/09/07 ║
╟─────────────────╢
║ date=2021/09/06 ║
╟─────────────────╢
║ date=2021/09/05 ║
╟─────────────────╢
║ date=2021/09/04 ║
╟─────────────────╢
║ date=2021/09/03 ║
╟─────────────────╢
║ date=2021/09/02 ║
╟─────────────────╢
║ date=2021/09/01 ║
╟─────────────────╢
║ date=2021/08/31 ║
╟─────────────────╢
║ date=2021/08/30 ║
╟─────────────────╢
║ date=2021/08/29 ║
╟─────────────────╢
║ date=2021/08/28 ║
╟─────────────────╢
║ date=2021/08/27 ║
╟─────────────────╢
║ date=2021/08/26 ║
╟─────────────────╢
║ date=2021/08/25 ║
╟─────────────────╢
║ date=2021/08/24 ║
╟─────────────────╢
║ date=2021/08/23 ║
╟─────────────────╢
║ date=2021/08/22 ║
╟─────────────────╢
║ date=2021/08/21 ║
╟─────────────────╢
║ date=2021/08/20 ║
╟─────────────────╢
║ date=2021/08/19 ║
╟─────────────────╢
║ date=2021/08/18 ║
╟─────────────────╢
║ date=2021/08/17 ║
╟─────────────────╢
║ date=2021/08/16 ║
╟─────────────────╢
║ date=2021/08/15 ║
╟─────────────────╢
║ date=2021/08/14 ║
╟─────────────────╢
║ date=2021/08/13 ║
╟─────────────────╢
║ date=2021/08/12 ║
╟─────────────────╢
║ date=2021/08/11 ║
╟─────────────────╢
║ date=2021/08/10 ║
╟─────────────────╢
║ date=2021/08/09 ║
╟─────────────────╢
║ date=2021/08/08 ║
╟─────────────────╢
║ date=2021/08/07 ║
╟─────────────────╢
║ date=2021/08/06 ║
╟─────────────────╢
║ date=2021/08/05 ║
╟─────────────────╢
║ date=2021/08/04 ║
╟─────────────────╢
║ date=2021/08/03 ║
╟─────────────────╢
║ date=2021/08/02 ║
╟─────────────────╢
║ date=2021/08/01 ║
╟─────────────────╢
║ date=2021/07/31 ║
╟─────────────────╢
║ date=2021/07/30 ║
╟─────────────────╢
║ date=2021/07/29 ║
╟─────────────────╢
║ date=2021/07/28 ║
╟─────────────────╢
║ date=2021/07/27 ║
╟─────────────────╢
║ date=2021/07/26 ║
╟─────────────────╢
║ date=2021/07/25 ║
╟─────────────────╢
║ date=2021/07/24 ║
╟─────────────────╢
║ date=2021/07/23 ║
╟─────────────────╢
║ date=2021/07/22 ║
╟─────────────────╢
║ date=2021/07/21 ║
╟─────────────────╢
║ date=2021/07/20 ║
╟─────────────────╢
║ date=2021/07/19 ║
╟─────────────────╢
║ date=2021/07/18 ║
╟─────────────────╢
║ date=2021/07/17 ║
╟─────────────────╢
║ date=2021/07/16 ║
╟─────────────────╢
║ date=2021/07/15 ║
╟─────────────────╢
║ date=2021/07/14 ║
╟─────────────────╢
║ date=2021/07/13 ║
╟─────────────────╢
║ date=2021/07/12 ║
╟─────────────────╢
║ date=2021/07/11 ║
╟─────────────────╢
║ date=2021/07/10 ║
╟─────────────────╢
║ date=2021/07/09 ║
╟─────────────────╢
║ date=2021/07/08 ║
╟─────────────────╢
║ date=2021/07/07 ║
╟─────────────────╢
║ date=2021/07/06 ║
╟─────────────────╢
║ date=2021/07/05 ║
╟─────────────────╢
║ date=2021/07/04 ║
╟─────────────────╢
║ date=2021/07/03 ║
╟─────────────────╢
║ date=2021/07/02 ║
╟─────────────────╢
║ date=2021/07/01 ║
╟─────────────────╢
║ date=2021/06/30 ║
╟─────────────────╢
║ date=2021/06/29 ║
╟─────────────────╢
║ date=2021/06/28 ║
╟─────────────────╢
║ date=2021/06/27 ║
╟─────────────────╢
║ date=2021/06/26 ║
╟─────────────────╢
║ date=2021/06/25 ║
╟─────────────────╢
║ date=2021/06/24 ║
╟─────────────────╢
║ date=2021/06/23 ║
╟─────────────────╢
║ date=2021/06/22 ║
╟─────────────────╢
║ date=2021/06/21 ║
╟─────────────────╢
║ date=2021/06/20 ║
╟─────────────────╢
║ date=2021/06/19 ║
╟─────────────────╢
║ date=2021/06/18 ║
╟─────────────────╢
║ date=2021/06/17 ║
╟─────────────────╢
║ date=2021/06/16 ║
╟─────────────────╢
║ date=2021/06/15 ║
╟─────────────────╢
║ date=2021/06/14 ║
╟─────────────────╢
║ date=2021/06/13 ║
╟─────────────────╢
║ date=2021/06/12 ║
╟─────────────────╢
║ date=2021/06/11 ║
╟─────────────────╢
║ date=2021/06/10 ║
╟─────────────────╢
║ date=2021/06/09 ║
╟─────────────────╢
║ date=2021/06/08 ║
╟─────────────────╢
║ date=2021/06/07 ║
╟─────────────────╢
║ date=2021/06/06 ║
╟─────────────────╢
║ date=2021/06/05 ║
╟─────────────────╢
║ date=2021/06/04 ║
╟─────────────────╢
║ date=2021/06/03 ║
╟─────────────────╢
║ date=2021/06/02 ║
╟─────────────────╢
║ date=2021/06/01 ║
╟─────────────────╢
║ date=2021/05/31 ║
╟─────────────────╢
║ date=2021/05/30 ║
╟─────────────────╢
║ date=2021/05/29 ║
╟─────────────────╢
║ date=2021/05/28 ║
╟─────────────────╢
║ date=2021/05/27 ║
╟─────────────────╢
║ date=2021/05/26 ║
╟─────────────────╢
║ date=2021/05/25 ║
╟─────────────────╢
║ date=2021/05/24 ║
╟─────────────────╢
║ date=2021/05/23 ║
╟─────────────────╢
║ date=2021/05/22 ║
╟─────────────────╢
║ date=2021/05/21 ║
╟─────────────────╢
║ date=2021/05/20 ║
╟─────────────────╢
║ date=2021/05/19 ║
╟─────────────────╢
║ date=2021/05/18 ║
╟─────────────────╢
║ date=2021/05/17 ║
╟─────────────────╢
║ date=2021/05/16 ║
╟─────────────────╢
║ date=2021/05/15 ║
╟─────────────────╢
║ date=2021/05/14 ║
╟─────────────────╢
║ date=2021/05/13 ║
╟─────────────────╢
║ date=2021/05/12 ║
╟─────────────────╢
║ date=2021/05/11 ║
╟─────────────────╢
║ date=2021/05/10 ║
╟─────────────────╢
║ date=2021/05/09 ║
╟─────────────────╢
║ date=2021/05/08 ║
╟─────────────────╢
║ date=2021/05/07 ║
╟─────────────────╢
║ date=2021/05/06 ║
╟─────────────────╢
║ date=2021/05/05 ║
╟─────────────────╢
║ date=2021/05/04 ║
╟─────────────────╢
║ date=2021/05/03 ║
╟─────────────────╢
║ date=2021/05/02 ║
╟─────────────────╢
║ date=2021/05/01 ║
╟─────────────────╢
║ date=2021/04/30 ║
╟─────────────────╢
║ date=2021/04/29 ║
╟─────────────────╢
║ date=2021/04/28 ║
╟─────────────────╢
║ date=2021/04/27 ║
╟─────────────────╢
║ date=2021/04/26 ║
╟─────────────────╢
║ date=2021/04/25 ║
╟─────────────────╢
║ date=2021/04/24 ║
╟─────────────────╢
║ date=2021/04/23 ║
╟─────────────────╢
║ date=2021/04/22 ║
╟─────────────────╢
║ date=2021/04/21 ║
╟─────────────────╢
║ date=2021/04/20 ║
╟─────────────────╢
║ date=2021/04/19 ║
╟─────────────────╢
║ date=2021/04/18 ║
╟─────────────────╢
║ date=2021/04/17 ║
╟─────────────────╢
║ date=2021/04/16 ║
╟─────────────────╢
║ date=2021/04/15 ║
╟─────────────────╢
║ date=2021/04/14 ║
╟─────────────────╢
║ date=2021/04/13 ║
╟─────────────────╢
║ date=2021/04/12 ║
╟─────────────────╢
║ date=2021/04/11 ║
╟─────────────────╢
║ date=2021/04/10 ║
╟─────────────────╢
║ date=2021/04/09 ║
╟─────────────────╢
║ date=2021/04/08 ║
╟─────────────────╢
║ date=2021/04/07 ║
╟─────────────────╢
║ date=2021/04/06 ║
╟─────────────────╢
║ date=2021/04/05 ║
╟─────────────────╢
║ date=2021/04/04 ║
╟─────────────────╢
║ date=2021/04/03 ║
╟─────────────────╢
║ date=2021/04/02 ║
╟─────────────────╢
║ date=2021/04/01 ║
╟─────────────────╢
║ date=2021/03/31 ║
╟─────────────────╢
║ date=2021/03/30 ║
╟─────────────────╢
║ date=2021/03/29 ║
╟─────────────────╢
║ date=2021/03/28 ║
╟─────────────────╢
║ date=2021/03/27 ║
╟─────────────────╢
║ date=2021/03/26 ║
╟─────────────────╢
║ date=2021/03/25 ║
╟─────────────────╢
║ date=2021/03/24 ║
╟─────────────────╢
║ date=2021/03/23 ║
╟─────────────────╢
║ date=2021/03/22 ║
╟─────────────────╢
║ date=2021/03/21 ║
╟─────────────────╢
║ date=2021/03/20 ║
╟─────────────────╢
║ date=2021/03/19 ║
╟─────────────────╢
║ date=2021/03/18 ║
╟─────────────────╢
║ date=2021/03/17 ║
╟─────────────────╢
║ date=2021/03/16 ║
╟─────────────────╢
║ date=2021/03/15 ║
╟─────────────────╢
║ date=2021/03/14 ║
╟─────────────────╢
║ date=2021/03/13 ║
╟─────────────────╢
║ date=2021/03/12 ║
╟─────────────────╢
║ date=2021/03/11 ║
╟─────────────────╢
║ date=2021/03/10 ║
╟─────────────────╢
║ date=2021/03/09 ║
╟─────────────────╢
║ date=2021/03/08 ║
╟─────────────────╢
║ date=2021/03/07 ║
╟─────────────────╢
║ date=2021/03/06 ║
╟─────────────────╢
║ date=2021/03/05 ║
╟─────────────────╢
║ date=2021/03/04 ║
╟─────────────────╢
║ date=2021/03/03 ║
╟─────────────────╢
║ date=2021/03/02 ║
╟─────────────────╢
║ date=2021/03/01 ║
╟─────────────────╢
║ date=2021/02/28 ║
╟─────────────────╢
║ date=2021/02/27 ║
╟─────────────────╢
║ date=2021/02/26 ║
╟─────────────────╢
║ date=2021/02/25 ║
╟─────────────────╢
║ date=2021/02/24 ║
╟─────────────────╢
║ date=2021/02/23 ║
╟─────────────────╢
║ date=2021/02/22 ║
╟─────────────────╢
║ date=2021/02/21 ║
╟─────────────────╢
║ date=2021/02/20 ║
╟─────────────────╢
║ date=2021/02/19 ║
╟─────────────────╢
║ date=2021/02/18 ║
╟─────────────────╢
║ date=2021/02/17 ║
╟─────────────────╢
║ date=2021/02/16 ║
╟─────────────────╢
║ date=2021/02/15 ║
╟─────────────────╢
║ date=2021/02/14 ║
╟─────────────────╢
║ date=2021/02/13 ║
╟─────────────────╢
║ date=2021/02/12 ║
╟─────────────────╢
║ date=2021/02/11 ║
╟─────────────────╢
║ date=2021/02/10 ║
╟─────────────────╢
║ date=2021/02/09 ║
╟─────────────────╢
║ date=2021/02/08 ║
╟─────────────────╢
║ date=2021/02/07 ║
╟─────────────────╢
║ date=2021/02/06 ║
╟─────────────────╢
║ date=2021/02/05 ║
╟─────────────────╢
║ date=2021/02/04 ║
╟─────────────────╢
║ date=2021/02/03 ║
╟─────────────────╢
║ date=2021/02/02 ║
╟─────────────────╢
║ date=2021/02/01 ║
╟─────────────────╢
║ date=2021/01/31 ║
╟─────────────────╢
║ date=2021/01/30 ║
╟─────────────────╢
║ date=2021/01/29 ║
╟─────────────────╢
║ date=2021/01/28 ║
╟─────────────────╢
║ date=2021/01/27 ║
╟─────────────────╢
║ date=2021/01/26 ║
╟─────────────────╢
║ date=2021/01/25 ║
╟─────────────────╢
║ date=2021/01/24 ║
╟─────────────────╢
║ date=2021/01/23 ║
╟─────────────────╢
║ date=2021/01/22 ║
╟─────────────────╢
║ date=2021/01/21 ║
╟─────────────────╢
║ date=2021/01/20 ║
╟─────────────────╢
║ date=2021/01/19 ║
╟─────────────────╢
║ date=2021/01/18 ║
╟─────────────────╢
║ date=2021/01/17 ║
╟─────────────────╢
║ date=2021/01/16 ║
╟─────────────────╢
║ date=2021/01/15 ║
╟─────────────────╢
║ date=2021/01/14 ║
╟─────────────────╢
║ date=2021/01/13 ║
╟─────────────────╢
║ date=2021/01/12 ║
╟─────────────────╢
║ date=2021/01/11 ║
╟─────────────────╢
║ date=2021/01/10 ║
╟─────────────────╢
║ date=2021/01/09 ║
╟─────────────────╢
║ date=2021/01/08 ║
╟─────────────────╢
║ date=2021/01/07 ║
╟─────────────────╢
║ date=2021/01/06 ║
╟─────────────────╢
║ date=2021/01/05 ║
╟─────────────────╢
║ date=2021/01/04 ║
╟─────────────────╢
║ date=2021/01/03 ║
╟─────────────────╢
║ date=2021/01/02 ║
╚═════════════════╝
was (Author: h7kanna):
Hi,
1) Yes partitions are of type 'yyyy/mm/dd'. No using wild cards takes a long
time. In fact we switch to only using base path from the suggestion from the
other ticket https://issues.apache.org/jira/browse/HUDI-3066
2) 'metadata list-partitions, I am not able to run it succesfully, will give
the info once I can do it. Fails with parsing SPARK_MASTER url=yarn or somethig
3) No delete_partition operations were performed
4) hive_sync disabled intentionally,
5) 'metadata validate-files' is running for all partitions for a while now,
total 389 of them, But I see these below errors for many partitions
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Number of log
files scanned => 7
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner -
MaxMemoryInBytes allowed for compaction => 1073741824
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Number of
entries in MemoryBasedMap in ExternalSpillableMap => 3
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Total size in
bytes of MemoryBasedMap in ExternalSpillableMap => 1800
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Number of
entries in BitCaskDiskMap in ExternalSpillableMap => 0
1640606 [Spring Shell] INFO
org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner - Size of file
spilled to disk => 0
1640607 [Spring Shell] INFO org.apache.hudi.metadata.HoodieBackedTableMetadata
- Opened 7 metadata log files (dataset instant=20220126024720121, metadata
instant=20220126024720121) in 3577 ms
1640806 [Spring Shell] INFO org.apache.hadoop.io.compress.CodecPool - Got
brand-new decompressor [.gz]
1640808 [Spring Shell] INFO org.apache.hudi.metadata.HoodieBackedTableMetadata
- Metadata read for 1 keys took [baseFileRead, logMerge] [0, 201] ms
1640809 [Spring Shell] INFO org.apache.hudi.metadata.BaseTableMetadata -
Listed file in partition from metadata: partition=date=2022/01/15, #files=0
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand -
FS and metadata files count not matching for date=2022/01/15. FS files count
19, metadata base files count 0
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
91eeab55-ee54-4285-a493-01d04a237691-0_775-489-15939_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
91eeab55-ee54-4285-a493-01d04a237691-1_775-489-15939_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
96c4d9d1-9de4-4c50-bd9c-f3f6a7bfb40b-0_133-10-6713_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
e266b306-b376-4954-8403-8f858dec34ee-0_134-10-6714_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
399fa917-1198-4c9a-bf63-754f40a5ad09-0_806-501-16124_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
dac6d5d0-ca15-48e2-9b13-f37b4d113e64-0_804-501-16163_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
dde98b16-326c-4890-b100-4548d3161328-0_138-10-6718_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
80cd989e-296c-4dda-ae2d-4c7577fdc351-0_805-501-15994_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
83409360-e1c2-4bd6-ac22-b59e52eaf6ad-0_776-489-16054_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5887f02d-fd66-4678-ac34-fe585e9946a4-0_137-10-6717_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
a03a35be-db55-4a96-a584-42b8007d507c-0_132-10-6712_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
ddd0500e-9434-451b-9066-dfc7c5f6260b-0_777-489-16040_20220122024553151.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
dac6d5d0-ca15-48e2-9b13-f37b4d113e64-1_804-501-16163_20220122014925413.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
8ff179b4-124e-4076-80bb-d72b40b13bc9-0_135-10-6715_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5cb8182c-b2c2-4d19-ac15-bd6a8aaee9bd-0_136-10-6716_20220121225020686.parquet
1641313 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5491f46c-9340-430a-a8e8-9afe74462724-0_130-10-6710_20220121225020686.parquet
1641314 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
66cdec80-acc8-483f-b901-9984adb04c48-0_807-501-16031_20220122014925413.parquet
1641314 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
5e707c93-b524-448f-afc9-ba264cba9e9f-0_131-10-6711_20220121225020686.parquet
1641314 [Spring Shell] ERROR org.apache.hudi.cli.commands.MetadataCommand - FS
file not found in metadata
cb438d0e-2cfa-4b45-b2bd-3b5be0717223-0_139-10-6719_20220121225020686.parquet
> Loading Hudi table fails with NullPointerException
> --------------------------------------------------
>
> Key: HUDI-3335
> URL: https://issues.apache.org/jira/browse/HUDI-3335
> Project: Apache Hudi
> Issue Type: Bug
> Affects Versions: 0.10.1
> Reporter: Harsha Teja Kanna
> Priority: Blocker
> Fix For: 0.11.0
>
>
> Have a COW table with metadata enabled. Loading from Spark query fails with
> java.lang.NullPointerException
> *Environment*
> Spark 3.1.2
> Hudi 0.10.1
> *Query*
> import org.apache.hudi.DataSourceReadOptions
> import org.apache.hudi.common.config.HoodieMetadataConfig
> val basePath = "s3a://datalake-hudi/v1"
> val df = spark.
> read.
> format("org.apache.hudi").
> option(HoodieMetadataConfig.ENABLE.key(), "true").
> option(DataSourceReadOptions.QUERY_TYPE.key(),
> DataSourceReadOptions.QUERY_TYPE_SNAPSHOT_OPT_VAL).
> load(s"${basePath}/sessions/")
> df.createOrReplaceTempView(table)
> *Passing an individual partition works though*
> val df = spark.
> read.
> format("org.apache.hudi").
> option(HoodieMetadataConfig.ENABLE.key(), "true").
> option(DataSourceReadOptions.QUERY_TYPE.key(),
> DataSourceReadOptions.QUERY_TYPE_SNAPSHOT_OPT_VAL).
> load(s"${basePath}/sessions/date=2022/01/25")
> df.createOrReplaceTempView(table)
> *Also, disabling metadata works, but the query taking very long time*
> val df = spark.
> read.
> format("org.apache.hudi").
> option(DataSourceReadOptions.QUERY_TYPE.key(),
> DataSourceReadOptions.QUERY_TYPE_SNAPSHOT_OPT_VAL).
> load(s"${basePath}/sessions/")
> df.createOrReplaceTempView(table)
> *Loading files with stacktrace:*
> at
> org.sparkproject.guava.base.Preconditions.checkNotNull(Preconditions.java:191)
> at org.sparkproject.guava.cache.LocalCache.put(LocalCache.java:4210)
> at
> org.sparkproject.guava.cache.LocalCache$LocalManualCache.put(LocalCache.java:4804)
> at
> org.apache.spark.sql.execution.datasources.SharedInMemoryCache$$anon$3.putLeafFiles(FileStatusCache.scala:161)
> at
> org.apache.hudi.HoodieFileIndex.$anonfun$loadPartitionPathFiles$4(HoodieFileIndex.scala:631)
> at
> org.apache.hudi.HoodieFileIndex.$anonfun$loadPartitionPathFiles$4$adapted(HoodieFileIndex.scala:629)
> at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:234)
> at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:468)
> at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:468)
> at
> org.apache.hudi.HoodieFileIndex.loadPartitionPathFiles(HoodieFileIndex.scala:629)
> at org.apache.hudi.HoodieFileIndex.refresh0(HoodieFileIndex.scala:387)
> at org.apache.hudi.HoodieFileIndex.<init>(HoodieFileIndex.scala:184)
> at
> org.apache.hudi.DefaultSource.getBaseFileOnlyView(DefaultSource.scala:199)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:119)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:69)
> at
> org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:355)
> at
> org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:325)
> at
> org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:307)
> at scala.Option.getOrElse(Option.scala:189)
> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:307)
> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:239)
> at $anonfun$res3$1(<console>:46)
> at $anonfun$res3$1$adapted(<console>:40)
> at scala.collection.Iterator.foreach(Iterator.scala:941)
> at scala.collection.Iterator.foreach$(Iterator.scala:941)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
> at scala.collection.IterableLike.foreach(IterableLike.scala:74)
> at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
> *Writer config*
> **
> spark-submit \
> --master yarn \
> --deploy-mode cluster \
> --driver-cores 4 \
> --driver-memory 4g \
> --executor-cores 4 \
> --executor-memory 6g \
> --num-executors 8 \
> --jars
> s3://datalake/jars/unused-1.0.0.jar,s3://datalake/jars/spark-avro_2.12-3.1.2.jar
> \
> --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer \
> --conf spark.serializer=org.apache.spark.serializer.KryoSerializer \
> --conf spark.sql.sources.parallelPartitionDiscovery.parallelism=25000 \
> s3://datalake/jars/hudi-0.10.1/hudi-utilities-bundle_2.12-0.10.1.jar \
> --table-type COPY_ON_WRITE \
> --source-ordering-field timestamp \
> --source-class org.apache.hudi.utilities.sources.ParquetDFSSource \
> --target-base-path s3a://datalake-hudi/sessions \
> --target-table sessions \
> --transformer-class
> org.apache.hudi.utilities.transform.SqlQueryBasedTransformer \
> --op INSERT \
> --hoodie-conf hoodie.clean.automatic=true \
> --hoodie-conf hoodie.cleaner.commits.retained=10 \
> --hoodie-conf hoodie.cleaner.policy=KEEP_LATEST_COMMITS \
> --hoodie-conf hoodie.clustering.inline=true \
> --hoodie-conf hoodie.clustering.inline.max.commits=5 \
> --hoodie-conf
> hoodie.clustering.plan.strategy.class=org.apache.hudi.client.clustering.plan.strategy.SparkRecentDaysClusteringPlanStrategy
> \
> --hoodie-conf hoodie.clustering.plan.strategy.max.num.groups=1000 \
> --hoodie-conf hoodie.clustering.plan.strategy.small.file.limit=268435456 \
> --hoodie-conf
> hoodie.clustering.plan.strategy.sort.columns=survey_dbid,session_dbid \
> --hoodie-conf hoodie.clustering.plan.strategy.target.file.max.bytes=536870912
> \
> --hoodie-conf hoodie.clustering.preserve.commit.metadata=true \
> --hoodie-conf hoodie.datasource.hive_sync.database=datalake-hudi \
> --hoodie-conf hoodie.datasource.hive_sync.enable=false \
> --hoodie-conf hoodie.datasource.hive_sync.ignore_exceptions=true \
> --hoodie-conf hoodie.datasource.hive_sync.mode=hms \
> --hoodie-conf
> hoodie.datasource.hive_sync.partition_extractor_class=org.apache.hudi.hive.HiveStylePartitionValueExtractor
> \
> --hoodie-conf hoodie.datasource.hive_sync.partition_fields=date \
> --hoodie-conf hoodie.datasource.hive_sync.table=sessions \
> --hoodie-conf hoodie.datasource.hive_sync.use_jdbc=false \
> --hoodie-conf hoodie.datasource.write.hive_style_partitioning=true \
> --hoodie-conf
> hoodie.datasource.write.keygenerator.class=org.apache.hudi.keygen.CustomKeyGenerator
> \
> --hoodie-conf hoodie.datasource.write.operation=insert \
> --hoodie-conf hoodie.datasource.write.partitionpath.field=date:TIMESTAMP \
> --hoodie-conf hoodie.datasource.write.precombine.field=timestamp \
> --hoodie-conf
> hoodie.datasource.write.recordkey.field=session_dbid,question_id,answer \
> --hoodie-conf
> hoodie.deltastreamer.keygen.timebased.input.dateformat=yyyy/MM/dd \
> --hoodie-conf hoodie.deltastreamer.keygen.timebased.input.timezone=GMT \
> --hoodie-conf
> hoodie.deltastreamer.keygen.timebased.output.dateformat=yyyy/MM/dd \
> --hoodie-conf hoodie.deltastreamer.keygen.timebased.output.timezone=GMT \
> --hoodie-conf
> hoodie.deltastreamer.keygen.timebased.timestamp.type=DATE_STRING \
> --hoodie-conf
> hoodie.deltastreamer.source.dfs.root=s3://datalake-hudi/raw/parquet/data/sessions/year=2022/month=01/day=26/hour=02
> \
> --hoodie-conf
> hoodie.deltastreamer.source.input.selector=org.apache.hudi.utilities.sources.helpers.DFSPathSelector
> \
> --hoodie-conf "\"hoodie.deltastreamer.transformer.sql=SELECT question_id,
> answer, to_timestamp(timestamp) as timestamp, session_dbid, survey_dbid,
> date_format(to_timestamp(timestamp), 'yyyy/MM/dd') AS date FROM <SRC> a \"" \
> --hoodie-conf hoodie.file.listing.parallelism=256 \
> --hoodie-conf hoodie.finalize.write.parallelism=256 \
> --hoodie-conf
> hoodie.generate.consistent.timestamp.logical.for.key.generator=true \
> --hoodie-conf hoodie.insert.shuffle.parallelism=1000 \
> --hoodie-conf hoodie.metadata.enable=true \
> --hoodie-conf hoodie.metadata.metrics.enable=true \
> --hoodie-conf
> hoodie.metrics.cloudwatch.metric.prefix=emr.datalake.prd.insert.sessions \
> --hoodie-conf hoodie.metrics.on=false \
> --hoodie-conf hoodie.metrics.reporter.type=CLOUDWATCH \
> --hoodie-conf hoodie.parquet.block.size=536870912 \
> --hoodie-conf hoodie.parquet.compression.codec=snappy \
> --hoodie-conf hoodie.parquet.max.file.size=536870912 \
> --hoodie-conf hoodie.parquet.small.file.limit=268435456
>
> *Metadata Commits (.hoodie/metadata/.hoodie)*
> **
> 20220125154001455002.clean
> 20220125154001455002.clean.inflight
> 20220125154001455002.clean.requested
> 20220125160751769002.clean
> 20220125160751769002.clean.inflight
> 20220125160751769002.clean.requested
> 20220125163020781002.clean
> 20220125163020781002.clean.inflight
> 20220125163020781002.clean.requested
> 20220125165722170002.clean
> 20220125165722170002.clean.inflight
> 20220125165722170002.clean.requested
> 20220125172016239002.clean
> 20220125172016239002.clean.inflight
> 20220125172016239002.clean.requested
> 20220125174427654002.clean
> 20220125174427654002.clean.inflight
> 20220125174427654002.clean.requested
> 20220125181218237002.clean
> 20220125181218237002.clean.inflight
> 20220125181218237002.clean.requested
> 20220125184343588002.clean
> 20220125184343588002.clean.inflight
> 20220125184343588002.clean.requested
> 20220125191038318002.clean
> 20220125191038318002.clean.inflight
> 20220125191038318002.clean.requested
> 20220125193445223002.clean
> 20220125193445223002.clean.inflight
> 20220125193445223002.clean.requested
> 20220125200741168002.clean
> 20220125200741168002.clean.inflight
> 20220125200741168002.clean.requested
> 20220125203814934002.clean
> 20220125203814934002.clean.inflight
> 20220125203814934002.clean.requested
> 20220125211447323002.clean
> 20220125211447323002.clean.inflight
> 20220125211447323002.clean.requested
> 20220125214421740002.clean
> 20220125214421740002.clean.inflight
> 20220125214421740002.clean.requested
> 20220125221009798002.clean
> 20220125221009798002.clean.inflight
> 20220125221009798002.clean.requested
> 20220125224319264002.clean
> 20220125224319264002.clean.inflight
> 20220125224319264002.clean.requested
> 20220125231128580002.clean
> 20220125231128580002.clean.inflight
> 20220125231128580002.clean.requested
> 20220125234345790002.clean
> 20220125234345790002.clean.inflight
> 20220125234345790002.clean.requested
> 20220126001130415002.clean
> 20220126001130415002.clean.inflight
> 20220126001130415002.clean.requested
> 20220126004341130002.clean
> 20220126004341130002.clean.inflight
> 20220126004341130002.clean.requested
> 20220126011114529002.clean
> 20220126011114529002.clean.inflight
> 20220126011114529002.clean.requested
> 20220126013648751002.clean
> 20220126013648751002.clean.inflight
> 20220126013648751002.clean.requested
> 20220126013859643.deltacommit
> 20220126013859643.deltacommit.inflight
> 20220126013859643.deltacommit.requested
> 20220126014254294.deltacommit
> 20220126014254294.deltacommit.inflight
> 20220126014254294.deltacommit.requested
> 20220126014516195.deltacommit
> 20220126014516195.deltacommit.inflight
> 20220126014516195.deltacommit.requested
> 20220126014711043.deltacommit
> 20220126014711043.deltacommit.inflight
> 20220126014711043.deltacommit.requested
> 20220126014808898.deltacommit
> 20220126014808898.deltacommit.inflight
> 20220126014808898.deltacommit.requested
> 20220126015008443.deltacommit
> 20220126015008443.deltacommit.inflight
> 20220126015008443.deltacommit.requested
> 20220126015119193.deltacommit
> 20220126015119193.deltacommit.inflight
> 20220126015119193.deltacommit.requested
> 20220126015119193001.commit
> 20220126015119193001.compaction.inflight
> 20220126015119193001.compaction.requested
> 20220126015653770.deltacommit
> 20220126015653770.deltacommit.inflight
> 20220126015653770.deltacommit.requested
> 20220126020011172.deltacommit
> 20220126020011172.deltacommit.inflight
> 20220126020011172.deltacommit.requested
> 20220126020405299.deltacommit
> 20220126020405299.deltacommit.inflight
> 20220126020405299.deltacommit.requested
> 20220126020405299002.clean
> 20220126020405299002.clean.inflight
> 20220126020405299002.clean.requested
> 20220126020813841.deltacommit
> 20220126020813841.deltacommit.inflight
> 20220126020813841.deltacommit.requested
> 20220126021002748.deltacommit
> 20220126021002748.deltacommit.inflight
> 20220126021002748.deltacommit.requested
> 20220126021231085.deltacommit
> 20220126021231085.deltacommit.inflight
> 20220126021231085.deltacommit.requested
> 20220126021429124.deltacommit
> 20220126021429124.deltacommit.inflight
> 20220126021429124.deltacommit.requested
> 20220126021445188.deltacommit
> 20220126021445188.deltacommit.inflight
> 20220126021445188.deltacommit.requested
> 20220126021949824.deltacommit
> 20220126021949824.deltacommit.inflight
> 20220126021949824.deltacommit.requested
> 20220126022154561.deltacommit
> 20220126022154561.deltacommit.inflight
> 20220126022154561.deltacommit.requested
> 20220126022154561001.commit
> 20220126022154561001.compaction.inflight
> 20220126022154561001.compaction.requested
> 20220126022523011.deltacommit
> 20220126022523011.deltacommit.inflight
> 20220126022523011.deltacommit.requested
> 20220126023054200.deltacommit
> 20220126023054200.deltacommit.inflight
> 20220126023054200.deltacommit.requested
> 20220126023530250.deltacommit
> 20220126023530250.deltacommit.inflight
> 20220126023530250.deltacommit.requested
> 20220126023530250002.clean
> 20220126023530250002.clean.inflight
> 20220126023530250002.clean.requested
> 20220126023637109.deltacommit
> 20220126023637109.deltacommit.inflight
> 20220126023637109.deltacommit.requested
> 20220126024028688.deltacommit
> 20220126024028688.deltacommit.inflight
> 20220126024028688.deltacommit.requested
> 20220126024137627.deltacommit
> 20220126024137627.deltacommit.inflight
> 20220126024137627.deltacommit.requested
> 20220126024720121.deltacommit
> 20220126024720121.deltacommit.inflight
> 20220126024720121.deltacommit.requested
> *Commits(.hoodie)*
> 20220125224502471.clean
> 20220125224502471.clean.inflight
> 20220125224502471.clean.requested
> 20220125225810828.clean
> 20220125225810828.clean.inflight
> 20220125225810828.clean.requested
> 20220125230125674.clean
> 20220125230125674.clean.inflight
> 20220125230125674.clean.requested
> 20220125230854957.clean
> 20220125230854957.clean.inflight
> 20220125230854957.clean.requested
> 20220125232236767.clean
> 20220125232236767.clean.inflight
> 20220125232236767.clean.requested
> 20220125232638588.clean
> 20220125232638588.clean.inflight
> 20220125232638588.clean.requested
> 20220125233355290.clean
> 20220125233355290.clean.inflight
> 20220125233355290.clean.requested
> 20220125234539672.clean
> 20220125234539672.clean.inflight
> 20220125234539672.clean.requested
> 20220125234944271.clean
> 20220125234944271.clean.inflight
> 20220125234944271.clean.requested
> 20220125235718218.clean
> 20220125235718218.clean.inflight
> 20220125235718218.clean.requested
> 20220126000225375.clean
> 20220126000225375.clean.inflight
> 20220126000225375.clean.requested
> 20220126000937875.clean
> 20220126000937875.clean.inflight
> 20220126000937875.clean.requested
> 20220126003307449.clean
> 20220126003307449.clean.inflight
> 20220126003307449.clean.requested
> 20220126003617137.clean
> 20220126003617137.clean.inflight
> 20220126003617137.clean.requested
> 20220126004518227.clean
> 20220126004518227.clean.inflight
> 20220126004518227.clean.requested
> 20220126005806798.clean
> 20220126005806798.clean.inflight
> 20220126005806798.clean.requested
> 20220126010011407.commit
> 20220126010011407.commit.requested
> 20220126010011407.inflight
> 20220126010227320.clean
> 20220126010227320.clean.inflight
> 20220126010227320.clean.requested
> 20220126010242754.replacecommit
> 20220126010242754.replacecommit.inflight
> 20220126010242754.replacecommit.requested
> 20220126010800207.commit
> 20220126010800207.commit.requested
> 20220126010800207.inflight
> 20220126010920192.clean
> 20220126010920192.clean.inflight
> 20220126010920192.clean.requested
> 20220126011114529.commit
> 20220126011114529.commit.requested
> 20220126011114529.inflight
> 20220126011230532.clean
> 20220126011230532.clean.inflight
> 20220126011230532.clean.requested
> 20220126011426028.commit
> 20220126011426028.commit.requested
> 20220126011426028.inflight
> 20220126011818299.commit
> 20220126011818299.commit.requested
> 20220126011818299.inflight
> 20220126012003045.clean
> 20220126012003045.clean.inflight
> 20220126012003045.clean.requested
> 20220126012240288.commit
> 20220126012240288.commit.requested
> 20220126012240288.inflight
> 20220126012443455.clean
> 20220126012443455.clean.inflight
> 20220126012443455.clean.requested
> 20220126012508460.replacecommit
> 20220126012508460.replacecommit.inflight
> 20220126012508460.replacecommit.requested
> 20220126013218816.commit
> 20220126013218816.commit.requested
> 20220126013218816.inflight
> 20220126013428875.clean
> 20220126013428875.clean.inflight
> 20220126013428875.clean.requested
> 20220126013648751.commit
> 20220126013648751.commit.requested
> 20220126013648751.inflight
> 20220126013859643.clean
> 20220126013859643.clean.inflight
> 20220126013859643.clean.requested
> 20220126014254294.commit
> 20220126014254294.commit.requested
> 20220126014254294.inflight
> 20220126014516195.clean
> 20220126014516195.clean.inflight
> 20220126014516195.clean.requested
> 20220126014711043.commit
> 20220126014711043.commit.requested
> 20220126014711043.inflight
> 20220126014808898.clean
> 20220126014808898.clean.inflight
> 20220126014808898.clean.requested
> 20220126015008443.commit
> 20220126015008443.commit.requested
> 20220126015008443.inflight
> 20220126015119193.replacecommit
> 20220126015119193.replacecommit.inflight
> 20220126015119193.replacecommit.requested
> 20220126015653770.commit
> 20220126015653770.commit.requested
> 20220126015653770.inflight
> 20220126020011172.commit
> 20220126020011172.commit.requested
> 20220126020011172.inflight
> 20220126020405299.commit
> 20220126020405299.commit.requested
> 20220126020405299.inflight
> 20220126020813841.commit
> 20220126020813841.commit.requested
> 20220126020813841.inflight
> 20220126021002748.clean
> 20220126021002748.clean.inflight
> 20220126021002748.clean.requested
> 20220126021231085.commit
> 20220126021231085.commit.requested
> 20220126021231085.inflight
> 20220126021429124.clean
> 20220126021429124.clean.inflight
> 20220126021429124.clean.requested
> 20220126021445188.replacecommit
> 20220126021445188.replacecommit.inflight
> 20220126021445188.replacecommit.requested
> 20220126021949824.commit
> 20220126021949824.commit.requested
> 20220126021949824.inflight
> 20220126022154561.clean
> 20220126022154561.clean.inflight
> 20220126022154561.clean.requested
> 20220126022523011.commit
> 20220126022523011.commit.requested
> 20220126022523011.inflight
> 20220126023054200.commit
> 20220126023054200.commit.requested
> 20220126023054200.inflight
> 20220126023530250.commit
> 20220126023530250.commit.requested
> 20220126023530250.inflight
> 20220126023637109.clean
> 20220126023637109.clean.inflight
> 20220126023637109.clean.requested
> 20220126024028688.commit
> 20220126024028688.commit.requested
> 20220126024028688.inflight
> 20220126024137627.replacecommit
> 20220126024137627.replacecommit.inflight
> 20220126024137627.replacecommit.requested
> 20220126024720121.commit
> 20220126024720121.commit.requested
> 20220126024720121.inflight
>
> **
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
