(hudi) 16/40: [HUDI-6902] Containerize the Azure CI (#10512)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2a5fd3cf999de19c4e15518e0657d4f4deb2e00a Author: Lin Liu <141371752+linli

(hudi) 06/40: [HUDI-6092] Set the timeout for the forked JVM (#10496)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e534a86d1ec9ae9d6109020bc43bcc063cb162b5 Author: Lin Liu <141371752+linli

(hudi) 15/40: [HUDI-7375] Disable a flaky test method (#10627)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit b0b83a2e9253246b09263e992db52f011138a37e Author: Lin Liu <141371752+linli

(hudi) 36/40: [HUDI-7694] Unify bijection-avro dependency version (#11132)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ca1c4005a39bc76915347067394d9ae4ecfc1001 Author: Y Ethan Guo AuthorDate: Tue Apr 30 18:35:02 2024

(hudi) 03/03: [HUDI-7513] Add jackson-module-scala to spark bundle (#10877)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit de25156a48ef35b211b71121225754a267806e79 Author: Manu <36392121+x...@users.noreply.github.

(hudi) branch release-0.14.1-spark35-scala213 updated (0f783f1a66f -> de25156a48e)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git from 0f783f1a66f [HUDI-6868] Support extracting passwords from credential store for Hive Sync

(hudi) 01/03: Revert "[HUDI-7001] ComplexAvroKeyGenerator should represent single record key as the value string without composing the key field name (#9936)"

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 1d385cab2c08b5f86c3ae18417ebb115645f3f74 Author: Y Ethan Guo AuthorDate: Fri May 3 08:03:22 2024

(hudi) 02/03: Upgrade version to 0.14.1-1

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 060a9aaab9406154f55733583125faa99be24176 Author: Y Ethan Guo AuthorDate: Fri May 3 08:05:04 2024

(hudi) branch release-0.14.1-spark35-scala213 updated (de25156a48e -> 1673e650d74)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git from de25156a48e [HUDI-7513] Add jackson-module-scala to spark bundle (#10877) add 1673e650d74

(hudi) branch release-0.14.1-spark35-scala213 updated (1673e650d74 -> faa874d80c8)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git discard 1673e650d74 Always use built jars for bundle validation add faa874d80c8 Always use built

(hudi) branch release-0.14.1-spark35-scala213 updated (faa874d80c8 -> 7d6e2ddd192)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git from faa874d80c8 Always use built jars for bundle validation add 7d6e2ddd192 [HUDI-7475

(hudi) branch master updated: [HUDI-7727] Avoid constructAbsolutePathInHadoopPath in hudi-common module (#11172)

2024-05-07 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ace3789e2d5 [HUDI-7727] Avoid

(hudi) branch master updated: [HUDI-7728] Use StorageConfiguration in LockProvider constructors (#11173)

2024-05-08 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 5d66a5e4e12 [HUDI-7728] Use StorageConfiguration

(hudi) branch master updated: [HUDI-7735] Remove usage of SerializableConfiguration (#11177)

2024-05-08 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new be8d5256a82 [HUDI-7735] Remove usage of

(hudi) branch master updated (a60266142dd -> cdd146b2c73)

2024-05-09 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from a60266142dd [MINOR] Cosmetic changes for names and log msgs (#11179) add cdd146b2c73 [HUDI-7737] Bump Spark 3.4

(hudi) branch master updated: [HUDI-7725] Restructure HFileBootstrapIndex to separate Hadoop-dependent logic (#11171)

2024-05-09 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new b1496068b3a [HUDI-7725] Restructure

(hudi) branch master updated: [HUDI-7729] Move ParquetUtils to hudi-hadoop-common module (#11186)

2024-05-09 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8f5f5470b61 [HUDI-7729] Move ParquetUtils to hudi

(hudi) branch master updated: [HUDI-7726] Restructure TableSchemaResolver to separate Hadoop logic and use BaseFileUtils (#11185)

2024-05-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 23b283acf3e [HUDI-7726] Restructure

(hudi) branch master updated: [HUDI-7742] Move Hadoop-dependent reader util classes to hudi-hadoop-common module (#11190)

2024-05-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new badcca2ebe8 [HUDI-7742] Move Hadoop-dependent

(hudi) branch master updated (badcca2ebe8 -> 0d0e27e2b9b)

2024-05-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from badcca2ebe8 [HUDI-7742] Move Hadoop-dependent reader util classes to hudi-hadoop-common module (#11190) add

(hudi) branch master updated: [HUDI-7731] Fix usage of new Configuration() in production code (#11191)

2024-05-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new c7c636c2d18 [HUDI-7731] Fix usage of new

(hudi) branch master updated: [HUDI-7508] Avoid collecting records in HoodieStreamerUtils.createHoodieRecords and JsonKafkaSource mapPartitions (#10872)

2024-05-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 49072d1e2e7 [HUDI-7508] Avoid collecting records

(hudi) branch master updated: [HUDI-4732] Add support for confluent schema registry with proto (#11070)

2024-05-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new aa5bb0dda34 [HUDI-4732] Add support for confluent

(hudi) branch master updated: [HUDI-7501] Use source profile for S3 and GCS sources (#10861)

2024-05-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new be0a6604b12 [HUDI-7501] Use source profile for S3

(hudi) branch master updated (be0a6604b12 -> ce08875a0d7)

2024-05-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from be0a6604b12 [HUDI-7501] Use source profile for S3 and GCS sources (#10861) add ce08875a0d7 [HUDI-7523] Add

(hudi) branch master updated: [HUDI-7743] Improve StoragePath usages (#11189)

2024-05-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 4b59b202f49 [HUDI-7743] Improve StoragePath usages

(hudi) branch master updated: [HUDI-7744] Introduce IOFactory and a config to set the factory (#11192)

2024-05-13 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ea4f14c2851 [HUDI-7744] Introduce IOFactory and a

(hudi) branch master updated (ea4f14c2851 -> 6627218f71f)

2024-05-13 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from ea4f14c2851 [HUDI-7744] Introduce IOFactory and a config to set the factory (#11192) add 6627218f71f [HUDI-7750

(hudi) branch master updated: [HUDI-7549] Reverting spurious log block deduction with LogRecordReader (#10922)

2024-05-13 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 45ad35b960c [HUDI-7549] Reverting spurious log

(hudi) branch master updated (45ad35b960c -> bbf028027ba)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 45ad35b960c [HUDI-7549] Reverting spurious log block deduction with LogRecordReader (#10922) add bbf028027ba [HUDI

(hudi) branch master updated: [HUDI-7535] Add metrics for sourceParallelism and Refresh profile in S3/GCS (#10918)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new d9eb7b469bf [HUDI-7535] Add metrics for

(hudi) branch branch-0.x updated: [HUDI-7460] Relaxing compaction scheduling when there are pending delta commits (#10791)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/branch-0.x by this push: new 33e73d9deba [HUDI-7460] Relaxing

(hudi) branch master updated: [HUDI-7712] Fixing RLI initialization to account for file slices instead of just base files while initializing (#11153)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new d74e642b5be [HUDI-7712] Fixing RLI initialization

(hudi) branch master updated: [HUDI-7624] Fixing index tagging duration (#11035)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8d103ad87d8 [HUDI-7624] Fixing index tagging

(hudi) 02/07: [MINOR] Improve mdt validator and upsert partitioner logs (#10656)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 6746f44ba1893c82c9793486600aa847adc9171a Author: Sagar Sumit AuthorDate: Tue Feb 27 22:45:10 2024 +0530 [MINOR

(hudi) 06/07: [HUDI-7450] Address minor comments on Fix offset computation bug when allocedEvents > actualNumEvents (#10771)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 292b1d850dbce784826c8ca1194146206a7965a1 Author: Vinish Reddy AuthorDate: Wed Feb 28 17:43:35 2024 +0530 [HUDI

(hudi) 07/07: [HUDI-7431] Add replication and block size to StoragePathInfo to be backwards compatible (#10717)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 91e176c0ef7f811be932534377599bde42379359 Author: Y Ethan Guo AuthorDate: Wed Feb 28 10:29:24 2024 -0800 [HUDI

(hudi) branch branch-0.x updated (33e73d9deba -> 91e176c0ef7)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git from 33e73d9deba [HUDI-7460] Relaxing compaction scheduling when there are pending delta commits (#10791) new

(hudi) 03/07: [HUDI-7450] Fix offset computation bug when allocedEvents > actualNumEvents (#10768)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit fbe4d371632bed012c107ee8aae6042d1845c13e Author: Vinish Reddy AuthorDate: Tue Feb 27 23:12:40 2024 +0530 [HUDI

(hudi) 01/07: [HUDI-7445] Move PR size labeling to GitHub scheduled workflow (#10761)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 736ea55ee27cb6feb0bf00da871972e076145e9f Author: Y Ethan Guo AuthorDate: Tue Feb 27 00:10:31 2024 -0800 [HUDI

(hudi) 04/07: [HUDI-5292] Exclude the test resources from every module packaging (#10702)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit b1c7528c86e08300bfc11c4a8532b8e819a5c415 Author: wombatu-kun AuthorDate: Wed Feb 28 07:56:20 2024 +0700 [HUDI

(hudi) 05/07: [MINOR] Modify filter to allow removal of column stats from metadata table for bootstrap table files (#10238)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit d62b245d9f498a79ea554edff991bc6b623fdf3b Author: Tim Brown AuthorDate: Tue Feb 27 18:55:01 2024 -0800 [MINOR

(hudi) branch master updated: [HUDI-7752] Abstract serializeRecords for log writing (#11210)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a8da2fdd1c0 [HUDI-7752] Abstract serializeRecords

(hudi) 06/08: [HUDI-7462] Refactor checkTopicCheckpoint in KafkaOffsetGen for reusability (#10794)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7a5719e0660ecf99e3e6ae8d3f5e3bd9f2286bf3 Author: Sampan S Nayak AuthorDate: Sat Mar 2 01:38:26 2024 +0530 [HUDI

(hudi) 02/08: [HUDI-7456] Set 'hudi' as the explicit provider for new table properties when create table by spark (#10776)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 1360b821ac6555c954862cc0e7f794825b360acf Author: majian <47964462+majian1...@users.noreply.github.com> AuthorDat

(hudi) 07/08: [HUDI-7464] Fix minor bugs in kafka post-processing related code (#10772)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0127db94e12bb57e24ae750d26ac389f100483c9 Author: Tim Brown AuthorDate: Fri Mar 1 15:50:46 2024 -0600 [HUDI-7464

(hudi) 03/08: [HUDI-7385] Add config for custom write support for parquet row writer (#10598)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit dfd40dc7d8fe651fe54e282f1b057eba612c0da7 Author: Jon Vexler AuthorDate: Thu Feb 29 18:17:35 2024 -0500 [HUDI-7385

(hudi) 05/08: [HUDI-7459] Update hudi-gcp-bundle pom (#10790)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit a598bd555f16688f07638c8e52d5ce5f2b12c86e Author: Jinpeng AuthorDate: Fri Mar 1 07:31:03 2024 -0800 [HUDI-7459

(hudi) branch branch-0.x updated (91e176c0ef7 -> 937513b6510)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git from 91e176c0ef7 [HUDI-7431] Add replication and block size to StoragePathInfo to be backwards compatible (#10717

(hudi) 01/08: [HUDI-7452] Repartition row dataset in S3/GCS based on task size (#10777)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit eccd183a3d3f5bbf02e32032b49cfbb6aa5201a3 Author: Vinish Reddy AuthorDate: Thu Feb 29 09:01:10 2024 +0530 [HUDI

(hudi) 04/08: Revert "[HUDI-6438] Config parameter 'MAKE_NEW_COLUMNS_NULLABLE' to allow for marking a newly created column as nullable." (#10782)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 29a2a6ccd4bb58353b4addd7044ac7f49b00027a Author: Geser Dugarov, PhD AuthorDate: Fri Mar 1 07:48:04 2024 +0700

(hudi) 08/08: [MINOR] Fix violations of Sonarqube rule java:S2184 (#10444)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 937513b6510ec3b4919bbe044e81b3a659c8b6c8 Author: KUTEJiang <44263168+kuteji...@users.noreply.github.com> Auth

(hudi) branch branch-0.x updated: [HUDI-7447] Fix not bootstrap when subTask restart when OPCoordinator handle CheckPointComplete not finished (#10767)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/branch-0.x by this push: new fbc4f4dd3ed [HUDI-7447] Fix not bootstrap

(hudi) branch branch-0.x updated (fbc4f4dd3ed -> 4f2d60dd387)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git from fbc4f4dd3ed [HUDI-7447] Fix not bootstrap when subTask restart when OPCoordinator handle CheckPointComplete not

(hudi) 06/08: [HUDI-3625] Update RFC-60 (#9462)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit e2e7c96bb399ae37a7434fb38ca1bb90fea58f0a Author: Shawn Chang <42792772+c...@users.noreply.github.com> AuthorDat

(hudi) 04/08: [HUDI-7469] Reduce redundant tests with Hudi record types (#10800)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2401ccf0362e8078c3ac2fa37ba37bec69f007c0 Author: Y Ethan Guo AuthorDate: Sat Mar 2 21:56:54 2024 -0800 [HUDI-7469

(hudi) 02/08: [HUDI-7465] Split tests in CI further to reduce total CI elapsed time (#10795)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2deb00f3147c46f905b3386a5d01bf38c275b1ea Author: Y Ethan Guo AuthorDate: Sat Mar 2 13:59:58 2024 -0800 [HUDI-7465

(hudi) 07/08: [MINOR] Clean code of FileSystemViewManager (#10797)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 39135e707faea601e35cc2c61bfda580991ee205 Author: stayrascal AuthorDate: Mon Mar 4 08:40:09 2024 +0800 [MINOR

(hudi) 08/08: [HUDI-7471] Use existing util method to get Spark conf in tests (#10802)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 4f2d60dd387c095b448365931492249208671b57 Author: Y Ethan Guo AuthorDate: Sun Mar 3 22:09:12 2024 -0800 [HUDI-7471

(hudi) 01/08: [HUDI-9424] Support using local timezone when writing flink TIMESTAMP data (#10594)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit e09f39aceb3230836ea5a5f2ff8ce1eb7693d3d5 Author: chengming AuthorDate: Sat Mar 2 09:08:06 2024 +0800 [HUDI-9424

(hudi) 03/08: [HUDI-6089] Handle default insert behaviour to ingest duplicates (#10728)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 5179da7d24ba7eb7ae89cd4837e5f1ee454a48da Author: wombatu-kun AuthorDate: Sun Mar 3 07:44:26 2024 +0700 [HUDI-6089

(hudi) 05/08: [HUDI-6953] Adding test for composite keys with bulk insert row writer (#10214)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit f358bb894883daa112507ede42a1ff823192f6b9 Author: Sivabalan Narayanan AuthorDate: Sat Mar 2 21:57:23 2024 -0800

(hudi) 02/04: [HUDI-7479] SQL confs don't propagate to spark row writer properly (#10786)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 07de2f0dc6bf878a1631a7e7f0c7628e9984afb6 Author: Jon Vexler AuthorDate: Tue Mar 5 04:31:55 2024 -0500 [HUDI-7479

(hudi) branch branch-0.x updated (4f2d60dd387 -> e2963a5d5a6)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git from 4f2d60dd387 [HUDI-7471] Use existing util method to get Spark conf in tests (#10802) new 68b7cfc9316 [MINOR

(hudi) 01/04: [MINOR] Add PR description validation on documentation updates (#10799)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 68b7cfc9316b2f7e4687269d526c1374c182a38c Author: Y Ethan Guo AuthorDate: Sun Mar 3 23:17:00 2024 -0800 [MINOR

(hudi) 03/04: [HUDI-7337] Implement MetricsReporter that reports metrics to M3 (#10565)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 780e10676d6ee8b0e7b690ddbd7732b5e8c955f0 Author: Krishen <22875197+kb...@users.noreply.github.com> AuthorDate: T

(hudi) 04/04: [HUDI-7413] Fix schema exception types and error messages thrown with schema exceptions (#10677)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit e2963a5d5a6ff8edbe3f36b1e80a1e9f02745c40 Author: Jon Vexler AuthorDate: Tue Mar 5 11:37:09 2024 -0800 [HUDI-7413

(hudi) branch branch-0.x updated (e2963a5d5a6 -> 78bf6761759)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git omit e2963a5d5a6 [HUDI-7413] Fix schema exception types and error messages thrown with schema exceptions (#10677

(hudi) 06/19: [MINOR] Fix violations of Sonarqube rule java:S2184 (#10444)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0a4bed64a513f7871dbdea0b6a0014e7f8365f44 Author: KUTEJiang <44263168+kuteji...@users.noreply.github.com> Auth

(hudi) 01/19: [HUDI-7385] Add config for custom write support for parquet row writer (#10598)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit fb456d51316a02cca2b565b71c3f64c95576484f Author: Jon Vexler AuthorDate: Tue May 14 13:02:36 2024 -0700 [HUDI-7385

(hudi) 05/19: [HUDI-7464] Fix minor bugs in kafka post-processing related code (#10772)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit d36e52694984239f739bdad4362e85e644fa40e1 Author: Tim Brown AuthorDate: Fri Mar 1 15:50:46 2024 -0600 [HUDI-7464

(hudi) 14/19: [MINOR] Clean code of FileSystemViewManager (#10797)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 734e0cfd98199ea20356acbe5a0b3ad842a3174f Author: stayrascal AuthorDate: Mon Mar 4 08:40:09 2024 +0800 [MINOR

(hudi) 12/19: [HUDI-6953] Adding test for composite keys with bulk insert row writer (#10214)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7c3437f69ec928a82318ca1b983ca82db8fe744e Author: Sivabalan Narayanan AuthorDate: Sat Mar 2 21:57:23 2024 -0800

(hudi) 18/19: [HUDI-7337] Implement MetricsReporter that reports metrics to M3 (#10565)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 5deb19640d4938064276b97fc35f413e8cb77192 Author: Krishen <22875197+kb...@users.noreply.github.com> AuthorDate: T

(hudi) 10/19: [HUDI-6089] Handle default insert behaviour to ingest duplicates (#10728)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 4bdb98b50c203e9f049734f80e9ee68110aff835 Author: wombatu-kun AuthorDate: Sun Mar 3 07:44:26 2024 +0700 [HUDI-6089

(hudi) 16/19: [MINOR] Add PR description validation on documentation updates (#10799)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit e35fa8d3ce33bfe16f20bb8e01507a2f8e161dcb Author: Y Ethan Guo AuthorDate: Sun Mar 3 23:17:00 2024 -0800 [MINOR

(hudi) 11/19: [HUDI-7469] Reduce redundant tests with Hudi record types (#10800)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 53725e8c91c2a904bf00d7a4e97556b7adca068c Author: Y Ethan Guo AuthorDate: Sat Mar 2 21:56:54 2024 -0800 [HUDI-7469

(hudi) 04/19: [HUDI-7462] Refactor checkTopicCheckpoint in KafkaOffsetGen for reusability (#10794)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 56c4937764461d3506fb7eb8555948a0acedca20 Author: Sampan S Nayak AuthorDate: Sat Mar 2 01:38:26 2024 +0530 [HUDI

(hudi) 02/19: Revert "[HUDI-6438] Config parameter 'MAKE_NEW_COLUMNS_NULLABLE' to allow for marking a newly created column as nullable." (#10782)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7a4f86af9b9562cef05475694201231ab2d24e52 Author: Geser Dugarov, PhD AuthorDate: Fri Mar 1 07:48:04 2024 +0700

(hudi) 03/19: [HUDI-7459] Update hudi-gcp-bundle pom (#10790)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit e358530e7e4f4a84e23e8b924821f69d82b160cc Author: Jinpeng AuthorDate: Fri Mar 1 07:31:03 2024 -0800 [HUDI-7459

(hudi) 15/19: [HUDI-7471] Use existing util method to get Spark conf in tests (#10802)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 05e16b7f292a342cdffa22d489646c55a0be6b39 Author: Y Ethan Guo AuthorDate: Sun Mar 3 22:09:12 2024 -0800 [HUDI-7471

(hudi) 09/19: [HUDI-7465] Split tests in CI further to reduce total CI elapsed time (#10795)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 68659a1c32f6e40d42b14d81a61d9b4e7f80bf27 Author: Y Ethan Guo AuthorDate: Sat Mar 2 13:59:58 2024 -0800 [HUDI-7465

(hudi) 13/19: [HUDI-3625] Update RFC-60 (#9462)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit e2ec366b82005b0eab533a2ca3ba6c8a0b5850cc Author: Shawn Chang <42792772+c...@users.noreply.github.com> AuthorDat

(hudi) 08/19: [HUDI-9424] Support using local timezone when writing flink TIMESTAMP data (#10594)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 99d52b79d6061f441ee0a74042558c5911ca9dd5 Author: chengming AuthorDate: Sat Mar 2 09:08:06 2024 +0800 [HUDI-9424

(hudi) 17/19: [HUDI-7479] SQL confs don't propagate to spark row writer properly (#10786)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit a4aa005e313b11d9e8454d30b0e3604ac5062d82 Author: Jon Vexler AuthorDate: Tue Mar 5 04:31:55 2024 -0500 [HUDI-7479

(hudi) 19/19: [HUDI-7413] Fix schema exception types and error messages thrown with schema exceptions (#10677)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 78bf676175968251832f29712b37d09bc4b49c41 Author: Jon Vexler AuthorDate: Tue Mar 5 11:37:09 2024 -0800 [HUDI-7413

(hudi) 07/19: [HUDI-7447] Fix not bootstrap when subTask restart when OPCoordinator handle CheckPointComplete not finished (#10767)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit d81f2bba8d1596bb0621d5992b145f2d7b6bde00 Author: wenbingshen AuthorDate: Sat Mar 2 08:43:56 2024 +0800 [HUDI-7447

(hudi) 01/04: [HUDI-7418] Create a common method for filtering in S3 and GCS sources and add tests for filtering out extensions (#10724)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 4538fb2fc3f070883a03cc254a6958f38bfffd1d Author: Rajesh Mahindra <76502047+rmahindra...@users.noreply.github.

(hudi) 03/04: [MINOR] Publish test results from the containerized job to Azure (#10818)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 111d1389ba51e09435e80eca77c04c4744cb0bfc Author: Y Ethan Guo AuthorDate: Wed Mar 6 11:07:36 2024 -0800 [MINOR

(hudi) 02/04: [MINOR] Fix Azure publishing of JUnit results (#10817)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 81fe5ad16f351d9c511dd7dede13626031f0d5eb Author: Y Ethan Guo AuthorDate: Tue Mar 5 22:13:31 2024 -0800 [MINOR

(hudi) branch branch-0.x updated (78bf6761759 -> 3d5d274847c)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git from 78bf6761759 [HUDI-7413] Fix schema exception types and error messages thrown with schema exceptions (#10677

(hudi) 04/04: [HUDI-7473] Rebalance CI (#10805)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 3d5d274847ce3782e2d6a9cb94ed8945401c5b16 Author: Y Ethan Guo AuthorDate: Tue May 14 13:25:42 2024 -0700 [HUDI

(hudi) branch master updated (a8da2fdd1c0 -> c8dec0ef523)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from a8da2fdd1c0 [HUDI-7752] Abstract serializeRecords for log writing (#11210) add c8dec0ef523 [HUDI-7429] Fixing

(hudi) 03/14: [HUDI-7197] Adding mis fixes related with table services testing (#10280)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 4680cb453334e545b3de553f9d98cd3bce829173 Author: harshal AuthorDate: Thu Mar 7 13:52:40 2024 +0530 [HUDI-7197

(hudi) 02/14: [HUDI-7356] Passing configs to file reader constructor for flexibility (#10698)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 695577bdc958c4edf7a81b306ea75ab0d3116c03 Author: wombatu-kun AuthorDate: Thu Mar 7 12:31:56 2024 +0700 [HUDI-7356

(hudi) 05/14: [HUDI-7488] The BigQuerySyncTool can't work well when the hudi table schema changed (#10830)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8ed8a20b6902b95a3e698a519822bdb0210a0a7f Author: steve-xi-awx <84497271+steve-xi-...@users.noreply.github.

(hudi) 09/14: [ENG-6316] Bump cleaner retention for MDT (#537) (#10655)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 866348adb39e83e7908bc0bfa6d6c1a9dc7f2a89 Author: Sagar Sumit AuthorDate: Fri Mar 8 23:47:41 2024 +0530 [ENG-6316

(hudi) 07/14: [HUDI-7491] Fixing handling null values of extra metadata in clean commit metadata (#10837)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8e6eff945bf09803e42eb2a1e33cb515befaad05 Author: Sivabalan Narayanan AuthorDate: Fri Mar 8 01:27:06 2024 -0800

(hudi) 14/14: [HUDI-7496] Bump mybatis from 3.4.6 to 3.5.6 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server (#7673)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 3f78130d007f1f8695d4ad200a2c04279438384c Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.

(hudi) 12/14: [HUDI-7495] Bump mysql-connector-java from 8.0.22 to 8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server (#7674)

2024-05-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 45a2e071a4eccec1cc39cfce8758b3384dac8caa Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.

<    1   2   3   4   5   6   7   8   9   10   >