This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch branch-0.x
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 3d5d274847c [HUDI-7473] Rebalance CI (#10805)
new 45923f3cacd [HUDI-6947] Refactored
HoodieSchemaUtils.deduceWriterSchema with many flags (#10810)
new 695577bdc95 [HUDI-7356] Passing configs to file reader constructor for
flexibility (#10698)
new 4680cb45333 [HUDI-7197] Adding mis fixes related with table services
testing (#10280)
new 9f00f6d6ed7 [HUDI-5167] Reducing total test run time: reducing tests
for virtual keys (#7153)
new 8ed8a20b690 [HUDI-7488] The BigQuerySyncTool can't work well when the
hudi table schema changed (#10830)
new 06584c6f768 [MINOR] Separate HoodieSparkWriterTestBase to reduce
duplication (#10832)
new 8e6eff945bf [HUDI-7491] Fixing handling null values of extra metadata
in clean commit metadata (#10837)
new dbe16f3f965 [HUDI-7411] Meta sync should consider cleaner commit
(#10676)
new 866348adb39 [ENG-6316] Bump cleaner retention for MDT (#537) (#10655)
new 632e61ff2d6 [HUDI-6043] Metadata Table should use default values for
Compaction preserveCommitMetadata field (#8393)
new 02ae11f4b46 [HUDI-5101] Adding spark-structured streaming test support
via spark-submit job (#7074)
new 45a2e071a4e [HUDI-7495] Bump mysql-connector-java from 8.0.22 to
8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server (#7674)
new 80990d42325 [HUDI-7163] Fix not parsable text DateTimeParseException
when compact (#10220)
new 3f78130d007 [HUDI-7496] Bump mybatis from 3.4.6 to 3.5.6 in
/hudi-platform-service/hudi-metaserver/hudi-metaserver-server (#7673)
The 14 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/hudi/io/HoodieCreateHandle.java | 4 +-
.../java/org/apache/hudi/io/HoodieMergeHandle.java | 4 +-
.../hudi/metadata/HoodieMetadataWriteUtils.java | 28 +++-
.../table/action/clean/CleanActionExecutor.java | 2 +-
.../hudi/table/action/clean/CleanPlanner.java | 4 +-
.../action/commit/BaseCommitActionExecutor.java | 1 +
.../compact/ScheduleCompactionActionExecutor.java | 9 +-
.../metadata/TestHoodieMetadataWriteUtils.java | 64 ++++++++
.../apache/hudi/table/action/TestCleanPlanner.java | 2 +-
.../io/storage/HoodieSparkFileReaderFactory.java | 9 +-
.../TestHoodieClientOnCopyOnWriteStorage.java | 112 ++++++-------
.../hudi/common/table/timeline/TimelineUtils.java | 27 +++-
.../io/storage/HoodieAvroFileReaderFactory.java | 13 +-
.../hudi/io/storage/HoodieFileReaderFactory.java | 20 +--
.../hudi/common/table/TestTimelineUtils.java | 46 +++++-
.../java/org/apache/hudi/util/StreamerUtil.java | 39 ++---
.../gcp/bigquery/HoodieBigQuerySyncClient.java | 25 +--
.../streaming/StructuredStreamingSinkUtil.java | 168 ++++++++++++++++++++
.../StructuredStreamingSinkTestWriter.scala | 104 ++++++++++++
.../hudi-metaserver/hudi-metaserver-server/pom.xml | 4 +-
.../scala/org/apache/hudi/HoodieSchemaUtils.scala | 176 +++++++++++----------
.../sql/catalyst/catalog/HoodieCatalogTable.scala | 7 +-
.../apache/hudi/HoodieSparkWriterTestBase.scala | 136 ++++++++++++++++
.../org/apache/hudi/TestHoodieSparkSqlWriter.scala | 152 +++---------------
.../apache/hudi/TestHoodieSparkSqlWriterUtc.scala | 2 +-
.../hudi/TestTableSchemaResolverWithSparkSQL.scala | 102 +-----------
.../apache/hudi/sync/common/HoodieSyncClient.java | 5 +-
.../org/apache/hudi/utilities/UtilHelpers.java | 1 +
.../apache/hudi/utilities/TestHoodieIndexer.java | 13 +-
29 files changed, 809 insertions(+), 470 deletions(-)
create mode 100644
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/metadata/TestHoodieMetadataWriteUtils.java
create mode 100644
hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/streaming/StructuredStreamingSinkUtil.java
create mode 100644
hudi-integ-test/src/main/scala/org/apache/hudi/integ/testsuite/streaming/StructuredStreamingSinkTestWriter.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/HoodieSparkWriterTestBase.scala
