rangareddy commented on issue #15755: URL: https://github.com/apache/hudi/issues/15755#issuecomment-4878331089
This issue was reviewed as part of the JIRA-migrated backlog triage, and verified with a test. Findings: insert overwrite via the row-writer code path is supported (PR #8076). HoodieSparkSqlWriter.bulkInsertAsRow dispatches SaveMode.Append+INSERT_OVERWRITE to DatasetBulkInsertOverwriteCommitActionExecutor and SaveMode.Overwrite+INSERT_OVERWRITE_TABLE to DatasetBulkInsertOverwriteTableCommitActionExecutor. Verified on Spark 3.5.5 + hudi-spark3.5-bundle 1.2.0-SNAPSHOT with hoodie.sql.bulk.insert.enable=true and hoodie.datasource.write.row.writer.enable=true: - SQL INSERT OVERWRITE of a single partition replaces only that partition (insert_overwrite); - SQL INSERT OVERWRITE of the whole table replaces all data (insert_overwrite_table); - both produce .replacecommit instants, and INFO logs confirm the row-writer path (BulkInsertDataInternalWriterHelper / HoodieRowCreateHandle) rather than the RDD path. Working as intended. Closing as fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
