yihua opened a new pull request, #19166:
URL: https://github.com/apache/hudi/pull/19166

   ### Change Logs
   
   Adds test coverage for the Spark structured-streaming source and sink/writer 
support in hudi-spark-common, targeting previously under-covered branches:
   
   - `TestStreamingSource`: new COW and MOR streaming-read tests that force the 
legacy incremental relation path in `HoodieStreamSourceV1` (streaming read 
table version 6 with `hoodie.file.group.reader.enabled=false`), complementing 
the existing tests that cover the file-group-reader path. Reads are 
synchronized via `processAllAvailable`.
   - `TestStructuredStreaming`: new test that injects a failing micro-batch and 
verifies `HoodieStreamingSink` swallows it under 
`hoodie.datasource.write.streaming.ignore.failed.batch`, completing the query 
without crashing and writing no commit.
   - `TestDataSkippingQuery`: new column-stats data-skipping test over multiple 
base files with disjoint value ranges, covering equality, range, IN, and 
empty-match predicates for COW and MOR, with a data-skipping-off parity check.
   
   ### Impact
   
   Test-only. No production code changes.
   
   ### Risk level
   
   none
   
   ### Documentation Update
   
   None.
   
   ### Contributor's checklist
   - [x] Read through the contributor's guide
   - [x] Change is test-only and behavior-preserving
   - [x] Tests assert meaningful behavior
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to