goutamadwant opened a new pull request, #12837:
URL: https://github.com/apache/seatunnel/pull/12837

   ### Purpose of this pull request
   
   Fixes #12835 in SeaTunnel's CSV read path.
   
   CSV deserialization previously returned null for a column missing from the 
file header or a field matching `null_format`, even when 
`schema.columns[].defaultValue` was configured. The file reader now passes its 
existing `CatalogTable` to the CSV deserializer, which applies the configured 
default converted to the declared field type.
   
   Ordinary blank fields retain their existing behavior unless they match 
`null_format`. Jobs without configured defaults are unchanged.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Missing and configured-null CSV fields now receive their schema default 
instead of null. A job that intentionally relied on null despite configuring a 
default can remove that default to retain the previous result. This 
compatibility boundary is documented in the English and Chinese connector and 
incompatible-changes pages.
   
   ### How was this patch tested?
   
   - CSV-format tests passed: 19 tests.
   - File-base tests passed: 341 tests.
   - `LocalFileIT#testLocalFileCsv` passed across six Zeta, Flink, and Spark 
invocations: 0 failures.
   - Scoped build, Spotless, and diff checks passed on Java 11.0.19.
   
   Full repository PR CI has not run yet.
   
   ### Check list
   
   - [x] No new JAR binary or dependency.
   - [x] English and Chinese connector documentation updated.
   - [x] English and Chinese `incompatible-changes.md` entries added.
   - [x] Existing format and file connector only; no plugin registration or 
distribution change. CSV unit tests and the existing LocalFile E2E test were 
extended.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to