GitHub user Jefffrey closed the discussion with a comment: Infer schema for NDJSON
Should be able to use `schema_infer_max_records` from `NdJsonReadOptions` to specify how many rows to use for inference now: https://github.com/apache/datafusion/blob/d24eb4a23156b7814836e765d5890186ab40682f/datafusion/core/src/datasource/file_format/options.rs#L445-L468 (https://github.com/apache/datafusion/pull/18920 adds a nicer API to configure this setting) GitHub link: https://github.com/apache/datafusion/discussions/10900#discussioncomment-15068479 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
