XiangpengHao commented on code in PR #11514:
URL: https://github.com/apache/datafusion/pull/11514#discussion_r1683471314
##########
datafusion/common/src/config.rs:
##########
@@ -311,6 +311,10 @@ config_namespace! {
/// Should DataFusion keep the columns used for partition_by in the
output RecordBatches
pub keep_partition_by_columns: bool, default = false
+
+ /// If true, the parquet reader will replace `Utf8/Utf8Large` with
`Utf8View`,
Review Comment:
It applies to other formats as well, as the transformation is done after we
call:
```rust
let mut schema = self.format.infer_schema(state, &store, &files).await?;
... // transformation
```
It should work for any format.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
