Re: [I] Querying Parquet file specifically with a predicate returns invalid data error but works in other situations [datafusion]

[via GitHub]

senyosimpson commented on issue #14281:
URL: https://github.com/apache/datafusion/issues/14281#issuecomment-2613908545

   Confirmed that the following works now.
   
   ```rust
   let mut parquet_options = TableParquetOptions::new();
   parquet_options
       .set("enable_page_index", "false")
       .expect("could not set enable_page_index config option");
   
   let exec = ParquetExec::builder(scan_config)
       .with_table_parquet_options(parquet_options)
       .with_predicate(predicate)
       .build_arc();
   ```
   
    Weirdly enough, setting the variable on the `SessionContext` doesn't work? 
Is that the correct behaviour? I'm sure I had it set right via
   
   ```rust
   let ctx = SessionContext::new_with_config(
     
SessionConfig::new().set_bool("datafusion.execution.parquet.enable_page_index", 
false)
   )
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org