In case of parquet, best source for me to configure and to ensure "min/max
statistics" was
https://www.slideshare.net/mobile/RyanBlue3/parquet-performance-tuning-the-missing-guide
---
I don't have any experience in orc.
2018년 2월 22일 (목) 오전 6:59, Kane Kim 님이 작성:
> Thanks, how does min/max index
For the reference, this was intended symptom by PARQUET-686 [1].
[1] https://www.mail-archive.com/commits@parquet.apache.org/msg00491.html
2018-01-24 10:31 GMT+09:00 Stephen Joung :
> How can I write parquet file with min/max statistic?
>
> 2018-01-24 10:30 GMT+09:00 Stephen Joung :
>
How can I write parquet file with min/max statistic?
2018-01-24 10:30 GMT+09:00 Stephen Joung :
> Hi, I am trying to use spark sql filter push down. and specially want to
> use row group skipping with parquet file.
>
> And I guessed that I need parquet file with statis
Hi, I am trying to use spark sql filter push down. and specially want to
use row group skipping with parquet file.
And I guessed that I need parquet file with statistics min/max.
On spark master branch - I tried to write single column with "a", "b", "c"
to parquet file f1
scala> List("a