Re: Optimize encoding/decoding strings when using Parquet

2015-02-13 Thread Mick Davies
This is not directly related to Spark but I wondered if anyone has got thrift 0.7 working on Mac Yosemite 10.0, or can suggest a work round. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p1061

Re: Optimize encoding/decoding strings when using Parquet

2015-01-23 Thread Michael Davies
t; http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p10195.html > > <http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp1

Re: Optimize encoding/decoding strings when using Parquet

2015-01-19 Thread Reynold Xin
t: > http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p10195.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > >

Re: Optimize encoding/decoding strings when using Parquet

2015-01-19 Thread Mick Davies
add this. Has anyone considered this? Shall I get a pull request together for it. Mick -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p10195.html Sent from the Apache Spark Developers List

Re: Optimize encoding/decoding strings when using Parquet

2015-01-19 Thread Mick Davies
s, std deviation 198.32633040858022 millis -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p10193.html Sent from the Apache Spark Developers List mailing list archive at Nabb

Re: Optimize encoding/decoding strings when using Parquet

2015-01-19 Thread Mick Davies
Added a JIRA to track https://issues.apache.org/jira/browse/SPARK-5309 -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p10189.html Sent from the Apache Spark Developers List mailing list

Re: Optimize encoding/decoding strings when using Parquet

2015-01-16 Thread Michael Armbrust
et could ensure that the > encoding/decoding of each Object occurs only once. > > Does anyone have an opinion on this, has it been considered already? > > Cheers Mick > > > > > > > > -- > View this message in context: > http://apache-spark-

Optimize encoding/decoding strings when using Parquet

2015-01-16 Thread Mick Davies
onsidered already? Cheers Mick -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141.html Sent from the Apache Spark Developers List mailing list archive at N