Forgot to paste the link...
http://ramblings.azurewebsites.net/2016/01/26/save-parquet-rdds-in-apache-spark/
On Sat, 27 Aug 2016, 19:18 Sebastian Piu, wrote:
> Hi Renato,
>
> Check here on how to do it, it is in Java but you can translate it to
> Scala if that is what you need.
>
> Cheers
>
> On
Hi Renato,
Check here on how to do it, it is in Java but you can translate it to Scala
if that is what you need.
Cheers
On Sat, 27 Aug 2016, 14:24 Renato Marroquín Mogrovejo, <
renatoj.marroq...@gmail.com> wrote:
> Hi Akhilesh,
>
> Thanks for your response.
> I am using Spark 1.6.1 and what I a
Hi Akhilesh,
Thanks for your response.
I am using Spark 1.6.1 and what I am trying to do is to ingest parquet
files into the Spark Streaming, not in batch operations.
val ssc = new StreamingContext(sc, Seconds(5))
ssc.sparkContext.hadoopConfiguration.set("parquet.read.support.class",
"par
Hi Renato,
Which version of Spark are you using?
If spark version is 1.3.0 or more then you can use SqlContext to read the
parquet file which will give you DataFrame. Please follow the below link:
https://spark.apache.org/docs/1.5.0/sql-programming-guide.html#loading-data-programmatically
Thank
Hi Renato,
Which version of Spark are you using?
If spark version is 1.3.0 or more then you can use SqlContext to read the
parquet file which will give you DataFrame. Please follow the below link:
https://spark.apache.org/docs/1.5.0/sql-programming-guide.html#loading-data-programmatically
Thank
Anybody? I think Rory also didn't get an answer from the list ...
https://mail-archives.apache.org/mod_mbox/spark-user/201602.mbox/%3ccac+fre14pv5nvqhtbvqdc+6dkxo73odazfqslbso8f94ozo...@mail.gmail.com%3E
2016-08-26 17:42 GMT+02:00 Renato Marroquín Mogrovejo <
renatoj.marroq...@gmail.com>:
> Hi
