nt:* 08 May 2016 23:20
> *To:* user @spark
> *Subject:* Parse Json in Spark
>
>
>
> Hi,
>
>
>
> I am working on parsing the json in spark but most of the information
> available online states that I need to have entire JSON in single line.
>
>
>
> In
out combining lines.
Ewan
From: KhajaAsmath Mohammed [mailto:mdkhajaasm...@gmail.com]
Sent: 08 May 2016 23:20
To: user @spark
Subject: Parse Json in Spark
Hi,
I am working on parsing the json in spark but most of the information available
online states that I need to have entire JSON in single line.
This limit is due to underlying inputFormat implementation. you can always
write your own inputFormat and then use spark newAPIHadoopFile api to pass
your inputFormat class path. You will have to place the jar file in /lib
location on all the nodes..
Ashish
On Sun, May 8, 2016 at 4:02 PM, Hyukji
I remember this Jira, https://issues.apache.org/jira/browse/SPARK-7366.
Parsing multiple lines are not supported in Json fsta source.
Instead this can be done by sc.wholeTextFiles(). I found some examples
here,
http://searchdatascience.com/spark-adventures-1-processing-multi-line-json-files
Altho
Hi,
I am working on parsing the json in spark but most of the information
available online states that I need to have entire JSON in single line.
In my case, Json file is delivered in complex structure and not in a single
line. could anyone know how to process this in SPARK.
I used Jackson jar
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Fast-way-to-parse-JSON-in-Spark-tp26306.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail
