Yes its in right format as we are able to process that in python.
Also I agree that JSONL would work when split that
[{},{},...]
array of objects into something like this
{}
{}
{}
But since i get the data from another system like this i cannot control, my
question is whether its possible to read json file which has an huge array
of objects?
And i can see it was not supported until < spark 2.2.0 where i have included
a bug that got resolved/fixed in 2.2.0
https://issues.apache.org/jira/browse/SPARK-20980
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
