Koert, Koert Kuipers wrote:
A single json object would mean for most parsers it needs to fit in memory when reading or writing
Note that codlife didn't seem to being asking about /single-object/ JSON files, but about /standard-format/ JSON files.
On Oct 15, 2016 11:09, "codlife" <1004910...@qq.com <mailto:1004910...@qq.com>> wrote: Hi: I'm doubt about the design of spark.read.json, why the json file is not a standard json file, who can tell me the internal reason. Any advice is appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Why-the-json-file-used-by-sparkSession-read-json-must-be-a-valid-json-object-per-line-tp27907.html <http://apache-spark-user-list.1001560.n3.nabble.com/Why-the-json-file-used-by-sparkSession-read-json-must-be-a-valid-json-object-per-line-tp27907.html> Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org <mailto:user-unsubscr...@spark.apache.org>
