Hi all,

I'm writing this email to propose switching back to the previous plain text
logs by default, for the following reasons:

   - The JSON log is not very human-readable. It's more verbose than plain
   text, and new lines become `\n`, making query plan tree string and error
   stacktrace very hard to read.
   - Structured Logging is not available out of the box. Users must set up
   a log pipeline to collect the JSON log files on drivers and executors
   first. Turning it on by default doesn't provide much value.

Some examples of the hard-to-read JSON log:
[image: image.png]
[image: image.png]

For the good of Spark engine developers and light Spark users, I think the
previous plain text log is a better choice. We can add a doc page to
introduce how to use Structured Logging: turn on the config, collect JSON
log files, and run queries.

Please let me know if you share the same feelings or have different
opinions.

Thanks,
Wenchen

Reply via email to