You can import org.apache.spark.Logging, and use logInfo, logWarning etc. Besides viewing them from the Web console, the location of the logs can be found under $SPARK_HOME/logs, on both the driver and executor machines. (If you are on YARN, these logs are located elsewhere, however.)
2014-06-10 11:39 GMT-07:00 Robert James <srobertja...@gmail.com>: > How can I write to Spark's logs from my client code? > What are the options to view those logs? > Besides the Web console, is there a way to read and grep the file? >
