Hi, What are "the spark driver and executor threads information" and "spark application logging"?
Spark uses log4j so set up logging levels appropriately and you should be done. Pozdrawiam, Jacek Laskowski ---- https://about.me/JacekLaskowski The Internals of Spark SQL https://bit.ly/spark-sql-internals The Internals of Spark Structured Streaming https://bit.ly/spark-structured-streaming The Internals of Apache Kafka https://bit.ly/apache-kafka-internals Follow me at https://twitter.com/jaceklaskowski On Fri, Jun 7, 2019 at 1:13 PM test test <h4ker...@gmail.com> wrote: > Hello, > > How can we dump the spark driver and executor threads information in spark > application logging.? > > > PS: submitting spark job using spark submit > > Regards > Rohit >
