Re: Understanding Executors UI

2021-01-12 Thread Eric Beabes
mentation for streaming, so you can you profit from testing there too. >> >> >> >> >> >> *From:* Eric Beabes >> *Sent:* Friday, January 8, 2021 04:23 >> *To:* Luca Canali >> *Cc:* spark-user >> *Subject:* Re: Understanding Executors U

Re: Understanding Executors UI

2021-01-09 Thread Amit Sharma
streaming, so you can you profit from testing there too. > > > > > > *From:* Eric Beabes > *Sent:* Friday, January 8, 2021 04:23 > *To:* Luca Canali > *Cc:* spark-user > *Subject:* Re: Understanding Executors UI > > > > So when I see this for 'Storage Memor

RE: Understanding Executors UI

2021-01-08 Thread Luca Canali
proved memory instrumentation and improved instrumentation for streaming, so you can you profit from testing there too. From: Eric Beabes Sent: Friday, January 8, 2021 04:23 To: Luca Canali Cc: spark-user Subject: Re: Understanding Executors UI So when I see this for 'Storage Memory': 3.3TB/

Re: Understanding Executors UI

2021-01-07 Thread Eric Beabes
-spark3-memory-monitoring > > > > Best, > > Luca > > > > *From:* Eric Beabes > *Sent:* Wednesday, January 6, 2021 00:20 > *To:* spark-user > *Subject:* Understanding Executors UI > > > > [image: image.png] > > > > > > Not sure i

RE: Understanding Executors UI

2021-01-06 Thread Luca Canali
6, 2021 00:20 To: spark-user Subject: Understanding Executors UI [image.png] Not sure if this image will go through. (Never sent an email to this mailing list with an image). I am trying to understand this 'Executors' UI in Spark 2.4. I have a Stateful Structured Streaming job w