dongjoon-hyun opened a new pull request, #54452:
URL: https://github.com/apache/spark/pull/54452

   ### What changes were proposed in this pull request?
   
   This PR aims to improve `EventLogFileWriter` to log `stop` operation.
   
   ### Why are the changes needed?
   
   Apache Spark has been logging the start of event log processing. We had 
better log the end of event log processing as a pair.
   
   **BEFORE**
   
   ```
   $ bin/run-example -c spark.eventLog.enabled=true -c spark.eventLog.dir=/tmp 
SparkPi 2>&1 | grep RollingEventLogFilesWriter
   26/02/24 08:24:27 INFO RollingEventLogFilesWriter: Logging events to 
file:/private/tmp/eventlog_v2_local-1771950267185/events_1_local-1771950267185.zstd
   ```
   
   **AFTER**
   
   ```
   $ bin/run-example -c spark.eventLog.enabled=true -c spark.eventLog.dir=/tmp 
SparkPi 2>&1 | grep RollingEventLogFilesWriter
   26/02/24 08:24:41 INFO RollingEventLogFilesWriter: Logging events to 
file:/private/tmp/eventlog_v2_local-1771950279197/events_1_local-1771950279197.zstd
   26/02/24 08:24:42 INFO RollingEventLogFilesWriter: Stopping event writer for 
file:/private/tmp/eventlog_v2_local-1771950279197
   ```
   
   ### Does this PR introduce _any_ user-facing change?
   
   No behavior change because this is a log.
   
   ### How was this patch tested?
   
   Manual test.
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   Generated-by: `Gemini 3.1 Pro (High)` on `Antigravity`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to