L. C. Hsieh created SPARK-33384:
-----------------------------------
Summary: Delete temporary file when cancelling writing to final
path even underlying stream throwing error
Key: SPARK-33384
URL: https://issues.apache.org/jira/browse/SPARK-33384
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.1.0
Reporter: L. C. Hsieh
Assignee: L. C. Hsieh
In {{RenameBasedFSDataOutputStream.cancel}}, we do two things: closing
underlying stream and delete temporary file, in a single try/catch block.
Closing {{OutputStream}} could possibly throw {{IOException}} so we possibly
missing deleting temporary file.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
