Yifan Cai created CASSANALYTICS-107:
---------------------------------------
Summary: Fix race condition in
DirectStreamSession#onSSTablesProduced and SortedSStableWriter#close
Key: CASSANALYTICS-107
URL: https://issues.apache.org/jira/browse/CASSANALYTICS-107
Project: Apache Cassandra Analytics
Issue Type: Bug
Components: Writer
Reporter: Yifan Cai
Assignee: Yifan Cai
onSSTablesProduced will trigger a task in the executor service (single
threaded).
and sstableWriter.close called in StreamSession#finalizeStreamAsync is in a
different thread.
{code:java}
Caused by: java.nio.file.NoSuchFileException:
/var/folders/rh/qt9nhp2n5_93kx9ccbtydlxm0000gp/T/d63327d6-5eb2-48c0-8efc-7f47c40d1174/0/0/0/0-0-e58317c7-b1a9-4384-93a4-9c79fcc094a9/nb-3-big-Data.db
at
java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92)
at
java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
at
java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
at
java.base/sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
at
java.base/sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:149)
at java.base/java.nio.file.Files.readAttributes(Files.java:1764)
at java.base/java.nio.file.Files.size(Files.java:2381)
at
org.apache.cassandra.spark.bulkwriter.SortedSSTableWriter.calculatedTotalSize(SortedSSTableWriter.java:319)
at
org.apache.cassandra.spark.bulkwriter.SortedSSTableWriter.close(SortedSSTableWriter.java:233)
at
org.apache.cassandra.spark.bulkwriter.StreamSession.finalizeStreamAsync(StreamSession.java:142)
at
org.apache.cassandra.spark.bulkwriter.RecordWriter.flushAsync(RecordWriter.java:481)
at
org.apache.cassandra.spark.bulkwriter.RecordWriter.write(RecordWriter.java:201)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
