[
https://issues.apache.org/jira/browse/CASSANDRA-20577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Capwell updated CASSANDRA-20577:
--------------------------------------
Attachment:
ci_summary-cassandra-5.0-31a894da1feaa28daf26d2516be0a805fdad878b.html
ci_summary-trunk-1ff5652cc3fc2a11e4af594ead681cacfb7cb85b.html
result_details-cassandra-5.0-31a894da1feaa28daf26d2516be0a805fdad878b.tar.gz
result_details-trunk-1ff5652cc3fc2a11e4af594ead681cacfb7cb85b.tar.gz
> zero copy streaming allocates direct memory that isn't used, but does help to
> fragment the memory space
> -------------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-20577
> URL: https://issues.apache.org/jira/browse/CASSANDRA-20577
> Project: Apache Cassandra
> Issue Type: Bug
> Components: Consistency/Streaming
> Reporter: David Capwell
> Assignee: David Capwell
> Priority: Normal
> Fix For: 5.0.5, 5.1
>
> Attachments:
> ci_summary-cassandra-5.0-31a894da1feaa28daf26d2516be0a805fdad878b.html,
> ci_summary-trunk-1ff5652cc3fc2a11e4af594ead681cacfb7cb85b.html,
> result_details-cassandra-5.0-31a894da1feaa28daf26d2516be0a805fdad878b.tar.gz,
> result_details-trunk-1ff5652cc3fc2a11e4af594ead681cacfb7cb85b.tar.gz
>
> Time Spent: 4.5h
> Remaining Estimate: 0h
>
> This is forked from the patch to CASSANDRA-20567 as it isn’t related to SAI,
> so better to isolate.
> When Zero Copy Streaming creates its per-file writers, it allocates direct
> memory per file; but this allocation is never used. This causes issues as
> the direct memory managed by Cassandra gets fragmented, so we run out of
> space and OOM
> {code}
> INFO [node3_Stream-Deserializer-/127.0.0.1:7012-cf906983] 2025-04-21
> 21:55:51,613 ERROR 21:55:51 [Stream 13815658-1dd2-11b2-98f1-3dfc14dd20f3]
> Error while reading sstable from stream for table = ks1.tbl
> java.lang.OutOfMemoryError: Cannot reserve 2097152 bytes of direct buffer
> memory (allocated: 1055235964, limit: 1056309248)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
