[
https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13960435#comment-13960435
]
Joshua McKenzie edited comment on CASSANDRA-3668 at 4/4/14 9:29 PM:
--------------------------------------------------------------------
We should be good with multiple StreamSessions per peer with some minimal
code-changes to clean up and consolidate StreamSessions and ProgressInfo data.
Prelim parallelized stream testing is peaking at ~ 55MB/s on 5
connections-per-host vs. 49MB/s on 4 connections - diminishing returns as we
get higher. Compared to the 24MB/s I'm benchmarking on a single connection
it's still a respectable increase.
was (Author: joshuamckenzie):
(edit) We're good with the multiple StreamSessions per peer, I just need to
iron out a socket-connection race on startup of streams.
Prelim parallelized stream testing is peaking at ~ 55MB/s on 5
connections-per-host vs. 49MB/s on 4 connections - diminishing returns as we
get higher. Compared to the 24MB/s I'm benchmarking on a single connection
it's still a respectable increase.
> Parallel streaming for sstableloader
> ------------------------------------
>
> Key: CASSANDRA-3668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3668
> Project: Cassandra
> Issue Type: Improvement
> Components: API
> Reporter: Manish Zope
> Assignee: Joshua McKenzie
> Priority: Minor
> Labels: streaming
> Fix For: 2.1 beta2
>
> Attachments: 3668-1.1-v2.txt, 3668-1.1.txt,
> 3688-reply_before_closing_writer.txt, sstable-loader performance.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> One of my colleague had reported the bug regarding the degraded performance
> of the sstable generator and sstable loader.
> ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589
> As stated in above issue generator performance is rectified but performance
> of the sstableloader is still an issue.
> 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the
> problem with sstableloader still exists.
> So opening other issue so that sstbleloader problem should not go unnoticed.
> FYI : We have tested the generator part with the patch given in 3589.Its
> Working fine.
> Please let us know if you guys require further inputs from our side.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
