Re: [Cassandra] [Generation of SStableLoader slow]

2014-12-24 Thread Ryan Svihla
I doubt it there are huge gains with tinkering if adding more CPU speeds the things up, that indicates you're resource bound. It's over a VM, it's probably a slow underlying disk, there is just physics at some point. You can try playing with using the java client instead of the sstableloader but I

Re: [Cassandra] [Generation of SStableLoader slow]

2014-12-24 Thread 严超
Yes, I think so too. Plus, I used VM with 4 CPUs and 2 CPUs, and 4CPUs really did faster. But It took 1 hour to generate sstable for 1G csv. I am wondering if there is other way to make it faster except adding CPUs and ram. *Best Regards!* *Chao Yan--**My twitter:Andy Yan @yanchao727

Re: [Cassandra] [Generation of SStableLoader slow]

2014-12-24 Thread Ryan Svihla
I think that'd be slow copying large files with just the cp command. Cassandra isn't doing anything amazingly strange here, you don't have a lot of RAM, nor CPU and I'm assuming the underlying disk is slow here as well. Without more parameters and details it's hard to define if there is an issue.

[Cassandra] [Generation of SStableLoader slow]

2014-12-24 Thread 严超
Hi, Everyone: I'm importing a CSV file into Cassandra using SStableLoader. And I'm following the example here: https://github.com/yukim/cassandra-bulkload-example/ But, Even though the streaming of SSTables is very fast , I find that generation of SStables is quite slow for very large files (CSV,