Hi Andy

Not sure what Cassandra version you're using, but with 2.0 I found I had to
remove all the non-essential SSTAble files from the directory (e.g only
have .Index and .Data). Otherwise I got OOM like you, even after stung -Xmx4

With 2.1 I was able load successfully even with all generated files (e.g.
.Filter etc) in the target directory.

Rory

On Wed, Dec 10, 2014, 12:58 AM 严超 <yanchao...@gmail.com> wrote:

> Hi, Everyone:
>         I'm importing a CSV file into Cassandra using SStableLoader. And
> I'm following the example here:
>         https://github.com/yukim/cassandra-bulkload-example/
>         When i try to run the sstableloader, it fails with OOM. I also
> changed the sstableloader.sh script (that runs the java -cp ...BulkLoader )
> to have more mem using -Xms and -Xmx args but still i keep hitting the same
> issue.
> Any hints/directions would be really helpful .
>
> *Stack Trace : *
> /usr/bin/sstableloader -v -d <internal-ip> /tmp/nitin_test/nitin_test_
> load/
>
> Established connection to initial hosts
> Opening sstables and calculating sections to stream
> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
> at java.util.ArrayList.<init>(ArrayList.java:144)
> at org.apache.cassandra.db.RowIndexEntry$Serializer.
> deserialize(RowIndexEntry.java:120)
> at org.apache.cassandra.io.sstable.SSTableReader.
> buildSummary(SSTableReader.java:457)
> at org.apache.cassandra.io.sstable.SSTableReader.
> openForBatch(SSTableReader.java:170)
> at org.apache.cassandra.io.sstable.SSTableLoader$1.
> accept(SSTableLoader.java:112)
> at java.io.File.list(File.java:1155)
> at org.apache.cassandra.io.sstable.SSTableLoader.
> openSSTables(SSTableLoader.java:73)
> at org.apache.cassandra.io.sstable.SSTableLoader.stream(
> SSTableLoader.java:155)
> at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:66)
>
>
> *Best Regards!*
>
>
> *Chao Yan--------------**My twitter:Andy Yan @yanchao727
> <https://twitter.com/yanchao727>*
>
>
> *My Weibo:http://weibo.com/herewearenow
> <http://weibo.com/herewearenow>--------------*
>

Reply via email to