Re: Tool for SQL -> Cassandra data movement

2011-11-02 Thread Brian O'Neill
5.588.6024 blog: http://weblogs.java.net/blog/boneill42/ blog: http://brianoneill.blogspot.com/ From: Maxim Potekhin Organization: Brookhaven National Laboratory Reply-To: Date: Tue, 01 Nov 2011 14:18:00 -0400 To: Subject: Re: Tool for SQL -> Cassandra data movement Just a short com

Re: Tool for SQL -> Cassandra data movement

2011-11-01 Thread Maxim Potekhin
Just a short comment -- we are going the CSV way as well because of its compactness and extreme portability. The CSV files are kept in the cloud as backup. They can also find other uses. JSON would work as well, but it would be at least twice as large in size. Maxim On 9/22/2011 1:25 PM, Nehal

Re: Tool for SQL -> Cassandra data movement

2011-09-27 Thread Nehal Mehta
Hi, Instead of passing it as command line argument, I am storing all of this configuration in config/config.xml. My earlier version was command line, but than as arguments increased I shifted to config.xml. Plus I thought providing all credentials at command line is also not a good idea. Sample C

Re: Tool for SQL -> Cassandra data movement

2011-09-27 Thread Radim Kolar
> I have cleaned up my code that imports CSV into Cassandra and I have put it open on https://github.com/nehalmehta/CSV2Cassandra. Have a look if it is useful to you. Hello, I will remake this tool into something which is like Oracle SQL*Loader. Basically, you will pass controlfile as command

Re: Tool for SQL -> Cassandra data movement

2011-09-22 Thread Nehal Mehta
Hi Ramdin, I have cleaned up my code that imports CSV into Cassandra and I have put it open on https://github.com/nehalmehta/CSV2Cassandra. Have a look if it is useful to you. I have used Hector instead of sstableloader. For me it was necessary to have consistency level of EACH_QUORUM. Thanks, N

Re: Tool for SQL -> Cassandra data movement

2011-09-22 Thread Radim Kolar
Dne 22.9.2011 19:25, Nehal Mehta napsal(a): We are trying to carry out same stuff, but instead of migrating into JSON, we are exporting into CSV and than importing CSV into Cassandra. You are right CSV seems to be more portable Which DB are you currently using? Postgresql and Apache Derby.

Re: Tool for SQL -> Cassandra data movement

2011-09-22 Thread Jeremy Hanna
Take a look at http://www.datastax.com/dev/blog/bulk-loading I'm sure there is a way to make it more seamless for what you want to do and it could be built on, but the recent bulk loading additions will provide the best foundation. On Sep 22, 2011, at 12:25 PM, Nehal Mehta wrote: > We are tryi

Re: Tool for SQL -> Cassandra data movement

2011-09-22 Thread Nehal Mehta
We are trying to carry out same stuff, but instead of migrating into JSON, we are exporting into CSV and than importing CSV into Cassandra. Which DB are you currently using? Thanks, Nehal Mehta. 2011/9/22 Radim Kolar > I need tool which is able to dump tables via JDBC into JSON format for > ca

Tool for SQL -> Cassandra data movement

2011-09-22 Thread Radim Kolar
I need tool which is able to dump tables via JDBC into JSON format for cassandra import. I am pretty sure that somebody already wrote that. Are there tools which can do direct JDBC -> cassandra import?