Re: Mystery PIG issue with 1.2.10

2013-09-26 Thread Janne Jalkanen
Unfortunately no, as I have a dozen legacy columnfamilies… Since no clear answers appeared, I'm going to assume that this is a regression and file a JIRA ticket on this. /Janne On 26 Sep 2013, at 08:00, Aaron Morton wrote: >> > (testc = LOAD 'cassandra://keyspace/testc' USING CassandraStorag

RE: 1.2.10 -> 2.0.1 migration issue

2013-09-26 Thread Christopher Wirt
Yes that was the problem. I got confused between 2.0.1 and 2.1.0 after downloading the trunk source. From: Robert Coli [mailto:rc...@eventbrite.com] Sent: 25 September 2013 18:10 To: user@cassandra.apache.org Subject: Re: 1.2.10 -> 2.0.1 migration issue On Wed, Sep 25, 2013 at 6:05 AM,

RE: [Cassandra] Initial Setup - VMs for Research

2013-09-26 Thread shathawa
Thanks for the link. I also found some useful infrastructure integration help documents on your web pages. Steven J. Hathaway > What help are u looking for ? > > http://www.datastax.com/docs/datastax_enterprise3.1/install/install_deb_pkg > > -Original Message- > From: shath...@e-z.net [m

Re: [Cassandra] Initial Setup - VMs for Research

2013-09-26 Thread shathawa
Thanks for the links! Very Helpful Steven J. Hathaway > There is also Debian for the standard Apache Cassandra build > http://wiki.apache.org/cassandra/DebianPackaging > > Or you can use DS Community which is a totally free distro of Apache > Cassandra > http://www.datastax.com/documentation/cas

Re: [Cassandra] Initial Setup - VMs for Research

2013-09-26 Thread shathawa
> There is also Debian for the standard Apache Cassandra build > http://wiki.apache.org/cassandra/DebianPackaging > > Or you can use DS Community which is a totally free distro of Apache > Cassandra > http://www.datastax.com/documentation/cassandra/2.0/webhelp/index.html#cassandra/install/installDe

Re: Mystery PIG issue with 1.2.10

2013-09-26 Thread Robert Coli
On Thu, Sep 26, 2013 at 1:00 AM, Janne Jalkanen wrote: > > Unfortunately no, as I have a dozen legacy columnfamilies… Since no clear > answers appeared, I'm going to assume that this is a regression and file a > JIRA ticket on this. > Could you let the list know the ticket number, when you do? :)

data schema for hourly runnning analytics

2013-09-26 Thread Renat Gilfanov
Hello, We have a column family which stores incoming requests, and we would like to perform some analytics  on that data using Hadoop. The analytic results should be available pretty soon, not realtime, but within an hour or so. So we store the current hour number (calculated from timestamp) a

How many Column Families can Cassandra handle?

2013-09-26 Thread Raihan Jamal
I am working on a use case for Timeline series data. I have been told to create 600 column families in Cassandra. Meaning for 10 minutes, I will be having column families in Cassandra. Each second will have its own column family, so till 10 minutes which is 600 second, I will be having 600 column f

Re: How many Column Families can Cassandra handle?

2013-09-26 Thread Hiller, Dean
600 is probably doable but each CF takes up memory……PlayOrm goes with a strategy that can virtualize CF's into one CF allowing less memory usage….we have 80,000 virtual CF's in cassandra through playorm….you can copy playorm's pattern if desired. But 600 is probably doable but high. 10,000 is

Re: Best version to upgrade from 1.1.10 to 1.2.X

2013-09-26 Thread Paulo Motta
Hello Charles, Thank you very much for your detailed upgrade report. It'll be very helpful during our upgrade operation (even though we'll do a rolling production upgrade). I'll also share our findings during the upgrade here. Cheers, Paulo 2013/9/24 Charles Brophy > Hi Paulo, > > I just co

What is the best way to install & upgrade Cassandra on Ubuntu ?

2013-09-26 Thread Ertio Lew
How do you install Cassandra on Ubuntu & later how do you upgrade the installation on the node when an update has arrived ? Do you simply download & replace the latest tar.gz, untar it to replace the older cassandra files? How do you do it ? How does this upgrade process differ for a major version

Re: How many Column Families can Cassandra handle?

2013-09-26 Thread Krishna Pisupat
I don't know the full use case. However, for a generic time series scenario, we can make the timestamp (may be unto second part) part of the key and write all the data into the same CF(one CF for all data). Again, it may not make sense in your case, given the full use case. Just my 2 cents. T

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

2013-09-26 Thread Robert Coli
On Thu, Sep 26, 2013 at 12:05 PM, Ertio Lew wrote: > How do you install Cassandra on Ubuntu & later how do you upgrade the > installation on the node when an update has arrived ? Do you simply > download & replace the latest tar.gz, untar it to replace the older > cassandra files? How do you do i

How to create multiple column families using some script?

2013-09-26 Thread Raihan Jamal
I have to create Multiple Column Families in my keyspace. One way is to create the column families one by one.. But in my case, I have around 100 column families so I cannot do it one by one... So is there any way, I can create multiple column families through some sort of script which can create m

Re: How to create multiple column families using some script?

2013-09-26 Thread Robert Coli
On Thu, Sep 26, 2013 at 1:18 PM, Raihan Jamal wrote: > I have to create Multiple Column Families in my keyspace. One way is to > create the column families one by one.. But in my case, I have around 100 > column families so I cannot do it one by one... So is there any way, I can > create multiple

Re: Query about class org.apache.cassandra.io.sstable.SSTableSimpleWriter

2013-09-26 Thread Aaron Morton
> org.apache.cassandra.thrift.Column column; // initialize this with name, > value, timestamp, TTL This is the wrong object to use. one overload of addColumn() accepts IColumn which is from org.apache.cassanda.db . The thrift classes are only use for the thrift API. > What is the difference b

Re: Nodes not added to existing cluster

2013-09-26 Thread Aaron Morton
> INFO 05:03:49,015 Cannot handshake version with /aa.bb.cc.dd > INFO 05:03:49,017 Handshaking version with /aa.bb.cc.dd If you can turn up logging to TRACE for org.apache.cassandra.net.OutboundTcpConnection it will include the full error. > The two addresses that it is unable to handshake wit

Re: Mystery PIG issue with 1.2.10

2013-09-26 Thread Aaron Morton
> Unfortunately no, as I have a dozen legacy columnfamilies… Since no clear > answers appeared, I'm going to assume that this is a regression and file a > JIRA ticket on this. Could you explain that a little more? You tried using the CqlStorage read with a CQL 3 table and it did not work ? C

Re: data schema for hourly runnning analytics

2013-09-26 Thread Aaron Morton
> CREATE TABLE requests ( > request_id UUID PRIMARY KEY, > partition_number INT, > payload ASCII > ); > > CREATE INDEX ON requests(partition_number); If reading all the request in an hour is something you do frequently than I strongly recommend modelling that with another table. e

Re: Mystery PIG issue with 1.2.10

2013-09-26 Thread Chad Johnston
The OP was using a Thrift table and CassandraStorage. I verified that the problem does not exist with a CQL3 table and CqlStorage. Chad On Thu, Sep 26, 2013 at 7:05 PM, Aaron Morton wrote: > > Unfortunately no, as I have a dozen legacy columnfamilies… Since no clear >> answers appeared, I'm goi

Re: Query about class org.apache.cassandra.io.sstable.SSTableSimpleWriter

2013-09-26 Thread Jayadev Jayaraman
Thanks for the reply. Isn't the addColumn(IColumn col) method in the writer private though? I know what to do now in order to construct a column with a TTL now. Thanks. On Sep 26, 2013 9:00 PM, "Aaron Morton" wrote: > > org.apache.cassandra.thrift.Column column; // initialize this with name, > va

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

2013-09-26 Thread Ertio Lew
Could you please clarify that: 1. when I upgrade to a newer version, would that retain my previous configurations so that I don't need to configure everything again ? 2. would that smoothly replace the previous installation by itself ? 3. what's the way (kindly, if you can tell the command) to

Re: Mystery PIG issue with 1.2.10

2013-09-26 Thread Janne Jalkanen
Sorry, got sidetracked :) https://issues.apache.org/jira/browse/CASSANDRA-6102 /Janne On Sep 26, 2013, at 20:04 , Robert Coli wrote: > On Thu, Sep 26, 2013 at 1:00 AM, Janne Jalkanen > wrote: > > Unfortunately no, as I have a dozen legacy columnfamilies… Since no clear > answers appeared,