Re: Weird behavior in Cassandra 1.1.0 - throwing unconfigured CF exceptions when the CF is present

2012-09-15 Thread Tharindu Mathew
Nagarajan < athiyur.sreeh...@gmail.com> wrote: > Hi, > I'm facing the same problem. > @Tharindu Mathew How was this solved. > > Regards, > -Sree > > > -- Regards, Tharindu blog: http://mackiemathew.com/

Re: Weird behavior in Cassandra 1.1.0 - throwing unconfigured CF exceptions when the CF is present

2012-06-24 Thread Tharindu Mathew
veloper > @aaronmorton > http://www.thelastpickle.com > > On 22/06/2012, at 12:22 AM, Tharindu Mathew wrote: > > Hi, > > I'm having issues with Hector 1.1.0 and Cassandra 1.1.0. > > I'm adding a column family dynamically, and after sleeping for some time > and making

Re: 48 character cap on Keyspace + CF name length?

2012-06-17 Thread Tharindu Mathew
gt; > Cheers > > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 15/06/2012, at 6:32 AM, Tharindu Mathew wrote: > > Hi, > > Wonder why this cap is in place? We are experimenting on some CF names > with

48 character cap on Keyspace + CF name length?

2012-06-14 Thread Tharindu Mathew
Hi, Wonder why this cap is in place? We are experimenting on some CF names with UUIDs and hit this issue. -- Regards, Tharindu blog: http://mackiemathew.com/

Re: design that mimics twitter tweet search

2012-03-18 Thread Tharindu Mathew
Sasha, It depends on the way you implement I guess... Maybe twitter uses Solandra, who's very good at indexing these in different ways but has the power of Cassandra underneath... If your doing your own impl of indexing be mindful that you can break the sentence into four words and index or you i

Re: Link in Wiki broken

2012-03-18 Thread Tharindu Mathew
Appreciate the quick reply. Thanks. On Mon, Mar 19, 2012 at 12:20 AM, Benoit Perroud wrote: > http://blip.tv/datastax/getting-to-know-the-cassandra-codebase-4034648 > > > 2012/3/18 Tharindu Mathew : > > Hi, > > > > It seems that [1] is broken. Wonder if it exi

Re: Repairing nodes when two schema versions appear

2012-03-07 Thread Tharindu Mathew
ccepting traffic it may log errors about > missing CF's during this time. > > Cheers > > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 7/03/2012, at 1:43 AM, Tharindu Mathew wrote: > > Hi, >

Re: Schema change causes exception when adding data

2012-03-07 Thread Tharindu Mathew
image: Inline image 1] > > ta...@tok-media.com > Tel: +972 2 6409736 > Mob: +972 54 8356490 > Fax: +972 2 5612956 > > > > > > On Tue, Mar 6, 2012 at 7:55 PM, Jeremiah Jordan < > jeremiah.jor...@morningstar.com> wrote: > >> That is the best one

Repairing nodes when two schema versions appear

2012-03-06 Thread Tharindu Mathew
Hi, I try to add column families programatically and end up with 2 schema versions in the Cassandra cluster. Using Cassandra 0.7. Is there a way to bring this back to normal (to one schema version) through the cli or through the API? -- Regards, Tharindu blog: http://mackiemathew.com/

Way to force the propagation of a schema change?

2012-03-02 Thread Tharindu Mathew
Hi everyone, I add a column family dynamically and notice that when describe schema versions return 2 values. Then it quickly changes back to 1. Sometimes this stays at 2 and does not change. Then I cannot insert values to the created column family, as it causes an exception. Is there a way to fo

Re: Schema change causes exception when adding data

2012-03-01 Thread Tharindu Mathew
ww.thelastpickle.com > > On 2/03/2012, at 12:25 AM, Tharindu Mathew wrote: > > > > On Thu, Mar 1, 2012 at 11:47 AM, Tharindu Mathew wrote: > >> Jeremiah, >> >> Thanks for the reply. >> >> This is what we have been doing, but it's not reliable as w

Re: Schema change causes exception when adding data

2012-03-01 Thread Tharindu Mathew
On Thu, Mar 1, 2012 at 11:47 AM, Tharindu Mathew wrote: > Jeremiah, > > Thanks for the reply. > > This is what we have been doing, but it's not reliable as we don't know a > definite time that the schema would get replicated. Is there any way I can > know for su

Re: Schema change causes exception when adding data

2012-02-29 Thread Tharindu Mathew
an’t use it > immediately, you have to wait for it to propagate. You can use calls to > describe schema to do so, keep calling it until every node is on the same > schema. > > ** ** > > -Jeremiah > > ** ** > > *From:* Tharindu Mathew [mailto:mcclou...@gmail

Re: Tips for using OrderedPartitioner

2012-02-09 Thread Tharindu Mathew
on morton > >> Nothing I can thin of other than making the keys uniform. >> >> Having a single index row with the RP can be a pain. Is there a way to >> partition it ? >> >> Cheers >> >> >> - >> Aaron Morton >> Freel

Re: Hive + Cassandra tutorial

2012-01-23 Thread Tharindu Mathew
Any idea whether the hive functionality will be merged to the Cassandra source? On Tue, Jan 24, 2012 at 1:00 AM, Tharindu Mathew wrote: > Hi Jeremy, > > Thanks for the reply. > > I was looking for a similar sample for Hive. I've already gone through the > Pig sample.

Re: Hive + Cassandra tutorial

2012-01-23 Thread Tharindu Mathew
HadoopSupport and in the > source download of cassandra there's a contrib/pig section that has a > wordcount example. > > On Jan 23, 2012, at 1:16 PM, Tharindu Mathew wrote: > > > Hi, > > > > I'm trying to experiment with Hive using Data in Cassandra. B

Hive + Cassandra tutorial

2012-01-23 Thread Tharindu Mathew
Hi, I'm trying to experiment with Hive using Data in Cassandra. Brisk looks good, but I'm interested in running the map reduce jobs on HDFS not on CFS. I'm taking a look at [1], but couldn't figure out how to run it with a Cassandra cluster. I was wondering is there a simple word count example si

Tips for using OrderedPartitioner

2012-01-23 Thread Tharindu Mathew
Hi, We use Cassandra in a way we always want to range slice queries. Because, of the tendency to create hotspots with OrderedPartioner we decided to use RandomPartitioner. Then we would use, a row as an index row, holding values of the other row keys of the CF. I feel this has become a burden and

Re: Efficient way of figuring out which nodes a set of keys belong to - Hadoop integration

2011-09-24 Thread Tharindu Mathew
Would really appreciate any help on this. On Thu, Sep 22, 2011 at 11:34 PM, Tharindu Mathew wrote: > Hi, > > I managed to modify the Hadoop-Cassandra integration to start with a column > of a CF used for indexing. In the map phase, I get keys from different CFs > and get the row

Re: Possibility of going OOM using get_count

2011-09-19 Thread Tharindu Mathew
ement >> the paging yourself. >> Cheers >> - >> Aaron Morton >> Freelance Cassandra Developer >> @aaronmorton >> http://www.thelastpickle.com >> On 19/09/2011, at 8:45 PM, Tharindu Mathew wrote: >> >> >> On Mo

Figuring out which node a key belongs to

2011-09-19 Thread Tharindu Mathew
Hi, I'd like to do $subject. Is there a way to do this? I feel this should be possible by hashing the key and comparing the token of each node. But I don't know the internals enough to know exactly? This is to tell hadoop to fetch a record from a specific node. I'm customizing the CFIF. Rega

Re: Possibility of going OOM using get_count

2011-09-19 Thread Tharindu Mathew
> > > > 2011/9/19 Tharindu Mathew : > > Thanks Aaron and Jake for the replies. > > Any chance of a possible workaround to use for Cassandra 0.7? > > > > On Mon, Sep 19, 2011 at 3:48 AM, aaron morton > > wrote: > >> > >> Cool > >>

Re: Possibility of going OOM using get_count

2011-09-18 Thread Tharindu Mathew
ttp://www.thelastpickle.com > > On 19/09/2011, at 9:55 AM, Jake Luciani wrote: > > This is fixed in 1.0 > https://issues.apache.org/jira/browse/CASSANDRA-2894 > > > On Sun, Sep 18, 2011 at 2:16 PM, Tharindu Mathew wrote: > >> Hi everyone, >> >> I noticed t

Possibility of going OOM using get_count

2011-09-18 Thread Tharindu Mathew
Hi everyone, I noticed this line in the API docs, The method is not O(1). It takes all the columns from disk to calculate the answer. The only benefit of the method is that you do not need to pull all the columns over Thrift interface to count them. Does this mean if a row has a large number of c

Re: Exception in Hadoop Word Count sample

2011-09-16 Thread Tharindu Mathew
The example works against the 7.0 branch, not against trunk. JIRA created at https://issues.apache.org/jira/browse/CASSANDRA-3215 On Thu, Sep 15, 2011 at 3:58 PM, Tharindu Mathew wrote: > Now I get this, > > Any help would be greatly appreciated. > > ./bin/word_count > 11/0

Re: Exception in Hadoop Word Count sample

2011-09-15 Thread Tharindu Mathew
0% 11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004 11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0 On Thu, Sep 15, 2011 at 12:17 PM, Tharindu Mathew wrote: > Found it. 'ant artifacts' > > > On Thu, Sep 15, 2011 at 12:02 PM, Tharindu Mathew wrote

Re: Exception in Hadoop Word Count sample

2011-09-14 Thread Tharindu Mathew
Found it. 'ant artifacts' On Thu, Sep 15, 2011 at 12:02 PM, Tharindu Mathew wrote: > Yes. That's the problem. Thanks Jonathan. > > I'm actually using trunk against a 0.7. How can I generate the distro in > trunk? > > Forgive my ignorance, I'm more use

Re: Exception in Hadoop Word Count sample

2011-09-14 Thread Tharindu Mathew
7 Cassandra? > > On Wed, Sep 14, 2011 at 2:19 PM, Tharindu Mathew > wrote: > > I see $subject. Can anyone help me to rectify this? > > Stacktrace: > > Exception in thread "main" org.apache.thrift.TApplicationException: > Required > > field &#x

Re: Recommendations on moving to Hadoop/Hive with Cassandra + RDBMS

2011-08-30 Thread Tharindu Mathew
might be helpful: > http://www.datastax.com/docs/0.8/brisk/about_pig > > On Aug 30, 2011, at 1:30 PM, Tharindu Mathew wrote: > > > Thanks Jeremy for your response. That gives me some encouragement, that I > might be on that right track. > > > > I think I need to t

Re: Recommendations on moving to Hadoop/Hive with Cassandra + RDBMS

2011-08-30 Thread Tharindu Mathew
n. If you're already storing your data in > Cassandra and are looking to use Hadoop with it, then I would seriously > consider using Brisk. > > That said, Cassandra with Hadoop works fine. > > On Aug 30, 2011, at 11:58 AM, Tharindu Mathew wrote: > > > Hi Eric, > >

Recommendations on moving to Hadoop/Hive with Cassandra + RDBMS

2011-08-29 Thread Tharindu Mathew
Hi, I have an already running system where I define a simple data flow (using a simple custom data flow language) and configure jobs to run against stored data. I use quartz to schedule and run these jobs and the data exists on various data stores (mainly Cassandra but some data exists in RDBMS li

Re: Problem with Schema change propagation time

2011-08-02 Thread Tharindu Mathew
> Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 3/08/2011, at 6:04 AM, Tharindu Mathew wrote: > > I ran across a problem, when trying to execute the following code through > Hector. > > private boolean createCF(String CFName) { >

Problem with Schema change propagation time

2011-08-02 Thread Tharindu Mathew
I ran across a problem, when trying to execute the following code through Hector. private boolean createCF(String CFName) { BasicColumnFamilyDefinition columnFamilyDefinition = new BasicColumnFamilyDefinition(); columnFamilyDefinition.setColumnType(ColumnType.STANDARD); col

Re: Creating key spaces on the fly

2010-07-06 Thread Tharindu Mathew
Thanks Jess and Aaron for the replies. I will take a checkout and try again.

Creating key spaces on the fly

2010-07-06 Thread Tharindu Mathew
Hi everyone, I'm trying to use Cassandra to replace a RDBMS. My application handles domains. And, for every domain it creates a new DB with a pre-defined set of tables. After reading the documentation, I assume that this should be handled on Cassandra by creating new key spaces. Could I know if