I approximate dynamic columns by data_key and data_value columns.
Is there a better way to get dynamic columns in CQL 3?

At 2015-01-21 09:41:02, "Peter Lin" <wool...@gmail.com> wrote:



I think that table example misses the point of chetan's functional requirement. 
he actually needs dynamic columns.



On Tue, Jan 20, 2015 at 8:12 PM, Xu Zhongxing <xu_zhong_x...@163.com> wrote:

Maybe this is the closest thing to "dynamic columns" in CQL 3.


create table reivew (
    product_id bigint,
    created_at timestamp,
    data_key text,
    data_tvalue text,
    data_ivalue int,
    primary key ((priduct_id, created_at), data_key)
);


data_tvalue and data_ivalue is optional.


At 2015-01-21 04:44:07, "chetan verma" <chetanverm...@gmail.com> wrote:

Hi,


Adding to previous mail. For example: We have a column family named review 
(with some arbitrary data in map).


CREATE TABLE review(
product_id bigint,
created_at timestamp,
data_int map<text, int>,
data_text map<text, text>,
PRIMARY KEY (product_id, created_at)
);


Assume that these 2 maps I use to store arbitrary data (i.e. data_int and 
data_text for int and text values)
when we see output on cassandra-cli, it looks like in a partition as :
<clustering_key>:data_int:map_key as column name and value as map value.
suppose I need to get this value, I couldn't do that with CQL3 but in thrift 
its possible. Any Solution?


On Wed, Jan 21, 2015 at 1:06 AM, chetan verma <chetanverm...@gmail.com> wrote:

Hi,


Most of the time I will  be querying on product_id and created_at, but for 
analytic I need to query almost on all column.
Multiple collections ideas is good but the only is cassandra reads a collection 
entirely, what if I need a slice of it, I mean 
columns for certain keys which is possible with thrift. Please suggest.


On Wed, Jan 21, 2015 at 12:36 AM, Jonathan Lacefield <jlacefi...@datastax.com> 
wrote:

Hello,


There are probably lots of options to this challenge.  The more details around 
your use case that you can provide, the easier it will be for this group to 
offer advice.


A few follow-up questions: 
  - How will you query this data?  
  - Do your queries require filtering on specific columns other than product_id 
and created_at, i.e. the dynamic columns?


Depending on the answers to these questions, you have several options, of which 
here are a few:
Cassandra efficiently stores sparse data, so you could create columns and not 
populate them, without much of a penalty
Could use a clustering column to store a columns type and another col 
(potentially clustering) to store the value
i.e. CREATE TABLE foo (col1 int, attname text, attvalue text, col4...n, PRIMARY 
KEY (col1, attname, attvalue));
where attname stores the name of the attribute/column and attvalue stores the 
value of that attribute
have seen users use this model and create a "main" attribute row within a 
partition that stores the values associated with col4...n
Could store multiple collections
Others probably have ideas as well
You may want to look in the archives for a similar discussion topic.  Believe 
this item was asked a few months ago as well.



Jonathan Lacefield

Solution Architect |(404) 822 3487 | jlacefi...@datastax.com





On Tue, Jan 20, 2015 at 1:40 PM, chetan verma <chetanverm...@gmail.com> wrote:

Hi,


I am creating a review system. for instance lets assume following are the 
attibutes of system:


Review{
id bigint,
product_id bigint,
created_at timestamp,
summary text,
description text,
pros set<text>,
cons set<text>,
feature_rating map<text, int>
etc....
}
I created partition key as product_id (so that all the reviews for a given 
product will reside on same node)
and clustering key as created_at and id (Desc) so that  reviews will be sorted 
by time.


I can have more column and that requirement I want to fulfil by dynamic columns 
but there are limitations to it explained above.
Could you please let me know the best way.


On Tue, Jan 20, 2015 at 11:59 PM, Jonathan Lacefield <jlacefi...@datastax.com> 
wrote:

Hello,


  Have you looked at solving this challenge with clustering columns?  Also, 
please describe the problem set details for more specific advice from this 
group.


  Starting new projects on Thrift isn't the recommended approach.  


Jonathan



Jonathan Lacefield

Solution Architect |(404) 822 3487 | jlacefi...@datastax.com





On Tue, Jan 20, 2015 at 1:24 PM, chetan verma <chetanverm...@gmail.com> wrote:

Hi,


I am starting a new project with cassandra as database.
I have unstructured data so I need dynamic columns, 
though in CQL3 we can achive this via Collections but there are some downsides 
to it.
1. Collections are used to store small amount of data.
2. The maximum size of an item in a collection is 64K.
3. Cassandra reads a collection in its entirety.
4. Restrictions on number of items in collections is 64,000


And no support to get single column by map key, which is possible via cassandra 
cli.
Please suggest whether I should use CQL3 or Thrift and which driver is best.


--

Regards,
Chetan Verma
+91 99860 86634







--

Regards,
Chetan Verma
+91 99860 86634







--

Regards,
Chetan Verma
+91 99860 86634





--

Regards,
Chetan Verma
+91 99860 86634

Reply via email to