Re: questions related to the SSTable file

2013-09-19 Thread Robert Coli
On Tue, Sep 17, 2013 at 6:51 PM, java8964 java8964 wrote: > I thought I was clearer, but your clarification confused me again. > > But there is no way we can be sure that these SSTable files will ONLY > contain modified data. So the statement being quoted above is not exactly > right. I agree th

Re: questions related to the SSTable file

2013-09-17 Thread Takenori Sato
o > realize that in the incremental backup sstable files, they could or most > likely contain old data which was previous being processed already. That > will require additional logic and responsibility in the ETL to handle it, > or any outsider SSTable consumer to pay attention to it.

RE: questions related to the SSTable file

2013-09-17 Thread java8964 java8964
attention to it. Yong Date: Tue, 17 Sep 2013 18:01:45 -0700 Subject: Re: questions related to the SSTable file From: rc...@eventbrite.com To: user@cassandra.apache.org On Tue, Sep 17, 2013 at 5:46 PM, Takenori Sato wrote: > So in fact, incremental backup of Cassandra is just hard link all the

Re: questions related to the SSTable file

2013-09-17 Thread Takenori Sato(Cloudian)
Thanks, Rob, for clarifying! - Takenori (2013/09/18 10:01), Robert Coli wrote: On Tue, Sep 17, 2013 at 5:46 PM, Takenori Sato > wrote: > So in fact, incremental backup of Cassandra is just hard link all the new SSTable files being generated during the increme

Re: questions related to the SSTable file

2013-09-17 Thread Robert Coli
On Tue, Sep 17, 2013 at 5:46 PM, Takenori Sato wrote: > > So in fact, incremental backup of Cassandra is just hard link all the > new SSTable files being generated during the incremental backup period. It > could contain any data, not just the data being update/insert/delete in > this period, cor

Re: questions related to the SSTable file

2013-09-17 Thread Takenori Sato
able files being generated during the incremental backup period. It > could contain any data, not just the data being update/insert/delete in > this period, correct? > > Thanks > > Yong > > > From: dean.hil...@nrel.gov > > To: user@cassandra.apache.org &g

Re: questions related to the SSTable file

2013-09-17 Thread Shahab Yunus
t; > > From: dean.hil...@nrel.gov > > To: user@cassandra.apache.org > > Date: Tue, 17 Sep 2013 08:11:36 -0600 > > Subject: Re: questions related to the SSTable file > > > > Netflix created file streaming in astyanax into cassandra specifically > because writi

Re: questions related to the SSTable file

2013-09-17 Thread Robert Coli
On Tue, Sep 17, 2013 at 6:54 AM, Shahab Yunus wrote: > java8964, basically are you asking that what will happen if we put large > amount of data in one column of one row at once? How will this blob of data > representing one column and one row i.e. cell will be split into multiple > SSTable? Or in

RE: questions related to the SSTable file

2013-09-17 Thread java8964 java8964
gov > To: user@cassandra.apache.org > Date: Tue, 17 Sep 2013 08:11:36 -0600 > Subject: Re: questions related to the SSTable file > > Netflix created file streaming in astyanax into cassandra specifically > because writing too big a column cell is a bad thing. The limit is reall

Re: questions related to the SSTable file

2013-09-17 Thread Hiller, Dean
ser@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Tuesday, September 17, 2013 7:54 AM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: questions related to t

Re: questions related to the SSTable file

2013-09-17 Thread Shahab Yunus
hanges apply to the same row key as above > example, additional SSTable file could be generated. That is clear for me. > > Yong > > > From: dean.hil...@nrel.gov > > To: user@cassandra.apache.org > > Date: Tue, 17 Sep 2013 07:39:48 -0600 > > Subject: Re: questio

RE: questions related to the SSTable file

2013-09-17 Thread java8964 java8964
t; To: user@cassandra.apache.org > Date: Tue, 17 Sep 2013 07:39:48 -0600 > Subject: Re: questions related to the SSTable file > > You have to first understand the rules of > > 1. Sstables are immutable so Color-1-Data.db will not be modified and only > deleted once compacted > 2. Me

RE: questions related to the SSTable file

2013-09-17 Thread java8964 java8964
last change, right? In MR world, each file COULD be processed by different Mapper, but will be sent to the same reducer as both data will be shared same key. Yong > From: dean.hil...@nrel.gov > To: user@cassandra.apache.org > Date: Tue, 17 Sep 2013 06:32:03 -0600 > Subject: Re: quest

Re: questions related to the SSTable file

2013-09-17 Thread Hiller, Dean
pache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Tuesday, September 17, 2013 7:32 AM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: RE: questions related to

RE: questions related to the SSTable file

2013-09-17 Thread java8964 java8964
ndra.apache.org Subject: Re: questions related to the SSTable file Hi, > 1) I will expect same row key could show up in both sstable2json output, as this one row exists in both SSTable files, right? Yes. > 2) If so, what is the bound

Re: questions related to the SSTable file

2013-09-17 Thread Hiller, Dean
>" mailto:user@cassandra.apache.org>> Subject: Re: questions related to the SSTable file Hi, > 1) I will expect same row key could show up in both sstable2json output, as > this one row exists in both SSTable files, right? Yes. > 2) If so, what is the boundary? Will Ca

Re: questions related to the SSTable file

2013-09-16 Thread Takenori Sato(Cloudian)
Hi, > 1) I will expect same row key could show up in both sstable2json output, as this one row exists in both SSTable files, right? Yes. > 2) If so, what is the boundary? Will Cassandra guarantee the column level as the boundary? What I mean is that for one column's data, it will be guarant