RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-21 Thread JOHN, BIBIN
, 2020 2:15 PM To: user@cassandra.apache.org Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis Question: would daily deltas be a good use of CDC? (Rather than export entire tables.) (I can understand that this might make analytics hard if you need to span multiple resultant

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-21 Thread Peter Corless
eams prefer full data > everyday. > > > > > > Thanks > > Bibin John > > > > *From:* Reid Pinchback > *Sent:* Wednesday, February 19, 2020 3:14 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Mechanism to Bulk Export from Cassandra on daily Basis

RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-21 Thread Durity, Sean R
, 2020 3:14 PM To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis To the question of ‘best approach’, so far the comments have been about alternatives in tools. Another axis you might want to consider is from th

RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread JOHN, BIBIN
to Bulk Export from Cassandra on daily Basis To the question of ‘best approach’, so far the comments have been about alternatives in tools. Another axis you might want to consider is from the data model viewpoint. So, for example, let’s say you have 600M rows. You want to do a daily transfer

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Reid Pinchback
To the question of ‘best approach’, so far the comments have been about alternatives in tools. Another axis you might want to consider is from the data model viewpoint. So, for example, let’s say you have 600M rows. You want to do a daily transfer of data for some reason. First question that

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Aakash Pandhi
application. There are 137 tables and 30 of them are have 300M+ records. So “COPY TO” taking lot of time.   Thank you Bibin John   From: Aakash Pandhi Sent: Wednesday, February 19, 2020 12:51 PM To: user@cassandra.apache.org Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Amanda Moran
y, February 19, 2020 12:51 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Mechanism to Bulk Export from Cassandra on daily Basis > > > > John, > > > > Greetings, > > > > Requirement is to just export data from table and stage it somewhere? OR > export

RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread JOHN, BIBIN
@cassandra.apache.org Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis John, Greetings, Requirement is to just export data from table and stage it somewhere? OR export it and load them in another cluster/table? sstableloader is a utility which can help you as it is designed for

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Aakash Pandhi
John, Greetings,  Requirement is to just export data from table and stage it somewhere? OR export it and load them in another cluster/table? sstableloader is a utility which can help you as it is designed for bulk loading.   Sincerely, Aakash Pandhi On Wednesday, February 19, 2020, 10:13: