Re: Using Spark to delete from Transactional Cluster

2018-03-24 Thread Jacques-Henri Berthemet
ndra.apache.org" , "user@cassandra.apache.org" Subject: Re: Using Spark to delete from Transactional Cluster I think there are better ways to leverage parallel processing than to use it to delete data. As I said , it works for one of my projects for the same exact reas

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Charulata Sharma (charshar)
user@cassandra.apache.org" Subject: Re: Using Spark to delete from Transactional Cluster I think there are better ways to leverage parallel processing than to use it to delete data. As I said , it works for one of my projects for the same exact reason you stated : business rules. Deleting data

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Rahul Singh
t very clean in our case. > > Thanks, > Charu > > From: Rahul Singh > Reply-To: "user@cassandra.apache.org" > Date: Thursday, March 22, 2018 at 5:08 PM > To: "user@cassandra.apache.org" , > "user@cassandra.apache.org" > Subject: Re: Using Spar

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Charulata Sharma (charshar)
, March 23, 2018 at 12:10 PM To: "user@cassandra.apache.org" Subject: Re: Using Spark to delete from Transactional Cluster I'm confused as to what the difference between deleting with prepared statements and deleting through spark is? To the best of my knowledge either way it&

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Nitan Kainth
a column level and there are business >> rules for purge which make the TTL solution not very clean in our case. >> >> >> >> Thanks, >> >> Charu >> >> >> >> From: Rahul Singh >> Reply-To: "user@cassandra.apache.

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Jonathan Haddad
> > Thanks, > > Charu > > > > *From: *Rahul Singh > *Reply-To: *"user@cassandra.apache.org" > *Date: *Thursday, March 22, 2018 at 5:08 PM > *To: *"user@cassandra.apache.org" , " > user@cassandra.apache.org" > *Subject: *Re: U

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Charulata Sharma (charshar)
e.org" , "user@cassandra.apache.org" Subject: Re: Using Spark to delete from Transactional Cluster Short answer : it works. You can even run “delete” statements from within Spark once you know which keys to delete. Not elegant but it works. It will create a bunch of tombstones and you may need to

Re: Using Spark to delete from Transactional Cluster

2018-03-22 Thread Rahul Singh
Short answer : it works. You can even run “delete” statements from within Spark once you know which keys to delete. Not elegant but it works. It will create a bunch of tombstones and you may need to spread your deletes over days. Another thing to consider is instead of deleting setting a TTL whi