Re: foreachPartition and task status

2014-10-14 Thread Salman Haq
On Tue, Oct 14, 2014 at 12:42 PM, Sean McNamara wrote: > Are you using spark streaming? > > No, not at this time.

Re: foreachPartition and task status

2014-10-14 Thread Sean McNamara
Are you using spark streaming? On Oct 14, 2014, at 10:35 AM, Salman Haq wrote: > Hi, > > In my application, I am successfully using foreachPartition to write large > amounts of data into a Cassandra database. > > What is the recommended practice if the application wants to know that the > ta

foreachPartition and task status

2014-10-14 Thread Salman Haq
Hi, In my application, I am successfully using foreachPartition to write large amounts of data into a Cassandra database. What is the recommended practice if the application wants to know that the tasks have completed for all partitions? Thanks, Salman