Getting Exceptions/WARN during random runs for same dataset

2016-01-29 Thread Khusro Siddiqui
Hi Everyone, Environment used: Datastax Enterprise 4.8.3 which is bundled with Spark 1.4.1 and scala 2.10.5. I am using Dataframes to query Cassandra, do processing and store the result back into Cassandra. The job is being submitted using spark-submit on a cluster of 3 nodes. While doing so I ge

Re: Getting Exceptions/WARN during random runs for same dataset

2016-01-28 Thread Khusro Siddiqui
gt; > On Thu, Jan 28, 2016 at 5:13 PM, Khusro Siddiqui > wrote: > >> Hi Everyone, >> >> Environment used: Datastax Enterprise 4.8.3 which is bundled with Spark >> 1.4.1 and scala 2.10.5. >> >> I am using Dataframes to query Cassandra, do process

Getting Exceptions/WARN during random runs for same dataset

2016-01-28 Thread Khusro Siddiqui
Hi Everyone, Environment used: Datastax Enterprise 4.8.3 which is bundled with Spark 1.4.1 and scala 2.10.5. I am using Dataframes to query Cassandra, do processing and store the result back into Cassandra. The job is being submitted using spark-submit on a cluster of 3 nodes. While doing so I ge