Job spark blocked and runs indefinitely

We encounter a problem on a Spark job 1.6(on yarn) that never ends, whene several jobs launched simultaneously. We found that by launching the job spark in yarn-client mode we do not have this problem, unlike launching it in yarn-cluster mode. it could be a trail to find the cause. we changed the

Job spark blocked and runs indefinitely

We encounter a problem on a Spark job 1.6(on yarn) that never ends, whene several jobs launched simultaneously. We found that by launching the job spark in yarn-client mode we do not have this problem, unlike launching it in yarn-cluster mode. it could be a trail to find the cause. we changed the

Update cassandra rows problem

Hello all, i'm using spark 1.2 with spark cassandra connector 1.2.3, i'm trying to update somme rows of table: example: *CREATE TABLE myTable ( a text, b text, c text, date timestamp, d text, e text static, f text static, PRIMARY KEY ((a, b, c), date, d) ) WITH C

Spark Kryo read method never called before reducing

We use Spark to build graphs of events after querying cassandra. We use mapPartition for both aggregating events and building two graphs per partition. Graphs are returned as Tuple2 as follows : val nodes = events.mapPartitions(part => { var nodeLeft : Node = null var nodeRight