Re: How to measure time to execute joinToCassandraTable

Anytime you want to measure distributed processes, you should look into logging, or sending the time data asynchronously to a persistent data store. I haven’t measured joinWithCassandra but I’ve measured other parts of spark using a Kafka topic to send execution times. I then consumed the times

How to measure time to execute joinToCassandraTable

I'm using the driver from Cassandra-Spark, I would like to know if there is a way to measure the time which takes a " joinWithCassandraTable" to execute easily inside a spark code.