Hi , In my scenario I have few companies , for which I need to calculate few stats like avg I need to be stored in Cassandra , for next set of records I need to get previously calculated and over it i need to calculate accumulated results ( i.e preset set of data + previously stored stats) and stored it back to Cassandra.
what function/API of spark be used while calculating the above for a group of companies? Regards, Shyam