VS: VS: Using Spark as a simulator

2017-07-07 Thread Esa Heikkinen
4 Vastaanottaja: Esa Heikkinen Kopio: Mahesh Sawaiker; user@spark.apache.org Aihe: Re: VS: Using Spark as a simulator Spark dropped Akka some time ago... I think the main issue he will face is a library for simulating the state machines (randomly), storing a huge amount of files (HDFS is probably

Re: VS: Using Spark as a simulator

2017-07-07 Thread Jörn Franke
uld want to read about PairRDDs. > > From: Esa Heikkinen [mailto:esa.heikki...@student.tut.fi] > Sent: Wednesday, June 21, 2017 1:12 PM > To: Jörn Franke > Cc: user@spark.apache.org > Subject: VS: Using Spark as a simulator > > > > Hi > > >

VS: Using Spark as a simulator

2017-07-06 Thread Esa Heikkinen
cts, which you can then process functional/set operators. You would want to read about PairRDDs. From: Esa Heikkinen [mailto:esa.heikki...@student.tut.fi] Sent: Wednesday, June 21, 2017 1:12 PM To: Jörn Franke Cc: user@spark.apache.org Subject: VS: Using Spark as a simulator Hi Thanks for

VS: Using Spark as a simulator

2017-06-21 Thread Esa Heikkinen
Hi Thanks for the answer. I think my simulator includes a lot of parallel state machines and each of them generates log file (with timestamps). Finally all events (rows) of all log files should combine as time order to (one) very huge log file. Practically the combined huge log file can als