Re: Advanced log processing

2014-05-20 Thread Laurent T
h with HBase allow me to simply join the incomplete data with the stored state using a key ?Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Advanced-log-processing-tp5743p6102.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Advanced log processing

2014-05-19 Thread Mayur Rustagi
can files one by one using spark ? > > I hope someone can guide me through this. > FYI, there will be gigs of data to process. > > Thanks > Laurent > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Advanced-log-processing-tp5743p6025.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: Advanced log processing

2014-05-19 Thread Laurent T
through this. FYI, there will be gigs of data to process. Thanks Laurent -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Advanced-log-processing-tp5743p6025.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Advanced log processing

2014-05-16 Thread Laurent T
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Advanced-log-processing-tp5743.html Sent from the Apache Spark User List mailing list archive at Nabble.com.