Re: Benchmarking Spark with YCSB

2014-05-17 Thread Mayur Rustagi
On that note Terasort would be good too :) Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Sat, May 17, 2014 at 4:13 PM, bhusted wrote: > Thanks Jay. I honestly think I just had a senior moment or something. I > was >

Re: Benchmarking Spark with YCSB

2014-05-17 Thread bhusted
Thanks Jay. I honestly think I just had a senior moment or something. I was getting HiBench and YCSB confused. Has anyone attempted to port HiBench to using Spark? HiBench performs a lot of map/reduce and it would be a very interesting comparison for us. -- View this message in context: htt

Re: Benchmarking Spark with YCSB

2014-05-16 Thread Jay Vyas
I'm not sure what you mean... YCSB is for transactional systems. Spark isnt really in that category - its an analytics platform. RDDs by their very nature are not transactional., On Fri, May 16, 2014 at 6:37 AM, bhusted wrote: > Can anyone comment on what it would take to run Spark with YCSB