On Thu, Jun 26, 2014 at 2:26 PM, Michael Bach Bui <free...@adatao.com> wrote:
The overhead of bringing up a AWS Spark spot instances is NOT the > inherent problem of Spark. That’s technically true, but I’d be surprised if there wasn’t a lot of room for improvement in spark-ec2 regarding cluster launch+config times. The tooling around Spark is part of the “Spark experience”, so to speak. So a problem with the tooling affects how the core product is used. Nick