Sounds like context would help, I just didn't want to subject people to a
wall of text if it wasn't necessary :)
Currently we use neither Spark SQL (or anything in the Hadoop stack) or
Redshift. We service templated queries from the appserver, i.e. user fills
out some forms, dropdowns: we transla
I'm in the midst of a heated debate about the use of Redshift v Spark with a
colleague. We keep trading anecdotes and links back and forth (eg airbnb
post from 2013 or amplab benchmarks), and we don't seem to be getting
anywhere.
So before we start down the prototype /benchmark road, and in desp