Yea, I'm looking for any personal experiences people have had with tools like these.
> On Jul 8, 2016, at 8:57 PM, charles li <charles.up...@gmail.com> wrote: > > Hi, Andrew, I've got lots of materials when asking google for "spark > performance test" > > https://github.com/databricks/spark-perf > https://spark-summit.org/2014/wp-content/uploads/2014/06/Testing-Spark-Best-Practices-Anupama-Shetty-Neil-Marshall.pdf > http://people.cs.vt.edu/~butta/docs/tpctc2015-sparkbench.pdf > > >> On Sat, Jul 9, 2016 at 11:40 AM, Andrew Ehrlich <and...@aehrlich.com> wrote: >> Hi group, >> >> What solutions are people using to do performance testing and tuning of >> spark applications? I have been doing a pretty manual technique where I lay >> out an Excel sheet of various memory settings and caching parameters and >> then execute each one by hand. It’s pretty tedious though, so I’m wondering >> what others do, and if you do performance testing at all. Also, is anyone >> generating test data, or just operating on a static set? Is regression >> testing for performance a thing? >> >> Andrew >> --------------------------------------------------------------------- >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > > > -- > ___________________ > Quant | Engineer | Boy > ___________________ > blog: http://litaotao.github.io > github: www.github.com/litaotao
