Hi George and Mike Thanks for your information. Did you use 186 i2.8xlarge servers for testing? Total one hour cost = 186 * 6.82 = $1,268.52. Do you know any person or company can sponsor this?
For our test approach, I have checked an industry standard from big data bench(http://prof.ict.ac.cn/BigDataBench/industry-standard-benchmarks/) Maybe we can test TeraSort to see the performance is better than your record or not. Please let me know if you have any comments. Thanks for the support. Best regards Hawin On Tue, Jul 14, 2015 at 9:42 AM, Mike Conley <mcon...@cs.ucsd.edu> wrote: > George is correct. We used i2.8xlarge with placement groups on Amazon > EC2. We ran Amazon Linux, which if I recall correctly is based on Red Hat, > but optimized for EC2. OS was essentially unmodified with some packages > installed for our dependencies. > > Thanks, > Mike > > On Tue, Jul 14, 2015 at 9:15 AM, George Porter <gmpor...@cs.ucsd.edu> > wrote: > >> Hello Hawin, >> >> Thanks for reaching out. We wrote a paper on our efforts, which we'll be >> posting to our website in a couple of weeks. >> >> However in summary, we used a cluster of i2.8xlarge instance types from >> Amazon, and we made use of the placement group feature to ensure that we'd >> get good bandwidth between them. Mike can correct me if I'm wrong, but I >> believe we used the stock AWS version of Linux (Ubuntu maybe?) >> >> So our environment was pretty stock--we didn't get any special support or >> features from AWS. >> >> Best of luck with your profiling and benchmarking. Do let us know how >> you perform. Flink looks like a pretty interesting project, and so let us >> know if we can help y'all out in some way. >> >> Thanks, George >> >> >> On Sun, Jul 12, 2015 at 11:12 PM, Hawin Jiang <hawin.ji...@gmail.com> >> wrote: >> >>> Hi Michael and George >>> >>> >>> >>> First of all, congratulation you guys have won the sort game again. We >>> are coming from Flink community. >>> >>> I am not sure if it is possible to get your test environment to test our >>> Flink for free. we saw that Apache spark did a good job as well. >>> >>> We want to challenge your records. But we don’t have that much servers >>> for testing. >>> >>> Please let me know if you can help us or not. >>> >>> Thank you very much. >>> >>> >>> >>> >>> >>> >>> >>> Best regards >>> >>> Hawin >>> >> >> >
