Map and Reduce cycle

f the performance impact of this as compared to say …. Spark where it's all in the JVM. Regards, Bill. -- Jonathan (Bill) Sparks Software Architecture Cray Inc.

RE: data conversion between flink and "other" paradigms

ocess. Best, Fabian 2015-07-06 9:30 GMT+02:00 Bill Sparks mailto:jspa...@cray.com>>: Just a question if there was some prior-art here. Just say someone wanted to use flink for processing, but at some point they wanted to call another function via say JNI/C which doesn't understand Dat

data conversion between flink and "other" paradigms

Just a question if there was some prior-art here. Just say someone wanted to use flink for processing, but at some point they wanted to call another function via say JNI/C which doesn't understand DataSet's. How would one go about this ... I'm assuming the code would have to convert the data to

Re: scaling question

To clarify Š it's 64HT cores per node, 16 nodes each with 128GB. Well actually I have 48 nodes Š but trying to limit it so we have a comparison with Spark/MPI/MapReduce all at the same node count. Thanks for the information. -- Jonathan (Bill) Sparks Software Architecture Cray Inc. On

scaling question

lt parallelism. Regards, Bill -- Jonathan (Bill) Sparks Software Architecture Cray Inc.

Re: start-scala-shell.sh

taskmanager.sh -rwxr-xr-x 1 jsparks 513 2793 Jun 8 08:21 webclient.sh -rwxr-xr-x 1 jsparks 513 2019 Jun 8 08:21 yarn-session.sh mbp-jsparks:flink jsparks$ -- Jonathan (Bill) Sparks Software Architecture Cray Inc. From: Aljoscha Krettek mailto:aljos...@apache.org>> Reply-To: "user@flink

Re: start-scala-shell.sh

No worries, just reading the docs… -- Jonathan (Bill) Sparks Software Architecture Cray Inc. From: Robert Metzger mailto:rmetz...@apache.org>> Reply-To: "user@flink.apache.org<mailto:user@flink.apache.org>" mailto:user@flink.apache.org>> Date: Saturday, Ju

start-scala-shell.sh

Question. Where is the start-scala-shell.sh script as referenced by the 0.9 documentation ? http://ci.apache.org/projects/flink/flink-docs-master/scala_shell.html I've check the latest master branch and can't find it. I must have missed something, sorry. Regards, Bill. -- Jona

Re: scaling flink

athan (Bill) Sparks Software Architecture Cray Inc. From: Stephan Ewen mailto:se...@apache.org>> Reply-To: "user@flink.apache.org<mailto:user@flink.apache.org>" mailto:user@flink.apache.org>> Date: Friday, June 5, 2015 12:48 PM To: "user@flink.apache.org<ma

scaling flink

Time Input_data_size Duration(s) Throughput(bytes/s) Throughput/node flinkWordCount 2015-06-04 16:27:27 2052360935068647.383 3170242244 66046713 -- Jonathan (Bill) Sparks Software Architecture Cray Inc.

Re: flink terasort

Will take a look, thanks. -- Jonathan (Bill) Sparks Software Architecture Cray Inc. From: Chiwan Park mailto:chiwanp...@icloud.com>> Reply-To: "user@flink.apache.org<mailto:user@flink.apache.org>" mailto:user@flink.apache.org>> Date: Wednesday, June 3, 2015 10:24 A

flink terasort

Just asking, is there an implementation of terasort for flink? Regards, Bill. -- Jonathan (Bill) Sparks Software Architecture Cray Inc.