I haven't really paid attention to the code, but I just subbmited a simple test funtion for his benchmarks in order to avoid timing the JIT, nothing cientific, but more accurate though:
* https://github.com/kostya/benchmarks/pull/79 function test() for i in 1:2 # First time it's also JIT compiling! @time main() end end test() El miércoles, 27 de enero de 2016, 14:25:01 (UTC-6), Stefan Karpinski escribió: > > Except that appears to be using Julia's * operator for Float64 arrays > which would call BLAS, no? > > On Wed, Jan 27, 2016 at 2:29 PM, Ismael Venegas Castelló < > [email protected] <javascript:>> wrote: > >> Native in this context means it's apure Julia implementation, ie. it's >> not calling an underliying C/Fortran library, see: >> >> * >> https://github.com/kostya/benchmarks/blob/master/matmul/matmul-native.jl >> >> It seems the author has updated the code to use @time, but it's still >> timing the JIT. I'll send him a PR >> >> >> El miércoles, 27 de enero de 2016, 8:33:28 (UTC-6), Sisyphuss escribió: >>> >>> In the Matmul benchmark, "Julia Native" ranks 1st. >>> What is Julia Native? >>> >>> >>> On Wednesday, January 27, 2016 at 7:02:51 AM UTC+1, Nitin Arora wrote: >>>> >>>> Check out this thread. There seems to be discussion on this matter >>>> already. Looks like the code used for these benchmarks was not well >>>> optimized for Julia and looks they are including Julia startup time and >>>> JIT >>>> compilation. >>>> >>>> https://groups.google.com/d/topic/julia-users/4AgBccftrps/discussion >>>> >>>> and >>>> >>>> https://github.com/JuliaLang/julia/issues/14808#event-527206420 >>>> >>>> >>>> On Tuesday, January 26, 2016 at 8:07:54 PM UTC-8, George wrote: >>>>> >>>>> I was surprised to se the results on the following benchmarks: >>>>> https://github.com/kostya/benchmarks >>>>> >>>>> Some benchmarks of different languages >>>>> <https://github.com/kostya/benchmarks#brainfuck>Brainfuck >>>>> >>>>> Brainfuck <https://github.com/kostya/benchmarks/tree/master/brainfuck> >>>>> <https://github.com/kostya/benchmarks#benchb>bench.b >>>>> LanguageTime,sMemory, Mb >>>>> Nim Clang 3.21 0.7 >>>>> Felix 4.07 1.3 >>>>> Nim Gcc 4.52 0.6 >>>>> Java 4.94 147.6 >>>>> C++ 5.08 1.1 >>>>> Rust 5.46 4.9 >>>>> Scala 5.90 116.3 >>>>> D 6.57 1.0 >>>>> D Ldc 6.61 0.9 >>>>> Crystal 6.97 1.3 >>>>> Go 7.29 1.3 >>>>> Javascript Node 8.74 15.0 >>>>> D Gdc 8.87 1.0 >>>>> Julia 9.25 59.0 >>>>> Javascript V8 9.41 8.1 >>>>> Go Gcc 13.60 10.0 >>>>> Python Pypy 13.94 55.4 >>>>> Javascript Jx 17.14 11.0 >>>>> C# Mono 18.08 15.4 >>>>> OOC 48.86 1.3 >>>>> Ruby JRuby 87.05 124.1 >>>>> Ruby Topaz 112.91 36.0 >>>>> Ruby JRuby9K 160.15 297.2 >>>>> Ruby 226.86 8.0 >>>>> Tcl 262.20 2.7 >>>>> Python 452.44 4.9 >>>>> Ruby Rbx 472.08 45.0 >>>>> Python3 480.78 5.5 <https://github.com/kostya/benchmarks#mandelb> >>>>> mandel.b >>>>> >>>>> Mandel in Brainfuck >>>>> <https://github.com/kostya/benchmarks/blob/master/brainfuck/mandel.b> >>>>> LanguageTime,sMemory, Mb >>>>> Nim Clang 28.96 1.0 >>>>> Felix 40.06 3.7 >>>>> D Ldc 43.30 0.9 >>>>> D 45.29 1.2 >>>>> Rust 46.34 4.9 >>>>> Crystal 48.62 1.3 >>>>> Nim Gcc 50.45 0.9 >>>>> Go 52.56 7.6 >>>>> Java 55.14 69.9 >>>>> Cpp 56.63 1.1 >>>>> Scala 64.37 126.4 >>>>> D Gdc 70.12 1.5 >>>>> Go Gcc 85.67 10.7 >>>>> Javascript Node 92.65 15.8 >>>>> Julia 94.33 56.9 >>>>> ... >>>> >>>> >
