[julia-users] Re: Hashing speed question

https://github.com/JuliaLang/julia/issues/6058

[julia-users] Re: Hashing speed question

Nice. Mine actually takes 30% more memory now (from how I understand Steven's comment mostly because we're making a copy of the Symbol) , but time is ~5% faster. Still about 0.55 though. Did you run the function several times in the REPL? I am getting these numbers when running the script from a

Re: [julia-users] Re: norm() strangeness

See https://github.com/JuliaLang/julia/pull/6057 On Tuesday, March 4, 2014 5:47:11 PM UTC-5, Stefan Karpinski wrote: > > I would be completely fine with that. > > > On Tue, Mar 4, 2014 at 5:32 PM, Steven G. Johnson > > > wrote: > >> If we have vecnorm(x,p=2), we won't need normfro any more, sinc

[julia-users] Re: Hashing speed question

Using Symbols seems to help, ie: using DataStructures function wordcounter_sym(filename) counts = counter(Symbol) words=split(readall(filename), Set([' ','\n','\r','\t','-','.',',',':','_','"',';','!']),false) for w in words add!(counts,symbol(w)) end retur

Re: [julia-users] Preferred way of slicing an array into DArray

Also note that prod(dist) <= length(pids) must be true On Wed, Mar 5, 2014 at 8:57 AM, Amit Murthy wrote: > It is using the default distribution scheme that splits along the largest > dimension first. > > For now, you could just define your own distribute function (a slight > modification of t

Re: [julia-users] Preferred way of slicing an array into DArray

It is using the default distribution scheme that splits along the largest dimension first. For now, you could just define your own distribute function (a slight modification of the distribute function in base/multi.jl) function distribute(a::AbstractArray, pids, dist) owner = myid() rr =

[julia-users] Re: Hashing speed question

I updated the gist with times and code snippets https://gist.github.com/lqdc/9342237 On Tuesday, March 4, 2014 5:15:29 PM UTC-8, Steven G. Johnson wrote: > > It's odd that the performance gain that you see is so much less than the > gain on my machine. > > Try putting @time in front of "for w in

Re: [julia-users] MCMC.jl on prerelease+1837

Thanks Ivar, the #4882 exchange you pointed me to gets me quite a bit further! Even though it shows a deprecated Set() warning, I also had to update Set(...) constructors to Set{Symbol}({...}) in a number of places. I am now studying below issue, a good way to better learn/understand Julia ...

Re: [julia-users] Re: Running a Julia script line by line

thank you, i've opened an issue! On Tuesday, March 4, 2014 5:52:06 PM UTC-5, Jacob Quinn wrote: > > Hey Jason, > > This is a known issue and is supposed to be fixed on master > Sublime-IJulia. I'm not sure if you have the latest or not, but one way ot > make sure is to remove and reinstall the p

Re: [julia-users] Re: Does winston support panning and zooming?

With Gaston, too, if that's any help. -- mb On Tue, Mar 4, 2014 at 8:16 PM, Steven G. Johnson wrote: > Panning and zooming work with PyPlot. > > On Tuesday, March 4, 2014 7:05:07 PM UTC-5, Dan Becker wrote: >> >> I just installed julia (v0.2.1) on windows, followed by winston. Plotting >> works

[julia-users] Re: Does winston support panning and zooming?

Panning and zooming work with PyPlot. On Tuesday, March 4, 2014 7:05:07 PM UTC-5, Dan Becker wrote: > > I just installed julia (v0.2.1) on windows, followed by winston. Plotting > works, but I see no obvious way to zoom or pan the plot. I also haven't > found anything about this in the documenta

[julia-users] Re: Hashing speed question

It's odd that the performance gain that you see is so much less than the gain on my machine. Try putting @time in front of "for w in words" and also in front of "words=...". That will tell you how much time is being spent in each, and whether the limitation is really hashing performance. On

[julia-users] Re: Hashing speed question

I got to about 0.55 seconds with the above suggestions. Still about 2x slower than Python unfortunately. The reason I find it necessary for hashing to work quickly is that I use it heavily for both NLP and when serving data on a Julia webserver. Thanks a lot for the suggestions. On Tuesday, Marc

[julia-users] Re: Immutable objects and identity

On Tuesday, March 4, 2014 3:01:13 AM UTC+1, andrew cooke wrote: > > > i assumed that passing by value was an optimization, but i don't know what > triggers it. it may be that it's only for immutable types without pointers > to mutable types. or it may be based on size. it might be something

[julia-users] Does winston support panning and zooming?

I just installed julia (v0.2.1) on windows, followed by winston. Plotting works, but I see no obvious way to zoom or pan the plot. I also haven't found anything about this in the documentation (http://winston.readthedocs.org/en/latest/) or github repo. Am I doing something wrong, or is this not

Re: [julia-users] Monte Carlo simulation

Thanks, the sum slipped in without me noticing. The array of random numbers are so that I don't have overhead for calling randn so many times. On Sunday, 2 March 2014 14:57:35 UTC-5, Scott Parish wrote: > > > On Sun, Feb 16, 2014 at 12:00 PM, Andreas Noack Jensen < > andreasno...@gmail.com > wro

Re: [julia-users] Monte Carlo simulation

Haha I'd love to have analytical solution for all types of simulation! Just to say I'm benchmarking a vanilla call option, but I'm using it for other types of path dependent derivatives as well. On Thursday, 20 February 2014 02:38:44 UTC-5, Alan Edelman wrote: > > Oh and if you like million fol

Re: [julia-users] Re: Running a Julia script line by line

Hey Jason, This is a known issue and is supposed to be fixed on master Sublime-IJulia. I'm not sure if you have the latest or not, but one way ot make sure is to remove and reinstall the package within sublime (ctrl+shift+p, type "remove package", select "IJulia", ctrl+shift+p, type "install packa

Re: [julia-users] Re: norm() strangeness

I would be completely fine with that. On Tue, Mar 4, 2014 at 5:32 PM, Steven G. Johnson wrote: > If we have vecnorm(x,p=2), we won't need normfro any more, since > normfro(M)=vecnorm(M) >

[julia-users] Preferred way of slicing an array into DArray

Hi all, I would like to know if there's any ways to distribute an array the way I want it. For example, if I have I have 4 workers and an array, a : julia> a = rand(4,3) and I want to give each worker a row to work on, how can I distribute the array? Julia has distribute function to slice arr

Re: [julia-users] Re: Running a Julia script line by line

Does Julia otherwise work when started directly? On Tue, Mar 4, 2014 at 4:20 PM, Jason Solack wrote: > Hi! I've tried using IJulia in sublime text because i love the idea of > that funcitonality... when i try to run it i get this error when i start > sublime text: > > Plugin_host.exe > The pr

Re: [julia-users] Re: norm() strangeness

If we have vecnorm(x,p=2), we won't need normfro any more, since normfro(M)=vecnorm(M)

[julia-users] Re: Hashing speed question

On Tuesday, March 4, 2014 12:41:17 PM UTC-5, Ivar Nesje wrote: > > Part of the advantage is also possible by just declaring the type of your > container. > > *counts=Dict{SubString{ASCIIString},Int}()* > That speeds it up by about 20% on my machine. I get another 25% speedup, bringing it clos

Re: [julia-users] Re: norm() strangeness

On Tuesday, March 4, 2014 9:39:18 AM UTC-5, Toivo Henningsson wrote: > I think you would want to do the opposite. Define >> >> norm(x::AbstractVector, p=2) = vecnorm(x, p=2) >> >> where you define vecnorm(itr, p) for any iterable type. >> > > >> I like the idea to define vecnorm for any iterab

Re: [julia-users] Re: Running a Julia script line by line

Hi! I've tried using IJulia in sublime text because i love the idea of that funcitonality... when i try to run it i get this error when i start sublime text: Plugin_host.exe The program can't start because libgcc_s_seh-1.dll is missing from your computer. Try reinstalling the program to fix

[julia-users] Re: Linear convolution

On Tuesday, March 4, 2014 3:38:15 AM UTC-8, Oliver Lylloff wrote: > > Hello all, > > Is anyone aware of a linear convolution implementation? > Not clear what you want but if it is to convolve a kernel with a longer stream you are looking for an implementation of overlap-add or overlap-save fa

[julia-users] Re: ERROR: no method display(DataFrame) in display at multimedia.jl:158

It was probably some version incompatibility issues then. It is not easy to know how much info is required to solve a problem. Sometimes you are lucky and it is a silly mistake that someone recognize and just tell you how to fix the issue. Other times you are unlucky and nobody understand what

[julia-users] Re: ERROR: no method display(DataFrame) in display at multimedia.jl:158

Sorry for not providing enough information - new domain here for me so Im not sure what's useful and what's not for debugging. My last issue was debugged with a similar post so figured the same would be true here. Guess not ;) Anyways, I seem to have resolved the issue by just starting over f

Re: [julia-users] Re: ERROR: no method display(DataFrame) in display at multimedia.jl:158

Or just versioninfo(true) Which combines the two functions. kl. 19:52:47 UTC+1 tirsdag 4. mars 2014 skrev Jacob Quinn følgende: > > Yeah, with how much DataFrames has been moving lately, we at least need to > know which version you're running. Can you post the output of > > versioninfo() > Pkg.

[julia-users] Re: MCMC.jl on prerelease+1837

This is probably due to #4882 where we changed the behaviour of the ~ operator to translate to a macrocall instead of a function. The code you reference will need to be updated. Ivar kl. 19:48:07 UTC+1 tirsdag 4. mars 2014 skrev Rob J Goedman føl

[julia-users] Re: Running a Julia script line by line

Thank you all for your suggestions and comments on the matter. :-) I had not previously heard of IJulia nor of Sublime-IJulia and I am happy to give both a go. Alas, I have run into some difficulties with the IJulia installation. I started out by using the Anaconda Python installer to get an

Re: [julia-users] Re: ERROR: no method display(DataFrame) in display at multimedia.jl:158

Yeah, with how much DataFrames has been moving lately, we at least need to know which version you're running. Can you post the output of versioninfo() Pkg.status() -Jacob On Tue, Mar 4, 2014 at 1:48 PM, Ivar Nesje wrote: > You might get much more response if you provide a (minmal?) executable

[julia-users] Re: ERROR: no method display(DataFrame) in display at multimedia.jl:158

You might get much more response if you provide a (minmal?) executable example. I can neither verify, nor help debug this issue, as I do not know what the result variable is. If nobody else recognize the issue from their own experience, and the rest of us do not have some code to run, we can not

[julia-users] MCMC.jl on prerelease+1837

Hi, Several examples using MCMC.jl work fine, but I now started to look at the autodiff examples and with linear_regression.jl I am running in below problem. I added a few println statements to pinpoint the problem and indeed there is no ExprH{:macrocall}(...) defined. Is this due to changes i

[julia-users] Re: ERROR: no method display(DataFrame) in display at multimedia.jl:158

Just checking one last time to see if anyone has any ideas. This has been a showstopper for us Open to trying any suggestions :) - - Dan On Thursday, February 27, 2014 7:31:33 PM UTC-8, Dan B wrote: > > Friends, > > Any idea on how I can resolve this error that Im seeing while trying to > sho

[julia-users] Re: Hashing speed question

Part of the advantage is also possible by just declaring the type of your container. *counts=Dict{SubString{ASCIIString},Int}()* Ivar kl. 18:16:00 UTC+1 tirsdag 4. mars 2014 skrev Keith Campbell følgende: > > As a general matter, Python has probably been more heavily optimized for > text IO an

[julia-users] Re: Hashing speed question

As a general matter, Python has probably been more heavily optimized for text IO and dictionary performance. However in this case, the Counter in library DataStructures.jl is your friend. On my system it runs almost 2x as fast as the code in your gist, presumably making it roughly equivalent

Re: [julia-users] Gadfly: multiple y axes in one plot

I think the Bode diagram from Electrical Engineering is a pretty good use of double y axes. It's a plot of circuit response showing both amplitude (in db) and phase (in deg) vs frequency. You can certainly do it as a stack, but over-plotting the curves allows even easier comparisons of importan

Re: [julia-users] confused about "no method endof"

It looks a lot like you're trying to index into a pointer object as though it were an array. Unlike in C, these are very different things – just as in C, a pointer has no idea how long it is, whereas an array object knows how long it is, so when you ask for the last element of it by writing a[end],

[julia-users] Re: confused about "no method endof"

some info that's more beginner level than other replies (so sorry if this is obvious). the compiler translates x[end] into x[endof(x)] so you get this error if you use [end] after something that isn't expecting it. at the most basic, perhaps you thought something was an array when it wasn't.

Re: [julia-users] Linear convolution

It's interesting that calculating the FFT and then the IFFT is more accurate; I wasn't aware of that. Thanks! -- mb On Tue, Mar 4, 2014 at 10:51 AM, Tobias Knopp wrote: > This depends a lot on the input sizes. For full length convolutions, the > fft approach should be more accurate because of l

Re: [julia-users] Linear convolution

That's funny, because in my opinion the functions in scipy.ndimage.filters are also specialized, as most of the time they seem to be used in image processing (but also in time-series processing) :) In DSP.jl we mainly have functions for one-dimensional signal processing, though, and it would be ni

Re: [julia-users] Linear convolution

This depends a lot on the input sizes. For full length convolutions, the fft approach should be more accurate because of less additions. For very short kernels this does not hold anymore. But in practice these kinds of errors are mostly negligable. Am Dienstag, 4. März 2014 16:42:33 UTC+1 schr

Re: [julia-users] Linear convolution

Thanks for the hint. This seems to be a good start although the available functions already seem to be quite specialized. The ndimage module from scipy (http://docs.scipy.org/doc/scipy/reference/ndimage.html#module-scipy.ndimage.filters) goes into a direction what in my mind could cover a Sign

Re: [julia-users] Linear convolution

I was worried about getting "a little noise in the result", so I ran a quick test in Matlab and Julia, and got almost exactly the same error. This is the Matlab code: Ts=0.01; t=-10:Ts:10; s=sinc(t); sc=Ts*conv(s,s); sc=sc(1000:3000); sum((sc-s).*(sc-s)) ans = 0.3695 So, at least for accura

Re: [julia-users] Linear convolution

We have some standard DSP stuff in https://github.com/JuliaDSP/DSP.jl. Our idea is to put everything DSP-related that is not application-specific in there, and then make other application-specific packages depend on it. -- João Felipe Santos On Tue, Mar 4, 2014 at 10:22 AM, Tobias Knopp wrote:

Re: [julia-users] Linear convolution

There is DSP.jl: http://dspjl.readthedocs.org/en/latest/index.html On Tue, Mar 4, 2014 at 10:22 AM, Tobias Knopp wrote: > I don't want to give a definate yes to it but will think a little bit how > such a package could look like. > My Cartesian macro foo is currently completely absent so that I

Re: [julia-users] Linear convolution

I don't want to give a definate yes to it but will think a little bit how such a package could look like. My Cartesian macro foo is currently completely absent so that I would have to learn this first. Do you know of others efforts/packages that go into that direction? Am Dienstag, 4. März 2014

[julia-users] Hashing speed question

Why is Julia 2x slower than Python on this test? https://gist.github.com/lqdc/9342237

Re: [julia-users] Gadfly: multiple y axes in one plot

Somehow, I didn't find the reasoning in that particular example very convincing. The real problem in that example---which the post completely ignores---is that neither of the axes starts at 0. (The zeros should also align between the two axes.) I can't see the objection to displaying the actual

Re: [julia-users] Linear convolution

I'm fine with that. Do you want to start it? --Tim On Tuesday, March 04, 2014 05:32:02 AM Tobias Knopp wrote: > Tim, > > a little bit offtopic question but might it make sense to break of the > algorithmic parts of Images.jl and put it into some "signal processing" > package? > I know that the i

Re: [julia-users] Re: norm() strangeness

On Tuesday, 4 March 2014 14:13:10 UTC+1, Steven G. Johnson wrote: > > > > On Tuesday, March 4, 2014 7:05:02 AM UTC-5, Toivo Henningsson wrote: >> >> Because of multiple dispatch, we go to exceptional lengths in Julia to >> make sure to only overload the same operation on different types, not to

[julia-users] Re: Help in Winston FramedPlot()

*Hi Harven,* *There is still something wrong...I don't know why. * *julia> **large = [i^4 + 1e12 for i in 1:10^3] ;* *julia> **small = [1:10^3] ;* *julia> **p = FramedPlot() ; * *julia> **plot(p,small,large)* *FramedPlot(...)* julia> using Winston ERROR: could not open file /Users/yuch

Re: [julia-users] Re: norm() strangeness

On Tuesday, March 4, 2014 2:48:05 AM UTC-6, Andreas Noack Jensen wrote: > > In master Julia the result is 3. I must have changed that when I > reorganised the norm code. > Since this is a breaking change with no deprecation, it should definitely be mentioned in NEWS.

Re: [julia-users] Linear convolution

Tim, a little bit offtopic question but might it make sense to break of the algorithmic parts of Images.jl and put it into some "signal processing" package? I know that the imagemagick dependency is a soft one but all the filtering stuff is IMHO so basic that it belongs to base, or rather into

Re: [julia-users] Re: norm() strangeness

On Tuesday, March 4, 2014 7:05:02 AM UTC-5, Toivo Henningsson wrote: > > Because of multiple dispatch, we go to exceptional lengths in Julia to > make sure to only overload the same operation on different types, not to > create functions that do different conceptual operations based on the type

Re: [julia-users] Re: norm() strangeness

On Tuesday, March 4, 2014 4:37:15 AM UTC-5, Carlos Becker wrote: > > Another option is to add a vecnorm() function, explicitly to treat the > argument as a vector, which would be undefined for other matrix sizes. > A vecnorm function could be defined to work on any iterable type, including matri

Re: [julia-users] Gadfly: multiple y axes in one plot

Thanks to everyone for the feedback, I actually tend to agree that the use of two different y axes in the same plot should be discouraged. Sometimes it's just too convenient... In the end, I used `Geom.subplot_grid` with a `Geom.bar` plot which worked fine. However, it only worked with `position

Re: [julia-users] Should ∞ equal Inf?

Probably it's sufficient for it to equal Inf. The reason is that Inf is already an "exact" value, so to speak; there is no loss of information when it is converted to other types (e.g. by promotion). On Tuesday, March 4, 2014 12:10:31 AM UTC-5, Kevin Squire wrote: > > It's probably possible. D

Re: [julia-users] Linear convolution

The main reason to choose one or the other is merely kernel size; for small kernels, a direct FIR convolution will be many times faster. --Tim On Tuesday, March 04, 2014 04:19:31 AM Toivo Henningsson wrote: > Yes, with sufficient padding, you can compute a linear convolution (of > finite length

Re: [julia-users] Linear convolution

Yes, with sufficient padding, you can compute a linear convolution (of finite length vectors) exactly using a circular convolution. The FFT might introduce a little noise in the result, but that is all. On Tuesday, 4 March 2014 13:12:48 UTC+1, Oliver Lylloff wrote: > > Well ok, > > Maybe I misun

Re: [julia-users] Linear convolution

Well ok, Maybe I misunderstood the whole thing then but since fft assumes periodic input then I don't see how it can be a linear convolution. I guess Base.conv2 probably uses zero-padding to reduce wrap-around but in theory it would still be a circular convolution. I'll read up on it :) Best,

Re: [julia-users] Re: norm() strangeness

I agree with Toivo's proposal. Introducing vecnorm() would make code and behavior clearer, and at the same time avoid the problems with the generic norm() function. Also, since vecnorm() calls norm(), we only have to care about maintaining the latter. cheers. --

Re: [julia-users] Linear convolution

Both conv and conv2 are linear convolutions but the implementations use the fft. Maybe the documentation could be more clear on that. 2014-03-04 13:01 GMT+01:00 Oliver Lylloff : > Thanks Tim. > > Can't believe I missed that - been working with Images.jl all day. Nice > job by the way, very usefu

Re: [julia-users] Re: norm() strangeness

I think that this is an unpleasant gotcha right now, when I started reading this post I still thought that the matrix norm of a row/column vector would reproduce the vector norm. Because of multiple dispatch, we go to exceptional lengths in Julia to make sure to only overload the same operation

Re: [julia-users] Linear convolution

Thanks Tim. Can't believe I missed that - been working with Images.jl all day. Nice job by the way, very useful. Best, Oliver Den tirsdag den 4. marts 2014 12.48.01 UTC+1 skrev Tim Holy: > > Images.jl's imfilter might be what you want. > --Tim > > On Tuesday, March 04, 2014 03:38:15 AM Oliver

Re: [julia-users] Linear convolution

Images.jl's imfilter might be what you want. --Tim On Tuesday, March 04, 2014 03:38:15 AM Oliver Lylloff wrote: > Hello all, > > Is anyone aware of a linear convolution implementation? > The Base.conv and Base.conv2 functions are implemented with fft which makes > them circular convolution functi

[julia-users] Linear convolution

Hello all, Is anyone aware of a linear convolution implementation? The Base.conv and Base.conv2 functions are implemented with fft which makes them circular convolution functions (as far as I know). I'm looking for something alike Matlabs conv2 or SciPys signal.convolve2d. Should be straightfo

Re: [julia-users] Re: norm() strangeness

On Tue, Mar 4, 2014 at 11:02 AM, Andreas Noack Jensen < andreasnoackjen...@gmail.com> wrote: > > makes really good sense. The distinction between arrays and and matrices > in Numpy has been confusing to me, but actually it appear that Numpy agrees > with how Julia is doing it right now > > In [1]:

Re: [julia-users] Re: norm() strangeness

I think it is unavoidable with some surprises when migrating from MATLAB or some other language. Hopefully, most are covered [here]( http://docs.julialang.org/en/latest/manual/noteworthy-differences/?highlight=matlab). Personally, I prefer consistency within the language over familiarity for MATLAB

Re: [julia-users] Re: norm() strangeness

Hi Andreas, I understand, though from your email it is as if this was an unintended behaviour. It is still very error-prone. In such cases Matlab returns 6, which is wrong from a matrix viewpoint, but probably closer to what people typically expect. Numpy has the same behavior. The latter is very

Re: [julia-users] Re: norm() strangeness

In master Julia the result is 3. I must have changed that when I reorganised the norm code. I think that 3 is the right answer anyway. In Julia [1 2 3] is a 1x3 matrix, i.e. not a vector. If you want it to behave as a vector, make it a vector. This causes some confusion when coming from MATLAB, but

[julia-users] Re: Help in Winston FramedPlot()

julia> large = [i^4 + 1e12 for i in 1:10^3] ; small = [1:10^3] ; plot(small,large) or julia> large = [i^4 + 1e12 for i in 1:10^3] ; small = [1:10^3] ; p = FramedPlot() ; plot(p,small,large)