Re: [sage-support] Writing parallel code

2016-05-11 Thread mmancini
He Andrew, I used @parallel in sage to parallelize some tensorial calculus (for example : src/sage/tensor/modules/comp.py) It is not very complicate to use it but sometimes you need to reorganize your computation. The parallelism depends strictly on your code so the part of code you posted is n

Re: [sage-support] Writing parallel code

2016-05-10 Thread Andrew
Thanks Vincent for both your answers. I am planning on using just one machine with up to 24 cores. (If I am not able to get far enough this way then I will think about using the cluster. Using 24 cores will already be a big step up compared with what I am currently doing.) If the processes can

Re: [sage-support] Writing parallel code

2016-05-10 Thread Vincent Delecroix
On 10/05/16 23:32, Andrew wrote: On Wednesday, 11 May 2016 14:00:20 UTC+10, William wrote: It depends on what you are trying to do. For some computations, @parallel is the best possible way to do them, and for others it is the worst possible way. Is there a good to learn about how best to do

Re: [sage-support] Writing parallel code

2016-05-10 Thread Vincent Delecroix
Hi Andrew, If you use *one* machine with many cores then have a look at the standard Python module multiprocessing https://docs.python.org/2/library/multiprocessing.html This is what parallel does use. And it is not hard to get it works. If you have access to a cluster with several nodes, th

Re: [sage-support] Writing parallel code

2016-05-10 Thread Andrew
On Wednesday, 11 May 2016 14:00:20 UTC+10, William wrote: > > > It depends on what you are trying to do. For some computations, > @parallel is the best possible way to do them, and for others it is > the worst possible way. > > Is there a good to learn about how best to do this (in sage/python/

Re: [sage-support] Writing parallel code

2016-05-10 Thread William Stein
On Tue, May 10, 2016 at 7:39 PM, Andrew wrote: > I have access to a centos machine with many cores, so I want to start > writing parallelised code on it. This is probably naive, but is using the > code in sage.parallel the best way to write parallel code in sage? It depends on what you are trying

[sage-support] Writing parallel code

2016-05-10 Thread Andrew
I have access to a centos machine with many cores, so I want to start writing parallelised code on it. This is probably naive, but *is using the code in sage.parallel the best way to write parallel code in sage*? I started using the @parallel decorator but then I found the optional packages op