[sage-devel] Re: Computational biology project needs distributed processing

2008-12-22 Thread Dan
I have not tried DSage. The manager of the cluster did not think it was an appropriate tool for the cluster as the description of DSage suggested it is only for coarse distribution (i.e. projects that can be largely broken into separate parts). Unfortunately, my project involves a sequential serie

[sage-devel] Re: Computational biology project needs distributed processing

2008-12-22 Thread Dan
I don't know if it is SQLalchemy or MySQL, but I also suspect it is MySQL. I'll give PostgreSQL a try (should be an easy change, right?) Thanks for the help Dan On Dec 19, 1:24 pm, Jason Grout wrote: > Dan wrote: > > Thanks for directing me. > > > The bottleneck appears to be queries to a MySQ

[sage-devel] Re: Computational biology project needs distributed processing

2008-12-19 Thread Gary Furnish
Did you test for the sql alchemy bottleneck without using dsage? There were some pretty severe (at times) speed issues fixed with dsage in 3.2.2. On Fri, Dec 19, 2008 at 11:24 AM, Jason Grout wrote: > > Dan wrote: >> Thanks for directing me. >> >> The bottleneck appears to be queries to a MySQL

[sage-devel] Re: Computational biology project needs distributed processing

2008-12-19 Thread Jason Grout
Dan wrote: > Thanks for directing me. > > The bottleneck appears to be queries to a MySQL database made via > SQLalchemy. I will need to make many complex queries, then do some > simple statistical work on the results. But even the first query is > taking a very long time. Any guidance you can gi

[sage-devel] Re: Computational biology project needs distributed processing

2008-12-19 Thread Dan
Thanks for directing me. The bottleneck appears to be queries to a MySQL database made via SQLalchemy. I will need to make many complex queries, then do some simple statistical work on the results. But even the first query is taking a very long time. Any guidance you can give is greatly appreciat

[sage-devel] Re: Computational biology project needs distributed processing

2008-12-19 Thread mhampton
Can you give a little more detail about what you are doing? Do you have an idea as to what the main bottleneck is in your computation? Cheers, Marshall Hampton On Dec 18, 2:52 pm, Dan wrote: > I have been using Sage for a fairly intense computational biology > project. I have been very please

[sage-devel] Re: Computational biology project needs distributed processing

2008-12-19 Thread Martin Albrecht
On Thursday 18 December 2008, Dan wrote: > I have been using Sage for a fairly intense computational biology > project. I have been very pleased with the software, but when it was > finely time to run my computations I learned that my hardware was > grossly inadequate. I have since gained access