Hey guys, here's a little question. I'm looking for something like a build system, where I can set up a bunch of jobs with dependencies, and have them run in parallel. Ideally, I'd like a system where jobs can be run in parallel, all the stdout and stderr for each job is kept in a database of some kind, jobs can be anything that can be run at a command line, and a failing job won't cause the whole run to fail. I've been looking into some of the standard stuff (GNU make) and some of the more pythonic stuff like SCons and AAP. SCons seems to do parallel execution, which is nice, but I can't figure out from the docs if it's possible to keep stdout and stderr somewhere. AAP seems to have a nice interface, but it doesn't do parallel.
So if I do wind up having to write this thing myself, I've been checking the docs on process creation, and have a couple questions if anyone can fill me in. It looks like the os.spawn* commands can start nonblocking sub-processes, but there doesn't seem to be a way to get stdout and stderr. On the other hand, the popen commands make it easy to trap stdout and stderr, but I guess I'd have to do the thread setup and spawning myself. Is there another alternative that I'm missing here? Thanks! -- http://mail.python.org/mailman/listinfo/python-list
