Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Michele Comitini
its python api is very easy too, you should give it a try. > > http://sphinxsearch.com/ yes I will

Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Phyo Arkar
Both MySQL and Postgre have index searching , yes. I have not tried PostgreSQL FTS but SphinxSearch is renowned for fastest indexing and fastest search. its python api is very easy too, you should give it a try. http://sphinxsearch.com/ On Sat, Aug 28, 2010 at 3:32 AM, Michele Comitini < michele.

Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Phyo Arkar
Ok then i should start trying fork on web2py , thx michele. On Sat, Aug 28, 2010 at 3:32 AM, Michele Comitini < michele.comit...@gmail.com> wrote: > 2010/8/27 Phyo Arkar : > > Yes i do use forks before in C and Python . > > Forks works well on web2py? > From my experience I would say so. > > > >

Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Michele Comitini
2010/8/27 Phyo Arkar : > Yes i do use forks before in C and Python . > Forks works well on web2py? >From my experience I would say so. > > what i am doing now is  trying to parse any kind of files. well lets say it > is a crawler (not and indexer) yet. it crawls and insert into database. > > for i

Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Phyo Arkar
Yes i do use forks before in C and Python . But i have not tried with web2py yet , i dont know how web2py will behave . Forks works well on web2py? if not i will just write a twisted base daemon, which will listen on a unix ipc socket for requests and if the crawling is done , will report "number

Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Michele Comitini
2010/8/27 Phyo Arkar : > strings is very neat unix/linux command to extract Strings (with more than 4 > chars by default)  inside any type of files (even binary files, images , > etc). > so if there a python implemantion of it , if u know i will use it. as Kevin > shows theres not much speed differ

Re: [web2py] Re: Trying to multiprocess

2010-08-27 Thread Phyo Arkar
strings is very neat unix/linux command to extract Strings (with more than 4 chars by default) inside any type of files (even binary files, images , etc). so if there a python implemantion of it , if u know i will use it. as Kevin shows theres not much speed difference in IO compare to C. (even fa

Re: [web2py] Re: Trying to multiprocess

2010-08-26 Thread Michele Comitini
Phyo, I agree mostly with what Kevin says, but some multiprocessing could be good for the case, unless "strings" is faster than IO. Since the specific problem is not web specific, I suggest that you do create a program in python (without web2py) and, as Kevin says, better if you replace "strings"

Re: [web2py] Re: Trying to multiprocess

2010-08-20 Thread Phyo Arkar
i use with subprocess.Popen(shell=False) and it works fine tho, can you point me what are the problems? i really need to call commands from web2py so what i should use ? On 8/20/10, mdipierro wrote: > You should not use subprocess in a web2py application (if you really > need too, look into the