On Mon, 18 Jul 2011, h.g. g.h. wrote:
The staff here who run parallel/multithreaded java code use the cmd
"java
-XX:ParallelGCThreads=16 JavaApp". I tried to pass the same argument as
"initVM(vmargs="-XX:ParallelGCThreads=4", but it doesn't obey. Am I
missing
something here, or misusing it, may be??
What are your assumptions here ?
I think my assumption here is that -XX:ParallelGCThreads is a keyword
argument that vmarg can convey while initializing the JVM...
Maybe it has a lower bounds ?
Maybe Python isn't adapted to the constraints you must run in ? Why not use
Java directly ?
We're not using Java since the rest of the application is already all coded
up in Python... We decided to venture into Lucene only very recently and
thought of using the PyLucene interface...
The only constraint really is that the application should run in the
resources allocated to it, and not based on the totality of all resources
available on the shared machine...
Ok, then using threads instead of subprocesses is your best bet.
Andi..
Andi..
Himanshu
On Fri, Jul 15, 2011 at 9:47 AM, Christian Heimes <[email protected]>
wrote:
Am 15.07.2011 10:10, schrieb Andi Vajda:
PyLucene embeds a Java VM. Thus, with each subprocess, a new JVM is
created with all its threads. This can get insane pretty quickly.
The Java VM starts a lot of threads. On my Linux box eleven threads
additional threads are running after initVM() has been called.
import lucene, os, psutil
psutil.Process(os.getpid()).get_num_threads()
1
lucene.initVM()
<jcc.JCCEnv object at 0x7f23a66f31e0>
psutil.Process(os.getpid()).get_num_threads()
12
Christian
