Thread pools are part of the architecture, take a look at the SEDA paper referenced at the bottom of this page http://wiki.apache.org/cassandra/ArchitectureInternals
The number of threads in the pool are used to govern the resources available to that part of the processing pipeline.
Aaron
On 19 Sep, 2010,at 06:12 AM, vineet daniel <vineetdan...@gmail.com> wrote:
Hi Peter
I actually checked after 15-20 of observation of monitor and logs when everything calmed down then it was showing this many processes, shouldnt it be good to reduce the no. of threads once server is idle or almost idle. As I am not a Java guy the only thing that I can think of is that may be creating processes/threads again will consume more memory than having idle threads.
Regards
Vineet Daniel
Cell : +918106217121
Websites :
Blog | Linkedin | Twitter
On Sat, Sep 18, 2010 at 10:50 PM, Peter Schuller <peter.schul...@infidyne.com> wrote:> Even I would like to add here something and correct me if I am wrong, II presume those are threads. It adds up; various stages have multiple
> downloaded 0.7 beta and ran it, just by chance I checked 'top' to see how
> the new version is doing and there were 64 processes running though
> Cassandra was on single node with default configuration options ( ran it as
> is, as soon as I downloaded). No inserts done, no selects done nothing. I
> don't think this is normal.
threads in cassandra, and the JVM itself has a number of threads (e.g.
GC threads, compiler threads). A 'jstack' on a freshly started trunk
cassandra for me, grepping for 'prio', yields 92 threads the
following.
"Attach Listener" daemon prio=9 tid=0x0000000805476800 nid=0x80554e3c0
waiting on condition [0x0000000000000000]
"Timer-1" prio=5 tid=0x00000009103ed800 nid=0x910777280 in
Object.wait() [0x00007ffffa1a4000]
"LB-TARGET:1" prio=5 tid=0x00000009103ee800 nid=0x910777b40 waiting on
condition [0x00007ffffa2a5000]
"LB-OPERATIONS:1" prio=5 tid=0x00000009103f0000 nid=0x910778400
waiting on condition [0x00007ffffa3a6000]
"ACCEPT-localhost/127.0.0.1" prio=5 tid=0x00000009103f0800
nid=0x910778cc0 runnable [0x00007ffffa4a7000]
"Timer-0" prio=5 tid=0x00000009103f1800 nid=0x9103d4ac0 in
Object.wait() [0x00007ffffa5a8000]
"GC inspection" prio=5 tid=0x00000009103f2000 nid=0x91051c540 in
Object.wait() [0x00007ffffa6a9000]
"CompactionExecutor:1" prio=1 tid=0x0000000911805800 nid=0x9111fb3c0
waiting on condition [0x00007ffffa7aa000]
"PERIODIC-COMMIT-LOG-SYNCER" prio=5 tid=0x00000009103f3000
nid=0x91051ce00 waiting on condition [0x00007ffffa8ab000]
"COMMIT-LOG-WRITER" prio=5 tid=0x00000009103f3800 nid=0x91051d6c0
waiting on condition [0x00007ffffa9ac000]
"MISC_STAGE:1" prio=5 tid=0x00000009103f4800 nid=0x91051df80 waiting
on condition [0x00007ffffaaad000]
"MIGRATION_STAGE:1" prio=5 tid=0x00000009103f5000 nid=0x91051e840
waiting on condition [0x00007ffffabae000]
"AE_SERVICE_STAGE:1" prio=5 tid=0x00000009103f6000 nid=0x91051f100
waiting on condition [0x00007ffffacaf000]
"GOSSIP_STAGE:1" prio=5 tid=0x00000009103f6800 nid=0x91051f9c0 waiting
on condition [0x00007ffffadb0000]
"STREAM_STAGE:1" prio=5 tid=0x00000009103f7800 nid=0x910520280 waiting
on condition [0x00007ffffaeb1000]
"RESPONSE_STAGE:4" prio=5 tid=0x00000009103f8000 nid=0x910520b40
waiting on condition [0x00007ffffafb2000]
"RESPONSE_STAGE:3" prio=5 tid=0x00000009103f9000 nid=0x910521400
waiting on condition [0x00007ffffb0b3000]
"RESPONSE_STAGE:2" prio=5 tid=0x00000009103f9800 nid=0x910521cc0
waiting on condition [0x00007ffffb1b4000]
"RESPONSE_STAGE:1" prio=5 tid=0x00000009103fa800 nid=0x9103c8900
waiting on condition [0x00007ffffb2b5000]
"READ_STAGE:8" prio=5 tid=0x0000000910505000 nid=0x9103ce380 waiting
on condition [0x00007ffffb3b6000]
"READ_STAGE:7" prio=5 tid=0x0000000910505800 nid=0x9103cec40 waiting
on condition [0x00007ffffb4b7000]
"READ_STAGE:6" prio=5 tid=0x0000000910506800 nid=0x9103cf500 waiting
on condition [0x00007ffffb5b8000]
"READ_STAGE:5" prio=5 tid=0x0000000910507000 nid=0x9103cfdc0 waiting
on condition [0x00007ffffb6b9000]
"READ_STAGE:4" prio=5 tid=0x0000000801cbf000 nid=0x9103d0680 waiting
on condition [0x00007ffffb7ba000]
"READ_STAGE:3" prio=5 tid=0x0000000801cbf800 nid=0x9103d0f40 waiting
on condition [0x00007ffffb8bb000]
"READ_STAGE:2" prio=5 tid=0x0000000801cc0800 nid=0x9103d1800 waiting
on condition [0x00007ffffb9bc000]
"READ_STAGE:1" prio=5 tid=0x0000000801cc1000 nid=0x9103d20c0 waiting
on condition [0x00007ffffbabd000]
"MUTATION_STAGE:32" prio=5 tid=0x0000000801cc2000 nid=0x9103d2980
waiting on condition [0x00007ffffbbbe000]
"MUTATION_STAGE:31" prio=5 tid=0x0000000801cc2800 nid=0x9103d3240
waiting on condition [0x00007ffffbcbf000]
"MUTATION_STAGE:30" prio=5 tid=0x0000000801cc3800 nid=0x9103d3b00
waiting on condition [0x00007ffffbdc0000]
"MUTATION_STAGE:29" prio=5 tid=0x0000000801cc4000 nid=0x9103d43c0
waiting on condition [0x00007ffffbec1000]
"MUTATION_STAGE:28" prio=5 tid=0x0000000801cc5000 nid=0x9103c21c0
waiting on condition [0x00007ffffbfc2000]
"MUTATION_STAGE:27" prio=5 tid=0x0000000801cc5800 nid=0x9103c2a80
waiting on condition [0x00007ffffc0c3000]
"MUTATION_STAGE:26" prio=5 tid=0x0000000801cc6800 nid=0x9103c3340
waiting on condition [0x00007ffffc1c4000]
"MUTATION_STAGE:25" prio=5 tid=0x0000000801cc7000 nid=0x9103c3c00
waiting on condition [0x00007ffffc2c5000]
"MUTATION_STAGE:24" prio=5 tid=0x0000000801cc8000 nid=0x9103c44c0
waiting on condition [0x00007ffffc3c6000]
"MUTATION_STAGE:23" prio=5 tid=0x0000000801cc8800 nid=0x9103c4d80
waiting on condition [0x00007ffffc4c7000]
"MUTATION_STAGE:22" prio=5 tid=0x0000000801cc9800 nid=0x9103c5640
waiting on condition [0x00007ffffc5c8000]
"MUTATION_STAGE:21" prio=5 tid=0x0000000801ccb000 nid=0x9103c5f00
waiting on condition [0x00007ffffc6c9000]
"MUTATION_STAGE:20" prio=5 tid=0x0000000801ccb800 nid=0x9103c67c0
waiting on condition [0x00007ffffc7ca000]
"MUTATION_STAGE:19" prio=5 tid=0x0000000801ccc800 nid=0x9103c7080
waiting on condition [0x00007ffffc8cb000]
"MUTATION_STAGE:18" prio=5 tid=0x0000000801ccd000 nid=0x9103c7940
waiting on condition [0x00007ffffc9cc000]
"MUTATION_STAGE:17" prio=5 tid=0x0000000801cce000 nid=0x9103c8200
waiting on condition [0x00007ffffcacd000]
"MUTATION_STAGE:16" prio=5 tid=0x0000000801cce800 nid=0x91037ae40
waiting on condition [0x00007ffffcbce000]
"MUTATION_STAGE:15" prio=5 tid=0x0000000801ccf800 nid=0x9103b98c0
waiting on condition [0x00007ffffcccf000]
"MUTATION_STAGE:14" prio=5 tid=0x0000000801cd0000 nid=0x9103ba180
waiting on condition [0x00007ffffcdd0000]
"MUTATION_STAGE:13" prio=5 tid=0x0000000801cd1000 nid=0x9103baa40
waiting on condition [0x00007ffffced1000]
"MUTATION_STAGE:12" prio=5 tid=0x0000000801cd1800 nid=0x9103bb300
waiting on condition [0x00007ffffcfd2000]
"MUTATION_STAGE:11" prio=5 tid=0x0000000801cd2800 nid=0x9103bbbc0
waiting on condition [0x00007ffffd0d3000]
"MUTATION_STAGE:10" prio=5 tid=0x0000000801cd3000 nid=0x9103bc480
waiting on condition [0x00007ffffd1d4000]
"MUTATION_STAGE:9" prio=5 tid=0x0000000801cd4000 nid=0x9103bcd40
waiting on condition [0x00007ffffd2d5000]
"MUTATION_STAGE:8" prio=5 tid=0x0000000801cd4800 nid=0x9103bd600
waiting on condition [0x00007ffffd3d6000]
"MUTATION_STAGE:7" prio=5 tid=0x0000000801cd5800 nid=0x9103bdec0
waiting on condition [0x00007ffffd4d7000]
"MUTATION_STAGE:6" prio=5 tid=0x0000000801cd7000 nid=0x9103be780
waiting on condition [0x00007ffffd5d8000]
"MUTATION_STAGE:5" prio=5 tid=0x0000000801cd7800 nid=0x9103bf040
waiting on condition [0x00007ffffd6d9000]
"MUTATION_STAGE:4" prio=5 tid=0x0000000801cd8800 nid=0x908d16c80
waiting on condition [0x00007ffffd7da000]
"MUTATION_STAGE:3" prio=5 tid=0x0000000801cd9000 nid=0x910374700
waiting on condition [0x00007ffffd8db000]
"MUTATION_STAGE:2" prio=5 tid=0x0000000801cda000 nid=0x910374fc0
waiting on condition [0x00007ffffd9dc000]
"MUTATION_STAGE:1" prio=5 tid=0x0000000801cda800 nid=0x910375880
waiting on condition [0x00007ffffdadd000]
"SSTABLE-CLEANUP-TIMER" prio=5 tid=0x0000000801cdb800 nid=0x910376140
in Object.wait() [0x00007ffffdbde000]
"SSTABLE-DELETER" prio=5 tid=0x0000000801cdc000 nid=0x910376a00 in
Object.wait() [0x00007ffffdcdf000]
"DroppedMessagesLogger" prio=5 tid=0x0000000801cdd000 nid=0x9103772c0
in Object.wait() [0x00007ffffdde0000]
"MESSAGE-STREAMING-POOL:1" prio=5 tid=0x0000000801cdd800
nid=0x910377b80 waiting on condition [0x00007ffffdee1000]
"EXPIRING-MAP-TIMER-2" daemon prio=5 tid=0x0000000801cde800
nid=0x910378440 in Object.wait() [0x00007ffffdfe2000]
"EXPIRING-MAP-TIMER-1" daemon prio=5 tid=0x0000000801cdf000
nid=0x910378d00 in Object.wait() [0x00007ffffe0e3000]
"CONSISTENCY-MANAGER:4" prio=5 tid=0x0000000801ce0000 nid=0x9103795c0
waiting on condition [0x00007ffffe1e4000]
"CONSISTENCY-MANAGER:3" prio=5 tid=0x0000000801ce0800 nid=0x910379e80
waiting on condition [0x00007ffffe2e5000]
"CONSISTENCY-MANAGER:2" prio=5 tid=0x0000000801ce1800 nid=0x91037a740
waiting on condition [0x00007ffffe3e6000]
"CONSISTENCY-MANAGER:1" prio=5 tid=0x0000000801ce3000 nid=0x908d10540
waiting on condition [0x00007ffffe4e7000]
"MEMTABLE-POST-FLUSHER:1" prio=5 tid=0x0000000801ce3800
nid=0x908d10e00 waiting on condition [0x00007ffffe5e8000]
"FLUSH-WRITER-POOL:1" prio=5 tid=0x0000000801ce4800 nid=0x908d116c0
waiting on condition [0x00007ffffe6e9000]
"FLUSH-SORTER-POOL:1" prio=5 tid=0x0000000801ce5000 nid=0x908d11f80
waiting on condition [0x00007ffffe7ea000]
"FLUSH-TIMER" prio=5 tid=0x0000000801ce6000 nid=0x908d12840 in
Object.wait() [0x00007ffffe8eb000]
"DynamicEndpointSnitch" prio=5 tid=0x0000000801ce6800 nid=0x908d13100
in Object.wait() [0x00007ffffe9ec000]
"RMI TCP Accept-0" daemon prio=5 tid=0x0000000801ce7800
nid=0x908d140c0 runnable [0x00007ffffebee000]
"RMI TCP Accept-8080" daemon prio=5 tid=0x0000000801ce8000
nid=0x908d14980 runnable [0x00007ffffecef000]
"RMI TCP Accept-0" daemon prio=5 tid=0x0000000801ce9000
nid=0x908d15240 runnable [0x00007ffffedf0000]
"Low Memory Detector" daemon prio=5 tid=0x0000000801ce9800
nid=0x908d15cc0 runnable [0x0000000000000000]
"CompilerThread1" daemon prio=9 tid=0x0000000801cea800 nid=0x908d16580
waiting on condition [0x0000000000000000]
"CompilerThread0" daemon prio=9 tid=0x0000000801ceb000 nid=0x801c3c380
waiting on condition [0x0000000000000000]
"Signal Dispatcher" daemon prio=9 tid=0x0000000801cec000
nid=0x801c3cc40 runnable [0x0000000000000000]
"Surrogate Locker Thread (CMS)" daemon prio=5 tid=0x0000000801cec800
nid=0x801c3d500 waiting on condition [0x0000000000000000]
"Finalizer" daemon prio=8 tid=0x0000000801ced800 nid=0x801c3ddc0 in
Object.wait() [0x00007fffff3f6000]
"Reference Handler" daemon prio=10 tid=0x0000000801cef000
nid=0x801c3e680 in Object.wait() [0x00007fffff4f7000]
"main" prio=5 tid=0x0000000801cef800 nid=0x800c0ae40 runnable
[0x00007fffffbfe000]
"VM Thread" prio=9 tid=0x0000000801d22000 nid=0x801c3ef40 runnable
"Gang worker#0 (Parallel GC Threads)" prio=9 tid=0x0000000801d26000
nid=0x801c41cc0 runnable
"Gang worker#1 (Parallel GC Threads)" prio=9 tid=0x0000000801d25000
nid=0x801c41400 runnable
"Gang worker#2 (Parallel GC Threads)" prio=9 tid=0x0000000801d24800
nid=0x801c40b40 runnable
"Gang worker#3 (Parallel GC Threads)" prio=9 tid=0x0000000801d24000
nid=0x801c40280 runnable
"Concurrent Mark-Sweep GC Thread" prio=9 tid=0x0000000801d23800
nid=0x801c3f800 runnable
"VM Periodic Task Thread" prio=10 tid=0x0000000801d20800
nid=0x908d139c0 waiting on condition
--
/ Peter Schuller
