RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-18 Thread damcdani
d McDaniel [EMAIL PROTECTED] > Cc: Eric C. Saxe; perf-discuss@opensolaris.org > Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior > > David McDaniel (damcdani) wrote: > > > Thanks for the feedback, Jonathan. I've got it on my todo > list to get > >those tool

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-16 Thread jonathan chew
ic C. Saxe; perf-discuss@opensolaris.org Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior Dave, Sorry, I forgot to reply to this sooner. Yes, I was just curious what else was running to see whether we would expect your application to be perturbed much. There could be a load imbalance

RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-11 Thread David McDaniel \(damcdani\)
6:08 PM > To: David McDaniel (damcdani) > Cc: Eric C. Saxe; perf-discuss@opensolaris.org > Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior > > Dave, > > Sorry, I forgot to reply to this sooner. Yes, I was just > curious what else was running to see whether we

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-09 Thread Alexander Kolbasov
> Dave, > > There are man pages, source, and binaries for our tools on the web > page. I wrote up a good example of how to use the tools to understand, > observe, and affect thread and memory placement among lgroups on a NUMA > machine and posted it on the web page in > http://opensolaris.org

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-09 Thread jonathan chew
[mailto:[EMAIL PROTECTED] Sent: Thursday, September 01, 2005 12:45 PM To: David McDaniel (damcdani) Cc: Eric C. Saxe; perf-discuss@opensolaris.org Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior David McDaniel (damcdani) wrote: Thanks, Jonathon for the good insights.

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread Alexander Kolbasov
David, The following blog has some examples showing how to use the observability tools that Jonathan mentioned: http://blogs.sun.com/roller/comments/akolb/Weblog/numa_observability_tools - Alexander Kolbasov ___ perf-discuss mailing list perf-discuss

RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread David McDaniel \(damcdani\)
avid McDaniel (damcdani) > Cc: Eric C. Saxe; perf-discuss@opensolaris.org > Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior > > David McDaniel (damcdani) wrote: > > > Thanks, Jonathon for the good insights. I'll be digging into the > >references

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread jonathan chew
't use a psrset? Jonathan -Original Message- From: jonathan chew [mailto:[EMAIL PROTECTED] Sent: Thursday, September 01, 2005 11:50 AM To: David McDaniel (damcdani) Cc: Eric C. Saxe; perf-discuss@opensolaris.org Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior Dave, It sou

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread Sherry Moore
> Thanks Sherry, will do, though probably not for a couple of days due > to other issues. In the meantime, I have seen references for years wrt > "kernel cage" but have never groked what it was really about. Any good > "kcage for dummies" places I might look for enlightenment? It is basically no

RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread David McDaniel \(damcdani\)
ginal Message- > From: jonathan chew [mailto:[EMAIL PROTECTED] > Sent: Thursday, September 01, 2005 11:50 AM > To: David McDaniel (damcdani) > Cc: Eric C. Saxe; perf-discuss@opensolaris.org > Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior > > Dave, > > It sounds

RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread David McDaniel \(damcdani\)
-d > -Original Message- > From: Sherry Moore [mailto:[EMAIL PROTECTED] > Sent: Thursday, September 01, 2005 11:46 AM > To: David McDaniel (damcdani) > Cc: Eric C. Saxe; perf-discuss@opensolaris.org > Subject: Re: [perf-discuss] Re: Puzzling scheduler behavior > > Hi Davi

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread jonathan chew
Dave, It sounds like you have an interesting application. You might want to create a processor set, leave some CPUs outside the psrset for other threads to run on, and run your application in a processor set to minimize interference from other threads. As long as there are enough CPUs for y

Re: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread Sherry Moore
Hi David, In addition to the various variables you can tune to help the scheduler make better decisions, here are some other things you can do at different levels: - Turn off kernel cage. Put the following line in /etc/system and reboot. set kcage_on=0 Without the kernel cage constra

RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread David McDaniel \(damcdani\)
Very, very enlightening, Eric. Its really terrific to have this kind of channel for dialog. The "return to home base" behavior you describe is clearly consistent with what I see and makes perfect sense. Let me followup with a question. In this application, processes have not only their "own"

RE: [perf-discuss] Re: Puzzling scheduler behavior

2005-09-01 Thread David McDaniel \(damcdani\)
Oh, sorry, I didn't answer your question about the latency observation with prstat. Not high, just higher than expected, approaching 1% which is of course higher than what I obtain when I coerce the situation by binding. > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL P