Re: [PATCH/RFC] A method for clearing out page cache

2005-03-01 Thread Pavel Machek
Hi! > So what it comes down to is > > sys_free_node_memory(long node_id, long pages_to_make_free, long what_to_free) > > where `what_to_free' consists of a bunch of bitflags (unmapped pagecache, > mapped pagecache, anonymous memory, slab, ...). Heh, swsusp needs shrink_all_memory() and I'd like

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Paul Jackson
Andrew asked: > So... Cannot the applicaiton remove all its pagecache with posix_fadvise() > prior to exitting? Hang on ... The replies of Ray and Martin answer your immediate question. But we (SGI) are still busy discussing the bigger picture behind the scenes ... -- I won'

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Ray Bryant
Andrew Morton wrote: Paul Jackson <[EMAIL PROTECTED]> wrote: As Martin wrote, when he submitted this patch: > The motivation for this patch is for setting up High Performance > Computing jobs, where initial memory placement is very important to > overall performance. Any left over cache is wrong, f

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Martin Hicks
On Tue, Feb 22, 2005 at 10:45:35AM -0800, Andrew Morton wrote: > Paul Jackson <[EMAIL PROTECTED]> wrote: > > > > As Martin wrote, when he submitted this patch: > > > The motivation for this patch is for setting up High Performance > > > Computing jobs, where initial memory placement is very imp

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Andrew Morton
Paul Jackson <[EMAIL PROTECTED]> wrote: > > As Martin wrote, when he submitted this patch: > > The motivation for this patch is for setting up High Performance > > Computing jobs, where initial memory placement is very important to > > overall performance. > > Any left over cache is wrong, fo

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Ray Bryant
Ingo Molnar wrote: * Andrew Morton <[EMAIL PROTECTED]> wrote: . enable users to specify an 'allocation priority' of some sort, which kicks out the pagecache on the local node - or something like that. Yes, that would be preferable - I don't know what the difficulty is with that. sys_set_mempolicy

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Paul Jackson
Ingo wrote: > app designers very frequently think that the VM gets its act wrong (most > of the time for the wrong reasons), As Martin wrote, when he submitted this patch: > The motivation for this patch is for setting up High Performance > Computing jobs, where initial memory placement is very im

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Ingo Molnar
* Andrew Morton <[EMAIL PROTECTED]> wrote: > > . enable users to > > specify an 'allocation priority' of some sort, which kicks out the > > pagecache on the local node - or something like that. > > Yes, that would be preferable - I don't know what the difficulty is > with that. sys_set_mempo

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-22 Thread Andrew Morton
Ingo Molnar <[EMAIL PROTECTED]> wrote: > > app designers very frequently think that the VM gets its act wrong (most > of the time for the wrong reasons), and the last thing we want to enable > them is to hack real problems around. Not really. Memory reclaim tries to predict the future and expec

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Ingo Molnar
* Andrew Morton <[EMAIL PROTECTED]> wrote: > > However, the first step is to do this manually from user space. > > Yup. The thing is, lots of people want this feature for various > reasons. Not just numerical-computing-users-on-NUMA. We should get > it right for them too. > > Especially kern

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Paul Jackson
Andrew wrote: > Yes, I ... [clarifies pj's various confusions] Yup - all sounds good - thanks. -- I won't rest till it's the best ... Programmer, Linux Scalability Paul Jackson <[EMAIL PROTECTED]> 1.650.933.1373, 1.925.600.0401 - To unsubscr

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Ray Bryant
Andrew Morton wrote: Ray Bryant <[EMAIL PROTECTED]> wrote: We did it this way because it was easier to get it into SLES9 that way. But there is no particular reason that we couldn't use a system call. It's just that we figured adding system calls is hard. aarggh. This is why you should target ke

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Andrew Morton
Ray Bryant <[EMAIL PROTECTED]> wrote: > > Andrew Morton wrote: > > Martin Hicks <[EMAIL PROTECTED]> wrote: > > > >>This patch introduces a new sysctl for NUMA systems that tries to drop > >> as much of the page cache as possible from a set of nodes. The > >> motivation for this patch is for setti

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Andrew Morton
Paul Jackson <[EMAIL PROTECTED]> wrote: > > Andrew wrote: > > sys_free_node_memory(long node_id, long pages_to_make_free, long > > what_to_free) > > ... > > - To make the syscall more general, we should be able to reclaim mapped > > pagecache and anonymous memory as well. > > sys_free_node_memo

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Ray Bryant
Andrew Morton wrote: Martin Hicks <[EMAIL PROTECTED]> wrote: This patch introduces a new sysctl for NUMA systems that tries to drop as much of the page cache as possible from a set of nodes. The motivation for this patch is for setting up High Performance Computing jobs, where initial memory place

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Paul Jackson
Andrew wrote: > sys_free_node_memory(long node_id, long pages_to_make_free, long what_to_free) > ... > - To make the syscall more general, we should be able to reclaim mapped > pagecache and anonymous memory as well. sys_free_node_memory() - nice. Does it make sense to also have it be able to f

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Nish Aravamudan
On Mon, 21 Feb 2005 14:27:21 -0500, Martin Hicks <[EMAIL PROTECTED]> wrote: > > Hi, > > I've made a bunch of changes that Paul suggested. I've also responded > to his concerns further down. Paul correctly pointed out that this > patch uses some helper functions that are part of the cpusets patc

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Andrew Morton
Martin Hicks <[EMAIL PROTECTED]> wrote: > > This patch introduces a new sysctl for NUMA systems that tries to drop > as much of the page cache as possible from a set of nodes. The > motivation for this patch is for setting up High Performance Computing > jobs, where initial memory placement is

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-21 Thread Martin Hicks
Hi, I've made a bunch of changes that Paul suggested. I've also responded to his concerns further down. Paul correctly pointed out that this patch uses some helper functions that are part of the cpusets patch. I should have mentioned this before. The major changes are: - Cleanup proc_dobitma

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-16 Thread Martin Hicks
On Mon, Feb 14, 2005 at 07:37:04PM -0800, Paul Jackson wrote: > Questions concerning this page cache patch that Martin submitted, > as a merge of something originally written by Ray Bryant. > > The following patch is not really a patch. It is a few questions, a > couple minor space tweaks, and

Re: [PATCH/RFC] A method for clearing out page cache

2005-02-14 Thread Paul Jackson
Questions concerning this page cache patch that Martin submitted, as a merge of something originally written by Ray Bryant. The following patch is not really a patch. It is a few questions, a couple minor space tweaks, and a never compiled nor tested rewrite of proc_do_toss_page_cache_nodes() to

[PATCH/RFC] A method for clearing out page cache

2005-02-14 Thread Martin Hicks
Hi, This patch introduces a new sysctl for NUMA systems that tries to drop as much of the page cache as possible from a set of nodes. The motivation for this patch is for setting up High Performance Computing jobs, where initial memory placement is very important to overall performance. Curren