Re: Kernel memory management problem

2009-03-03 Thread Alexander Indenbaum
On Tue, Mar 3, 2009 at 1:28 AM, guy keren wrote: > - Show quoted text - > Alexander Indenbaum wrote: >> >> On Mon, Mar 2, 2009 at 4:44 PM, Valery Reznic >> wrote: >>> >>> --- On Mon, 3/2/09, Alexander Indenbaum >>> wrote: >>> >

Re: Kernel memory management problem

2009-03-02 Thread guy keren
Alexander Indenbaum wrote: On Mon, Mar 2, 2009 at 4:44 PM, Valery Reznic wrote: --- On Mon, 3/2/09, Alexander Indenbaum wrote: From: Alexander Indenbaum Subject: Re: Kernel memory management problem To: "guy keren" Cc: "linux-il." Date: Monday, March 2, 2009, 4:24 PM

Re: Kernel memory management problem

2009-03-02 Thread Valery Reznic
--- On Mon, 3/2/09, Alexander Indenbaum wrote: > From: Alexander Indenbaum > Subject: Re: Kernel memory management problem > To: valery_rez...@yahoo.com > Cc: "linux-il." > Date: Monday, March 2, 2009, 4:45 PM > On Mon, Mar 2, 2009 at 4:3

Re: Kernel memory management problem

2009-03-02 Thread Alexander Indenbaum
On Mon, Mar 2, 2009 at 5:00 PM, Valery Reznic wrote: > > --- On Mon, 3/2/09, Alexander Indenbaum wrote: > >> From: Alexander Indenbaum >> Subject: Re: Kernel memory management problem >> To: valery_rez...@yahoo.com >> Cc: "linux-il." >> Date

Re: Kernel memory management problem

2009-03-02 Thread Valery Reznic
> > Unfortunately this is real problem: if you do something > like > while(true) { transfer } then application crashes and burns > in hell :) Are you sure that culprit is kernel ? May be "transfer" part has memory leak ? Did you try to run it under valgrind ? or run top ? > Nondeterministi

Re: Kernel memory management problem

2009-03-02 Thread Alexander Indenbaum
On Mon, Mar 2, 2009 at 4:44 PM, Valery Reznic wrote: > > --- On Mon, 3/2/09, Alexander Indenbaum wrote: > >> From: Alexander Indenbaum >> Subject: Re: Kernel memory management problem >> To: "guy keren" >> Cc: "linux-il." >> Date: Mo

Re: Kernel memory management problem

2009-03-02 Thread Alexander Indenbaum
On Mon, Mar 2, 2009 at 4:35 PM, Valery Reznic wrote: >> >> Unfortunately this is real problem: if you do something >> like >> while(true) { transfer } then application crashes and burns >> in hell :) > Are you sure that culprit is kernel ? > May be "transfer" part has memory leak ? > > Did you try

Re: Kernel memory management problem

2009-03-02 Thread Valery Reznic
--- On Mon, 3/2/09, Alexander Indenbaum wrote: > From: Alexander Indenbaum > Subject: Re: Kernel memory management problem > To: "guy keren" > Cc: "linux-il." > Date: Monday, March 2, 2009, 4:24 PM > On Mon, Mar 2, 2009 at 1:16 PM, guy keren > w

Re: Kernel memory management problem

2009-03-02 Thread Alexander Indenbaum
On Mon, Mar 2, 2009 at 1:16 PM, guy keren wrote: > > if you don't care about the speed of copying the data and of slowing down > the disk media consderably during this copying, try to change the copy > program, so it will use the O_DIRECT flag when opening the file (and then > you'll need to make

Re: Kernel memory management problem

2009-03-02 Thread Alexander Indenbaum
Valery, See answer inline. On Mon, Mar 2, 2009 at 1:11 PM, Valery Reznic wrote: > > --- On Mon, 3/2/09, Alexander Indenbaum wrote: > >> >> We noticed that if we copy large media file ( 1.4G ) to >> flash storage >> filesystem, using wget/sftp/whatever kernel grabs almost >> all the >> available

Re: Kernel memory management problem

2009-03-02 Thread Valery Reznic
--- On Mon, 3/2/09, Alexander Indenbaum wrote: > > We noticed that if we copy large media file ( 1.4G ) to > flash storage > filesystem, using wget/sftp/whatever kernel grabs almost > all the > available physical memory and buffers are not released > even after > transfer is completed and s

Re: Kernel memory management problem

2009-03-02 Thread guy keren
if you don't care about the speed of copying the data and of slowing down the disk media consderably during this copying, try to change the copy program, so it will use the O_DIRECT flag when opening the file (and then you'll need to make sure the buffers you pass to write() are aligned to di

Kernel memory management problem

2009-03-02 Thread Alexander Indenbaum
Guys/Girls/Dudes, I'm working with embedded Linux box powered by 2.4 kernel ( I know :) we are in process of switching to 2.6 ) with 1G physical memory, no swap defined and some slow flash storage mounted. We noticed that if we copy large media file ( 1.4G ) to flash storage filesystem, using wge