Re: Detecting page cache trashing state

2017-11-26 Thread Minchan Kim
Hello, On Mon, Nov 20, 2017 at 09:40:56PM +0200, Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco) wrote: > Hi Johannes, > > I tested with your patches but situation is still mostly the same. > > Spend some time for debugging and found that the problem is squashfs > specific (probably

Re: Detecting page cache trashing state

2017-11-20 Thread Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco)
Hi Johannes, I tested with your patches but situation is still mostly the same. Spend some time for debugging and found that the problem is squashfs specific (probably some others fs's too). The point is that iowait for squashfs reads will be awaited inside squashfs readpage() callback. Here

Re: Detecting page cache trashing state

2017-10-27 Thread Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco)
On 10/26/2017 06:53 AM, vinayak menon wrote: On Thu, Sep 28, 2017 at 9:19 PM, Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco) wrote: Hi Johannes, Hopefully I was able to rebase the patch on top v4.9.26 (latest supported version by us right now) and test a bit. The overall idea defi

Re: Detecting page cache trashing state

2017-10-27 Thread Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco)
Hi Johannes, On 10/25/2017 08:54 PM, Johannes Weiner wrote: Hi Ruslan, sorry about the delayed response, I missed the new activity in this older thread. On Thu, Sep 28, 2017 at 06:49:07PM +0300, Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco) wrote: Hi Johannes, Hopefully I was

Re: Detecting page cache trashing state

2017-10-25 Thread vinayak menon
On Thu, Sep 28, 2017 at 9:19 PM, Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco) wrote: > Hi Johannes, > > Hopefully I was able to rebase the patch on top v4.9.26 (latest supported > version by us right now) > and test a bit. > The overall idea definitely looks promising, although I ha

Re: Detecting page cache trashing state

2017-10-25 Thread Johannes Weiner
Hi Ruslan, sorry about the delayed response, I missed the new activity in this older thread. On Thu, Sep 28, 2017 at 06:49:07PM +0300, Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco) wrote: > Hi Johannes, > > Hopefully I was able to rebase the patch on top v4.9.26 (latest supported

Re: Detecting page cache trashing state

2017-10-25 Thread Daniel Walker
On 09/28/2017 08:49 AM, Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco) wrote: Hi Johannes, Hopefully I was able to rebase the patch on top v4.9.26 (latest supported version by us right now) and test a bit. The overall idea definitely looks promising, although I have one question

Re: Detecting page cache trashing state

2017-09-28 Thread Ruslan Ruslichenko -X (rruslich - GLOBALLOGIC INC at Cisco)
Hi Johannes, Hopefully I was able to rebase the patch on top v4.9.26 (latest supported version by us right now) and test a bit. The overall idea definitely looks promising, although I have one question on usage. Will it be able to account the time which processes spend on handling major page

Re: Detecting page cache trashing state

2017-09-18 Thread Johannes Weiner
Hi Taras, On Fri, Sep 15, 2017 at 10:28:30AM -0700, Taras Kondratiuk wrote: > Quoting Michal Hocko (2017-09-15 07:36:19) > > On Thu 14-09-17 17:16:27, Taras Kondratiuk wrote: > > > Has somebody faced similar issue? How are you solving it? > > > > Yes this is a pain point for a _long_ time. And we

Re: Detecting page cache trashing state

2017-09-17 Thread Michal Hocko
On Fri 15-09-17 14:20:28, vcap...@pengaru.com wrote: > On Fri, Sep 15, 2017 at 04:36:19PM +0200, Michal Hocko wrote: > > On Thu 14-09-17 17:16:27, Taras Kondratiuk wrote: > > > Hi > > > > > > In our devices under low memory conditions we often get into a trashing > > > state when system spends mos

Re: Detecting page cache trashing state

2017-09-15 Thread Taras Kondratiuk
Quoting vcap...@pengaru.com (2017-09-15 14:20:28) > On Fri, Sep 15, 2017 at 04:36:19PM +0200, Michal Hocko wrote: > > On Thu 14-09-17 17:16:27, Taras Kondratiuk wrote: > > > Hi > > > > > > In our devices under low memory conditions we often get into a trashing > > > state when system spends most o

Re: Detecting page cache trashing state

2017-09-15 Thread vcaputo
On Fri, Sep 15, 2017 at 04:36:19PM +0200, Michal Hocko wrote: > On Thu 14-09-17 17:16:27, Taras Kondratiuk wrote: > > Hi > > > > In our devices under low memory conditions we often get into a trashing > > state when system spends most of the time re-reading pages of .text > > sections from a file

Re: Detecting page cache trashing state

2017-09-15 Thread Daniel Walker
On 09/15/2017 09:38 AM, Taras Kondratiuk wrote: Quoting Daniel Walker (2017-09-15 07:22:27) On 09/14/2017 05:16 PM, Taras Kondratiuk wrote: Hi In our devices under low memory conditions we often get into a trashing state when system spends most of the time re-reading pages of .text sections fr

Re: Detecting page cache trashing state

2017-09-15 Thread Taras Kondratiuk
Quoting Michal Hocko (2017-09-15 07:36:19) > On Thu 14-09-17 17:16:27, Taras Kondratiuk wrote: > > Hi > > > > In our devices under low memory conditions we often get into a trashing > > state when system spends most of the time re-reading pages of .text > > sections from a file system (squashfs in

Re: Detecting page cache trashing state

2017-09-15 Thread Taras Kondratiuk
Quoting Daniel Walker (2017-09-15 07:22:27) > On 09/14/2017 05:16 PM, Taras Kondratiuk wrote: > > Hi > > > > In our devices under low memory conditions we often get into a trashing > > state when system spends most of the time re-reading pages of .text > > sections from a file system (squashfs in o

Re: Detecting page cache trashing state

2017-09-15 Thread Michal Hocko
On Thu 14-09-17 17:16:27, Taras Kondratiuk wrote: > Hi > > In our devices under low memory conditions we often get into a trashing > state when system spends most of the time re-reading pages of .text > sections from a file system (squashfs in our case). Working set doesn't > fit into available pa

Re: Detecting page cache trashing state

2017-09-15 Thread Daniel Walker
On 09/14/2017 05:16 PM, Taras Kondratiuk wrote: Hi In our devices under low memory conditions we often get into a trashing state when system spends most of the time re-reading pages of .text sections from a file system (squashfs in our case). Working set doesn't fit into available page cache, so

Re: Detecting page cache trashing state

2017-09-15 Thread Zdenek Kabelac
Dne 15.9.2017 v 02:16 Taras Kondratiuk napsal(a): Hi In our devices under low memory conditions we often get into a trashing state when system spends most of the time re-reading pages of .text sections from a file system (squashfs in our case). Working set doesn't fit into available page cache,

Detecting page cache trashing state

2017-09-14 Thread Taras Kondratiuk
Hi In our devices under low memory conditions we often get into a trashing state when system spends most of the time re-reading pages of .text sections from a file system (squashfs in our case). Working set doesn't fit into available page cache, so it is expected. The issue is that OOM killer does