Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-17 Thread Daniel Jordan
On Thu, Sep 17, 2020 at 08:39:34AM -0700, Alexander Duyck wrote: > On Thu, Sep 17, 2020 at 7:26 AM Daniel Jordan > wrote: > > > > On Thu, Sep 17, 2020 at 10:37:45AM +0800, Alex Shi wrote: > > > 在 2020/9/16 上午12:58, Daniel Jordan 写道: > > > > On Tue, Sep 15, 2020 at 01:21:56AM -0700, Hugh Dickins wr

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-17 Thread Alexander Duyck
On Thu, Sep 17, 2020 at 7:26 AM Daniel Jordan wrote: > > On Thu, Sep 17, 2020 at 10:37:45AM +0800, Alex Shi wrote: > > 在 2020/9/16 上午12:58, Daniel Jordan 写道: > > > On Tue, Sep 15, 2020 at 01:21:56AM -0700, Hugh Dickins wrote: > > >> On Sun, 13 Sep 2020, Alex Shi wrote: > > >>> Uh, I updated the te

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-17 Thread Daniel Jordan
On Thu, Sep 17, 2020 at 10:37:45AM +0800, Alex Shi wrote: > 在 2020/9/16 上午12:58, Daniel Jordan 写道: > > On Tue, Sep 15, 2020 at 01:21:56AM -0700, Hugh Dickins wrote: > >> On Sun, 13 Sep 2020, Alex Shi wrote: > >>> Uh, I updated the testing with some new results here: > >>> https://lkml.org/lkml/2020

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-16 Thread Alex Shi
在 2020/9/16 上午12:58, Daniel Jordan 写道: > On Tue, Sep 15, 2020 at 01:21:56AM -0700, Hugh Dickins wrote: >> On Sun, 13 Sep 2020, Alex Shi wrote: >>> Uh, I updated the testing with some new results here: >>> https://lkml.org/lkml/2020/8/26/212 >> Right, I missed that, that's better, thanks. Any ot

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-15 Thread Daniel Jordan
On Tue, Sep 15, 2020 at 01:21:56AM -0700, Hugh Dickins wrote: > On Sun, 13 Sep 2020, Alex Shi wrote: > > Uh, I updated the testing with some new results here: > > https://lkml.org/lkml/2020/8/26/212 > > Right, I missed that, that's better, thanks. Any other test results? Alex, you were doing som

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-15 Thread Hugh Dickins
On Sun, 13 Sep 2020, Alex Shi wrote: > > IIRC, all of comments are accepted and push to > https://github.com/alexshi/linux.git lruv19 I just had to relax for the weekend, so no progress from me. I'll take a look at your tree tomorrow, er, later today. > If you don't minder, could you change eve

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-13 Thread Alex Shi
在 2020/9/12 上午10:13, Hugh Dickins 写道: > On Fri, 11 Sep 2020, Alex Shi wrote: >> 在 2020/9/10 上午7:16, Hugh Dickins 写道: >>> On Wed, 9 Sep 2020, Alex Shi wrote: 在 2020/9/9 上午7:41, Hugh Dickins 写道: > > [PATCH v18 05/32] mm/thp: remove code path which never got into > This is a good s

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-13 Thread Alex Shi
在 2020/9/12 下午4:38, Hugh Dickins 写道: > On Wed, 9 Sep 2020, Alex Shi wrote: >> 在 2020/9/9 上午7:41, Hugh Dickins 写道: >>> >>> The use of lock_page_memcg() in __munlock_pagevec() in 20/32, >>> introduced in patchset v17, looks good but it isn't: I was lucky that >>> systemd at reboot did some munlock

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-12 Thread Hugh Dickins
On Wed, 9 Sep 2020, Alex Shi wrote: > 在 2020/9/9 上午7:41, Hugh Dickins 写道: > > > > The use of lock_page_memcg() in __munlock_pagevec() in 20/32, > > introduced in patchset v17, looks good but it isn't: I was lucky that > > systemd at reboot did some munlocking that exposed the problem to lockdep. >

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-11 Thread Hugh Dickins
On Thu, 10 Sep 2020, Alexander Duyck wrote: > On Wed, Sep 9, 2020 at 5:32 PM Hugh Dickins wrote: > > On Wed, 9 Sep 2020, Alexander Duyck wrote: > > > On Tue, Sep 8, 2020 at 4:41 PM Hugh Dickins wrote: > > > > [PATCH v18 28/32] mm/compaction: Drop locked from > > > > isolate_migratepages_block >

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-11 Thread Hugh Dickins
On Fri, 11 Sep 2020, Alex Shi wrote: > 在 2020/9/10 上午7:16, Hugh Dickins 写道: > > On Wed, 9 Sep 2020, Alex Shi wrote: > >> 在 2020/9/9 上午7:41, Hugh Dickins 写道: > >>> > >>> [PATCH v18 05/32] mm/thp: remove code path which never got into > >>> This is a good simplification, but I see no sign that you un

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-10 Thread Alex Shi
在 2020/9/10 上午7:16, Hugh Dickins 写道: > On Wed, 9 Sep 2020, Alex Shi wrote: >> 在 2020/9/9 上午7:41, Hugh Dickins 写道: >>> >>> [PATCH v18 05/32] mm/thp: remove code path which never got into >>> This is a good simplification, but I see no sign that you understand >>> why it's valid: it relies on lru_

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-10 Thread Alexander Duyck
On Wed, Sep 9, 2020 at 5:32 PM Hugh Dickins wrote: > > On Wed, 9 Sep 2020, Alexander Duyck wrote: > > On Tue, Sep 8, 2020 at 4:41 PM Hugh Dickins wrote: > > > [PATCH v18 28/32] mm/compaction: Drop locked from > > > isolate_migratepages_block > > > Most of this consists of replacing "locked" by "

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-09 Thread Hugh Dickins
On Wed, 9 Sep 2020, Alex Shi wrote: > 在 2020/9/9 上午7:41, Hugh Dickins 写道: > > > > [PATCH v18 05/32] mm/thp: remove code path which never got into > > This is a good simplification, but I see no sign that you understand > > why it's valid: it relies on lru_add_page_tail() being called while > > hea

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-09 Thread Hugh Dickins
On Wed, 9 Sep 2020, Alexander Duyck wrote: > On Tue, Sep 8, 2020 at 4:41 PM Hugh Dickins wrote: > > [PATCH v18 28/32] mm/compaction: Drop locked from isolate_migratepages_block > > Most of this consists of replacing "locked" by "lruvec", which is good: > > but please fold those changes back into 2

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-09 Thread Alex Shi
Hi Hugh, Thanks a lot for so rich review and comments! 在 2020/9/9 上午7:41, Hugh Dickins 写道: > Miscellaneous Acks and NAKs and other comments on the beginning and > the end of the series, but not much yet on the all-important middle. > I'm hoping to be spared sending ~20 email replies to ~20 patche

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-09 Thread Alexander Duyck
On Tue, Sep 8, 2020 at 4:41 PM Hugh Dickins wrote: > > [PATCH v18 28/32] mm/compaction: Drop locked from isolate_migratepages_block > Most of this consists of replacing "locked" by "lruvec", which is good: > but please fold those changes back into 20/32 (or would it be 17/32? > I've not yet loo

Re: [PATCH v18 00/32] per memcg lru_lock

2020-09-09 Thread Michal Hocko
On Wed 09-09-20 10:44:32, Aaron Lu wrote: > On Thu, Aug 27, 2020 at 09:40:22PM -0400, Daniel Jordan wrote: > > I went back to your v1 post to see what motivated you originally, and you > > had > > some results from aim9 but nothing about where this reared its head in the > > first place. How did

Re: [PATCH v18 00/32] per memcg lru_lock

2020-09-08 Thread Aaron Lu
On Thu, Aug 27, 2020 at 09:40:22PM -0400, Daniel Jordan wrote: > I went back to your v1 post to see what motivated you originally, and you had > some results from aim9 but nothing about where this reared its head in the > first place. How did you discover the bottleneck? I'm just curious about ho

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-08 Thread Wei Yang
On Tue, Sep 08, 2020 at 04:41:00PM -0700, Hugh Dickins wrote: [...] >[PATCH v18 06/32] mm/thp: narrow lru locking >Why? What part does this play in the series? "narrow lru locking" can >also be described as "widen page cache locking": you are changing the >lock ordering, and not giving any reason t

Re: [PATCH v18 00/32] per memcg lru_lock: reviews

2020-09-08 Thread Hugh Dickins
Miscellaneous Acks and NAKs and other comments on the beginning and the end of the series, but not much yet on the all-important middle. I'm hoping to be spared sending ~20 email replies to ~20 patches. [PATCH v18 01/32] mm/memcg: warning on !memcg after readahead page charged Acked-by: Hugh Dicki

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-27 Thread Alex Shi
在 2020/8/28 上午9:40, Daniel Jordan 写道: > I went back to your v1 post to see what motivated you originally, and you had > some results from aim9 but nothing about where this reared its head in the > first place. How did you discover the bottleneck? I'm just curious about how > lru_lock hurts in p

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-27 Thread Daniel Jordan
On Wed, Aug 26, 2020 at 04:59:28PM +0800, Alex Shi wrote: > I clean up my testing and make it reproducable by a Dockerfile and a case > patch which > attached. Ok, I'll give that a shot once I've taken care of sysbench. > >>> Even better would be a description of the problem you're having in >

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-27 Thread Hugh Dickins
On Mon, 24 Aug 2020, Hugh Dickins wrote: > On Mon, 24 Aug 2020, Andrew Morton wrote: > > On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi > > wrote: > > > > > The new version which bases on v5.9-rc2. > > Well timed and well based, thank you Alex. Particulary helpful to me, > to include those that a

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-26 Thread Alex Shi
在 2020/8/26 上午9:19, Daniel Jordan 写道: > On Tue, Aug 25, 2020 at 11:26:58AM +0800, Alex Shi wrote: >> 在 2020/8/25 上午9:56, Daniel Jordan 写道: >>> Alex, do you have a pointer to the modified readtwice case? >> >> Sorry, no. my developer machine crashed, so I lost case my container and >> modified >>

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-25 Thread Daniel Jordan
On Tue, Aug 25, 2020 at 11:26:58AM +0800, Alex Shi wrote: > 在 2020/8/25 上午9:56, Daniel Jordan 写道: > > Alex, do you have a pointer to the modified readtwice case? > > Sorry, no. my developer machine crashed, so I lost case my container and > modified > case. I am struggling to get my container bac

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-25 Thread Alex Shi
在 2020/8/25 下午4:52, Alex Shi 写道: > > 在 2020/8/25 上午9:56, Daniel Jordan 写道: >> On Mon, Aug 24, 2020 at 01:24:20PM -0700, Hugh Dickins wrote: >>> On Mon, 24 Aug 2020, Andrew Morton wrote: On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi wrote: >>> Andrew demurred on version 17 for lack of

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-25 Thread Matthew Wilcox
On Tue, Aug 25, 2020 at 11:26:58AM +0800, Alex Shi wrote: > I tried reusing page->prviate to store lruvec pointer, that could remove some > regression on this, since private is generally unused on a lru page. But the > patch > is too buggy now. page->private is for the use of the filesystem. Y

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-25 Thread Alex Shi
在 2020/8/25 上午9:56, Daniel Jordan 写道: > On Mon, Aug 24, 2020 at 01:24:20PM -0700, Hugh Dickins wrote: >> On Mon, 24 Aug 2020, Andrew Morton wrote: >>> On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi >>> wrote: >> Andrew demurred on version 17 for lack of review. Alexander Duyck has >> been doing

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-25 Thread Michal Hocko
On Mon 24-08-20 11:42:04, Andrew Morton wrote: > On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi > wrote: > > > The new version which bases on v5.9-rc2. The first 6 patches was picked into > > linux-mm, and add patch 25-32 that do some further post optimization. > > 32 patches, version 18. That's

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-24 Thread Alex Shi
在 2020/8/25 上午9:56, Daniel Jordan 写道: > On Mon, Aug 24, 2020 at 01:24:20PM -0700, Hugh Dickins wrote: >> On Mon, 24 Aug 2020, Andrew Morton wrote: >>> On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi >>> wrote: >> Andrew demurred on version 17 for lack of review. Alexander Duyck has >> been doing

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-24 Thread Daniel Jordan
On Mon, Aug 24, 2020 at 01:24:20PM -0700, Hugh Dickins wrote: > On Mon, 24 Aug 2020, Andrew Morton wrote: > > On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi > > wrote: > Andrew demurred on version 17 for lack of review. Alexander Duyck has > been doing a lot on that front since then. I have intend

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-24 Thread Hugh Dickins
On Mon, 24 Aug 2020, Andrew Morton wrote: > On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi > wrote: > > > The new version which bases on v5.9-rc2. Well timed and well based, thank you Alex. Particulary helpful to me, to include those that already went into mmotm: it's a surer foundation to test o

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-24 Thread Qian Cai
On Mon, Aug 24, 2020 at 11:42:04AM -0700, Andrew Morton wrote: > On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi > wrote: > > > The new version which bases on v5.9-rc2. The first 6 patches was picked into > > linux-mm, and add patch 25-32 that do some further post optimization. > > 32 patches, vers

Re: [PATCH v18 00/32] per memcg lru_lock

2020-08-24 Thread Andrew Morton
On Mon, 24 Aug 2020 20:54:33 +0800 Alex Shi wrote: > The new version which bases on v5.9-rc2. The first 6 patches was picked into > linux-mm, and add patch 25-32 that do some further post optimization. 32 patches, version 18. That's quite heroic. I'm unsure whether I should merge it up at this

[PATCH v18 00/32] per memcg lru_lock

2020-08-24 Thread Alex Shi
The new version which bases on v5.9-rc2. The first 6 patches was picked into linux-mm, and add patch 25-32 that do some further post optimization. The patchset includes 4 parts: 1, some code cleanup and minimum optimization as a preparation. patch 1-15. 2, use TestCleanPageLRU as page isolation's