Re: [PATCH v1 00/14] Multigenerational LRU

2021-04-13 Thread Yu Zhao
On Mon, Apr 12, 2021 at 9:02 PM Huang, Ying wrote: > > Yu Zhao writes: > > > On Tue, Mar 16, 2021 at 02:14:43PM -0700, Dave Hansen wrote: > >> On 3/16/21 1:30 PM, Yu Zhao wrote: > >> > On Tue, Mar 16, 2021 at 07:50:23AM -0700, Dave Hansen wrote: > >> >> I think it would also be very worthwhile to

Re: [PATCH v1 00/14] Multigenerational LRU

2021-04-12 Thread Huang, Ying
Yu Zhao writes: > On Tue, Mar 16, 2021 at 02:14:43PM -0700, Dave Hansen wrote: >> On 3/16/21 1:30 PM, Yu Zhao wrote: >> > On Tue, Mar 16, 2021 at 07:50:23AM -0700, Dave Hansen wrote: >> >> I think it would also be very worthwhile to include some research in >> >> this series about why the kernel

Re: [PATCH v1 00/14] Multigenerational LRU

2021-04-10 Thread Yu Zhao
On Tue, Mar 16, 2021 at 02:14:43PM -0700, Dave Hansen wrote: > On 3/16/21 1:30 PM, Yu Zhao wrote: > > On Tue, Mar 16, 2021 at 07:50:23AM -0700, Dave Hansen wrote: > >> I think it would also be very worthwhile to include some research in > >> this series about why the kernel moved away from page tab

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-16 Thread Dave Hansen
On 3/16/21 1:30 PM, Yu Zhao wrote: > On Tue, Mar 16, 2021 at 07:50:23AM -0700, Dave Hansen wrote: >> I think it would also be very worthwhile to include some research in >> this series about why the kernel moved away from page table scanning. >> What has changed? Are the workloads we were concerne

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-16 Thread Yu Zhao
On Tue, Mar 16, 2021 at 07:50:23AM -0700, Dave Hansen wrote: > On 3/15/21 7:24 PM, Yu Zhao wrote: > > On Mon, Mar 15, 2021 at 11:00:06AM -0700, Dave Hansen wrote: > >> How bad does this scanning get in the worst case if there's a lot of > >> sharing? > > > > Actually the improvement is larger when

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-16 Thread Dave Hansen
On 3/15/21 7:24 PM, Yu Zhao wrote: > On Mon, Mar 15, 2021 at 11:00:06AM -0700, Dave Hansen wrote: >> How bad does this scanning get in the worst case if there's a lot of >> sharing? > > Actually the improvement is larger when there is more sharing, i.e., > higher map_count larger improvement. Let'

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-15 Thread Yu Zhao
On Mon, Mar 15, 2021 at 11:38:20AM -0700, Yang Shi wrote: > On Fri, Mar 12, 2021 at 11:57 PM Yu Zhao wrote: > > > > TLDR > > > > The current page reclaim is too expensive in terms of CPU usage and > > often making poor choices about what to evict. We would like to offer > > a performant, vers

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-15 Thread Yu Zhao
On Mon, Mar 15, 2021 at 11:00:06AM -0700, Dave Hansen wrote: > On 3/12/21 11:57 PM, Yu Zhao wrote: > > Background > > == > > DRAM is a major factor in total cost of ownership, and improving > > memory overcommit brings a high return on investment. Over the past > > decade of research and ex

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-15 Thread Yang Shi
On Fri, Mar 12, 2021 at 11:57 PM Yu Zhao wrote: > > TLDR > > The current page reclaim is too expensive in terms of CPU usage and > often making poor choices about what to evict. We would like to offer > a performant, versatile and straightforward augment. > > Repo > > git fetch https://l

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-15 Thread Dave Hansen
On 3/12/21 11:57 PM, Yu Zhao wrote: > Background > == > DRAM is a major factor in total cost of ownership, and improving > memory overcommit brings a high return on investment. Over the past > decade of research and experimentation in memory overcommit, we > observed a distinct trend across

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-14 Thread Yu Zhao
On Mon, Mar 15, 2021 at 09:13:50AM +0800, Hillf Danton wrote: > On Sat, 13 Mar 2021 00:57:33 -0700 Yu Zhao wrote: > > TLDR > > > > The current page reclaim is too expensive in terms of CPU usage and > > often making poor choices about what to evict. We would like to offer > > a performant, ver

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-14 Thread Yu Zhao
On Sun, Mar 14, 2021 at 06:48:17PM -0400, Zi Yan wrote: > On 13 Mar 2021, at 2:57, Yu Zhao wrote: > > Problems > > > > 31.03% page_vma_mapped_walk > > 25.59% lzo1x_1_do_compress > >4.63% do_raw_spin_lock > >3.89% vma_interval_tree_iter_next > >3.33% vma_interval_tree

Re: [PATCH v1 00/14] Multigenerational LRU

2021-03-14 Thread Zi Yan
On 13 Mar 2021, at 2:57, Yu Zhao wrote: > TLDR > > The current page reclaim is too expensive in terms of CPU usage and > often making poor choices about what to evict. We would like to offer > a performant, versatile and straightforward augment. > > Repo > > git fetch https://linux-mm.go

[PATCH v1 00/14] Multigenerational LRU

2021-03-13 Thread Yu Zhao
TLDR The current page reclaim is too expensive in terms of CPU usage and often making poor choices about what to evict. We would like to offer a performant, versatile and straightforward augment. Repo git fetch https://linux-mm.googlesource.com/page-reclaim refs/changes/01/1101/1 Gerrit