RE: RFC: Split EPT huge pages in advance of dirty logging

2020-03-02 Thread Zhoujian (jay)
) ; Huangweidong (C) ; Junaid Shahid Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > -Original Message- > From: Peter Feiner [mailto:pfei...@google.com] [...] >Hi Jay, >I've been sick since I sent my last email, so I haven't gotten to this patch >

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-03-02 Thread Peter Feiner
Xu ; > > k...@vger.kernel.org; qemu-devel@nongnu.org; pbonz...@redhat.com; > > dgilb...@redhat.com; quint...@redhat.com; Liujinsong (Paul) > > ; linfeng (M) ; wangxin > (U) > > ; Huangweidong (C) > > > > Subject: Re: RFC: Split EPT huge pages in advanc

RE: RFC: Split EPT huge pages in advance of dirty logging

2020-03-02 Thread Zhoujian (jay)
ilb...@redhat.com; quint...@redhat.com; Liujinsong (Paul) > ; linfeng (M) ; wangxin (U) > ; Huangweidong (C) > > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > On Fri, Feb 21, 2020 at 2:08 PM Junaid Shahid wrote: > > > > On 2/20/20 9:34 AM, Ben Gard

RE: RFC: Split EPT huge pages in advance of dirty logging

2020-02-23 Thread Zhoujian (jay)
ilb...@redhat.com; quint...@redhat.com; Liujinsong (Paul) > ; linfeng (M) ; wangxin (U) > ; Huangweidong (C) > > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > On Fri, Feb 21, 2020 at 2:08 PM Junaid Shahid wrote: > > > > On 2/20/20 9:34 AM, Ben Gard

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-21 Thread Peter Feiner
On Fri, Feb 21, 2020 at 2:08 PM Junaid Shahid wrote: > > On 2/20/20 9:34 AM, Ben Gardon wrote: > > > > FWIW, we currently do this eager splitting at Google for live > > migration. When the log-dirty-memory flag is set on a memslot we > > eagerly split all pages in the slot down to 4k granularity.

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-21 Thread Junaid Shahid
On 2/20/20 9:34 AM, Ben Gardon wrote: FWIW, we currently do this eager splitting at Google for live migration. When the log-dirty-memory flag is set on a memslot we eagerly split all pages in the slot down to 4k granularity. As Jay said, this does not cause crippling lock contention because the

RE: RFC: Split EPT huge pages in advance of dirty logging

2020-02-20 Thread Zhoujian (jay)
hat.com; > Liujinsong (Paul) ; linfeng (M) > ; wangxin (U) ; > Huangweidong (C) > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > On Thu, Feb 20, 2020 at 09:34:52AM -0800, Ben Gardon wrote: > > On Thu, Feb 20, 2020 at 5:53 AM Zhoujian (jay) >

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-20 Thread Ben Gardon
gnu.org; pbonz...@redhat.com; > > dgilb...@redhat.com; quint...@redhat.com; Liujinsong (Paul) > > ; linfeng (M) ; wangxin (U) > > ; Huangweidong (C) > > > > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > > > On Wed, Feb 19, 2020 at 01

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-20 Thread Ben Gardon
gt; > From: Peter Xu [mailto:pet...@redhat.com] > > > > Sent: Wednesday, February 19, 2020 1:43 AM > > > > To: Zhoujian (jay) > > > > Cc: k...@vger.kernel.org; qemu-devel@nongnu.org; > > pbonz...@redhat.com; > > > > dgilb...@redhat.com; quint...@redhat.com

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-20 Thread Peter Xu
2020 1:19 AM > > > To: Zhoujian (jay) > > > Cc: k...@vger.kernel.org; qemu-devel@nongnu.org; pbonz...@redhat.com; > > > dgilb...@redhat.com; quint...@redhat.com; Liujinsong (Paul) > > > ; linfeng (M) ; wangxin (U) > > > ; Huangweidong (C) > >

RE: RFC: Split EPT huge pages in advance of dirty logging

2020-02-20 Thread Zhoujian (jay)
ul) > ; linfeng (M) ; wangxin (U) > ; Huangweidong (C) > > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > On Wed, Feb 19, 2020 at 01:19:08PM +, Zhoujian (jay) wrote: > > Hi Peter, > > > > > -Original Message- > > > From: P

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-19 Thread Peter Xu
el.org; qemu-devel@nongnu.org; pbonz...@redhat.com; > > dgilb...@redhat.com; quint...@redhat.com; Liujinsong (Paul) > > ; linfeng (M) ; wangxin (U) > > ; Huangweidong (C) > > > > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > > > On Tue, Feb 18

RE: RFC: Split EPT huge pages in advance of dirty logging

2020-02-19 Thread Zhoujian (jay)
(Paul) > ; linfeng (M) ; wangxin (U) > ; Huangweidong (C) > > Subject: Re: RFC: Split EPT huge pages in advance of dirty logging > > On Tue, Feb 18, 2020 at 01:13:47PM +, Zhoujian (jay) wrote: > > Hi all, > > > > We found that the guest will be soft-lockup

Re: RFC: Split EPT huge pages in advance of dirty logging

2020-02-18 Thread Peter Xu
On Tue, Feb 18, 2020 at 01:13:47PM +, Zhoujian (jay) wrote: > Hi all, > > We found that the guest will be soft-lockup occasionally when live migrating > a 60 vCPU, > 512GiB huge page and memory sensitive VM. The reason is clear, almost all of > the vCPUs > are waiting for the KVM MMU spin-lo