Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-03-01 Thread Michal Hocko
On Wed 01-03-17 13:06:57, Robert Kudyba wrote: [...] > Does this ever finish? Once there is no memory pressure > The output file seems to grow really quickly. Here are a few lines and > I can upload the file somewhere if you think it’d be helpful: [...] > kswapd0-52[001] 90900.8

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-03-01 Thread Michal Hocko
On Wed 01-03-17 10:55:33, Robert Kudyba wrote: > > > On Mar 1, 2017, at 3:06 AM, Michal Hocko wrote: > > > > On Tue 28-02-17 14:32:18, Robert Kudyba wrote: > >> > >>> On Feb 28, 2017, at 11:56 AM, Michal Hocko >>> > wrote: > > [...] > Will do here’s a perf report

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-03-01 Thread Michal Hocko
On Tue 28-02-17 14:32:18, Robert Kudyba wrote: > > > On Feb 28, 2017, at 11:56 AM, Michal Hocko wrote: [...] > >> Will do here’s a perf report: > > > > this will not tell us much. Tracepoints have much better chance to tell > > us how reclaim is progressing. > > I have SystemTap configured are

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-28 Thread Robert Kudyba
> On Feb 28, 2017, at 11:56 AM, Michal Hocko wrote: > > On Tue 28-02-17 11:19:33, Robert Kudyba wrote: >> >>> On Feb 28, 2017, at 10:15 AM, Michal Hocko wrote: >>> >>> On Tue 28-02-17 09:59:35, Robert Kudyba wrote: > On Feb 28, 2017, at 9:40 AM, Michal Hocko wrote: > > On

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-28 Thread Michal Hocko
On Tue 28-02-17 11:19:33, Robert Kudyba wrote: > > > On Feb 28, 2017, at 10:15 AM, Michal Hocko wrote: > > > > On Tue 28-02-17 09:59:35, Robert Kudyba wrote: > >> > >>> On Feb 28, 2017, at 9:40 AM, Michal Hocko wrote: > >>> > >>> On Tue 28-02-17 09:33:49, Robert Kudyba wrote: > > >

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-28 Thread Robert Kudyba
> On Feb 28, 2017, at 10:15 AM, Michal Hocko wrote: > > On Tue 28-02-17 09:59:35, Robert Kudyba wrote: >> >>> On Feb 28, 2017, at 9:40 AM, Michal Hocko wrote: >>> >>> On Tue 28-02-17 09:33:49, Robert Kudyba wrote: > On Feb 28, 2017, at 9:15 AM, Michal Hocko wrote: > and this on

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-28 Thread Michal Hocko
On Tue 28-02-17 09:59:35, Robert Kudyba wrote: > > > On Feb 28, 2017, at 9:40 AM, Michal Hocko wrote: > > > > On Tue 28-02-17 09:33:49, Robert Kudyba wrote: > >> > >>> On Feb 28, 2017, at 9:15 AM, Michal Hocko wrote: > >>> and this one is hitting the min watermark while there is not really > >

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-28 Thread Michal Hocko
On Tue 28-02-17 09:33:49, Robert Kudyba wrote: > > > On Feb 28, 2017, at 9:15 AM, Michal Hocko wrote: > > and this one is hitting the min watermark while there is not really > > much to reclaim. Only the page cache which might be pinned and not > > reclaimable from this context because this is GF

Re: rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-28 Thread Michal Hocko
On Mon 27-02-17 16:36:43, Robert Kudyba wrote: > Feb 27 04:36:54 curie kernel: rsync: page allocation stalls for 10699ms, > order:0, mode:0x2420848(GFP_NOFS|__GFP_NOFAIL|__GFP_HARDWALL|__GFP_MOVABLE) > Feb 27 04:36:54 curie kernel: CPU: 2 PID: 32649 Comm: rsync Tainted: G > L 4.9.10-

rsync: page allocation stalls in kernel 4.9.10 to a VessRAID NAS

2017-02-27 Thread Robert Kudyba
This sounds very similar to David Arendt’s problem from December 2016 on 12/13 post numbered 529 in the URL with the title page allocation stall in kernel 4.9 when copying files from one btrfs hdd to another This happens about 2 hours after our daily rsnapshot/rsync cron job starts pretty much