Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-07 Thread Mel Gorman
On Wed, May 06, 2015 at 10:37:28PM -0400, Waiman Long wrote: > On 05/06/2015 01:58 PM, Waiman Long wrote: > >On 05/06/2015 06:22 AM, Mel Gorman wrote: > >>On Wed, May 06, 2015 at 08:12:46AM +0100, Mel Gorman wrote: > >>>On Tue, May 05, 2015 at 03:25:49PM -0700, Andrew Morton wrote: > On Tue, 5

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-06 Thread Waiman Long
On 05/06/2015 01:58 PM, Waiman Long wrote: On 05/06/2015 06:22 AM, Mel Gorman wrote: On Wed, May 06, 2015 at 08:12:46AM +0100, Mel Gorman wrote: On Tue, May 05, 2015 at 03:25:49PM -0700, Andrew Morton wrote: On Tue, 5 May 2015 23:13:29 +0100 Mel Gorman wrote: Alternatively, the page allocat

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-06 Thread Waiman Long
On 05/06/2015 06:22 AM, Mel Gorman wrote: On Wed, May 06, 2015 at 08:12:46AM +0100, Mel Gorman wrote: On Tue, May 05, 2015 at 03:25:49PM -0700, Andrew Morton wrote: On Tue, 5 May 2015 23:13:29 +0100 Mel Gorman wrote: Alternatively, the page allocator can go off and synchronously initialize s

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-06 Thread Mel Gorman
On Wed, May 06, 2015 at 11:22:20AM +0100, Mel Gorman wrote: > On Wed, May 06, 2015 at 08:12:46AM +0100, Mel Gorman wrote: > > On Tue, May 05, 2015 at 03:25:49PM -0700, Andrew Morton wrote: > > > On Tue, 5 May 2015 23:13:29 +0100 Mel Gorman wrote: > > > > > > > > Alternatively, the page allocator

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-06 Thread Mel Gorman
On Wed, May 06, 2015 at 08:12:46AM +0100, Mel Gorman wrote: > On Tue, May 05, 2015 at 03:25:49PM -0700, Andrew Morton wrote: > > On Tue, 5 May 2015 23:13:29 +0100 Mel Gorman wrote: > > > > > > Alternatively, the page allocator can go off and synchronously > > > > initialize some pageframes itself

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-06 Thread Mel Gorman
On Tue, May 05, 2015 at 03:25:49PM -0700, Andrew Morton wrote: > On Tue, 5 May 2015 23:13:29 +0100 Mel Gorman wrote: > > > > Alternatively, the page allocator can go off and synchronously > > > initialize some pageframes itself. Keep doing that until the > > > allocation attempt succeeds. > > >

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Waiman Long
On 05/05/2015 11:01 AM, Waiman Long wrote: On 05/05/2015 10:31 AM, Mel Gorman wrote: On Tue, May 05, 2015 at 09:55:52AM -0400, Waiman Long wrote: On 05/05/2015 06:45 AM, Mel Gorman wrote: On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: Before the patch, the boot time from elilo

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Andrew Morton
On Tue, 05 May 2015 21:21:19 -0400 Waiman Long wrote: > On 05/05/2015 04:02 PM, Andrew Morton wrote: > > On Tue, 5 May 2015 11:45:14 +0100 Mel Gorman wrote: > > > >> On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: > Before the patch, the boot time from elilo prompt to ssh log

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Waiman Long
On 05/05/2015 04:02 PM, Andrew Morton wrote: On Tue, 5 May 2015 11:45:14 +0100 Mel Gorman wrote: On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: Before the patch, the boot time from elilo prompt to ssh login was 694s. After the patch, the boot up time was 346s, a saving of 348s

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Waiman Long
On 05/05/2015 10:31 AM, Mel Gorman wrote: On Tue, May 05, 2015 at 09:55:52AM -0400, Waiman Long wrote: On 05/05/2015 06:45 AM, Mel Gorman wrote: On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: Before the patch, the boot time from elilo prompt to ssh login was 694s. After the pat

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Andrew Morton
On Tue, 5 May 2015 23:13:29 +0100 Mel Gorman wrote: > > Alternatively, the page allocator can go off and synchronously > > initialize some pageframes itself. Keep doing that until the > > allocation attempt succeeds. > > > > That was rejected during review of earlier attempts at this feature o

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Mel Gorman
On Tue, May 05, 2015 at 01:02:55PM -0700, Andrew Morton wrote: > On Tue, 5 May 2015 11:45:14 +0100 Mel Gorman wrote: > > > On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: > > > > Before the patch, the boot time from elilo prompt to ssh login was > > > > 694s. > > > > After the pa

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Andrew Morton
On Tue, 5 May 2015 11:45:14 +0100 Mel Gorman wrote: > On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: > > > Before the patch, the boot time from elilo prompt to ssh login was 694s. > > > After the patch, the boot up time was 346s, a saving of 348s (about 50%). > > > > Having to g

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Mel Gorman
On Tue, May 05, 2015 at 09:55:52AM -0400, Waiman Long wrote: > On 05/05/2015 06:45 AM, Mel Gorman wrote: > >On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: > >>>Before the patch, the boot time from elilo prompt to ssh login was 694s. > >>>After the patch, the boot up time was 346s, a

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Waiman Long
On 05/05/2015 10:31 AM, Mel Gorman wrote: On Tue, May 05, 2015 at 09:55:52AM -0400, Waiman Long wrote: On 05/05/2015 06:45 AM, Mel Gorman wrote: On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: Before the patch, the boot time from elilo prompt to ssh login was 694s. After the pat

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Waiman Long
On 05/05/2015 06:45 AM, Mel Gorman wrote: On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: Before the patch, the boot time from elilo prompt to ssh login was 694s. After the patch, the boot up time was 346s, a saving of 348s (about 50%). Having to guesstimate the amount of memory

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-05 Thread Mel Gorman
On Mon, May 04, 2015 at 02:30:46PM -0700, Andrew Morton wrote: > > Before the patch, the boot time from elilo prompt to ssh login was 694s. > > After the patch, the boot up time was 346s, a saving of 348s (about 50%). > > Having to guesstimate the amount of memory which is needed for a > successf

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-04 Thread Waiman Long
On 05/04/2015 05:30 PM, Andrew Morton wrote: On Fri, 01 May 2015 20:09:21 -0400 Waiman Long wrote: On 05/01/2015 06:02 PM, Waiman Long wrote: Bad news! I tried your patch on a 24-TB DragonHawk and got an out of memory panic. The kernel log messages were: ... [ 81.360287] [] dump_stack+

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-04 Thread Andrew Morton
On Fri, 01 May 2015 20:09:21 -0400 Waiman Long wrote: > On 05/01/2015 06:02 PM, Waiman Long wrote: > > > > Bad news! > > > > I tried your patch on a 24-TB DragonHawk and got an out of memory > > panic. The kernel log messages were: > > ... > > > [ 81.360287] [] dump_stack+0x68/0x77 > > [ 81

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-02 Thread Daniel J Blueman
On Sat, May 2, 2015 at 4:52 PM, Daniel J Blueman wrote: On Sat, May 2, 2015 at 8:09 AM, Waiman Long wrote: On 05/01/2015 06:02 PM, Waiman Long wrote: Bad news! I tried your patch on a 24-TB DragonHawk and got an out of memory panic. The kernel log messages were: : [ 80.126186] CPU 47

RE: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-02 Thread Elliott, Robert (Server Storage)
> -Original Message- > From: linux-kernel-ow...@vger.kernel.org [mailto:linux-kernel- > ow...@vger.kernel.org] On Behalf Of Daniel J Blueman > Sent: Thursday, April 30, 2015 11:10 AM > Subject: Re: [PATCH 0/13] Parallel struct page initialisation v4 ... > On a 7TB, 172

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-02 Thread Daniel J Blueman
On Sat, May 2, 2015 at 8:09 AM, Waiman Long wrote: On 05/01/2015 06:02 PM, Waiman Long wrote: Bad news! I tried your patch on a 24-TB DragonHawk and got an out of memory panic. The kernel log messages were: : [ 80.126186] CPU 474: hi: 186, btch: 31 usd: 0 [ 80.131457] CPU 475: h

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-01 Thread Waiman Long
On 05/01/2015 06:02 PM, Waiman Long wrote: Bad news! I tried your patch on a 24-TB DragonHawk and got an out of memory panic. The kernel log messages were: : [ 80.126186] CPU 474: hi: 186, btch: 31 usd: 0 [ 80.131457] CPU 475: hi: 186, btch: 31 usd: 0 [ 80.136726] CPU 476:

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-05-01 Thread Waiman Long
On 04/28/2015 09:16 PM, Waiman Long wrote: On 04/28/2015 10:36 AM, Mel Gorman wrote: The bulk of the changes here are related to Andrew's feedback. Functionally there is almost no difference. Changelog since v3 o Fix section-related warning o Comments, clarifications, checkpatch o Report the n

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-04-30 Thread Mel Gorman
On Thu, Apr 30, 2015 at 12:12:50PM -0500, nzimmer wrote: > > Out of curiosity has anyone ran any tests post boot time? > Some functional tests only to exercise the machine and see if anything blew up. It looked fine to me at least. -- Mel Gorman SUSE Labs -- To unsubscribe from this list: send

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-04-30 Thread nzimmer
On 04/30/2015 11:10 AM, Daniel J Blueman wrote: On Wed, Apr 29, 2015 at 2:38 AM, nzimmer wrote: On 04/28/2015 11:06 AM, Pekka Enberg wrote: On Tue, Apr 28, 2015 at 5:36 PM, Mel Gorman wrote: Struct page initialisation had been identified as one of the reasons why large machines take a long t

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-04-30 Thread Daniel J Blueman
On Wed, Apr 29, 2015 at 2:38 AM, nzimmer wrote: On 04/28/2015 11:06 AM, Pekka Enberg wrote: On Tue, Apr 28, 2015 at 5:36 PM, Mel Gorman wrote: Struct page initialisation had been identified as one of the reasons why large machines take a long time to boot. Patches were posted a long time ago

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-04-28 Thread Waiman Long
On 04/28/2015 10:36 AM, Mel Gorman wrote: The bulk of the changes here are related to Andrew's feedback. Functionally there is almost no difference. Changelog since v3 o Fix section-related warning o Comments, clarifications, checkpatch o Report the number of pages initialised Changelog since v

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-04-28 Thread nzimmer
On an older 8 TB box with lots and lots of cpus the boot time, as measure from grub to login prompt, the boot time improved from 1484 seconds to exactly 1000 seconds. I have time on 16 TB box tonight and a 12 TB box thursday and will hopefully have more numbers then. On 04/28/2015 11:06 AM

Re: [PATCH 0/13] Parallel struct page initialisation v4

2015-04-28 Thread Pekka Enberg
On Tue, Apr 28, 2015 at 5:36 PM, Mel Gorman wrote: > Struct page initialisation had been identified as one of the reasons why > large machines take a long time to boot. Patches were posted a long time ago > to defer initialisation until they were first used. This was rejected on > the grounds it

[PATCH 0/13] Parallel struct page initialisation v4

2015-04-28 Thread Mel Gorman
The bulk of the changes here are related to Andrew's feedback. Functionally there is almost no difference. Changelog since v3 o Fix section-related warning o Comments, clarifications, checkpatch o Report the number of pages initialised Changelog since v2 o Reduce overhead of topology_init o Remov