Re: [HACKERS] huge tlb support

2012-08-21 Thread David Gould
On Tue, 21 Aug 2012 18:06:38 +0200 Andres Freund wrote: > On Tuesday, August 21, 2012 05:56:58 PM Robert Haas wrote: > > On Tue, Aug 21, 2012 at 11:31 AM, Andres Freund > > > wrote: > > > On Tuesday, August 21, 2012 05:30:28 PM Robert Haas wrote: > > >> On Thu, Aug 16, 2012 at 10:53 PM, David G

Re: [HACKERS] huge tlb support

2012-08-21 Thread Andres Freund
On Tuesday, August 21, 2012 05:56:58 PM Robert Haas wrote: > On Tue, Aug 21, 2012 at 11:31 AM, Andres Freund wrote: > > On Tuesday, August 21, 2012 05:30:28 PM Robert Haas wrote: > >> On Thu, Aug 16, 2012 at 10:53 PM, David Gould wrote: > >> > A warning, on RHEL 6.1 (2.6.32-131.4.1.el6.x86_64 #1

Re: [HACKERS] huge tlb support

2012-08-21 Thread Robert Haas
On Tue, Aug 21, 2012 at 11:31 AM, Andres Freund wrote: > On Tuesday, August 21, 2012 05:30:28 PM Robert Haas wrote: >> On Thu, Aug 16, 2012 at 10:53 PM, David Gould wrote: >> > A warning, on RHEL 6.1 (2.6.32-131.4.1.el6.x86_64 #1 SMP) we have had >> > horrible problems caused by transparent_hugep

Re: [HACKERS] huge tlb support

2012-08-21 Thread Andres Freund
On Tuesday, August 21, 2012 05:30:28 PM Robert Haas wrote: > On Thu, Aug 16, 2012 at 10:53 PM, David Gould wrote: > > A warning, on RHEL 6.1 (2.6.32-131.4.1.el6.x86_64 #1 SMP) we have had > > horrible problems caused by transparent_hugepages running postgres on > > largish systems (128GB to 512GB

Re: [HACKERS] huge tlb support

2012-08-21 Thread Robert Haas
On Thu, Aug 16, 2012 at 10:53 PM, David Gould wrote: > A warning, on RHEL 6.1 (2.6.32-131.4.1.el6.x86_64 #1 SMP) we have had > horrible problems caused by transparent_hugepages running postgres on > largish systems (128GB to 512GB memory, 32 cores). The system sometimes > goes 99% system time and

Re: [HACKERS] huge tlb support

2012-08-16 Thread David Gould
On Mon, 9 Jul 2012 12:30:23 +0200 Andres Freund wrote: > On Monday, July 09, 2012 08:11:00 AM Tom Lane wrote: > > y...@mwd.biglobe.ne.jp (YAMAMOTO Takashi) writes: > > >> Also, I was under the impression that recent Linux kernels use > > >> hugepages automatically if they can, so I wonder exactly

Re: [HACKERS] huge tlb support

2012-07-09 Thread YAMAMOTO Takashi
> y...@mwd.biglobe.ne.jp (YAMAMOTO Takashi) writes: >>> Also, I was under the impression that recent Linux kernels use hugepages >>> automatically if they can, so I wonder exactly what Andres was testing >>> on ... > >> if you mean the "trasparent hugepage" feature, iirc it doesn't affect >> MAP_S

Re: [HACKERS] huge tlb support

2012-07-09 Thread YAMAMOTO Takashi
> Robert Haas writes: >> On Fri, Jun 29, 2012 at 3:52 PM, Andres Freund >> wrote: >>> In a *very* quick patch I tested using huge pages/MAP_HUGETLB for the >>> mmap'ed >>> memory. > >> So, considering that there is required setup, it seems that the >> obvious thing to do here is add a GUC: hug

Re: [HACKERS] huge tlb support

2012-07-09 Thread Andres Freund
On Monday, July 09, 2012 08:11:00 AM Tom Lane wrote: > y...@mwd.biglobe.ne.jp (YAMAMOTO Takashi) writes: > >> Also, I was under the impression that recent Linux kernels use hugepages > >> automatically if they can, so I wonder exactly what Andres was testing > >> on ... > > > > if you mean the "tr

Re: [HACKERS] huge tlb support

2012-07-09 Thread Martijn van Oosterhout
On Mon, Jul 09, 2012 at 02:11:00AM -0400, Tom Lane wrote: > y...@mwd.biglobe.ne.jp (YAMAMOTO Takashi) writes: > >> Also, I was under the impression that recent Linux kernels use hugepages > >> automatically if they can, so I wonder exactly what Andres was testing > >> on ... > > > if you mean the

Re: [HACKERS] huge tlb support

2012-07-08 Thread Tom Lane
y...@mwd.biglobe.ne.jp (YAMAMOTO Takashi) writes: >> Also, I was under the impression that recent Linux kernels use hugepages >> automatically if they can, so I wonder exactly what Andres was testing >> on ... > if you mean the "trasparent hugepage" feature, iirc it doesn't affect > MAP_SHARED map

Re: [HACKERS] huge tlb support

2012-07-03 Thread Robert Haas
On Tue, Jul 3, 2012 at 8:23 AM, Andres Freund wrote: > On Tuesday, July 03, 2012 04:49:10 AM Robert Haas wrote: >> So, considering that there is required setup, it seems that the >> obvious thing to do here is add a GUC: huge_tlb_pages (boolean). >> >> The other alternative is to try with MAP_HUGE

Re: [HACKERS] huge tlb support

2012-07-03 Thread Andres Freund
On Tuesday, July 03, 2012 04:49:10 AM Robert Haas wrote: > So, considering that there is required setup, it seems that the > obvious thing to do here is add a GUC: huge_tlb_pages (boolean). > > The other alternative is to try with MAP_HUGETLB and, if it fails, try > again without MAP_HUGETLB. What

Re: [HACKERS] huge tlb support

2012-07-03 Thread Andres Freund
On Tuesday, July 03, 2012 05:18:04 AM Tom Lane wrote: > Robert Haas writes: > > On Fri, Jun 29, 2012 at 3:52 PM, Andres Freund wrote: > >> In a *very* quick patch I tested using huge pages/MAP_HUGETLB for the > >> mmap'ed memory. > > > > So, considering that there is required setup, it seems th

Re: [HACKERS] huge tlb support

2012-07-02 Thread Tom Lane
Robert Haas writes: > On Fri, Jun 29, 2012 at 3:52 PM, Andres Freund wrote: >> In a *very* quick patch I tested using huge pages/MAP_HUGETLB for the mmap'ed >> memory. > So, considering that there is required setup, it seems that the > obvious thing to do here is add a GUC: huge_tlb_pages (boole

[HACKERS] huge tlb support

2012-07-02 Thread Robert Haas
On Fri, Jun 29, 2012 at 3:52 PM, Andres Freund wrote: > Hi All, > > In a *very* quick patch I tested using huge pages/MAP_HUGETLB for the mmap'ed > memory. > That gives around 9.5% performance benefit in a read-only pgbench run (-n -S - > j 64 -c 64 -T 10 -M prepared, scale 200, 6GB s_b, 8 cores,