RE: GSOC 2018 Project - A New Sorting Routine

2018-08-01 Thread Kefan Yang
Thanks for your time! From: Tomas Vondra Sent: August 1, 2018 6:30 AM To: Kefan Yang Cc: Andrey Borodin; Peter Geoghegan; alvhe...@2ndquadrant.com; PostgreSQL Hackers Subject: Re: GSOC 2018 Project - A New Sorting Routine On 07/30/2018 11:21 PM, Kefan Yang wrote: > Hey Tomas! > >

RE: GSOC 2018 Project - A New Sorting Routine

2018-07-30 Thread Kefan Yang
Hey Tomas! Sorry to bother but it would be great if we can get the test results this week. Regards, Kefan From: Tomas Vondra Sent: July 24, 2018 8:16 AM To: Kefan Yang Cc: Andrey Borodin; Peter Geoghegan; alvhe...@2ndquadrant.com; PostgreSQL Hackers Subject: Re: GSOC 2018 Project - A New

Re: GSOC 2018 Project - A New Sorting Routine

2018-07-24 Thread Tomas Vondra
On 07/24/2018 12:21 AM, Kefan Yang wrote: Hi Tomas! I did a few tests on my own Linux machine, but the problem is that my resources on AWS(CPU, RAM and even Disk space) are very limited. I considered establishing virtual machine on my own PC but the performance is even worse. My original

RE: GSOC 2018 Project - A New Sorting Routine

2018-07-23 Thread Kefan Yang
Subject: Re: GSOC 2018 Project - A New Sorting Routine I don't have any script for that - load the files into a spreadsheet, create pivot tables and you're done. regards On 07/18/2018 11:13 PM, Kefan Yang wrote: > Hey Tomas! > >   > > I am trying to reproduce the results

Re: GSOC 2018 Project - A New Sorting Routine

2018-07-18 Thread Alvaro Herrera
On 2018-Jul-18, Tomas Vondra wrote: > I don't have any script for that - load the files into a spreadsheet, > create pivot tables and you're done. What!? You don't use psql's \crosstabview !? ... walks away disappointed ... -- Álvaro Herrerahttps://www.2ndQuadrant.com/ Postgre

Re: GSOC 2018 Project - A New Sorting Routine

2018-07-18 Thread Tomas Vondra
ilto:p...@bowt.ie>; Kefan Yang > <mailto:starord...@gmail.com>; PostgreSQL Hackers > <mailto:pgsql-hackers@lists.postgresql.org> > *Subject: *Re: GSOC 2018 Project - A New Sorting Routine > >   > >   > >   > > On 07/18/2018 07:06 AM, Andrey Borodin

RE: GSOC 2018 Project - A New Sorting Routine

2018-07-18 Thread Kefan Yang
Hey Tomas! I am trying to reproduce the results on my machine. Could you please share the script to generate .ods files? Regards, Kefan From: Tomas Vondra Sent: July 18, 2018 2:05 AM To: Andrey Borodin Cc: Peter Geoghegan; Kefan Yang; PostgreSQL Hackers Subject: Re: GSOC 2018 Project - A New

Re: GSOC 2018 Project - A New Sorting Routine

2018-07-17 Thread Andrey Borodin
Hi, Tomas! > 15 июля 2018 г., в 1:20, Tomas Vondra > написал(а): > > So I doubt it's this, but I've tweaked the scripts to also set this GUC > and restarted the tests on both machines. Let's see what that does. Do you observe any different results? Thanks! Best regards, Andrey Borodin.

Re: GSOC 2018 Project - A New Sorting Routine

2018-07-14 Thread Tomas Vondra
On 07/14/2018 12:10 AM, Peter Geoghegan wrote: > On Fri, Jul 13, 2018 at 3:04 PM, Kefan Yang wrote: >> 1. Slow on CREATE INDEX cases. >> >> I am still trying to figure out where the bottleneck is. Is the data pattern >> in index creation very different from other cases? Also, pg_qsort has >> 10%-2

Re: Fwd: GSOC 2018 Project - A New Sorting Routine

2018-07-13 Thread Peter Geoghegan
On Fri, Jul 13, 2018 at 6:03 PM, Tomas Vondra wrote: > Unlikely. The pivot randomization is merely a way to defeat an adversary > attempting to perform DoS by triggering sorts on a killer sequence. > Randomization makes it much harder/impossible, because the killer > sequence changes over time. It

Re: Fwd: GSOC 2018 Project - A New Sorting Routine

2018-07-13 Thread Tomas Vondra
On 07/14/2018 12:04 AM, Kefan Yang wrote: > > ... > > And finally, I see the PDF reports "CPU clocks" but I'm not sure what > that actually is? Is that elapsed time in milliseconds or something > else? > > > Sorry for the confusion, but "CPU clocks" actually means CPU clock > ticks,

Re: GSOC 2018 Project - A New Sorting Routine

2018-07-13 Thread Peter Geoghegan
On Fri, Jul 13, 2018 at 3:04 PM, Kefan Yang wrote: > 1. Slow on CREATE INDEX cases. > > I am still trying to figure out where the bottleneck is. Is the data pattern > in index creation very different from other cases? Also, pg_qsort has > 10%-20% advantage at creating index even on sorted data (fa

Fwd: GSOC 2018 Project - A New Sorting Routine

2018-07-13 Thread Kefan Yang
-- Forwarded message -- From: Kefan Yang Date: 2018-07-13 15:02 GMT-07:00 Subject: Re: GSOC 2018 Project - A New Sorting Routine To: Tomas Vondra Hey Tomas, Thanks for your reply! First I’d like to make some clarification about my test result. > First of all, test