Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-03-04 Thread David Steele
On 3/4/17 8:33 AM, Peter Eisentraut wrote: > On 3/3/17 16:16, David Steele wrote: >> While this looks like it could be a really significant performance >> improvement, I think the above demonstrates that it needs a lot of work. >> I know this is not new to the 2017-03 CF but it doesn't seem enough

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-03-04 Thread Peter Eisentraut
On 3/3/17 16:16, David Steele wrote: > While this looks like it could be a really significant performance > improvement, I think the above demonstrates that it needs a lot of work. > I know this is not new to the 2017-03 CF but it doesn't seem enough > progress has been made since posting to allow

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-03-03 Thread David Steele
On 2/13/17 8:59 PM, Haribabu Kommi wrote: > The current patch that I shared doesn't contains the plan and executor > changes to show > the performance benefit of the clustered index. we used custom plan to > generate the plan > for the clustered index. Currently I am working on it to rebase it to

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-02-13 Thread Haribabu Kommi
On Tue, Feb 14, 2017 at 2:57 AM, Konstantin Knizhnik < k.knizh...@postgrespro.ru> wrote: > Hi, > > I wonder if it is possible to somehow benchmark your clustered index > implementation. > I tried to create VCI index for lineitem table from TPC and run Q6 query. > After index creation Postgres is n

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-02-13 Thread Konstantin Knizhnik
Hi, I wonder if it is possible to somehow benchmark your clustered index implementation. I tried to create VCI index for lineitem table from TPC and run Q6 query. After index creation Postgres is not using parallel execution plan any more but speed of sequential plan is not changed and nothin

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-02-05 Thread Haribabu Kommi
On Fri, Feb 3, 2017 at 8:28 PM, Konstantin Knizhnik < k.knizh...@postgrespro.ru> wrote: > On 30.12.2016 06:55, Haribabu Kommi wrote: > > > Hi All, > > Fujitsu was interested in developing a columnar storage extension with > minimal > changes the server backend. > > > We in PostgresPRO are also ve

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-02-03 Thread Konstantin Knizhnik
On 30.12.2016 06:55, Haribabu Kommi wrote: Hi All, Fujitsu was interested in developing a columnar storage extension with minimal changes the server backend. We in PostgresPRO are also very interested in developing vertical storage (VS) for Postgres. And after considering many alternative

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-31 Thread Michael Paquier
On Fri, Dec 30, 2016 at 12:55 PM, Haribabu Kommi wrote: > Any Comments on the approach? I have moved this patch to CF 2017-03. -- Michael -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hacker

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-22 Thread Jim Nasby
On 1/16/17 10:09 PM, Haribabu Kommi wrote: Yes, that' correct. Currently with this approach, it is not possible to ditch the heap completely. This approach is useful for the cases, where the user wants to store only some columns as part of clustered index. Ahh, that's unfortunate. Billion row+

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-19 Thread Haribabu Kommi
On Wed, Jan 18, 2017 at 2:25 PM, Peter Eisentraut < peter.eisentr...@2ndquadrant.com> wrote: > On 12/29/16 10:55 PM, Haribabu Kommi wrote: > > Fujitsu was interested in developing a columnar storage extension with > > minimal > > changes the server backend. > > > > The columnar store is implemente

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-17 Thread Peter Eisentraut
On 12/29/16 10:55 PM, Haribabu Kommi wrote: > Fujitsu was interested in developing a columnar storage extension with > minimal > changes the server backend. > > The columnar store is implemented as an extension using index access > methods. > This can be easily enhanced with pluggable storage meth

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-16 Thread Haribabu Kommi
On Sun, Jan 8, 2017 at 2:01 PM, Jim Nasby wrote: > On 12/29/16 9:55 PM, Haribabu Kommi wrote: > >> The tuples which don't have multiple copies or frozen data will be moved >> from WOS to ROS periodically by the background worker process or autovauum >> process. Every column data is stored separat

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-16 Thread Haribabu Kommi
On Sun, Jan 8, 2017 at 4:20 AM, Bruce Momjian wrote: > On Fri, Dec 30, 2016 at 02:55:39PM +1100, Haribabu Kommi wrote: > > > > Hi All, > > > > Fujitsu was interested in developing a columnar storage extension with > minimal > > changes the server backend. > > > > The columnar store is implemented

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-07 Thread Jim Nasby
On 12/29/16 9:55 PM, Haribabu Kommi wrote: The tuples which don't have multiple copies or frozen data will be moved from WOS to ROS periodically by the background worker process or autovauum process. Every column data is stored separately in it's relation file. There is no transaction information

Re: [HACKERS] [WIP]Vertical Clustered Index (columnar store extension)

2017-01-07 Thread Bruce Momjian
On Fri, Dec 30, 2016 at 02:55:39PM +1100, Haribabu Kommi wrote: > > Hi All, > > Fujitsu was interested in developing a columnar storage extension with minimal > changes the server backend. > > The columnar store is implemented as an extension using index access methods. > This can be easily enha