Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Jeff Davis
On Tue, 2012-11-06 at 12:57 -0500, Tom Lane wrote: > That particular example can be handled perfectly well today, with > > select * from stream_table where tscol < 'whatever'; > > The FDW could be coded to throw an error if the query doesn't provide a > WHERE clause that constrains the time

Re: [HACKERS] Proposal for Allow postgresql.conf values to be changed via SQL

2012-11-06 Thread Amit Kapila
On Tuesday, November 06, 2012 11:30 PM Robert Haas wrote: > On Wed, Oct 31, 2012 at 8:17 AM, Magnus Hagander > wrote: > >> I'm not convinced we ever *had* a consensus on this. There were > >> proposals, but I'm not sure a majority ever bought into any one of > 'em. > > > > I thought there was a c

Re: [HACKERS] FDW for PostgreSQL

2012-11-06 Thread Tom Lane
=?iso-2022-jp?B?GyRCMlZFRBsoQiAbJEJMUBsoQg==?= writes: > ClassifyConditions creates new lists, local_conds and remote_conds, > which have cells which point RestrictInfo(s) in baserestrictinfo. > It doesn't copy RestrictInfo for new lists, but I think it's ok > because baserestrictinfo list itself

Re: [HACKERS] FDW for PostgreSQL

2012-11-06 Thread 花田 茂
On 2012/11/07, at 1:35, Tom Lane wrote: > >> Isn't it possible to pick-up only columns to be used in targetlist or >> local qualifiers, without modification of baserestrictinfo? > > What the doc means to suggest is that you can look through the > baserestrictinfo list and then record informatio

Re: [HACKERS] Update obsolete text in indexam.sgml

2012-11-06 Thread Etsuro Fujita
> From: Tom Lane [mailto:t...@sss.pgh.pa.us] > "Etsuro Fujita" writes: > > Agreed. However, I am concerned about the next comment in the current code: > > > /* > > * Our generic assumption is that the index pages will be read > > * sequentially, so they cost seq_page_cost each, not random_page

Re: [HACKERS] Update obsolete text in indexam.sgml

2012-11-06 Thread Tom Lane
"Etsuro Fujita" writes: > Agreed. However, I am concerned about the next comment in the current code: > /* > * Our generic assumption is that the index pages will be read > * sequentially, so they cost seq_page_cost each, not random_page_cost. > * ... > I think this assumption is completely

[HACKERS] WIP patch for hint bit i/o mitigation

2012-11-06 Thread Merlin Moncure
Following the sig is a first cut at a patch (written by Atri) that attempts to mitigate hint bit i/o penalty when many pages worth of tuples are sequentially written out with the same transaction id. There have been other attempts to deal with this problem that fit niche cases (especially those tha

Re: [HACKERS] RFC: Timing Events

2012-11-06 Thread Tom Lane
Josh Berkus writes: >> You can reduce the logging volume on busy servers with >> auto_explain.log_min_duration. You can also activate it for a single >> database user only by setting log_min_duration to -1 globally and >> change the setting for one user with ALTER ROLE SET, right? > Not accordin

Re: [HACKERS] RFC: Timing Events

2012-11-06 Thread Josh Berkus
> You can reduce the logging volume on busy servers with > auto_explain.log_min_duration. You can also activate it for a single > database user only by setting log_min_duration to -1 globally and > change the setting for one user with ALTER ROLE SET, right? Not according to the docs, you can't.

Re: [HACKERS] Doc patch, distinguish sections with an empty row in error code table

2012-11-06 Thread Karl O. Pinc
On 11/06/2012 01:40:56 PM, Robert Haas wrote: > Frankly, I don't view this as enough of a problem to be worth > spending > time on. Actually, I'm not sure I view the formatting of that table > as a problem at all, but if it is a problem it's not a big enough one > to justify knocking ourselves o

Re: [HACKERS] libpq

2012-11-06 Thread Claudio Freire
On Tue, Nov 6, 2012 at 7:25 PM, Tom Lane wrote: > Claudio Freire writes: >> Maybe anl libs / install-libs makefile target? > >> I've already faced the complicated procedure one has to go through to >> build and install only libpq built from source. > > The documentation already suggests > >

Re: [HACKERS] libpq

2012-11-06 Thread Tom Lane
Claudio Freire writes: > Maybe anl libs / install-libs makefile target? > I've already faced the complicated procedure one has to go through to > build and install only libpq built from source. The documentation already suggests gmake -C src/interfaces install Dunno that it's worth mor

Re: [HACKERS] libpq

2012-11-06 Thread Claudio Freire
On Tue, Nov 6, 2012 at 6:59 PM, Tom Lane wrote: >> If, instead, you are keen on getting the source code for libpq in a >> separate tarball, I'd seriously question why that would be expected to be >> valuable. On most systems, these days, it doesn't take terribly much time >> or space (on our syst

Re: [HACKERS] libpq

2012-11-06 Thread Tom Lane
Christopher Browne writes: > It seems not unusual for Linux distributions to supply libpq as part of a > archiver, or RPM, which uses cpio). AFAIK, it's standard to ship libpq plus minimum required supporting files in a postgresql-libs or similarly named package. Certainly the PGDG RPMs do it th

Re: [HACKERS] libpq

2012-11-06 Thread k...@rice.edu
On Tue, Nov 06, 2012 at 04:04:51PM -0500, Christopher Browne wrote: > It seems not unusual for Linux distributions to supply libpq as part of a > separate package (whether via dpkg, which I think uses "ar" as the > archiver, or RPM, which uses cpio). > > Possibly this is already provided on your s

Re: [HACKERS] libpq

2012-11-06 Thread Christopher Browne
It seems not unusual for Linux distributions to supply libpq as part of a separate package (whether via dpkg, which I think uses "ar" as the archiver, or RPM, which uses cpio). Possibly this is already provided on your system via some means akin to those. If, instead, you are keen on getting the

Re: [HACKERS] Failing SSL connection due to weird interaction with openssl

2012-11-06 Thread Robert Haas
On Tue, Oct 23, 2012 at 4:09 AM, Lars Kanis wrote: > While investigating a ruby-pg issue [1], we noticed that a libpq SSL > connection can fail, if the running application uses OpenSSL for other work, > too. Root cause is the thread local error queue of OpenSSL, that is used to > transmit textual

Re: [HACKERS] Doc patch, distinguish sections with an empty row in error code table

2012-11-06 Thread Karl O. Pinc
On 11/06/2012 01:40:56 PM, Robert Haas wrote: > On Mon, Nov 5, 2012 at 10:41 PM, Karl O. Pinc wrote: > > So at this point I'm out of ideas. Unless somebody > > can chime in with a clue I'm ready to give up. > > Frankly, I don't view this as enough of a problem to be worth > spending > time on.

[HACKERS] libpq

2012-11-06 Thread Stefan
Would it be possible to provide libpq in separate tarbal or is that too much to ask for ? Thank you! Kind regards Stefan -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Doc patch, distinguish sections with an empty row in error code table

2012-11-06 Thread Robert Haas
On Mon, Nov 5, 2012 at 10:41 PM, Karl O. Pinc wrote: > So at this point I'm out of ideas. Unless somebody > can chime in with a clue I'm ready to give up. Frankly, I don't view this as enough of a problem to be worth spending time on. Actually, I'm not sure I view the formatting of that table a

Re: [HACKERS] Pg_upgrade speed for many tables

2012-11-06 Thread Bruce Momjian
On Mon, Nov 5, 2012 at 03:08:17PM -0500, Bruce Momjian wrote: > Magnus reported that a customer with a million tables was finding > pg_upgrade slow. I had never considered many table to be a problem, but > decided to test it. I created a database with 2k tables like this: > > CREATE TABLE

Re: [HACKERS] the number of pending entries in GIN index with FASTUPDATE=on

2012-11-06 Thread Robert Haas
On Tue, Nov 6, 2012 at 1:01 PM, Tom Lane wrote: > Robert Haas writes: >> On Fri, Nov 2, 2012 at 12:48 PM, Fujii Masao wrote: >>> Is there the way to know the number of pending entries in GIN index which >>> was created with FASTUPDATE = on? If not, is it worth implementing the >>> function retur

Re: [HACKERS] Doc patch, distinguish sections with an empty row in error code table

2012-11-06 Thread Karl O. Pinc
Note: This email is not immediately relevant to Postgres, although someday it may be. On 11/06/2012 11:38:07 AM, Andrew Dunstan wrote: > > On 11/06/2012 12:09 PM, Karl O. Pinc wrote: > >> > >>> Postgresql uses Docbook 4.2 and openjade/dsssl style sheets. > I don't recall what the arguments again

Re: [HACKERS] the number of pending entries in GIN index with FASTUPDATE=on

2012-11-06 Thread Tom Lane
Robert Haas writes: > On Fri, Nov 2, 2012 at 12:48 PM, Fujii Masao wrote: >> Is there the way to know the number of pending entries in GIN index which >> was created with FASTUPDATE = on? If not, is it worth implementing the >> function returning that number? > Seems useful to me. Seems like th

Re: [HACKERS] Proposal for Allow postgresql.conf values to be changed via SQL

2012-11-06 Thread Robert Haas
On Wed, Oct 31, 2012 at 8:17 AM, Magnus Hagander wrote: >> I'm not convinced we ever *had* a consensus on this. There were >> proposals, but I'm not sure a majority ever bought into any one of 'em. > > I thought there was a consensus. But given that the one I thought we > had consensus on was dif

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Tom Lane
Jeff Davis writes: > On Tue, 2012-11-06 at 09:19 +0100, Ronan Dunklau wrote: >> If you don't mind, do you have a specific use-case for this ? > Let's say that your remote data source is a stream of data that is not > actually being stored anywhere, e.g. network events. The data you want > to retr

Re: [HACKERS] Doc patch, distinguish sections with an empty row in error code table

2012-11-06 Thread Andrew Dunstan
On 11/06/2012 12:09 PM, Karl O. Pinc wrote: Postgresql uses Docbook 4.2 and openjade/dsssl style sheets. Is there even a remote chance for you to migrate to XSL stylesheets ? I'm not sure the DSSL ones are maintained at all at this point, so improvements, fixes, and customizations are much ea

Re: [HACKERS] Doc patch, distinguish sections with an empty row in error code table

2012-11-06 Thread Karl O. Pinc
On 11/05/2012 09:41:13 PM, Karl O. Pinc wrote: > > The attached patch, errorcode_table_v2.patch, is an attempt to > do it the right way. Since I'm stuck I asked about this patch on the docbook-apps mailing list. https://lists.oasis-open.org/archives/docbook-apps/201211/msg00027.html I got the f

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Tom Lane
Jeff Davis writes: > On Tue, 2012-11-06 at 10:55 -0500, Tom Lane wrote: >> I'd also opine that the FDW APIs are pretty darn heavyweight for an SRF. >> There might be a small number of SRFs for which it's actually worth >> dealing with the planner in full generality, but surely not very many. > I

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Jeff Davis
On Tue, 2012-11-06 at 10:55 -0500, Tom Lane wrote: > I'd also opine that the FDW APIs are pretty darn heavyweight for an SRF. > There might be a small number of SRFs for which it's actually worth > dealing with the planner in full generality, but surely not very many. I was not suggesting that we

Re: [HACKERS] the number of pending entries in GIN index with FASTUPDATE=on

2012-11-06 Thread Robert Haas
On Fri, Nov 2, 2012 at 12:48 PM, Fujii Masao wrote: > Is there the way to know the number of pending entries in GIN index which > was created with FASTUPDATE = on? If not, is it worth implementing the > function returning that number? > > I sometimes would like to know that number when I measure h

Re: [HACKERS] FDW for PostgreSQL

2012-11-06 Thread Tom Lane
Kohei KaiGai writes: > 2012/11/6 Shigeru HANADA : >> Indeed postgresql_fdw touches baserestrictinfo in GetForeignRelSize, but >> it's because of optimization for better width estimate. The doc Fujita-san >> pointed says that: >>> The actual identification of such a clause should happen during >>

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Pavel Stehule
2012/11/6 Jeff Davis : > On Tue, 2012-11-06 at 09:19 +0100, Ronan Dunklau wrote: >> Maybe you could set some options on the foreign table before selecting >> from it ? >> Another way you could achieve the same result would be to give some >> column a special meaning (like it is done in the twitter_

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Jeff Davis
On Tue, 2012-11-06 at 09:19 +0100, Ronan Dunklau wrote: > Maybe you could set some options on the foreign table before selecting > from it ? > Another way you could achieve the same result would be to give some > column a special meaning (like it is done in the twitter_fdw for > example). > > > I

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Jeff Davis
On Tue, 2012-11-06 at 09:39 +0100, Dimitri Fontaine wrote: > Jeff Davis writes: > > Take something as simple as generate_series: right now, it materializes > > the entire thing if it's in the FROM clause, but it wouldn't need to if > > it could use the foreign table mechanism. > > So, my understa

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Jeff Davis
On Tue, 2012-11-06 at 08:35 +, Simon Riggs wrote: > Tom is complaining about conflating the two features, which does seem > unnecessary. But we can still merge code. That's a good way to put it. > Providing run-time parameters or table-level options to Foreign Scans > seems sensible. I can se

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Tom Lane
Simon Riggs writes: > (On another thought: why do Foreign Scans get to avoid the > materialization we hate with SRFs?) [ shrug... ] That works both ways. If it would be convenient for an FDW to return a tuplestore, which is hardly unlikely, it's out of luck; it has to do the expansion itself.

Re: [HACKERS] MySQL search query is not executing in Postgres DB

2012-11-06 Thread Robert Haas
On Thu, Aug 30, 2012 at 9:13 AM, Robert Haas wrote: >> Upthread you were complaining about how we'd reject calls even when >> there was only one possible interpretation. I wonder whether there'd be >> any value in taking that literally: that is, allow use of assignment >> rules when there is, in

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Tom Lane
Dimitri Fontaine writes: > Jeff Davis writes: >> Take something as simple as generate_series: right now, it materializes >> the entire thing if it's in the FROM clause, but it wouldn't need to if >> it could use the foreign table mechanism. > So, my understanding of your proposal is that a good

Re: [HACKERS] [PATCH] Prefetch index pages for B-Tree index scans

2012-11-06 Thread John Lumby
Bruce Momjian wrote: > > On Fri, Nov 2, 2012 at 09:59:08AM -0400, John Lumby wrote: > > However,the OP describes an implementation based on libaio. > > Today what we have (for linux) is librt, which is quite different. > > Well, good thing we didn't switch to using libaio, now that it is gone

[HACKERS] File Corruption recovery

2012-11-06 Thread m...@rpzdesign.com
I have been working on external replication on Postgresql 9.2 for a little while (with too many interruptions blocking my progress!) Who knows a good utility to aggressively analyze and recover Postgresql Databases? It seems the standard reply that I see is "Make regular backups", but that guar

Re: [HACKERS] Proposal [modified] for Allow postgresql.conf values to be changed via SQL

2012-11-06 Thread Amit Kapila
Based on feedback in this mail chain, please find the modified method to have this feature: Syntax for Command: 1. Have SQL command to change the configuration parameter values: ALTER SYSTEM SET configuration_parameter {TO | =} {value, | 'value'} COMMENT 'value'; 2. Have built-in to change

Re: [HACKERS] FDW for PostgreSQL

2012-11-06 Thread Kohei KaiGai
2012/11/6 Shigeru HANADA : > Sorry for delayed response. > > On Sun, Oct 21, 2012 at 3:16 AM, Kohei KaiGai wrote: >> >> 2012/10/11 Etsuro Fujita : >> >>> I've reviewed your patch quickly. I noticed that the patch has been >>> created in >>> a slightly different way from the guidelines: >>> http:/

Re: [HACKERS] FDW for PostgreSQL

2012-11-06 Thread Shigeru HANADA
Sorry for delayed response. On Sun, Oct 21, 2012 at 3:16 AM, Kohei KaiGai wrote: 2012/10/11 Etsuro Fujita : I've reviewed your patch quickly. I noticed that the patch has been created in a slightly different way from the guidelines: http://www.postgresql.org/docs/devel/static/fdw-planning.htm

Re: [HACKERS] RFC: Timing Events

2012-11-06 Thread Albe Laurenz
Josh Berkus wrote: >> Huh? The typical use-case is to enable it for all sessions by >> including it in shared_preload_libraries. That doesn't require any >> particular session to be superuser. (If you're superuser you can then >> turn it *off* in your session, should you wish.) > > It's not pra

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Simon Riggs
On 6 November 2012 06:09, Jeff Davis wrote: > On Sun, 2012-11-04 at 15:13 -0500, Tom Lane wrote: >> Jeff Davis writes: >> > Is there any fundamental or philosophical reason why a foreign table >> > can't accept arguments? >> >> That isn't a table; it's some sort of function. Now that we have >>

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Dimitri Fontaine
Jeff Davis writes: > Take something as simple as generate_series: right now, it materializes > the entire thing if it's in the FROM clause, but it wouldn't need to if > it could use the foreign table mechanism. So, my understanding of your proposal is that a good way to implement streaming SRF wo

Re: [HACKERS] Arguments to foreign tables?

2012-11-06 Thread Ronan Dunklau
Maybe you could set some options on the foreign table before selecting from it ? Another way you could achieve the same result would be to give some column a special meaning (like it is done in the twitter_fdw for example). If you don't mind, do you have a specific use-case for this ? -- Ronan Du