Re: [HACKERS] UPDATE SET (a,b,c) = (SELECT ...) versus rules

2014-06-17 Thread Martijn van Oosterhout
NSERT INTO foolog VALUES (bar.a, bar.b, ...) Or am I missing something? Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhau

Re: [HACKERS] Minmax indexes

2014-06-21 Thread Martijn van Oosterhout
to a minmax structure which only indexes whole pages it could be quite efficient. > One problem with such a generalized implementation would be, that I'm > not sure in-place modification of the "compressed set" on-disk can be > assumed to be safe on all cases. Surely, for str

Re: [HACKERS] Can simplify 'limit 1' with slow function?

2014-07-01 Thread Martijn van Oosterhout
CT s > from road order by c limit 1) as a; > There are about 7000 records in 'road'. I think to help here I think we need the EXPLAIN ANALYSE output for both queries. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses the

Re: [HACKERS] Escaping from blocked send() reprised.

2014-07-01 Thread Martijn van Oosterhout
start, the kernel returns ERESTARTHAND (IIRC) and the libc will redo the call internally. Default BSD does not return EINTR normally, but supports sigaction(). Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very ou

Re: [HACKERS] Can simplify 'limit 1' with slow function?

2014-07-02 Thread Martijn van Oosterhout
On Tue, Jul 01, 2014 at 02:36:55PM -0500, Merlin Moncure wrote: > On Tue, Jul 1, 2014 at 2:16 PM, Martijn van Oosterhout > wrote: > > On Sun, Jun 29, 2014 at 10:05:50PM +0800, gotoschool6g wrote: > >> The simplified scene: > >> select slowfunction(s) from a order b

Re: [HACKERS] Can simplify 'limit 1' with slow function?

2014-07-02 Thread Martijn van Oosterhout
On Wed, Jul 02, 2014 at 04:17:13PM -0400, Tom Lane wrote: > David G Johnston writes: > > Martijn van Oosterhout wrote > >> I'm probably dense, but I'm not sure I understand. Or it is that the > >> slowfunction() is called prior to the sort? That seems ins

Re: [HACKERS] Can simplify 'limit 1' with slow function?

2014-07-03 Thread Martijn van Oosterhout
y well that it's expensive, it just doesn't appear to understand it has the option of moving the calculation above the limit. In this case though, it seems an index on road(id) would make it instant in any case. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] better atomics - v0.5

2014-07-11 Thread Martijn van Oosterhout
uch easier to optimise for. I strongly recommend the "Atomic Weapons" talk on the C11 memory model to help understand how they work. As a bonus it includes correct implementations for the major architectures. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He

Re: [HACKERS] SQL MERGE is quite distinct from UPSERT

2014-07-20 Thread Martijn van Oosterhout
eful too. FWIW, I agree. MERGE is hard enough as it is, but trying to guarentee some kind of atomicity makes it nigh on impossible. Indeed, after reading what you wrote I think it may well be impossible to make it atomic *and* make it perform in the general case. So, +1 UPSERT. Have a nice day, --

Re: [HACKERS] WAL logging problem in 9.4.3?

2015-07-21 Thread Martijn van Oosterhout
robably won't be a serious problem though. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Making strxfrm() blobs in indexes work

2014-02-12 Thread Martijn van Oosterhout
ld make a noticable difference if it can be made to work. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] HBA files w/include support?

2014-02-15 Thread Martijn van Oosterhout
ncern. This is not an important feature for me though: the config file is generated by puppet with a bunch of loops and an include directory would not really reduce the amount of work. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses t

Re: ALTER SYSTEM SET command to change postgresql.conf parameters (RE: [HACKERS] Proposal for Allow postgresql.conf values to be changed via SQL [review])

2013-08-20 Thread Martijn van Oosterhout
r settings. Comment it out, ALTER SYSTEM stop working. Put it back and it's immediately clear what it means. And the user can control where the settings go. Syntax is a bit fugly though. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confe

Re: ALTER SYSTEM SET command to change postgresql.conf parameters (RE: [HACKERS] Proposal for Allow postgresql.conf values to be changed via SQL [review])

2013-08-24 Thread Martijn van Oosterhout
ing to it, like allow user to change it, > handling and defining of that will be bit complex. Letting the user configure the location seems like common curtesy. Note this line isn't in itself a GUC, so you can't configure it via ALTER SYSTEM. Have a nice day, -- Martijn van Oosterhou

Re: [HACKERS] UTF8 national character data type support WIP patch and list of open issues.

2013-09-20 Thread Martijn van Oosterhout
dings, that I can remember anyway. So rather than this whole NCHAR thing, why not just add a type "sjistext", and a few type casts and call it a day... Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very

Re: [HACKERS] record identical operator - Review

2013-09-20 Thread Martijn van Oosterhout
med. Something like: SELECT foo OPERATOR("byte_equivalent") bar; is simultaneously obscure, yet clear. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much impor

Re: [HACKERS] Add min and max execute statement time in pg_stat_statement

2013-10-23 Thread Martijn van Oosterhout
stribution it is, these are useful numbers. If I had to guess a distribution for query runtimes I'd go for Poisson, which would mean you'd expect the mean to equal the variance. Don't have enough experience with such measurements to say whether that is reasonable. Have a nice day, --

Re: [HACKERS] logical column order and physical column order

2013-11-03 Thread Martijn van Oosterhout
ves for the full story. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] [GENERAL] pg_dump -s dumps data?!

2012-01-31 Thread Martijn van Oosterhout
default. Just throwing out some completely different ideas. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Our regex vs. POSIX on "longest match"

2012-03-05 Thread Martijn van Oosterhout
lar expressions as a specialised parsing language where you can configure a state machine to process your strings. Not ideal, but predicatable. The question is, what are users expecting of the PostgreSQL regex implementation? Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ &

Re: [HACKERS] pgsql_fdw, FDW for PostgreSQL server

2012-03-10 Thread Martijn van Oosterhout
ing custom constructs. They have compilers for 11 different database engines, so it seems flexible enough. Mind you, they also handle DDL mapping (where most of the variation is) and datatype translations, which seems a lot further than we need here. Have a nice day, -- Martijn van Oosterhout

Re: [HACKERS] sortsupport for text

2012-03-19 Thread Martijn van Oosterhout
st for interest I looked at the ICU API for this and they have the same restriction. There is another function which you can use to return partial sort keys (ucol_nextSortKeyPart) but it produces "uncompressed sortkeys", which it seems is what Mac OSX is doing, which seems useless for o

Re: [HACKERS] Re: Cross-backend signals and administration (Was: Re: pg_terminate_backend for same-role)

2012-03-27 Thread Martijn van Oosterhout
ode and teach the various input layers (like SSL) to handle the EINTR case. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Combo xids

2013-06-01 Thread Martijn van Oosterhout
7;t throw away the xmin because you need it to prove that A can't see the tuple. Or is the idea to create multixacts for each combination of xmin/xmax encountered? And the assumption is that there aren't that many? That could be measured. Have a nice day, -- Martijn van Oosterhout

Re: [HACKERS] Which table stored in which file in PGDATA/base/[db-oid]

2013-06-01 Thread Martijn van Oosterhout
and index is stored in a separate file. For ordinary relations, these files are named after the table or index's filenode number, which can be found in pg_class.relfilenode. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses

Re: [HACKERS] Which table stored in which file in PGDATA/base/[db-oid]

2013-06-01 Thread Martijn van Oosterhout
t database? Kan you list the filenames? Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Vacuum, Freeze and Analyze: the big picture

2013-06-03 Thread Martijn van Oosterhout
viour. The solution, as usual, is to make it more aggressive, so the kernel background writer triggers at 1% memory. I'm not saying that's the problem here, but it is an example of a situation where the write queue can become very large very quickly. Have a nice day, -- Martijn van Oosterh

Re: [HACKERS] Batch API for After Triggers

2013-06-09 Thread Martijn van Oosterhout
_event_num % 1) == 0 || tg_event_num == tg_tot_num_events Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Hard to Use WAS: Hard limit on WAL space

2013-06-15 Thread Martijn van Oosterhout
r annoyance is that in recent version of PostgreSQL you have to give check_postgres admin rights, otherwise it can't warn you about "idle in transaction" problems.) Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses th

Re: [HACKERS] plpython implementation

2013-06-30 Thread Martijn van Oosterhout
rl does provide a sandbox, hence you can have two interpreters in a single backend. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- A

Re: [HACKERS] plpython implementation

2013-06-30 Thread Martijn van Oosterhout
/pipermail/python-dev/2009-February/086401.html If you read through it I think you will understand the difficulties. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much imp

Re: [HACKERS] How to implement Gin method?

2013-07-07 Thread Martijn van Oosterhout
ch are difficult any other way, like full-text search. If you give some idea of what you'd like to index then we can give an idea of what the functions should do. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very

Re: [HACKERS] How to implement Gin method?

2013-07-08 Thread Martijn van Oosterhout
of the query argument passed to extractQuery and consistent is whatever is specified as the right-hand input type of the class member operator identified by the strategy number. This need not be the same as the item type, so long as key values of the correct type can be

Re: [HACKERS] Patch to add support of "IF NOT EXISTS" to others "CREATE" statements

2013-07-14 Thread Martijn van Oosterhout
it is parsing. Bison only has one token lookahead and if that's not enough you get errors. BTW, bison dumps a large file describing all its states that you should be able to work out from that where the exact problem lies. Have a nice day, -- Martijn van Oosterhout http://svana.org/klep

Re: [HACKERS] pg_memory_barrier() doesn't compile, let alone work, for me

2013-07-16 Thread Martijn van Oosterhout
lers that don't support it. [1] http://en.wikipedia.org/wiki/Sequential_consistency There are places where you put code in and verify it does what you want. With this one you can put test programs in and it can tell you all possibly results due to memory reordering. http://svr-pes20-cpp

Re: [HACKERS] Proposal - Support for National Characters functionality

2013-07-16 Thread Martijn van Oosterhout
with unicode characters this might be acceptable. [1] Python does a similar trick to handle filenames coming from disk in an unknown encoding: http://docs.python.org/3/howto/unicode.html#files-in-an-unknown-encoding Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He

Re: [HACKERS] improve Chinese locale performance

2013-07-28 Thread Martijn van Oosterhout
mance I have no idea. The main issue with strxfrm() is its lame API. If it supported returning prefixes you'd be set, but as it is you need >10MB of memory just to transform a 10MB string, even if only the first few characers would be enough to sort... Mvg, -- Martijn van Oosterhout

Re: [HACKERS] Clock sweep not caching enough B-Tree leaf pages?

2015-04-15 Thread Martijn van Oosterhout
nd use that to drive your divisor, so if you have a lots of allocations you become more aggressive about reducing the counts. Or if the load is light fall back to just subtracting one. Then you don't need a cap at all. (Apologies if this has been suggested before, Google didn't find anyth

Re: [HACKERS] upper planner path-ification

2015-05-14 Thread Martijn van Oosterhout
w that fast. I think it may be better to have each path track the relids and aggregates it covers, but then you need to have an efficient way to work out which rels/aggregates can be considered for each path. Either sounds it sounds like quite a planner overhaul. Hope this helps, -- Martijn va

Re: [HACKERS] On partitioning

2014-08-31 Thread Martijn van Oosterhout
me, so you couldn't have two "live repartitionings" happening simultaneously. Now, if you want to close the door on online repartitioning forever then that fine. But being in the position of having to say "yes our partitioning scheme sucks, but we would have to take the database d

Re: [HACKERS] On partitioning

2014-09-02 Thread Martijn van Oosterhout
On Tue, Sep 02, 2014 at 09:44:17AM -0400, Bruce Momjian wrote: > On Sun, Aug 31, 2014 at 10:45:29PM +0200, Martijn van Oosterhout wrote: > > There is one situation where you need to be more flexible, and that is > > if you ever want to support online repartitioning. To do that

Re: [HACKERS] Aussie timezone database changes incoming

2014-09-14 Thread Martijn van Oosterhout
eople > will be cheering than screaming. Indeed, this has been a pain in the ass for a long long time. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importanc

Re: [HACKERS] Collations and Replication; Next Steps

2014-09-17 Thread Martijn van Oosterhout
ctly so many of the push-ups FreeBSD does are no longer necessary. It is often faster than glibc and the key sizes for strxfrm are more compact [1] which is relevent for the recent optimisation patch. Lets solve this problem for once and for all. [1] http://site.icu-project.org/charts/collation

Re: [HACKERS] Collations and Replication; Next Steps

2014-09-17 Thread Martijn van Oosterhout
like > to apply it to a branch and start playing with it. http://people.freebsd.org/~girgen/postgresql-icu/README.html http://people.freebsd.org/~girgen/postgresql-icu/ Note I said optional. It is a large library for sure, but for some installations I think the benefits are sufficient. Mvg,

Re: [HACKERS] Collations and Replication; Next Steps

2014-09-18 Thread Martijn van Oosterhout
nk this is surely a problem. Only if we're thinking of distributing it. If the user gets ICU from their distribution then there is no need to list the licence (just like we don't need to mention the licence of glibc). We only need link against it, not distribute it. Have a nice day,

Re: [HACKERS] Anonymous code block with parameters

2014-09-18 Thread Martijn van Oosterhout
; using pg_temp schema. Umm, IIRC it used to work that way but was changed to work like this. IIRC the reason was that anyone can create functions in the temp tablespace and thus hijack other functions that more priviledged functions might call. Or something like that. I think it was even a CVE.

Re: [HACKERS] Collations and Replication; Next Steps

2014-09-18 Thread Martijn van Oosterhout
, ICU doesn't require configuration just like glibc doesn't require configuration. Mvg, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. --

Re: [HACKERS] [PATCH] add ssl_protocols configuration option

2014-10-22 Thread Martijn van Oosterhout
cipher list, couldn't you just add -SSLv3 to the cipher list and be done? Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] [PATCH] add ssl_protocols configuration option

2014-10-22 Thread Martijn van Oosterhout
On Wed, Oct 22, 2014 at 09:36:59PM +0200, Dag-Erling Smørgrav wrote: > Martijn van Oosterhout writes: > > Dag-Erling Smørgrav writes: > > > If I understand correctly, imaps has been shown to be vulnerable as > > > well, so I wouldn't be so sure. > > Refer

Re: [HACKERS] Enabling Checksums

2012-12-20 Thread Martijn van Oosterhout
nyway is useful. It won't pin down the exact error, but it will tell you where to look and help find the non-obvious corruption (so you can possibly fix it by hand). Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at t

Re: [HACKERS] Rethinking representation of sort/hash semantics in queries and plans

2010-11-28 Thread Martijn van Oosterhout
nulls-first flag > > * A btree opfamily plus direction and nulls-first flags Sounds like a good idea to me. Quite aside from the performance issues, having one way to represent things will make it clearer what's going on and easier to extend in the future. Have a nice day, -- M

Re: [HACKERS] Report: Linux huge pages with Postgres

2010-11-28 Thread Martijn van Oosterhout
cache, but only just. Memory access is expensive. I think if you got good statistics on how much time your CPU is waiting for memory it'd be pretty depressing. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first

Re: [HACKERS] Idle git question: how come so many "objects"?

2010-11-30 Thread Martijn van Oosterhout
e and four for the directories. What the delta is for I don't know. Perhaps some of the diffs were the same between branches and these got merged? Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism

Re: [HACKERS] proposal : cross-column stats

2010-12-12 Thread Martijn van Oosterhout
>differ significantly (may help if most of the values are indendent, >but there's a small glitch somewhere). Comrpessing that grid would be useful, given that for many dimensions most of the grid will be not interesting. In fact, storing the 20 largest values may be enough. Wo

Re: [HACKERS] can shared cache be swapped to disk?

2010-12-19 Thread Martijn van Oosterhout
mory so large that you're creating significant memory pressure, otherwise the kernel might choose to swap our your shared memory rather than say the webserver. Your shared memory should be reasonably sized, but you should make sure the kernel has enough "cache" memory it can throw a

Re: [HACKERS] Extensions, patch v20 (bitrot fixes)

2010-12-20 Thread Martijn van Oosterhout
gt; > > > Why is it necessary to have such a parameter at all? > > UTF-8 is not a superset of all encodings. I think you mean Unicode is not a superset of all character sets. I've heard this before but never found what's missing. [citation needed]? Have a nice day, -- Martijn va

Re: [HACKERS] bug in SignalSomeChildren

2010-12-20 Thread Martijn van Oosterhout
call so the userspace process doesn't notice. This has been a bug since forever though, so I wouldn't hold my breath. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism, > when hate for p

Re: [HACKERS] Extensions, patch v20 (bitrot fixes)

2010-12-20 Thread Martijn van Oosterhout
tual lists of characters that can't be converted. ISTM that since all the mapping tables are public it should be a SMOP to *prove* roundtrip conversions are safe, or identify the problems. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of yo

Re: [HACKERS] knngist - 0.8

2010-12-28 Thread Martijn van Oosterhout
erations, but I can't think of any at the moment. Actually, perhaps you could use it with ints/floats/etc as well, since you could skip the function call overhead. You'd be trading (n log n int compares + n sortkeys) with (n log n comparisions). Just some thoughts, Have a nice day, -- M

Re: [HACKERS] "writable CTEs"

2010-12-29 Thread Martijn van Oosterhout
sions, so that each page in the docs could reference the equivalent page in other versions. That would be extremely useful when trying to work out what works in your particular version. I've never done anything serious with SGML, but it'd be cool if it was possible. Have a nice day, --

Re: [HACKERS] can shared cache be swapped to disk?

2011-01-04 Thread Martijn van Oosterhout
cessed very often and the kernel thinks it's better used somewhere else, it may be right. Repeatable test cases in this area are really hard. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism, >

Re: [HACKERS] WIP: Range Types

2011-01-11 Thread Martijn van Oosterhout
at the output function must be able to determine itself what kind of Datum it is dealing with. Thought experiment: the datum is an integer, but the oid says it's a pass-by-ref datum. Now the code may now to use the integer to derefence an arbitrary place in memory. Have a nice day, -- Martijn v

Re: [HACKERS] arrays as pl/perl input arguments [PATCH]

2011-01-13 Thread Martijn van Oosterhout
Class; sub TIESCALAR { my $class = shift; my $self = shift; return bless $self, $class; } sub FETCH { my $self = shift; return join(",", @$self); } my @a=(1,2); tie $a, "MyClass", \@a; print "\$a='$a'\n"; print "\$a[0]='$a[0]'\n

Re: [HACKERS] limiting hint bit I/O

2011-01-15 Thread Martijn van Oosterhout
be frozen goes down, so they should cancel somewhat. To avoid rewriting pages multiple times, if one tuple can be frozen on a page, we should freeze as many as possible, but the logic may do that already. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is w

Re: [HACKERS] texteq/byteaeq: avoid detoast [REVIEW]

2011-01-19 Thread Martijn van Oosterhout
ow much and whether it makes hash join unfeasible. I doubt it, since by definition it must be faster than strcoll(). I suppose a test would be interesting. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nation

Re: [HACKERS] Considering Gerrit for CFs

2013-02-06 Thread Martijn van Oosterhout
ks alright. You'll want to run a Postgres database next to it for storing the actual reviews and such. It's a nice tool and integrates reasonably well with other thing. We have a bot connected to it which sends messages on IRC in response to various state changes. I've never se

Re: [HACKERS] Interesting post-mortem on a near disaster with git

2013-03-24 Thread Martijn van Oosterhout
a backup. RAID, ZFS, and version control are all not backups. Taking a tarball of the entire repository and storing it on a different machine would solve just about any problem you can think of in this area. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who wri

Re: [HACKERS] Inconsistent DB data in Streaming Replication

2013-04-19 Thread Martijn van Oosterhout
that it can close() completely. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Substituting Checksum Algorithm (was: Enabling Checksums)

2013-04-30 Thread Martijn van Oosterhout
application sent. It appears SCSI has standardised on a CRC-16 checksum with polynomial 0x18bb7 . http://www.t10.org/ftp/t10/document.03/03-290r0.pdf https://oss.oracle.com/~mkp/docs/dix-draft.pdf Not directly relavent to PostgreSQL now, but possibly in the future. Have a nice day, -- Martijn va

Re: [HACKERS] about index inheritance

2013-05-08 Thread Martijn van Oosterhout
ey. Since each value can only possibly appear in one table your locking problems vanish. The question is: how often does this happen? Hope this helps, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does

Re: [HACKERS] spinlock->pthread_mutex : real world results

2012-08-06 Thread Martijn van Oosterhout
om/ml/os.dragonfly-bsd.kernel/2003-10/msg00232.html Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Rules and WITH and LATERAL

2012-08-20 Thread Martijn van Oosterhout
good guide to optimise WITH statements. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Oid registry

2012-09-25 Thread Martijn van Oosterhout
that if present. If you don't like cast, allow other extensions to define a function to_json_hook(yourtype) -> json which is used. Hardcoding IDs in extensions just doesn't seem right somehow... (Hmm, I see someone else in the thread pointed this out too). Have a nice day, -- Martijn van

Re: [HACKERS] Hash id in pg_stat_statements

2012-10-02 Thread Martijn van Oosterhout
queries in your system end up having the same hash is miniscule. Like mentioned elsewhere, a system with more than 10,000 different queries sounds rare to me (once you exclude query parameters ofcourse). Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes care

Re: [HACKERS] do we EXEC_BACKEND on Mac OS X?

2012-10-03 Thread Martijn van Oosterhout
ossible. A simple solution would be to use pthread_atfork() to register a handler that puts the socket into an invalid state in either the parent or the child. http://pubs.opengroup.org/onlinepubs/009695399/functions/pthread_atfork.html Ofcourse, the backward compatabilty issues prevent us doin

Re: [HACKERS] Detecting libpq connections improperly shared via fork()

2012-10-09 Thread Martijn van Oosterhout
would probably be sufficient, since that's what every program is going to start with. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] Bugs in planner's equivalence-class processing

2012-10-17 Thread Martijn van Oosterhout
ly haven't written these kinds of queries so I'm not affected, but I don't like the idea of known bugs being unfixed. It's a pity we can't have a system that can somehow independantly checks the results of the planner Have a nice day, -- Martijn van Oosterhout http

Re: [HACKERS] Successor of MD5 authentication, let's use SCRAM

2012-10-21 Thread Martijn van Oosterhout
ance issues I'd suggest defaulting to SSL everywhere transparently with ephemeral certs. It would protect against any number of passive attacks. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that

Re: [HACKERS] Memory leaks in record_out and record_send

2012-11-13 Thread Martijn van Oosterhout
his is all handwaving, but it might a nice project for someone interested in learning to hack postgres. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to his own thoughts. -- Arthur Schopenhauer signature.asc Description: Digital signature

Re: [HACKERS] review: More frame options in window functions

2010-02-11 Thread Martijn van Oosterhout
ract(). A difficulty may be that the arguments to these functions are not obvious as in the (timestamp,interval) case, but if there is only one suitable possibility I think this can be made to work. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Please line up in a tre

Re: [HACKERS] LISTEN/NOTIFY versus encoding conversion

2010-02-15 Thread Martijn van Oosterhout
e of the reasons why it got limited was because we couldn't decide. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Please line up in a tree and maintain the heap invariant while > boarding. Thank you for flying nlogn airlines. signature.asc Description: Digital signature

Re: [HACKERS] PostgreSQL::PLPerl::Call - Simple interface for calling SQL functions from PostgreSQL PL/Perl

2010-02-16 Thread Martijn van Oosterhout
ferences), but they are not the same. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Please line up in a tree and maintain the heap invariant while > boarding. Thank you for flying nlogn airlines. signature.asc Description: Digital signature

Re: [HACKERS] Set LC_COLLATE to de_DE_phoneb

2010-04-10 Thread Martijn van Oosterhout
will give you alternate sort orders and even custom sort orders. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism, > when hate for people other than your own comes first. >

Re: [HACKERS] pg_ctl stop -m immediate on the primary server inflates sequences

2010-04-10 Thread Martijn van Oosterhout
on a normal shutdown it writes out the actual value. When you say "immediate" you mean "right now, don't bother with anything not important", like for example gaps in sequences. You're essentially crashing the DB. Have a ncie day, -- Martijn van Oosterhout http:/

Re: [HACKERS] Last gasp

2012-04-12 Thread Martijn van Oosterhout
asier, like testing: does this patch cherry-pick cleanly or is there a conflict. No merge commits, just using git purely as patch storage. (Note to make this work it has a git server emulation which may or may not be easy to do, but it's just a thought about workflow.) Have a nice day, -- Martij

Re: [HACKERS] libpq compression

2012-06-18 Thread Martijn van Oosterhout
... So unless the openssl includes the code twice there must be a way to extract the list from the library. Have a nice ay, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not attach much importance to h

Re: [HACKERS] Pg default's verbosity?

2012-06-19 Thread Martijn van Oosterhout
produced by pg_dump that would make a successful restore of a dump produce barely any output at all with -q. That would make errors significantly more visible. Not sure how to go about that though. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes c

Re: [HACKERS] why roll-your-own s_lock? / improving scalability

2012-06-26 Thread Martijn van Oosterhout
support it.) Seems not very well tested in any case. It might be worthwhile testing futexes on Linux though, they are specifically supported on any kind of shared memory (shm/mmap/fork/etc) and quite well tested. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who

Re: [HACKERS] experimental: replace s_lock spinlock code with pthread_mutex on linux

2012-06-27 Thread Martijn van Oosterhout
cess exit (so everything can still work after a kill -9). So it's more a replacement for the SysV semaphores than anything else. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carelessly confesses thereby at the very outset that he does > not at

Re: [HACKERS] Bug tracker tool we need

2012-07-07 Thread Martijn van Oosterhout
g thread gets pushed into the CF app.) It's also a searchable identifier, which is also useful for google. We do this at my work, it's a very low barrier method of linking different systems. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > He who writes carele

Re: [HACKERS] huge tlb support

2012-07-09 Thread Martijn van Oosterhout
gned is all address spaces. However, it seems it should work for SysV shared memory, see: http://lwn.net/Articles/375096/ . The same page suggests shared mappings should work fine. However, this page refers to the non-transparent feature. If you think about it, it must work since huge pages

Re: [HACKERS] Resetting libpq connections after an app error

2012-07-21 Thread Martijn van Oosterhout
PQclear(res); > } > > but this is blocking, and if the error had been caused by the network > down, we'll just get stuck in a poll() waiting for a timeout. There is PQreset(), which also exists in a non-blocking variant. Hope this helps, -- Martijn van Oosterhout

Re: [HACKERS] Streaming a base backup from master

2010-09-03 Thread Martijn van Oosterhout
synchronise at all. If the client sends nothing, the server sends everything. The tricky part of rsync (finding block that have moved) is not needed here. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own p

Re: [HACKERS] Streaming a base backup from master

2010-09-05 Thread Martijn van Oosterhout
On Sat, Sep 04, 2010 at 02:42:40PM +0100, Greg Stark wrote: > On Fri, Sep 3, 2010 at 8:30 PM, Martijn van Oosterhout > wrote: > > > > rsync is not rocket science. All you need is for the receiving end to > > send a checksum for each block it has. The server side does the s

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-09-08 Thread Martijn van Oosterhout
even if the signal handler is explicitly configured to do so? Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism, > when hate for people other than your own comes first. >

Re: [HACKERS] Why is time with timezone 12 bytes?

2010-09-25 Thread Martijn van Oosterhout
han changing everything at once. So, regular small changes rather than one big change that nobody wants to try. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism, > when hate for people other th

Re: [HACKERS] Which file does the SELECT?

2010-10-10 Thread Martijn van Oosterhout
you need to know the type of a datum before you can manipulate it. The type is not stored inside the datum. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriotism is when love of your own people comes first; nationalism, > wh

Re: [HACKERS] knngist - 0.8

2010-10-16 Thread Martijn van Oosterhout
hink you can make hard and fast rules about how to make this work and that perhaps we should be looking for a way to push that to the index implementation code, with the default rule being: same collection yes, different no. Just some thoughts, Have a nice day, -- Martijn van Oosterhout h

Re: [HACKERS] Creation of temporary tables on read-only standby servers

2010-10-19 Thread Martijn van Oosterhout
one point there was the idea to have a sort of permanent temporary tables which would have a pg_class entry but each session would have its own copy. Replicated slaves would then also be able to use this construction. Doesn't help with the XIDs though. Have a nice day, -- Martijn

Re: [HACKERS] ask for review of MERGE

2010-10-24 Thread Martijn van Oosterhout
e command, MERGE without atomicity is useful enough already. Simply, if the row is visible in the current snapshot you do an update otherwise an insert. If you get an error, raise it. Icing can be added later. Have a nice day, -- Martijn van Oosterhout http://svana.org/kleptog/ > Patriot

  1   2   3   4   5   6   7   8   9   10   >