Re: [HACKERS] Convert pltcl from strings to objects

2016-02-27 Thread Jim Nasby
On 2/25/16 9:30 AM, Alvaro Herrera wrote: Jim Nasby wrote: Here we have another case. prodesc is a global thing. And it is shared between different operations. Problem was that there is no partcular owner, and we have to wait when last operation which deals with it would finish. It looks like

Re: [HACKERS] Sanity checking for ./configure options?

2016-02-27 Thread Jim Nasby
it`s rather important to make cleanup work on that project. Did you mean to mark all those items as tested, failed? On another note, the other use case for allowing 1-1024 is if you run with listen_address=''. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in

Re: [HACKERS] Sanity checking for ./configure options?

2016-02-27 Thread Jim Nasby
On 2/26/16 9:29 PM, Peter Eisentraut wrote: To make this really robust, you might need to do pattern matching on the value. Yeah, and I don't see any reasonable way to do that... we don't require sed or the like, do we? I'll look at the other things you mentioned. --

[HACKERS] Improve error handling in pltcl

2016-02-28 Thread Jim Nasby
...@wagner.wagner.home [2] http://www.postgresql.org/message-id/56cce7d2.9090...@bluetreble.com -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com diff --git a/doc/src/sgml/pltcl.sgml b/doc

Re: [HACKERS] Convert pltcl from strings to objects

2016-02-29 Thread Jim Nasby
Ahh, thanks for pointing that out. Completely agree on it being a separate patch. Flight Aware is a big pltcl user as well as a contributor to the TCL community, so there's several more patches in the works. This would be one of them. -- Jim Nasby, Data Architect, Blue Treble Consulting,

Re: [HACKERS] Improve error handling in pltcl

2016-02-29 Thread Jim Nasby
On 2/28/16 5:50 PM, Jim Nasby wrote: Per discussion in [1], this patch improves error reporting in pltcl. I forgot to mention that this work is sponsored by Flight Aware (http://flightaware.com). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data

Re: [HACKERS] dealing with extension dependencies that aren't quite 'e'

2016-02-29 Thread Jim Nasby
to grok so I suspect there'd be a lot of problems with that, resulting in more raw DML to try and fix things, resulting in pg_depend getting completely screwed up... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Tro

Re: [HACKERS] dealing with extension dependencies that aren't quite 'e'

2016-03-01 Thread Jim Nasby
where "any" would be all the other reg* types. That should be a lot less work to code up than messing with the grammar. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTre

Re: [HACKERS] WIP: Upper planner pathification

2016-03-01 Thread Jim Nasby
since one of the biggest obstacles to upgrading remains dealing with the on-disk format, I don't think users would freak out about it. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! ht

Re: [HACKERS] PROPOSAL: Fast temporary tables

2016-03-01 Thread Jim Nasby
olumn that was always NULL in the parent, but populated in children. That means children could use their own local form of an OID. When a backend terminates you'd just truncate all it's tables. Actually translating that into relcache and everything else would be a serious amount o

Re: [HACKERS] Publish autovacuum informations

2016-03-01 Thread Jim Nasby
I agree that all this is for monitoring purpose. I'm not sure what are the fancy things that Michael had in mind with exposing the private structure. Michael, was it something like having the ability to change some of these data through an extension? -- Jim Nasby, Data Architect, Blue Tr

Re: [HACKERS] Improve error handling in pltcl

2016-03-01 Thread Jim Nasby
On 2/29/16 10:01 PM, Tom Lane wrote: Jim Nasby writes: On 2/28/16 5:50 PM, Jim Nasby wrote: Per discussion in [1], this patch improves error reporting in pltcl. I forgot to mention that this work is sponsored by Flight Aware (http://flightaware.com). Huh ... I use that site. There'

Re: [HACKERS] Publish autovacuum informations

2016-03-01 Thread Jim Nasby
ld be done in vacuum.c/lazyvacuum.c so it works for manual vacuums as well. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (

Re: [HACKERS] plpgsql - DECLARE - cannot to use %TYPE or %ROWTYPE for composite types

2016-03-02 Thread Jim Nasby
but we're pretty late in the game for that, and I don't see why that couldn't be added later. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Se

Re: [HACKERS] Freeze avoidance of very large table.

2016-03-02 Thread Jim Nasby
ether in the documentation, but we all know that. +1. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.or

Re: [HACKERS] Convert pltcl from strings to objects

2016-03-02 Thread Jim Nasby
On 3/2/16 12:32 PM, Tom Lane wrote: Jim Nasby writes: [ pltcl_objects_2.patch ] I've pushed this with some minor fixes, as well as the followup work mentioned in this thread. Awesome, thanks! I've asked Karl's opinion on increasing the minimum TCL version, but I suspect t

Re: [HACKERS] Convert pltcl from strings to objects

2016-03-02 Thread Jim Nasby
#x27;t beat me to it. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to you

Re: [HACKERS] Publish autovacuum informations

2016-03-02 Thread Jim Nasby
ould be done as well. Having that real-time info is also valuable. I don't see too much point in adding stuff to the stats system for this. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treb

Re: [HACKERS] Freeze avoidance of very large table.

2016-03-02 Thread Jim Nasby
On 3/2/16 5:41 PM, Tom Lane wrote: Jim Nasby writes: On 3/2/16 4:21 PM, Peter Geoghegan wrote: I think you should commit this. The chances of anyone other than you and Masahiko recalling that you developed this tool in 3 years is essentially nil. I think that the cost of committing a

Re: [HACKERS] jsonb array-style subscription

2016-03-02 Thread Jim Nasby
s how you'd want to interface with all of those. Presumably the point type is handled specially today, so that should be taken care off too. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treb

Re: [HACKERS] [COMMITTERS] pgsql: Provide much better wait information in pg_stat_activity.

2016-03-11 Thread Jim Nasby
ked the catalog for a specific Postgres version. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)

Re: [HACKERS] amcheck (B-Tree integrity checking tool)

2016-03-11 Thread Jim Nasby
s that return info about all the corruption found, but that's probably overkill. It'd be nice if you had the option to obey vacuum_cost_delay when running this, but that's clearly just a nice-to-have (or maybe just obey it all the time, since it defaults to 0). -- Jim Nasby, Data A

Re: [HACKERS] Relation extension scalability

2016-03-11 Thread Jim Nasby
ent demand for extension that means you're running lots of small DML operations, not really big ones. I'd think that would make *1 more appropriate. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble?

Re: [HACKERS] amcheck (B-Tree integrity checking tool)

2016-03-11 Thread Jim Nasby
s to be there. Isn't it just a few extra lines of code to support it? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pg

Re: [HACKERS] Is there a way around function search_path killing SQL function inlining? - and backup / restore issue

2016-03-11 Thread Jim Nasby
appens to be installed in. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes t

Re: [HACKERS] [PROPOSAL] VACUUM Progress Checker.

2016-03-12 Thread Jim Nasby
t what was going on. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your su

Re: [HACKERS] Improve error handling in pltcl

2016-03-13 Thread Jim Nasby
Because errorCode unfortunately is an array and not a dict. It doesn't really seem worth messing with it in the eval since this is just a sanity check... New patch attached. It also removes some other unstable output from the regression test. -- Jim Nasby, Data Architect, Blue Trebl

Re: [HACKERS] Sanity checking for ./configure options?

2016-03-13 Thread Jim Nasby
[port must be between 1 and 65535]) fi but that still leaks the shell's error message. There is also the risk of someone specifying a number with a leading zero, which C would interpret as octal but the shell would not. All issues should now be addressed. -- Jim Nasby, Data Architect, Blue Tre

Re: [HACKERS] psql metaqueries with \gexec

2016-03-13 Thread Jim Nasby
uot;, "\\l", - "\\lo_import", "\\lo_export", "\\lo_list", "\\lo_unlink", + "\\f", "\\g", "\\gexec", "\\gset", "\\h", "\\help", "\\H", "\\i", "

Re: [HACKERS] psql metaqueries with \gexec

2016-03-13 Thread Jim Nasby
The following review has been posted through the commitfest application: make installcheck-world: tested, passed Implements feature: tested, passed Spec compliant: not tested Documentation:not tested Still needs documentation. The new status of this patch is: Waiting

Re: [HACKERS] amcheck (B-Tree integrity checking tool)

2016-03-13 Thread Jim Nasby
ALYZE does use it though, so the ship has already sorta sailed. I'm actually a bit surprised cost delay isn't used anywhere else. As more background operations are added I suspect users will want it at some point. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Expert

Re: [HACKERS] [patch] Proposal for \crosstabview in psql

2016-03-13 Thread Jim Nasby
estriction of result set definitions needing to be determined at plan time. That would open the door for server-side crosstab/pivot as well a a host of other things (such as dynamically turning a hstore/json/xml field into a recordset). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austi

Re: [HACKERS] Relation extension scalability

2016-03-13 Thread Jim Nasby
on of stress on IO, even with magnetic media (assuming the whole 4MB is queued to write in one shot...). 4MB would still reduce the number of locks by 500x. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in T

Re: [HACKERS] checkpointer continuous flushing - V18

2016-03-13 Thread Jim Nasby
be done via the wiki. IMO we should also be encouraging users to test various tips and provide feedback, so maybe a wiki page with a big fat request at the top asking users to submit any feedback about the page to -performance. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Exper

Re: [HACKERS] Publish autovacuum informations

2016-03-18 Thread Jim Nasby
s is that vacuum is a very low-frequency operation, so it has none of the concerns that the generic stats system does. I think it would be reasonable to provide event triggers that fire on every launcher loop, after a worker has built it's "TODO list", and after every (auto)vacuu

Re: [HACKERS] plpgsql - DECLARE - cannot to use %TYPE or %ROWTYPE for composite types

2016-03-19 Thread Jim Nasby
this feature in SQL side. I don't buy that. plpgsql doesn't work that way, so why would this? *especially* with the %TYPE decorator. Now, if the syntax was CREATE TABLE b(a a.a) then I would expect b.a to be a foreign key reference to a. -- Jim Nasby, Data Architect, Blue Treble Consul

[HACKERS] Minor typos in optimizer/README

2016-03-19 Thread Jim Nasby
Studying the partification commit, I noticed a few typos in $SUBJECT. Patch attached. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com diff --git a/src/backend/optimizer

Re: [HACKERS] plpgsql - DECLARE - cannot to use %TYPE or %ROWTYPE for composite types

2016-03-19 Thread Jim Nasby
s allowing [] referencing to be more modular. Offhand I don't see how that would impact this new type referencing stuff, but maybe someone else sees an issue. BTW, it might also be useful to allow {} to work as a reference method. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austi

Re: [HACKERS] fd.c doesn't remove files on a crash-restart

2016-03-19 Thread Jim Nasby
ctly what files were left after the crash vs what's new. Actually, I guess another option would be to have a separate directory to move all these files into. On restart, nuke the directory if it exists, then move stuff in there if necessary. -- Jim Nasby, Data Architect, Blue Treble Co

Re: [HACKERS] typmod is always -1

2016-03-20 Thread Jim Nasby
you can also disallow a registered variant from being used in a table definition). I did run into some cases where Postgres ignored typmod, so I special case the default typmod (-1) to a registered variant that's disabled. [1] https://github.com/BlueTreble/variant/blob/master/doc/varia

Re: [HACKERS] oldest xmin is far in the past

2016-03-20 Thread Jim Nasby
this one) What values are set for those? Better yet, can you just run this query? SELECT name, setting, unit, source FROM pg_settings WHERE name ~ 'freeze|vacuum' OR source !~ 'default|override' ; -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

Re: [HACKERS] WIP: Upper planner pathification

2016-03-20 Thread Jim Nasby
of the rewrite code. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to you

Re: [HACKERS] Improve error handling in pltcl

2016-03-20 Thread Jim Nasby
hink it's the OID not PID). I'll set this patch back to Waiting On Author. I believe it's well within reach of getting committed in this fest, but it needs more work. Interim patch attached (need to work on the docs). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin T

Re: [HACKERS] Relax requirement for INTO with SELECT in pl/pgsql

2016-03-21 Thread Jim Nasby
nd t-sql) which have a different set of rules in terms of passing variables in and out of queries. +1 -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hacke

Re: [HACKERS] [PATCH] we have added support for box type in SP-GiST index

2016-03-21 Thread Jim Nasby
TM it'd be better to work on pulling cube's features into box? If it's not true, I'm still wondering if there's enough commonality here that we should pull cube into core... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architec

Re: [HACKERS] [PATCH] we have added support for box type in SP-GiST index

2016-03-22 Thread Jim Nasby
In any case, if you've got a good reason why box and cube should stay separate then further discussion should happen in another thread. BTW, if you haven't seen it, take a look at http://madlib.apache.org/ -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in A

Re: [HACKERS] Speed up Clog Access by increasing CLOG buffers

2016-03-22 Thread Jim Nasby
27;ve used that in places that would probably have moderately high concurrency, and I suspect I'm not alone in that. That said, it wouldn't surprise me if plpgsql overhead swamps an effect this patch has, so perhaps it's a moot point. -- Jim Nasby, Data Architect, Blue Treble

Re: [HACKERS] Improve error handling in pltcl

2016-03-22 Thread Jim Nasby
On 3/20/16 8:42 PM, Jim Nasby wrote: The doc example also makes me think that more effort should get expended on converting internalquery/internalpos to just be query/cursorpos. It seems unlikely to me that a Tcl function could ever see a case where the latter fields are useful directly. Is

Re: [HACKERS] Show dropped users' backends in pg_stat_activity

2016-03-22 Thread Jim Nasby
for now, but... what happens if you drop a role that's in use on a streaming replica? Does replay stall or do we just ignore it? There should probably be some doc changes to go with the patch too, no? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Dat

Re: [HACKERS] Relax requirement for INTO with SELECT in pl/pgsql

2016-03-23 Thread Jim Nasby
head, declaring variables that are never referenced and have no assignment is a big one. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing lis

Re: [HACKERS] WIP: Upper planner pathification

2016-03-23 Thread Jim Nasby
On 3/22/16 7:28 AM, Michael Paquier wrote: On Mon, Mar 21, 2016 at 7:55 AM, Jim Nasby wrote: On 3/17/16 9:01 AM, Robert Haas wrote: I think that there are an awful lot of cases where extension authors haven't been able to quite do what they want to do without core changes because

Re: [HACKERS] [WIP] Effective storage of duplicates in B-tree index.

2016-03-24 Thread Jim Nasby
t small, and a patch that is doing things in critical sections isn't terribly isolated). I do think this will be a great addition, but it's just too late to be adding this to 9.6. (BTW, I'm getting bounces from a.lebe...@postgrespro.ru, as well as postmaster@. I emailed i...@postgres

Re: [HACKERS] Alter or rename enum value

2016-03-24 Thread Jim Nasby
r the idea, write the patch, and shepard the patch through the review process. So if you want these features added, you need to either: do it yourself, convince someone else to do it for free, or pay someone to do it for you. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts i

Re: [HACKERS] avg,first,last,median in one query

2016-03-24 Thread Jim Nasby
to modify it to do what you need. [1] http://www.postgresql.org/docs/9.5/static/functions-window.html -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-

Re: [HACKERS] Alter or rename enum value

2016-03-25 Thread Jim Nasby
to locking concerns I don't think we'd want to put the FKs in place by default either. I've certainly heard people avoiding ENUMs because of their limitations, so it'd be nice if there was a way to lift them. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Ex

Re: [HACKERS] Alter or rename enum value

2016-03-25 Thread Jim Nasby
E TABLE invoice(customer int NOT NULL REFERENCES(customer)); SELECT invoice.*, customer->first_name, customer->last_name, ... FROM invoice; If we had that capability, there would be less need for ENUMs. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics,

Re: [HACKERS] Improve error handling in pltcl

2016-03-25 Thread Jim Nasby
On 3/25/16 3:11 PM, Tom Lane wrote: Jim Nasby writes: the data, we're making it unnecessarily hard. All we need is one more field in there, and you can simplify that to Ahh, nice. I think actually it's a simple point: there won't ever be a case where cursorpos is set here,

[HACKERS] SQL access to access method details

2016-03-28 Thread Jim Nasby
talog compatibility breaks, this one completely removes that information, so if someone was using it they're now completely hosed. [1] http://www.postgresql.org/message-id/55fec1ab.8010...@2ndquadrant.com -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analy

Re: [HACKERS] backup tools ought to ensure created backups are durable

2016-03-28 Thread Jim Nasby
an fs that doesn't speak fsync (if that exists), in which case I don't really think we even need a switch to turn it off. I'd even go so far as spitting out a warning any time we can't fsync (maybe that's what you're suggesting?) -- Jim Nasby, Data Architect, Blu

Re: [HACKERS] Alter or rename enum value

2016-03-28 Thread Jim Nasby
... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http

[HACKERS] Weird behavior during CREATE EXTENSION

2016-01-12 Thread Jim Nasby
t wouldn't work directly here because we want to split commands apart, but it wouldn't be hard to have psql spit out a special command separator line and then look for that. psql would have to ignore \quit in this mode though, but I think that's fine. -- Jim Nasby, Data Arch

Re: [HACKERS] proposal: PL/Pythonu - function ereport

2016-01-13 Thread Jim Nasby
ove them, but it certainly shouldn't dig the hole deeper. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hacker

Re: [HACKERS] Weird behavior during CREATE EXTENSION

2016-01-13 Thread Jim Nasby
failed (ie: the command in the extension file). I'm guessing the way to do that would be to have pg_parse_query() keep the original statement in the parse nodes? I guess if this was easy it would already have been fixed... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

Re: [HACKERS] Interesting read on SCM upending software and hardware architecture

2016-01-18 Thread Jim Nasby
installed in. The implication of this shift is significant: non-volatile memory is in the process of replacing the CPU as the economic center of the datacenter. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble?

[HACKERS] Rethinking TRANSFORM FOR TYPE ...

2016-01-19 Thread Jim Nasby
ay back and forth in C, I sure as hell wish I could have done it in python! Since plpythonu understands bytea, I don't see any reason I couldn't have. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble?

Re: [HACKERS] proposal: PL/Pythonu - function ereport

2016-01-22 Thread Jim Nasby
stablishment_of_sqlconnection 08007EERRCODE_TRANSACTION_RESOLUTION_UNKNOWN transaction_resolution_unknown 08P01EERRCODE_PROTOCOL_VIOLATION protocol_violation -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL

Re: [HACKERS] Releasing in September

2016-01-22 Thread Jim Nasby
e our scarcest resource doing what is essentially a project management task, especially when at least one commercial company has offered to donate paid staff time. I don't think the last CF of 9.6 is the time to experiment, but I think we should try using a PM for the first CF of 9.7. --

Re: [HACKERS] Releasing in September

2016-01-22 Thread Jim Nasby
ome feature doesn't really interest -hackers but there's 50 users that want it and someone willing to work on it, ISTM we should make efforts to get it committed. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL D

Re: [HACKERS] Releasing in September

2016-01-22 Thread Jim Nasby
esting, because the tests that are part of the patch should answer every question they would have, but I don't see that happening until we have a separate automation-only target that we don't care how long it takes to run. -- Jim Nasby, Data Architect, Blue Treble Consulting, A

Re: [HACKERS] count_nulls(VARIADIC "any")

2016-01-22 Thread Jim Nasby
ay I'd say it's up to you as author. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) T

Re: [HACKERS] Releasing in September

2016-01-22 Thread Jim Nasby
r to change when necessary (like add-on functions or PLs). Things like new JSON operators could be released much more rapidly that way. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://Bl

Re: [HACKERS] Releasing in September

2016-01-29 Thread Jim Nasby
On 1/22/16 12:14 PM, Andres Freund wrote: On 2016-01-22 08:40:28 -0600, Jim Nasby wrote: Ideally reviewers shouldn't be doing any testing, because the tests that are part of the patch should answer every question they would have, but I don't see that happening until we have

Re: [HACKERS] WAL Re-Writes

2016-02-01 Thread Jim Nasby
the need for reading back from disk. Amit, did you do performance testing with archiving enabled an a no-op archive_command? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTre

Re: [HACKERS] Way to check whether a particular block is on the shared_buffer?

2016-02-01 Thread Jim Nasby
ethod would just be to call BufTableLookup() without any locks and if you get a result > -1 just call the relevant ReadBuffer function. Sometimes you'll end up calling ReadBuffer even though the buffer isn't in shared buffers, but I would think that would be a rare occurrence. -- Jim

Re: [HACKERS] statistics for shared catalogs not updated when autovacuum is off

2016-02-01 Thread Jim Nasby
that the functions implementing the shared catalog views need something similar. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-ha

Re: [HACKERS] Trigger.sgml

2016-02-01 Thread Jim Nasby
ully it shows the problem. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes t

[HACKERS] Add links to commit fests to patch summary page

2016-02-01 Thread Jim Nasby
https://commitfest.postgresql.org/9/353/ -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscri

Re: [HACKERS] WIP: Access method extendability

2016-02-01 Thread Jim Nasby
The following review has been posted through the commitfest application: make installcheck-world: tested, passed Implements feature: tested, failed Spec compliant: not tested Documentation:not tested There are currently no docs or unit tests. I suspect this patch is st

Re: [HACKERS] Freeze avoidance of very large table.

2016-02-01 Thread Jim Nasby
e potential for disaster if freeze bits are set incorrectly. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgres

Re: [HACKERS] Raising the checkpoint_timeout limit

2016-02-01 Thread Jim Nasby
imally so that you'll get performance similar to reads when it's time to fsync.) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers ma

Re: [HACKERS] statistics for shared catalogs not updated when autovacuum is off

2016-02-01 Thread Jim Nasby
BHash = pgstat_read_statsfiles(MyDatabaseId, false, true); The interesting thing is that we always start the launcher one time, to protect against wraparound, but apparently that path doesn't call anything that calls backend_read_statsfile() (which is static). -- Jim Nasby, Data Architect, B

Re: [HACKERS] Add links to commit fests to patch summary page

2016-02-01 Thread Jim Nasby
On 2/1/16 6:15 PM, Alvaro Herrera wrote: Jim Nasby wrote: It would be nice if the patch summary page (ie, [1]) had links to the relevant entry in that CF. The specific need I see is if you look up a patch in the current CF and it's been moved to the next CF you have to manually go to th

Re: [HACKERS] Add links to commit fests to patch summary page

2016-02-02 Thread Jim Nasby
On 2/2/16 6:35 AM, Alvaro Herrera wrote: what I want is the link to go to *that patch's* page in the other commitfest. That's also what I think Jim wants. +1 -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data

Re: [HACKERS] PostgreSQL Auditing

2016-02-02 Thread Jim Nasby
27;m sure a big part of that is the need for even SQL extensions to have server access, but I suspect part of it is because it's a separate project. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble?

Re: [HACKERS] PostgreSQL Auditing

2016-02-02 Thread Jim Nasby
would also help if the community better publicized ways that companies could give back. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mail

Re: [HACKERS] Integer overflow in timestamp_part()

2016-02-02 Thread Jim Nasby
#x27;m not sure though where we'd need to enforce such a restriction; certainly in timestamp[tz]_in, but where else? Probably some of the casts (I'd think at least timestamp->timestamptz). Maybe timestamp[tz]_recv. Most of the time*pl* functions. :/ -- Jim Nasby, Data Architect, Blue Tr

Re: [HACKERS] PostgreSQL Auditing

2016-02-02 Thread Jim Nasby
ot standby. IIRC that was before sites like kickstarter existed too, so it would probably be even easier to do today. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com --

Re: [HACKERS] proposal: PL/Pythonu - function ereport

2016-02-02 Thread Jim Nasby
k backwards compatibility, but I'm also far from a python expert. It might well be worth adding a plpython GUC to control the behavior so that there's a migration path forward, or maybe do something like the 'import __future__' that python is doing to ease migration to pyt

Re: [HACKERS] Add links to commit fests to patch summary page

2016-02-02 Thread Jim Nasby
9/353/, which I needed to do in order to submit the review. So, perhaps another enhancement would be for commenting/reviewing to always work regardless of what commitfest ID is in the URL. Perhaps Edit too. I think the Status dropdown needs to stay specific to the correct CF though. -- Jim Nasby,

Re: [HACKERS] Idle In Transaction Session Timeout, revived

2016-02-03 Thread Jim Nasby
lient. Added to the March commitfest. +1 for doing something like this. Great idea! Wouldn't it be more sensible to just roll the transaction back and not disconnect? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreS

Re: [HACKERS] PostgreSQL Audit Extension

2016-02-03 Thread Jim Nasby
ecause of it's superior extensibility, and I think continuing to encourage that with formal support for things like PGXN is important. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http:/

Re: [HACKERS] Raising the checkpoint_timeout limit

2016-02-03 Thread Jim Nasby
c GUC. The AWS team has done testing that shows it to be worthless from a performance standpoint now that we have synchronous commit, and it's an extremely large foot-bazooka to have laying around. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Ar

Re: [HACKERS] Idle In Transaction Session Timeout, revived

2016-02-03 Thread Jim Nasby
On 2/3/16 4:05 PM, David Steele wrote: On 2/3/16 4:25 PM, Tom Lane wrote: Robert Haas writes: On Wed, Feb 3, 2016 at 3:41 PM, Jim Nasby wrote: Wouldn't it be more sensible to just roll the transaction back and not disconnect? I'm not sure how messy this would be in practice.

Re: [HACKERS] Batch update of indexes

2016-02-03 Thread Jim Nasby
trying to apply it to the indexes. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make

[HACKERS] Sanity checking for ./configure options?

2016-02-03 Thread Jim Nasby
uke if pgport isn't valid? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes t

Re: [HACKERS] "using previous checkpoint record at" maybe not the greatest idea?

2016-02-04 Thread Jim Nasby
ting a starting point I would expect any such description ​to be here as well. Yeah, I think we should fix the docs. Especially since I imagine that if you're reading that part of the docs you're probably having a really bad day, and bad info won't help you... -- Jim Nasb

Re: [HACKERS] "using previous checkpoint record at" maybe not the greatest idea?

2016-02-04 Thread Jim Nasby
I'm guessing that if this is happening in the field there's a decent chance people aren't noticing it, so maybe the best thing for now is to turn off the automatic behavior bust still have a relatively easy way to re-enable it. In case this is more common than we think... -- Jim

Re: [HACKERS] proposal: PL/Pythonu - function ereport

2016-02-04 Thread Jim Nasby
hink it's also worth having plpy.raise(LEVEL, ...) as an alternative. If folks feel that's overkill then I'd vote to leave the existing behavior alone and just add plpy.raise(LEVEL, ...). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data A

Re: [HACKERS] Way to check whether a particular block is on the shared_buffer?

2016-02-04 Thread Jim Nasby
smgrwrite(...) > +-- (extension's own function) > +-- mdwrite ISTR someone (Robert Haas?) complaining that this method of hooks is cumbersome to use and can be fragile if multiple hooks are being installed. So maybe we don't want to extend it's usage... I&#x

Re: [HACKERS] Batch update of indexes

2016-02-04 Thread Jim Nasby
e matviews. If we had such a capability then we could add options to the AM infrastructure to allow indexes to support doing bulk maintenance as well as per-tuple maintenance (or even support only bulk maintenance...) I don't think any of that has anything to do with ALTER INDEX. -- Jim

  1   2   3   4   5   6   7   8   9   10   >