Re: [GENERAL] SSDs - SandForce or not?

2012-12-09 Thread Greg Smith
em to be reliable for PostgreSQL. Those are expected to be significantly cheaper than the 710 models, while having the same reliability characteristics. I haven't been able to get one yet though, so I don't really know for sure how well they perform. -- Greg Smith 2ndQuadrant USg...@2

Re: [GENERAL] Unexpectedly high disk space usage

2012-11-07 Thread Greg Smith
t; 'i' AND nspname !~ '^pg_toast' AND relpages > 100 ORDER BY pg_total_relation_size(C.oid) DESC LIMIT 20; On my trivial test install that gives me just the one user table: relation | total_size ------+---- public.t | 3568 kB While still showing large

Re: [GENERAL] Plug-pull testing worked, diskchecker.pl failed

2012-10-26 Thread Greg Smith
d drives still on the market I know of that pass a serious test. The other good models are direct PCI-E storage units, like the FusionIO drives. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com -- Sent

Re: [GENERAL] PostgreSQL training recommendations?

2012-10-16 Thread Greg Smith
material outside of the manual and distribute them to the world than to add 40 pages to the official manual. And I say that as someone who tried wandering down both paths to see which was more productive. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Train

Re: [GENERAL] Partitioning Advice

2012-06-07 Thread Greg Smith
t subject at http://notemagnet.blogspot.com/2008/08/linux-write-cache-mystery.html and http://blog.2ndquadrant.com/tuning_linux_for_low_postgresq/ (note that some of the links in that second one, to the test pgbench results, are broken; http://www.highperfpostgres.com/pgbench-results/index.htm is

Re: [GENERAL] oracle linux

2012-04-03 Thread Greg Smith
Of course a several year newer kernel runs much faster on latest generation hardware. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To

Re: [GENERAL] Why checkpoint_timeout had maximum value of 1h?

2012-04-02 Thread Greg Smith
hing to consider. I'm not sure if you'll really see the gains you're hoping for, but it should be easy enough to test. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com -- Sent

Re: [GENERAL] pgcon 2012

2012-03-25 Thread Greg Smith
ellent conference. It's also very well run by its organizers, even though they are "private event management" by your definition. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com

Re: [GENERAL] Optimise PostgreSQL for fast testing

2012-02-23 Thread Greg Smith
NALYZE plans of whatever the slowest single query is. More on that subject at http://wiki.postgresql.org/wiki/Slow_Query_Questions -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com -- Sent via pgsql-general

Re: [GENERAL] fsync on ext4 does not work

2011-12-20 Thread Greg Smith
28.890 ops/sec Non-Sync'ed 8kB writes: write 112113.908 ops/sec -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent via pgsql-general mailing list (pgsql-gener

Re: [GENERAL] Hope for a new PostgreSQL era?

2011-12-13 Thread Greg Smith
e to be in the PostgreSQL core to be packaged nicely so that you can easily install and use it. It's probably easy for you to get pgAdmin installed and working for example, and that's not a part of core. There's just been a lot more work put into packaging it than most to

Re: [GENERAL] Hope for a new PostgreSQL era?

2011-12-12 Thread Greg Smith
On 12/09/2011 08:54 PM, Greg Smith wrote: I decided about a year ago that further work on using Systemtap was a black hole: time goes in, nothing really usable on any production server seems to come out. My off-list e-mail this weekend has, quite rightly, pointed out that this cheap shot is

Re: [GENERAL] Hope for a new PostgreSQL era?

2011-12-12 Thread Greg Smith
e this sort of thing easier to build into the core database. For example, the recent "Command Triggers" feature submission will make it easier to catch DDL changes as well as queries for this sort of thing. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQ

Re: [GENERAL] Hope for a new PostgreSQL era?

2011-12-10 Thread Greg Smith
we'd have to validate whether query prioritization code was operating as expected or not, I imagine some extra monitoring tools really need to get built first. Might as well expose those for people like yourself too, once they're built for that purpose. -- Greg Smith 2ndQuadra

Re: [GENERAL] Hope for a new PostgreSQL era?

2011-12-09 Thread Greg Smith
t. And the earlier the better--since many migrations have a long lead time, just knowing it's coming in the next version would be good enough for some people who are blocked right now to start working on theirs. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Po

Re: [GENERAL] Performance degradation 8.4 -> 9.1

2011-11-18 Thread Greg Smith
get a better response on the lower volume pgsql-performance mailing list too. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make

Re: [GENERAL] : Looking for a PostgreSQL book

2011-09-29 Thread Greg Smith
http://www.pgcon.org/2010/schedule/events/261.en.html for more information. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make ch

Re: [GENERAL] Materialized views in Oracle

2011-09-22 Thread Greg Smith
On 09/22/2011 01:34 AM, Mike Christensen wrote: If Oracle was a swimming pool, I would have those little floaty duck things on my arms. Yes, it's too bad the license to get Oracle 11g with Floaties is cost prohibitive for most companies. -- Greg Smith 2ndQuadrant US

Re: [GENERAL] heavy swapping, not sure why

2011-08-29 Thread Greg Smith
n the PostgreSQL buffer cache code, there really is no reason to give more than 8GB of dedicated memory to the database on Linux via shared_buffers. You're better off letting the OS do caching with it instead. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Post

Re: [GENERAL] Whether the function exists a in pgsql table or not?

2011-08-28 Thread Greg Smith
n the PostgreSQL cache is a bit more complicated than an LRU, while the one in the OS probably is a LRU. If the table is used frequently, it's very likely to stay in one of the two caches anyway. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, S

Re: [GENERAL] Streaming Replication: Observations, Questions and Comments

2011-08-24 Thread Greg Smith
ments a whole lot, all of your checkpoints will be based on the timeout instead. Then you can see how WAL load decreases as you increase checkpoint_timeout. I've had to set checkpoint_timeout as high as 30 minutes before on busy systems, to lower the WAL overhead. -- Greg Smith 2nd

Re: [GENERAL] question regarding full_page_write

2011-08-24 Thread Greg Smith
covery only has to replay activity since that checkpoint marker to fix all torn pages. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org

Re: [GENERAL] question regarding full_page_write

2011-08-22 Thread Greg Smith
es of checkpoints are to move forward the pointer of how far back crash recovery needs to replay from. Starting each new checkpoint over again, with a full copy of all the data modified going into the WAL, it is part of that logic. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimor

Re: [GENERAL] INSERTing rows from external file

2011-08-16 Thread Greg Smith
lpful for spotting what's wrong with your input file. P.S. The fast way to get lots of data into PostgreSQL is to use COPY, not a series of INSERT statements. You may want to turn off synchronous_commit to get good performance when doing lots of INSERTs. -- Greg Smith 2ndQuadrant USg

Re: [GENERAL] backup-strategies for large databases

2011-08-16 Thread Greg Smith
t of thing once that ships. But it looks like the issues around not supporting Intel's latest graphics drivers on recent "Sandy Bridge" servers may postpone adopting that further for me. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Trai

Re: [GENERAL] Postgres on SSD

2011-08-12 Thread Greg Smith
if it's that the flash cells deliver stuff faster when you read a sequential series from the same cell of flash, or if it's just that there's less physical IOs happening. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services

Re: [GENERAL] Postgres on SSD

2011-08-11 Thread Greg Smith
wal_buffers over 16MB. This setting for work_mem can easily allow your server to allocate over 250GB of RAM for query working memory, if all 100 connections do something. Either reduce that a lot, or decrease max_connections, if you want this server to run safely. -- Greg Smith 2ndQuadrant U

Re: [GENERAL] is max connections in a database table somewhere

2011-08-10 Thread Greg Smith
eger) FROM pg_settings WHERE name='max_connections'; The setting comes back as a text field when using current_setting on the pg_settings view (which isn't a real table, under the hood it's calling a system function) -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Bal

Re: [GENERAL] heavy load-high cpu itilization

2011-07-27 Thread Greg Smith
ust a web interface to it. They can't move things around there because they don't really own the list; they just make a copy of all its messages. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.

Re: [GENERAL] 100 times faster than mysql

2011-07-26 Thread Greg Smith
did the math on MySQL, too. Could be worse; could have ran into http://bugs.mysql.com/bug.php?id=33704 which, as you can see, is totally not a bug. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent

Re: [GENERAL] heavy load-high cpu itilization

2011-07-26 Thread Greg Smith
uying a copy of that should repay itself in time savings--where you can look something up rather than trying to figure it out from scratch--about once every week. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQ

Re: [GENERAL] Building an home computer for best Poker Tracker performance

2011-07-20 Thread Greg Smith
per hour; that rate can show you one of these 990:1 shots every 7 hours of play. Leaves one with a healthy respect for the sharp pointy bit on the end of the bell curve, after you've been stabbed with it a few times you start to remember it's there. -- Greg Smith 2ndQuadrant U

Re: [GENERAL] Building an home computer for best Poker Tracker performance

2011-07-19 Thread Greg Smith
lost this sort of 990:1 long shot multiple times. It definitely gives you a better gut feel for "gambler's ruin", one that translates back into stock trading--and into thinking about how to really achieve high-availability for a computing system, too. -- Greg Smith 2ndQuadrant U

Re: [GENERAL] Programmer ( Postgres), Milwaukee - offsite-Remote - onsite

2011-07-19 Thread Greg Smith
the future instead: http://archives.postgresql.org/pgsql-jobs/ In addition to that being the policy here, using that list instead means that we can block people replying to the whole list with their resumes and similar details they didn't mean to make public (which does happen). --

Re: [GENERAL] announcements regarding tools

2011-07-19 Thread Greg Smith
ing the sort of info Scott is asking for into their messages. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Building an home computer for best Poker Tracker performance

2011-07-19 Thread Greg Smith
y if you disable that, and the speed improvement could be large. -If you want to start up a discussion about optimizing your server, that would be better done on the pgsql-performance list than this one. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD -- Sent

Re: [GENERAL] How to create "auto-increment" field WITHOUT a sequence object?

2011-06-30 Thread Greg Smith
xity needs to consider how difficult a program is going to be to debug and maintain. And in those areas, making a single table gapless is quite complicated. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Comprehensive and Customized PostgreSQL Training Classes: http:/

Re: [GENERAL] Setup postgres with automatic table and user intitiallisation

2011-06-28 Thread Greg Smith
rried about locking down security, you probably wouldn't be deploying an auto-installer on Windows in the first place. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Comprehensive and Customized PostgreSQL Training Classes: http://www.2ndquadrant.us/postgresql-training/

Re: [GENERAL] rationale behind quotes for camel case?

2011-06-28 Thread Greg Smith
ions are basically: 1) Use case to help sort this out 2) Use lots of underscores and cope with the ambiguity 3) Pick something to put in the middle to represent relationships between things, to make them less ambiguous. You might name this foo_to_barbiz or the compact but expres

Re: [GENERAL] Multi-tenancy in Postgres

2011-06-28 Thread Greg Smith
e actually have, and the ones the paper tries to solve are not the ones I've seen in my own experiments in multi-tenant deployments. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Comprehensive and Customized PostgreSQL Training Classes: http://www.2ndquadrant.us/post

Re: [GENERAL] Multi-tenancy in Postgres

2011-06-28 Thread Greg Smith
by. And discussing aspects of that problem does flare up among the PostgreSQL developers regularly. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Comprehensive and Customized PostgreSQL Training Classes: http://www.2ndquadrant.us/postgresql-training/ -- Sent via pgsql-gene

Re: [GENERAL] rationale behind quotes for camel case?

2011-06-28 Thread Greg Smith
stead of letting it "fold" the name to all lower-case, you must continue to reference it that way in the future. There's nothing stopping you from just never quoting anything though. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Comprehensive and C

Re: [GENERAL] Oracle / PostgreSQL comparison...

2011-06-24 Thread Greg Smith
e of their customers, because they have their hands where they can firmly squeeze their...uh, wallets. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2

Re: [GENERAL] Help making tablespaces work for my application

2011-06-24 Thread Greg Smith
backup, too. You can treat your data as disposable and expect to lose it when any single component fails, or you can include some good redundancy practices in the design to reduce odds of a failure. There really isn't really a good solution providing partial protection in the middle of tho

Re: [GENERAL] Oracle / PostgreSQL comparison...

2011-06-23 Thread Greg Smith
quite a history of squeezing as many dollars out of its customers as its can. Since there is choice among PostgreSQL support companies, you'll never get into that position with it. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, a

Re: [GENERAL] Help needed with PostgreSQL clustering/switching from MySQL

2011-06-21 Thread Greg Smith
o use one of these really complicated sharded approaches to make their server perform well. Unless you have a massive database or extremely high write volume, it's way more trouble than it's worth to go through distributing writes onto multiple nodes. -- Greg Smith 2ndQuadrant US

Re: [GENERAL] Tuning for a tiny database

2011-06-21 Thread Greg Smith
address this particular need: filling the cache back up with relevant data after restart. This is the main one: http://pgfoundry.org/projects/pgfincore/ http://www.pgcon.org/2010/schedule/events/261.en.html -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQ

Re: [GENERAL] While converting the Master to Standby , FATAL: timeline 2 of the primary does not match recovery target timeline 1

2011-06-18 Thread Greg Smith
uot;--inplace" feature to make the copy from new master -> old master faster. Since it has older copies of the files, the copy can go faster than one to an empty system would take. But you can't just convert the old master to be a standby of a new master. -- Greg Smith

Re: [GENERAL] Another RAID controller recommendation question

2011-06-18 Thread Greg Smith
WAL split between spindle groups). If you can try to measure the exact ratio of database to WAL traffic here, that might help guide which of these configurations makes more sense. Hard to answer in a general way. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL T

Re: [GENERAL] 2 questions re RAID

2011-06-17 Thread Greg Smith
pplying the write cache to help, your write throughput requirements don't ever exceed what a single disk can provide, than maybe RAID5 will be fine for you. Make sure you keep shared_buffers low though, because you're not going to be able to absorb a heavy checkpoint sync on R

Re: [GENERAL] how to find a tablespace for the table?

2011-06-17 Thread Greg Smith
I think that if you start with this and try to experiment from there, you may be able to figure out what's going on here a little better. This connects up the main relevant tables in the right way. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Traini

Re: [GENERAL] Postgres performance and the Linux scheduler

2011-06-16 Thread Greg Smith
Linux; that's available at http://pgmag.org/ -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books

Re: [GENERAL] PostgreSQL 9.0 or 9.1 ?

2011-06-16 Thread Greg Smith
u're doing--some bug fixes to pg_upgrade--have all been backported to 9.0 now. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books

Re: [GENERAL] You could be a PostgreSQL Patch Reviewer!

2011-06-16 Thread Greg Smith
eSQL into a tree under your home directory, with reasonable defaults for all of the parts related to downloading the source code and compiling it. See the documentation for the peg utility at https://github.com/gregs1104/peg for more examples -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com

Re: [GENERAL] determine client os

2011-06-13 Thread Greg Smith
fill in this information. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] Write performance on a large database

2011-06-09 Thread Greg Smith
-performance list with some of the information recommended at http://wiki.postgresql.org/wiki/SlowQueryQuestions : disk controller and disk info, PostgreSQL version, and database server configuration all have a lot of impact here. The contents of pg_stat_bgwriter would be interesting too.

Re: [GENERAL] Regular disk activity of an idle DBMS

2011-05-29 Thread Greg Smith
onitoring-stats.html , it's possible to change PGSTAT_STAT_INTERVAL at server compile time to make it write statistics less frequently. There's no easier way to adjust that though. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, an

Re: [GENERAL] Regular disk activity of an idle DBMS

2011-05-28 Thread Greg Smith
possible causes quite a bit. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books -- Sent via pgsql-general mailing list (pgsql-genera

Re: [GENERAL] SELECT COUNT(*) execution time on large tables (v9.0.4-1)

2011-05-28 Thread Greg Smith
to where you can find alternate approaches here. If you need an exact count and can't afford to generate a full query to find one, some sort of trigger-based approach is likely where you'll need to go. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQ

Re: [GENERAL] Inspecting a DB - psql or system tables ?

2011-05-28 Thread Greg Smith
d are: 1) Use information_schema. If all the info you need is in here, great; it may not be though. 2) Use the system catalog data directly 3) Parse text output from psql. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support

Re: [GENERAL] max_connections proposal

2011-05-28 Thread Greg Smith
ncreasing this value. This area pops up enough that I've made a discussion of it part of even my shortest talk about PostgreSQL performance issues to be wary of. There's a good documentation patch project for somebody here, I just haven't had time to get to it yet.

Re: [GENERAL] Shared Buffer Size

2011-05-28 Thread Greg Smith
base cache without a write. If the database needs that page again, it will ask the OS for it. If the OS still has it in its own read cache, it may just read it from the cache again, without a real disk read happening. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD

Re: [GENERAL] Shared Buffer Size

2011-05-28 Thread Greg Smith
ure if things are working well. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] Postgresql CBT

2011-05-24 Thread Greg Smith
l for some samples. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mai

Re: [GENERAL] Postgresql CBT

2011-05-24 Thread Greg Smith
database for too long. That's a very specific type of post-traumatic stress disorder, and mild cases can be treated with CBT. Severe cases will instead require ECT, aka electroshock. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and

Re: Fwd: Re: [GENERAL] SSDD reliability

2011-05-05 Thread Greg Smith
usage on the drive. So a 4:1 ratio between best and worst manufacturer for SSD seemed possible. Plenty of us have seen particular drive models that were much more than 4X as bad as average ones among regular hard drives. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD

Re: [GENERAL] SSDD reliability

2011-05-05 Thread Greg Smith
etter quality components could be justified. The quality trend at the board and component level has been trending for a long time toward cheap over good in almost every case nowadays. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24

Re: Fwd: Re: [GENERAL] SSDD reliability

2011-05-04 Thread Greg Smith
pect that Intel's numbers are actually much better than the other manufacturers here, so a SSD from anyone else can easily be less reliable than a regular hard drive still. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Suppo

Re: [GENERAL] Question on Wal time lines

2011-05-04 Thread Greg Smith
timelines in a set of WAL files using recovery_target_timeline and the other target settings. It really is worth the trouble to run some experiments with these ideas to see what you can do, before you're forced to do so by an emergency. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.

Re: [GENERAL] Bidirectional replication

2011-05-04 Thread Greg Smith
em to stop replicating in your yard? -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-04 Thread Greg Smith
not be so bad. But if they go many characters before you can distinguish between any two entries, you're probably not going to be happy with the performance or size of the indexes, relative to simple integer keys. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD Postg

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-03 Thread Greg Smith
Jeff Davis wrote: On Mon, 2011-05-02 at 23:07 -0400, Greg Smith wrote: I see this whole area as being similar to SQL injection. The same way that you just can't trust data input by the user to ever be secure, you can't trust inputs to your database will ever be unique in t

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-03 Thread Greg Smith
g though, and that does factor into why there is such a preference for surrogate keys in the industry. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQ

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-02 Thread Greg Smith
s and possibly be slower though--part number strings can easily end up longer than SERIAL-like integers. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-02 Thread Greg Smith
led "natural key" based on them, expect that to break one day. That doesn't mean you can't use them as a sort of foreign key indexing the data; it just means you can't make them the sole unique identifier for a particular entity, where that entity is a person, company,

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-02 Thread Greg Smith
eliminate one just by throwing some resources at it, that's normally the right thing to do. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.

Re: [GENERAL] Postgresql, PSN hack and table limits

2011-05-01 Thread Greg Smith
hard limit. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To

Re: [GENERAL] Switching Database Engines

2011-04-30 Thread Greg Smith
and to migrate a wiki from one server to another. There are all kinds of issues you could have left here before this works, trying to do a database-level export/reload--encoding, foreign key problems, who knows what else. The database-agnostic export/import into XML avoids all of those. -- G

Re: [GENERAL] Looking for Silicon Valley/Peninsula/San Francisco users group

2011-04-29 Thread Greg Smith
On 04/29/2011 06:13 PM, Jeff Davis wrote: I'm not sure which reference you found, but SFPUG is certainly active with meetings every month. http://pugs.postgresql.org/sfpug ; last meeting listed there is January 2009. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimor

Re: [GENERAL] SSDs with Postgresql?

2011-04-29 Thread Greg Smith
hy the lifetimes actually are a serious concern in some situations. Not all of them, of course, but this is why I recommend things like directly measuring your WAL volume. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www

Re: [GENERAL] Partitioning an existing table

2011-04-29 Thread Greg Smith
an that, but still with a PostgreSQL tilt to them, and I never get those accepted either. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.co

Re: [GENERAL] SSDs with Postgresql?

2011-04-28 Thread Greg Smith
scary technology for database use so far. The published numbers from the manufacturer literature are a very rosy best case when you're hitting the disk with this type of workload. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x

Re: [GENERAL] PG 9.0 - Default postgresql.conf?

2011-04-27 Thread Greg Smith
e log file. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org)

Re: [GENERAL] Partitioning an existing table

2011-04-26 Thread Greg Smith
sides. And you really, really want to do this as a proper database transaction, which is easiest to express using INSERT instead of COPY. If any step of the migration goes wrong, being able to do ROLLBACK and undo the recent bad steps is vital. -- Greg Smith 2ndQuadrant USg...@2ndquad

Re: [GENERAL] 10 missing features

2011-04-26 Thread Greg Smith
recognize an alternate solution that is just as useful--just not as familiar--that is available or being built. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http:

Re: [GENERAL] 10 missing features

2011-04-25 Thread Greg Smith
it sounds like the author is managing lots of smallish (to me) databases, so putting so much emphasis on making each individual one easier to troubleshoot makes more sense. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.

Re: [GENERAL] Poor performance of btrfs with Postgresql

2011-04-21 Thread Greg Smith
ydata: http://www.flamingspork.com/projects/libeatmydata/ -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books -- Sent via pgsql-gene

Re: [GENERAL] Poor performance of btrfs with Postgresql

2011-04-21 Thread Greg Smith
And I'd still expect ext4/XFS to beat any ext2/ext3 combination you can come up with, performance-wise. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": ht

Re: [GENERAL] SSDs with Postgresql?

2011-04-21 Thread Greg Smith
es that as part of the SQL itself, so it gets pulled out of the database already in bytes. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant

Re: [GENERAL] SSDs with Postgresql?

2011-04-21 Thread Greg Smith
l.com as one worked out sample. Anyone deploying PostgreSQL onto MLC can't necessarily ignore this issue. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance"

Re: [GENERAL] SSDs with Postgresql?

2011-04-14 Thread Greg Smith
PS as being a real-world expectation for the larger sizes of these drives. Also, it is cheap flash, so durability in a server environment won't be great. Don't put your WAL on them if you have a high transaction rate. Put some indexes there instead. -- Greg Smith 2ndQuadrant US

Re: [GENERAL] Raid Controller Write Cache setting for WAL and Data

2011-02-16 Thread Greg Smith
at but not the final piece to really make it perform well wouldn't be a good move. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.co

Re: [GENERAL] question regarding full_page_write

2011-02-16 Thread Greg Smith
abase can get corrupted. Your system needs to ensure that when a write happens, either the whole thing goes to disk, or none of it does. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQ

Re: [GENERAL] effective_io_concurrency

2011-02-03 Thread Greg Smith
ain from smgr, src/backend/storage/buffer/bufmgr.c has PrefetchBuffer, and the one place the executor calls that is BitmapHeapNext inside src/backend/executor/nodeBitmapHeapscan.c -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Suppo

Re: [GENERAL] Book recommendation?

2011-02-01 Thread Greg Smith
cktpub.com/article/postgresql-tips-tricks https://www.packtpub.com/sites/default/files/0301OS-Chapter-2-Database-Hardware.pdf -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us "PostgreSQL 9.0 High Performan

Re: [GENERAL] SHMMAX and SHMALL question

2011-01-22 Thread Greg Smith
the hard work, haven't found a Linux system yet it didn't do the right thing on. It sounds like you might have the math on the relation between the two backwards, look at the output and code of this once and that should sort things out for you. -- Greg Smith 2ndQuadra

Re: [GENERAL] migrate hashname function from 8.1.x to 8.4

2011-01-11 Thread Greg Smith
how I can reproduce 8.1 function in 8.4? https://github.com/petere/pgvihash provides the function you're looking for. I agree with Craig's concerns here, but this may let you convert toward a better long-term format more easily. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.

Re: [GENERAL] PG84 and SELinux

2010-12-05 Thread Greg Smith
ine 624 of the version at: http://code.google.com/p/commitmonitor/source/browse/trunk/common/openssl/crypto/conf/conf_def.c So guessing something in the SSL autonegotiation is failing here in a really unexpected way. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQ

Re: [GENERAL] Considering Solid State Drives

2010-11-15 Thread Greg Smith
background about this topic at http://wiki.postgresql.org/wiki/Reliable_Writes -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services and Supportwww.2ndQuadrant.us "PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books

Re: [GENERAL] The first dedicated PostgreSQL forum

2010-11-15 Thread Greg Smith
sn't help with that. I find it hard to get too excited about yet another forum style discussion area when there's already more PostgreSQL talk on http://stackoverflow.com/ than I have time to keep up with. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreS

  1   2   3   4   5   6   7   8   >