mehma sarja wrote:
> MY SITUATION
>
> I can take your Megabytes and shame you with my 9,868,868 mostly Maildir
> files and 690.8 GB space they take up. Take that! It took 25 hours to
> transfer and is currently "indexing." Before I ramble on, here is some
> confguration info:
....
>
> WHAT HAVE YOU DONE?!
>
> I have tweaked FreeBSD to run on all 4 CPU cores and tweaked PG
> (postgresql.conf) thus:
>
> # - Memory -
>
> shared_buffers = 10MB # min 128kB or max_connections*16kB
> temp_buffers = 10MB # min 800kB
> work_mem = 10MB # min 64kB
> maintenance_work_mem = 40MB # min 1MB
> max_stack_depth = 525kB # min 100kB
>
Some gurus in pg list give me the rule they use (for other work than bacula) I
have to do massive import
10 billions records in each 16 tables ( and next create an gist column ).
For them, the most efficient way is to allow (when possible) 20% of ram for the
shared buffers.
So for example on my dev box (centrino core 2) with 4Go ram with pae kernel
I use this
shared_buffers = 1024MB # min 128kB or max_connections*16kB
# (change requires restart)
temp_buffers = 128MB # min 800kB
max_prepared_transactions = 10 # can be 0 or more
# (change requires restart)
# Note: Increasing max_prepared_transactions costs ~600 bytes of shared memory
# per transaction slot, plus lock space (see max_locks_per_transaction).
work_mem = 512MB # min 64kB
maintenance_work_mem = 64MB # min 1MB
max_stack_depth = 6MB # min 100kB
# - Free Space Map -
max_fsm_pages = 2048000 # min max_fsm_relations*16, 6 bytes each
# (change requires restart)
max_fsm_relations = 64000 # min 100, ~70 bytes each
# (change requires restart)
I've got quiet some nice thoughtput with this iotop giving me pg running at the
full raw speed of the disk.
75MB/s with getting records in gis software after.
I've launch a vaccum full after the insert, and this one take very long time to
finish ( > 10 hours ).
you will get some more accurate information on the pg guru list if you explain
what you have (hardware,software),
and have to do.
--
Bruno Friedmann
------------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
