Re: Backup

2024-10-23 Thread Andy Hartman
The images are part of the csv file... On Wed, Oct 23, 2024 at 3:47 PM Adrian Klaver wrote: > On 10/23/24 10:43, Andy Hartman wrote: > > I'm using the DB as a History repository... I'm pulling info from a > > Mssql db using a P/S script to a csv file then Import that to Postgres I > > only keep

Re: Backup

2024-10-23 Thread Adrian Klaver
On 10/23/24 10:43, Andy Hartman wrote: I'm using the DB as a History repository... I'm pulling info from a Mssql db using a P/S script to a csv file then Import that to Postgres I only keep 6 months live on the mssql db and roll everything else to Postgres Arch DB.   After I load this latest

Re: Backup

2024-10-23 Thread Andy Hartman
I'm using the DB as a History repository... I'm pulling info from a Mssql db using a P/S script to a csv file then Import that to Postgres I only keep 6 months live on the mssql db and roll everything else to Postgres Arch DB. After I load this latest month to Postgres I just need to backup, or

Re: Backup

2024-10-23 Thread Adrian Klaver
On 10/23/24 07:07, Andy Hartman wrote: I have been testing different backup methods suggested and wonder if I have all my files used to load the DB .. could that be considered a backup... obviously need to have schema backup in case of problem, but that seems to be easily re-created Thoughts?

Re: Backup

2024-10-23 Thread Andy Hartman
I have been testing different backup methods suggested and wonder if I have all my files used to load the DB .. could that be considered a backup... obviously need to have schema backup in case of problem, but that seems to be easily re-created Thoughts? On Fri, Oct 18, 2024 at 2:30 PM Adrian Kla

Re: Backup

2024-10-18 Thread Adrian Klaver
On 10/18/24 11:25 AM, Andy Hartman wrote: Windows Server 2022 I would like a backup process similar to what I'm used to using in the mssql world if that's  possible with Postgres... I will be loading monthly archive data to Postgresql so that's why I probably only need once a backup .. onc

Re: Backup

2024-10-18 Thread Andy Hartman
Windows Server 2022 I would like a backup process similar to what I'm used to using in the mssql world if that's possible with Postgres... I will be loading monthly archive data to Postgresql so that's why I probably only need once a backup .. once loaded data is just viewed thru an app... no upd

Re: Backup

2024-10-18 Thread Adrian Klaver
On 10/18/24 05:39, Andy Hartman wrote: I would like to use the closest thing to a mssql backup... As in? Searching on 'mssql backup' returns a lot of choices. You will need to be more specific on what you want to achieve. Also be specific about what versions of OS and Postgres you are usin

Re: Backup

2024-10-18 Thread Adrian Klaver
On 10/18/24 09:52, Andy Hartman wrote: Reply to list also Ccing list. Windows 22 and Postgres 16.4 Is that Windows Server 2022 or Windows 10/11 with the 22H2 update? You also need to provide a more detailed description of what you want the backup to do? On Fri, Oct 18, 2024 at 12:04 PM

Re: Backup

2024-10-18 Thread Adrian Klaver
On 10/18/24 08:34, Andy Hartman wrote: Thanks.. I'm on a Windows platform using PG. AFAIK pgBackRest does not run on Windows: https://github.com/pgbackrest/pgbackrest/issues/2431 -- Adrian Klaver adrian.kla...@aklaver.com

Re: Backup

2024-10-18 Thread Andy Hartman
Thanks.. I'm on a Windows platform using PG. On Fri, Oct 18, 2024 at 10:45 AM Adrian Klaver wrote: > On 10/18/24 05:39, Andy Hartman wrote: > > I would like to use the closest thing to a mssql backup... > > > > How do I install pgbackrest after downloading and UnZip? > > Read the docs?: > > htt

Re: Backup

2024-10-18 Thread Adrian Klaver
On 10/18/24 05:39, Andy Hartman wrote: I would like to use the closest thing to a mssql backup... How do I install pgbackrest after downloading  and UnZip? Read the docs?: https://pgbackrest.org/user-guide.html#installation -- Adrian Klaver adrian.kla...@aklaver.com

Re: Backup

2024-10-18 Thread Andy Hartman
I would like to use the closest thing to a mssql backup... How do I install pgbackrest after downloading and UnZip? On Thu, Oct 17, 2024 at 6:28 AM Andy Hartman wrote: > This is great, thank you so much! > > On Thu, Oct 17, 2024 at 12:47 AM Asad Ali wrote: > >> >> Hi Andy, >> >> I hope you'

Re: Backup

2024-10-17 Thread Andy Hartman
This is great, thank you so much! On Thu, Oct 17, 2024 at 12:47 AM Asad Ali wrote: > > Hi Andy, > > I hope you're doing well. Based on your inquiry about PostgreSQL backups > for your 100GB historical database with images, here are some suggestions > that should help you achieve compressed, effi

Re: Backup

2024-10-16 Thread Asad Ali
Hi Andy, I hope you're doing well. Based on your inquiry about PostgreSQL backups for your 100GB historical database with images, here are some suggestions that should help you achieve compressed, efficient backups without running into storage issues. *1. Use Custom Format with Compression* A mor

Re: Backup

2024-10-16 Thread Muhammad Usman Khan
Hi, you can refer the following link where many backup methods are mentioned according to your need. Backups in PostgreSQL. In PostgreSQL, different types of… | by Usman Khan | Aug, 2024 | Medium On Thu, 17 Oct 2024 at 00:37

Re: Backup

2024-10-16 Thread Andy Hartman
I'm on Ver16 and yes Our database has image in a bytea field. Running on Win22 box... On Wed, Oct 16, 2024 at 5:49 PM Peter J. Holzer wrote: > On 2024-10-16 16:02:24 -0400, Ron Johnson wrote: > > On Wed, Oct 16, 2024 at 4:00 PM Achilleas Mantzios < > > a.mantz...@cloud.gatewaynet.com> wrote: >

Re: Backup

2024-10-16 Thread Peter J. Holzer
On 2024-10-16 16:02:24 -0400, Ron Johnson wrote: > On Wed, Oct 16, 2024 at 4:00 PM Achilleas Mantzios < > a.mantz...@cloud.gatewaynet.com> wrote: > Στις 16/10/24 22:55, ο/η Ron Johnson έγραψε: > On Wed, Oct 16, 2024 at 3:37 PM Andy Hartman > wrote: [...] > > Step 1: re

Re: Backup

2024-10-16 Thread Adrian Klaver
On 10/16/24 12:52, Tomas Vondra wrote: On 10/16/24 21:37, Andy Hartman wrote: I am very new to Postgres and have always worked in the mssql world. I'm You didn't specify the Postgres version - that matters, because older pg_dump versions (before PG 16) do not support compression. Since PG 16

Re: Backup

2024-10-16 Thread Achilleas Mantzios
Στις 16/10/24 23:02, ο/η Ron Johnson έγραψε: On Wed, Oct 16, 2024 at 4:00 PM Achilleas Mantzios wrote: Στις 16/10/24 22:55, ο/η Ron Johnson έγραψε: On Wed, Oct 16, 2024 at 3:37 PM Andy Hartman wrote: I am very new to Postgres and have always worked in the mssql

Re: Backup

2024-10-16 Thread Ron Johnson
On Wed, Oct 16, 2024 at 4:00 PM Achilleas Mantzios < a.mantz...@cloud.gatewaynet.com> wrote: > Στις 16/10/24 22:55, ο/η Ron Johnson έγραψε: > > On Wed, Oct 16, 2024 at 3:37 PM Andy Hartman > wrote: > >> I am very new to Postgres and have always worked in the mssql world. I'm >> looking for sugges

Re: Backup

2024-10-16 Thread Ron Johnson
On Wed, Oct 16, 2024 at 3:52 PM Tomas Vondra wrote: [snip] > You didn't specify the Postgres version - that matters, because older > pg_dump versions (before PG 16) do not support compression. Since PG 16 > you can use either -Fc or -Fd (instead of the tar format), and it'll > compress the output

Re: Backup

2024-10-16 Thread Achilleas Mantzios
Στις 16/10/24 22:55, ο/η Ron Johnson έγραψε: On Wed, Oct 16, 2024 at 3:37 PM Andy Hartman wrote: I am very new to Postgres and have always worked in the mssql world. I'm looking for suggestions on DB backups. I currently have a DB used to store Historical information that has imag

Re: Backup

2024-10-16 Thread Ron Johnson
On Wed, Oct 16, 2024 at 3:37 PM Andy Hartman wrote: > I am very new to Postgres and have always worked in the mssql world. I'm > looking for suggestions on DB backups. I currently have a DB used to store > Historical information that has images it's currently around 100gig. > > I'm looking to tak

Re: Backup

2024-10-16 Thread Tomas Vondra
On 10/16/24 21:37, Andy Hartman wrote: > I am very new to Postgres and have always worked in the mssql world. I'm > looking for suggestions on DB backups. I currently have a DB used to > store Historical information that has images it's currently around 100gig.  > > I'm looking to take a monthly b

Re: backup

2024-10-08 Thread Andy Hartman
Thanks, I'll check it out. On Mon, Oct 7, 2024 at 11:25 PM Muhammad Usman Khan wrote: > > Hi, > You can refer the following: > Automating PostgreSQL Backups with Python Using pg_basebackup | by Usman > Khan | Sep, 2024 | Medium >

Re: backup

2024-10-07 Thread Muhammad Usman Khan
Hi, You can refer the following: Automating PostgreSQL Backups with Python Using pg_basebackup | by Usman Khan | Sep, 2024 | Medium Automating PostgreSQL Backups with PG Back Web: The Com

Re: backup

2024-10-07 Thread Ron Johnson
On Mon, Oct 7, 2024 at 11:48 AM Andy Hartman wrote: > anyone use Powershell in an automated fashion to do DB backup? Would you > share your example? > PS can execute utilities, so using it as a wrapper for pg_dump and pg_restore (just like a bash script) is perfectly viable. -- Death to , and

Re: backup

2024-10-07 Thread Adrian Klaver
On 10/7/24 08:48, Andy Hartman wrote: anyone use Powershell in an automated fashion to do DB backup?  Would you share your example? Search engine of your choice: "powershell postgresql backup script" Using DuckDuckGo I see 6 relevant entries right of the top.  Thanks. -- Adrian Klaver ad

Re: Backup failure Postgres

2024-05-23 Thread Alvaro Herrera
On 2024-May-23, Jethish Jethish wrote: > I have tried by increasing the max_standby_streaming_delay but I'm facing > lag issues on the replica server. > > When i increase the max_standby_streaming_delay even if a query runs for 2 > minutes I'm facing lag issues for 2 minutes. You could use a sep

Re: Backup failure Postgres

2024-05-23 Thread Torsten Förtsch
Look, you have to compromise somewhere. Let me explain the problem. PG uses MVCC. That means if you update or delete rows, rows are not actually modified or added back to free space. They are just marked for later removal. That actual removal is VACUUM's task. The reason for doing so is that a conc

Re: Backup failure Postgres

2024-05-23 Thread Jethish Jethish
Hi Torsten, I have tried by increasing the max_standby_streaming_delay but I'm facing lag issues on the replica server. When i increase the max_standby_streaming_delay even if a query runs for 2 minutes I'm facing lag issues for 2 minutes. Please suggest here. Data size is 3TB On Thu, May 23, 2

Re: Backup failure Postgres

2024-05-23 Thread Torsten Förtsch
As the error message says, your query was aborted due to it conflicting with recovery. There are many ways to deal with that. You could enable hot_standby_feedback on the replica. You could disconnect the replica from the master for the time the COPY takes (reset primary_conninfo). You could increa

Re: Backup certain months old data

2024-01-22 Thread Adrian Klaver
On 1/22/24 19:11, Siraj G wrote: Hello! I would like to know how we can backup certain months old data from PgSQL and then delete it. The intent is to backup everything that is older than 2 quarters to a blob storage and delete it, to improve performance and reduce billing. 1) Postgres does

Re: Backup certain months old data

2024-01-22 Thread Ron Johnson
On Mon, Jan 22, 2024 at 10:12 PM Siraj G wrote: > Hello! > > I would like to know how we can backup certain months old data from PgSQL > Use the COPY command. > and then delete it. > That would depend on how many records, how big the records are, and if there's index support on the "date" fie

Re: Backup Copy of a Production server.

2023-08-07 Thread Ron
On 8/7/23 07:05, KK CHN wrote: On Mon, Aug 7, 2023 at 10:49 AM Ron wrote: On 8/7/23 00:02, KK CHN wrote: List, I am in need to copy a production PostgreSQL server  data( 1 TB)  to  an external storage( Say USB Hard Drive) and need to set up a backup server with this data

Re: Backup Copy of a Production server.

2023-08-07 Thread Chris Travers
On Mon, Aug 7, 2023 at 7:00 PM KK CHN wrote: > > > On Mon, Aug 7, 2023 at 10:49 AM Ron wrote: > >> On 8/7/23 00:02, KK CHN wrote: >> >> List, >> >> I am in need to copy a production PostgreSQL server data( 1 TB) to an >> external storage( Say USB Hard Drive) and need to set up a backup server

Re: Backup Copy of a Production server.

2023-08-07 Thread KK CHN
On Mon, Aug 7, 2023 at 10:49 AM Ron wrote: > On 8/7/23 00:02, KK CHN wrote: > > List, > > I am in need to copy a production PostgreSQL server data( 1 TB) to an > external storage( Say USB Hard Drive) and need to set up a backup server > with this data dir. > > What is the trivial method to ach

Re: Backup Copy of a Production server.

2023-08-06 Thread Ron
On 8/7/23 00:02, KK CHN wrote: List, I am in need to copy a production PostgreSQL server  data( 1 TB)  to  an external storage( Say USB Hard Drive) and need to set up a backup server with this data dir. What is the trivial method to achieve this ?? 1. Is Sqldump an option at a production se

Re: Backup schema without data

2023-04-06 Thread Brent Wood
Looking at the result of: pg_dump --help Usage:   pg_dump [OPTION]... [DBNAME] ...  -n, --schema=PATTERN dump the specified schema(s) only...  -s, --schema-only    dump only the schema, no data...  So: pg_dump -s -n It works for me... Cheers Brent Wood On Friday, Apri

Re: Backup schema without data

2023-04-06 Thread Tom Lane
Atul Kumar writes: > Please help me in telling that how I can take the backup of one single > schema without its data using pg_dump utility ? Doesn't "pg_dump -s -n ..." do what you want? regards, tom lane

Re: Backup schema without data

2023-04-06 Thread Michael Loftis
>From the man page…. “ -s --schema-only Dump only the object definitions (schema), not data. …..” On Thu, Apr 6, 2023 at 18:40 Atul Kumar wrote: > Hi, > > Please help me in telling that how I can take the backup of one single > schema without its data using pg_dump utility ? > > > So far, I

Re: Re. Backup of postgresql database

2022-02-05 Thread Ron
Fire your DBA!! After that, I'd install "pgbackrest", and use it to write backups to an S3 bucket. On 2/5/22 2:37 AM, sivapostg...@yahoo.com wrote: Not done so far. Started using A2 for production just a couple of months back. Sent from Yahoo Mail on Android

Re: Re. Backup of postgresql database

2022-02-05 Thread sivapostg...@yahoo.com
Should manually do pg_dump and then copy the resultant one to the destination? Sent from Yahoo Mail on Android On Sat, Feb 5, 2022 at 10:32 AM, Benedict Holland wrote: Pg_dump or do a wal archive. Thanks,Ben On Fri, Feb 4, 2022, 10:49 PM Ron wrote: On 2/4/22 9:14 PM, sivapostg...@yahoo

Re: Re. Backup of postgresql database

2022-02-05 Thread sivapostg...@yahoo.com
Not done so far. Started using A2 for production just a couple of months back.  Sent from Yahoo Mail on Android On Sat, Feb 5, 2022 at 9:19 AM, Ron wrote:On 2/4/22 9:14 PM, sivapostg...@yahoo.com wrote: Hello, Got few (currently 3 will increase as days go) database in A2 hosting un

Re: Re. Backup of postgresql database

2022-02-04 Thread Benedict Holland
Pg_dump or do a wal archive. Thanks, Ben On Fri, Feb 4, 2022, 10:49 PM Ron wrote: > On 2/4/22 9:14 PM, sivapostg...@yahoo.com wrote: > > Hello, > Got few (currently 3 will increase as days go) database in A2 hosting > unmanaged vps server, running Ubuntu server 18 lts > > Planning to have an ad

Re: Re. Backup of postgresql database

2022-02-04 Thread Ron
On 2/4/22 9:14 PM, sivapostg...@yahoo.com wrote: Hello, Got few (currently 3 will increase as days go) database in A2 hosting unmanaged vps server, running Ubuntu server 18 lts Planning to have an additional backup of all files, including pg database, to another cloud provider like Amazon S3

Re. Backup of postgresql database

2022-02-04 Thread sivapostg...@yahoo.com
Hello,Got few (currently 3 will increase as days go) database in A2 hosting unmanaged vps server, running Ubuntu server 18 lts Planning to have an additional backup of all files, including pg database, to another cloud provider like Amazon S3 (any other suggestions?) Size won't be crossing 5GB pe

Re: Backup Restore from other node after switchover/failover

2020-10-28 Thread Sushant Pawar
Hi Dirk, Yes, this will work fine. You can use the existing backup to restore it on the new node and use the WAL archives from new node for the recovery purpose. As a best practice, I would suggest setting the parameter "recovery_target_timeline=latest" in your recovery command to ensure the recov

Re: backup -restore question

2020-07-13 Thread Ron
On 7/13/20 7:37 PM, Adrian Klaver wrote: On 7/13/20 2:56 PM, Ron wrote: On 7/13/20 2:32 PM, Adrian Klaver wrote: On 7/13/20 12:12 PM, Julie Nishimura wrote: Hello there, One of our PostgreSQL 9.4.1  databases has been backed up as *.gz file with the compression 9 "pg_dump -Z 9". What is the r

Re: backup -restore question

2020-07-13 Thread Adrian Klaver
On 7/13/20 2:56 PM, Ron wrote: On 7/13/20 2:32 PM, Adrian Klaver wrote: On 7/13/20 12:12 PM, Julie Nishimura wrote: Hello there, One of our PostgreSQL 9.4.1  databases has been backed up as *.gz file with the compression 9 "pg_dump -Z 9". What is the right format of restore this file when nee

Re: backup -restore question

2020-07-13 Thread Ron
On 7/13/20 2:32 PM, Adrian Klaver wrote: On 7/13/20 12:12 PM, Julie Nishimura wrote: Hello there, One of our PostgreSQL 9.4.1  databases has been backed up as *.gz file with the compression 9 "pg_dump -Z 9". What is the right format of restore this file when needed? Can I run the restore from

Re: backup -restore question

2020-07-13 Thread Adrian Klaver
On 7/13/20 12:12 PM, Julie Nishimura wrote: Hello there, One of our PostgreSQL 9.4.1  databases has been backed up as *.gz file with the compression 9 "pg_dump -Z 9". What is the right format of restore this file when needed? Can I run the restore from a compressed file or I need to unzip the

Re: Backup & Restore

2020-02-25 Thread Thomas Kellerer
sivapostg...@yahoo.com schrieb am 25.02.2020 um 02:55: > Can u suggest a good backup solution for a windows installation ? > Looks like the suggested two [ pgbarman, pgbackrest ] works only in > Linux. pg_probackup provides Windows binaries: https://github.com/postgrespro/pg_probackup/

Re: Backup & Restore

2020-02-25 Thread sivapostg...@yahoo.com
We do have plans to move to Linux in the future after the successful implementation of at least 4 or 5 projects.  Till then we want to keep windows. We were (are) using SQL Server (also) and this is our first one with Postgres.   With our manpower, we feel tough to switch two things (Database &

Re: Backup & Restore

2020-02-25 Thread Adrian Ho
On 24/2/20 4:18 pm, Dor Ben Dov wrote: > > Hi All, > >   > > What is your backup and restore solution in production when working > with Postgres ? > > (+ if you can say few words why you picked this X solution instead of > others) > This is the THIRD time you've asked the same question with minimal

Re: Backup & Restore

2020-02-25 Thread Stephen Frost
Greetings, * sivapostg...@yahoo.com (sivapostg...@yahoo.com) wrote: > HiCan u suggest a good backup solution for a windows installation ?  Looks > like the suggested two [ pgbarman, pgbackrest ] works only in Linux. While it's certainly something we'd like to do, we haven't ported pgbackrest to

Re: Backup & Restore

2020-02-24 Thread sivapostg...@yahoo.com
HiCan u suggest a good backup solution for a windows installation ?  Looks like the suggested two [ pgbarman, pgbackrest ] works only in Linux. On Tuesday, 25 February, 2020, 01:46:33 am IST, Stephen Frost wrote: Greetings, * Dor Ben Dov (dor.ben-...@amdocs.com) wrote: > What is your

Re: Backup & Restore

2020-02-24 Thread Stephen Frost
Greetings, * Dor Ben Dov (dor.ben-...@amdocs.com) wrote: > What is your backup and restore solution in production when working with > Postgres ? > (+ if you can say few words why you picked this X solution instead of others) I'd recommend pgbackrest- https://www.pgbackrest.org, it's got lots of

Re: Backup & Restore

2020-02-24 Thread Andreas Kretschmer
Am 24.02.20 um 09:18 schrieb Dor Ben Dov: Hi All, What is your backup and restore solution in production when working with Postgres ? most of our customers using Barman: https://www.pgbarman.org/ Regards, Andreas -- 2ndQuadrant - The PostgreSQL Support Company. www.2ndQuadrant.com

Re: backup broken

2020-02-24 Thread bvo
I correct the pg_hba.conf host all all 0.0.0.0/0 md5 to trust and the backup script work as root and postgres but pgAdmin4 stop launched. I needed to change all from ident to trust and add host all all 0.0.0.0/0 trust all working fine now. thank you. Bach-Nga -- Sent from: https://www.postg

Re: Backup and Restore

2019-12-25 Thread Adrian Klaver
On 12/25/19 5:34 AM, Dor Ben Dov wrote: Hi All, What Is the best recommended / used tool for backup and restore that you suggest or work with postgres ? This is the second time around for this question: https://www.postgresql.org/message-id/AM0PR06MB4817A7035134FD88B2C1D033CC550%40AM0PR06MB4

Re: Backup and Restore

2019-12-25 Thread Ron
On 12/25/19 7:46 AM, Andreas Kretschmer wrote: Am 25.12.19 um 14:34 schrieb Dor Ben Dov: Hi All, What Is the best recommended / used tool for backup and restore that you suggest or work with postgres ? depends on your needs, most of our customers using barman. pgbackrest is also popul

Re: Backup and Restore

2019-12-25 Thread Andreas Kretschmer
Am 25.12.19 um 14:34 schrieb Dor Ben Dov: Hi All, What Is the best recommended / used tool for backup and restore that you suggest or work with postgres ? depends on your needs, most of our customers using barman. Regards, Andreas -- 2ndQuadrant - The PostgreSQL Support Company. www.2n

Re: Backup and Restore

2019-12-12 Thread Andreas Kretschmer
Am 12.12.19 um 16:12 schrieb Dor Ben Dov: What is the most common used back and restore solution for postgres ? most of our customers are using Barman, which is not a surprise since it is developed by us ;-) Regards, Andreas -- 2ndQuadrant - The PostgreSQL Support Company. www.2ndQuadra

Re: Backup and Restore

2019-12-12 Thread Grigory Smolkin
Hello! I would recommend to look at pg_probackup: https://github.com/postgrespro/pg_probackup On 12/12/19 6:12 PM, Dor Ben Dov wrote: Hi, What is the most common used back and restore solution for postgres ? Which one are you using ? Regards, Dor *This email and the information contained

Re: Backup and Restore

2019-12-12 Thread Adrian Klaver
On 12/12/19 7:12 AM, Dor Ben Dov wrote: Hi, What is the most common used back and restore solution for postgres ? I would say it goes from pg_dump/pg_restore for smaller databases to some form of replication for larger. Which one are you using ? I use pg_dump/pg_restore and have started

Re: Backup PostgreSQL from RDS straight to S3

2019-09-18 Thread Steven Lembark
s3fs available on linux allows mounting S3 directly as a local filesystem. At that point something like: pg_dump ... | gzip -9 -c > /mnt/s3-mount-point/$basename.pg_dump.gz; will do the deed nicely. If your S3 volume is something like your_name_here.com/pg_dump then you could parallize it by

Re: Backup PostgreSQL from RDS straight to S3

2019-09-18 Thread Adrian Klaver
On 9/18/19 12:04 PM, Anthony DeBarros wrote: Great, thanks. The question I have, which at first glance isn't covered there, is whether those instructions will at any point bring the dump file onto the EC2 box, either in memory or temp file storage, on its way to S3? I don't know enough about ho

Re: Backup PostgreSQL from RDS straight to S3

2019-09-18 Thread Anthony DeBarros
Great, thanks. The question I have, which at first glance isn't covered there, is whether those instructions will at any point bring the dump file onto the EC2 box, either in memory or temp file storage, on its way to S3? I don't know enough about how Linux handles data piped from one command to th

Re: Backup PostgreSQL from RDS straight to S3

2019-09-18 Thread Adrian Klaver
On 9/18/19 11:32 AM, Anthony DeBarros wrote: Hi, folks -- I'm a longtime PostgreSQL user but a bit of a noob when it comes to maintenance. Question: I'm running PostgreSQL 11 on Amazon RDS. Also have an EC2 box running Ubuntu that runs some Python scripts that collect data into PostgreSQL. W

Re: Backup and Restore (pg_dump & pg_restore)

2019-04-21 Thread Adrian Klaver
On 4/21/19 2:20 PM, Ron wrote: I see this sort of thing in monitoring systems e.g. environmental controls all the time. Things get flagged because they wander over set points intermittently. It is technically an error but unless they stay over the line it is just another data point. Errors n

Re: Backup and Restore (pg_dump & pg_restore)

2019-04-21 Thread Ron
On 4/21/19 3:58 PM, Adrian Klaver wrote: On 4/21/19 1:42 PM, Ron wrote: On 4/21/19 1:46 PM, Adrian Klaver wrote: On 4/21/19 9:35 AM, Daulat Ram wrote: Hello Team, We are getting below error while migrating pg_dump from Postgresql 9.6 to Postgresql 11.2 via pg_restore in docker environment.

Re: Backup and Restore (pg_dump & pg_restore)

2019-04-21 Thread Adrian Klaver
On 4/21/19 1:42 PM, Ron wrote: On 4/21/19 1:46 PM, Adrian Klaver wrote: On 4/21/19 9:35 AM, Daulat Ram wrote: Hello Team, We are getting below error while migrating pg_dump from Postgresql 9.6 to Postgresql 11.2 via pg_restore in docker environment. 90d4c9f363c8:~$ pg_restore -d kbcn "/var/

Re: Backup and Restore (pg_dump & pg_restore)

2019-04-21 Thread Ron
On 4/21/19 1:46 PM, Adrian Klaver wrote: On 4/21/19 9:35 AM, Daulat Ram wrote: Hello Team, We are getting below error while migrating pg_dump from Postgresql 9.6 to Postgresql 11.2 via pg_restore in docker environment. 90d4c9f363c8:~$ pg_restore -d kbcn "/var/lib/kbcn_backup19" pg_restore:

Re: Backup and Restore (pg_dump & pg_restore)

2019-04-21 Thread Tom Lane
Adrian Klaver writes: > On 4/21/19 9:35 AM, Daulat Ram wrote: >> pg_restore: [archiver (db)] could not execute query: ERROR: schema >> "public" already exists >> Command was: CREATE SCHEMA public; > Expected as the public schema is there by default. It is an > informational error, you can ignor

Re: Backup and Restore (pg_dump & pg_restore)

2019-04-21 Thread Adrian Klaver
On 4/21/19 9:35 AM, Daulat Ram wrote: Hello Team, We are getting below error while migrating pg_dump from Postgresql 9.6 to Postgresql 11.2 via pg_restore in docker environment. 90d4c9f363c8:~$ pg_restore -d kbcn "/var/lib/kbcn_backup19" pg_restore: [archiver (db)] Error while PROCESSING TOC

Re: Backup Strategy Advise

2018-04-24 Thread Vick Khera
On Tue, Apr 24, 2018 at 10:50 AM, David Gauthier wrote: > Typically, I would think doing a weekly full backup, daily incremental > backups and turn on journaling to capture what goes on since the last > backup. > This is almost the whole concept of the streaming replication built into postgres,

Re: Backup Strategy Advise

2018-04-24 Thread Adrian Klaver
On 04/24/2018 07:50 AM, David Gauthier wrote: Hi:  I need some advise on how best to backup a PG DB. PG 9.5.2 on RHEL6 The requirement is to be able to restore the DB after catastrophic failure and lose no more than the last 15 minutes worth of data.  Also, we would like to be able to do the b