This is going to be a monthly process not just a 1 time exercise.
On Wed, Feb 5, 2025 at 5:58 PM Andy Hartman wrote:
> Reduce batch size still caused error as reported nothing in WIndows Server
> log...
>
> The SimplySql is slick because just qry from src and load to dst ... Is
>
Klaver
wrote:
> On 2/5/25 13:09, Andy Hartman wrote:
> > I also reduced batch size to 5000 on the last run .. I like using this
> > SImplySql because it's a script I can launch, so that's why I chose that
> > solution... I'm using it to load a History Env.
I also reduced batch size to 5000 on the last run .. I like using this
SImplySql because it's a script I can launch, so that's why I chose that
solution... I'm using it to load a History Env.
THanks again.
On Wed, Feb 5, 2025 at 4:05 PM Andy Hartman wrote:
> nothing in l
nothing in log from mssql side and no anti-virus
On Wed, Feb 5, 2025 at 2:06 PM Adrian Klaver
wrote:
>
>
> On 2/5/25 9:46 AM, Andy Hartman wrote:
> > [6992] ERROR: unexpected EOF on client connection with an open
> transaction
> > 2025-02-05 12:19:44.919 E
, datevalue, dataintegrity,
t_stamp) FROM STDIN (FORMAT BINARY)
2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection because
protocol synchronization was lost
On Wed, Feb 5, 2025 at 11:15 AM Adrian Klaver
wrote:
> On 2/5/25 05:40, Andy Hartman wrote:
> > mssql - 2016
>
I have down other tables of same size no problems
mssql OS Windows Server 2019
PG OS Windows Server 2022
Table:
[image: image.png]
On Tue, Feb 4, 2025 at 3:02 PM Adrian Klaver
wrote:
>
>
> On 2/4/25 11:51 AM, Andy Hartman wrote:
> > I'm copying a large table from mssql
I'm copying a large table from mssql to PG using SImplysql and in the Log I
see this message
2025-02-04 14:42:17.975 EST [4796] ERROR: unexpected EOF on client
connection with an open transaction
2025-02-04 14:42:17.975 EST [4796] CONTEXT: COPY sqlt_data_1_2022_03, line
208274199, column tagid
2
In mssql its a image datatype.
On Sat, Jan 11, 2025 at 7:08 PM Adrian Klaver
wrote:
> On 1/11/25 15:49, Andy Hartman wrote:
> > I still have csv files and loaded right into PG no decoding and look
> > like this little snippet and I did the COpy command into PG
>
>
I still have csv files and loaded right into PG no decoding and look like
this little snippet and I did the COpy command into PG
"/9j/4AAQSkZJRgABAQAAAQABAAD
On Sat, Jan 11, 2025 at 11:50 AM Adrian Klaver
wrote:
> On 1/11/25 03:05, Andy Hartman wrote:
> > I used PS to pull the d
On Fri, Jan 10, 2025 at 12:35 PM Erik Wienhold wrote:
> On 2025-01-09 21:31 +0100, Andy Hartman wrote:
> > could it be done using Powershell?
>
> I use this: https://blog.cleverelephant.ca/2021/04/psql-binary.html
> But I don't know if that translates to PowerShell.
>
> --
> Erik Wienhold
>
could it be done using Powershell?
On Thu, Jan 9, 2025 at 3:25 PM Ron Johnson wrote:
> On Thu, Jan 9, 2025 at 3:17 PM Andy Hartman
> wrote:
>
>> How thru a simple query can I make sure data matches and I can display it
>>
>> On Thu, Jan 9, 2025 at 3:16 PM Andy Hartm
How thru a simple query can I make sure data matches and I can display it
On Thu, Jan 9, 2025 at 3:16 PM Andy Hartman wrote:
> I have migrated over a Table from Mssql that had an Image column I now
> have it in Postgres
>
I have migrated over a Table from Mssql that had an Image column I now have
it in Postgres
Thanks... I just found that myself... so normal behavior then...
On Fri, Nov 15, 2024 at 10:47 AM Adrian Klaver
wrote:
> On 11/15/24 06:27, Andy Hartman wrote:
> > I created a new table (V16) and then used SimplySql to take data from
> > mssql to the new Postgres table. The tab
I created a new table (V16) and then used SimplySql to take data from
mssql to the new Postgres table. The table is 212gig in size. Myquestion
comes from the files created on the OS(Windows2022 server) I can see lots
of files with the last being:
2474695.143
They are all 1,048,576kb
Is this nor
The images are part of the csv file...
On Wed, Oct 23, 2024 at 3:47 PM Adrian Klaver
wrote:
> On 10/23/24 10:43, Andy Hartman wrote:
> > I'm using the DB as a History repository... I'm pulling info from a
> > Mssql db using a P/S script to a csv file then Import that to
backup, or
should I just retain my .csv files as a Backup... I have 2 tables that I
load to Hist and one table holds the images...
THanks .
On Wed, Oct 23, 2024 at 11:50 AM Adrian Klaver
wrote:
> On 10/23/24 07:07, Andy Hartman wrote:
> > I have been testing different backup methods s
Klaver
wrote:
>
>
> On 10/18/24 11:25 AM, Andy Hartman wrote:
> > Windows Server 2022
> >
> > I would like a backup process similar to what I'm used to using in the
> > mssql world if that's possible with Postgres... I will be
> > loading monthly ar
ru an app... no updates..
in mssql you create the .bak and easily restorable that's what I'm
looking for with Postgres
thanks for replies..
On Fri, Oct 18, 2024 at 1:00 PM Adrian Klaver
wrote:
> On 10/18/24 09:52, Andy Hartman wrote:
>
> Reply to list also
> Ccing lis
Thanks.. I'm on a Windows platform using PG.
On Fri, Oct 18, 2024 at 10:45 AM Adrian Klaver
wrote:
> On 10/18/24 05:39, Andy Hartman wrote:
> > I would like to use the closest thing to a mssql backup...
> >
> > How do I install pgbackrest after downloading an
I would like to use the closest thing to a mssql backup...
How do I install pgbackrest after downloading and UnZip?
On Thu, Oct 17, 2024 at 6:28 AM Andy Hartman
wrote:
> This is great, thank you so much!
>
> On Thu, Oct 17, 2024 at 12:47 AM Asad Ali wrote:
>
>>
>&g
help you identify any potential bottlenecks and optimize the backup process.
>
> I hope this helps you create smaller and quicker backups for your
> PostgreSQL database. Let me know if you have any questions or need further
> assistance!
>
> Best regards,
>
> Asad Ali
>
>
d.gatewaynet.com> wrote:
> > Στις 16/10/24 22:55, ο/η Ron Johnson έγραψε:
> > On Wed, Oct 16, 2024 at 3:37 PM Andy Hartman <
> hartman60h...@gmail.com>
> > wrote:
> [...]
> >
> > Step 1: redesign your DB to NOT use large object
I am very new to Postgres and have always worked in the mssql world. I'm
looking for suggestions on DB backups. I currently have a DB used to store
Historical information that has images it's currently around 100gig.
I'm looking to take a monthly backup as I archive a month of data at a
time. I am
e-walkthrough-7a0aade69b1c>
>
> On Mon, 7 Oct 2024 at 20:48, Andy Hartman wrote:
>
>> anyone use Powershell in an automated fashion to do DB backup? Would you
>> share your example?
>>
>> Thanks.
>>
>
anyone use Powershell in an automated fashion to do DB backup? Would you
share your example?
Thanks.
psql -h $pgServer -d $pgDatabase -U $pgUser -c $copyCommand
I'm wondering if it's waiting on P/w ?
Thanks.
On Tue, Sep 17, 2024 at 7:10 PM Andy Hartman
wrote:
> I'll echo vars and see if something looks strange.
>
> THanks.
>
> On Tue, Sep 17, 2024
I'll echo vars and see if something looks strange.
THanks.
On Tue, Sep 17, 2024 at 3:46 PM Rob Sargent wrote:
>
>
> > On Sep 17, 2024, at 12:25 PM, Adrian Klaver
> wrote:
> >
> > On 9/17/24 09:21, Andy Hartman wrote:
> >> The command work outside of p
Still when I try to run from my powershell script it hangs...
On Tue, Sep 17, 2024 at 8:31 AM Andy Hartman
wrote:
> I have bad data in an Int field...
>
> Thanks for your help.
>
> On Tue, Sep 17, 2024 at 1:55 AM Muhammad Usman Khan
> wrote:
>
>> Hi,
&
The command work outside of powershell yes
On Tue, Sep 17, 2024 at 11:39 AM Adrian Klaver
wrote:
> On 9/17/24 08:35, Andy Hartman wrote:
> > I don't see anything in LOG
>
> 1) Are you logging connections/disconnection per?:
>
>
> https://www.postgresql.or
I don't see anything in LOG
On Tue, Sep 17, 2024 at 11:23 AM Adrian Klaver
wrote:
> On 9/17/24 08:13, Andy Hartman wrote:
> > Still when I try to run from my powershell script it hangs...
> >
>
> And the Postgres log shows?
>
> --
> Adrian Klaver
> adrian.kla...@aklaver.com
>
>
>- set a timeout using the PGCONNECT_TIMEOUT environment variable:
>$env:PGCONNECT_TIMEOUT=30
>
>
>
> On Mon, 16 Sept 2024 at 20:35, Andy Hartman
> wrote:
>
>> I'm trying to run this piece of code from Powershell and it just sits
>> there and never comes back. There are
in LOG
2024-09-16 12:55:37.295 EDT [428] ERROR: invalid byte sequence for
encoding "UTF8": 0x00
2024-09-16 12:55:37.295 EDT [428] CONTEXT: COPY
image_classification_master, line 1, column spoolstarttime
On Mon, Sep 16, 2024 at 12:56 PM Adrian Klaver
wrote:
> On 9/16/24 09:46,
It Looks correct.
$pgTable = "image_classification_master"
On Mon, Sep 16, 2024 at 12:17 PM Adrian Klaver
wrote:
> On 9/16/24 09:12, Andy Hartman wrote:
> > 2024-09-16 12:06:00.968 EDT [4968] ERROR: relation
> > "image_classification_master" does not ex
gt;
>
> On Mon, 16 Sept 2024 at 17:36, Andy Hartman
> wrote:
>
>> I'm trying to run this piece of code from Powershell and it just sits
>> there and never comes back. There are only 131 records in the csv.
>> $connectionString =
>> "Host=$pgServer;Databa
I'm trying to run this piece of code from Powershell and it just sits there
and never comes back. There are only 131 records in the csv.
$connectionString =
"Host=$pgServer;Database=$pgDatabase;Username=$pgUser;Password=$pgPassword"
$copyCommand = "\COPY $pgTable FROM '$csvPath' DELIMITER ',' CSV
I'm trying to get the latest version so I can use it in my Powershell
script. I think I have 4.51 but having issues connection to server from
script.
I get this error:
Exception calling "Open" with "0" argument(s): "Authentication method not
supported (Received: 10)"
How can I tell that?
Thanks.
On Fri, Aug 2, 2024 at 12:18 PM Adrian Klaver
wrote:
>
>
> On 8/2/24 9:00 AM, Andy Hartman wrote:
> Reply to list also.
> Ccing list.
> > I changed to md5 and I can connect via HeideSQL interface no problem
>
> Changed what to md5?
&
I'm using a Powershell script to connect to a remote 16.3(windows) version
of the DB.
Add-type -path 'C:\Program Files
(x86)\PostgreSQL\Npgsql\bin\net451\Npgsql.dll'
# Define connection strings for MS SQL and PostgreSQL
$pgsqlConnectionString =
"Host=xx;Port=5432;Username=xxx;Password=xx;Data
39 matches
Mail list logo
