Re: Sample data generator for performance testing

On 1/3/24 9:50 AM, arun chirappurath wrote: On Wed, 3 Jan, 2024, 23:03 Adrian Klaver, wrote: On 1/3/24 09:24, arun chirappurath wrote: > Hi Adrian, > > Thanks for your mail. > > Is this for all tables in the database or a subset? Yes Yes all tables or yes just

Re: Sample data generator for performance testing

gt; work & explaining it takes to get lots of people to engage in a > discussion since they need to take time to understand how the test is > engineered. For very narrowly targeted reproductions this is usually the > right approach with a very simple schema and workload, but not commonly > for general performance testing. > > -Jeremy > > > -- > http://about.me/jeremy_schneider > >

Re: Sample data generator for performance testing

y simple schema and workload, but not commonly for general performance testing. -Jeremy -- http://about.me/jeremy_schneider

Re: Sample data generator for performance testing

On Wed, 3 Jan, 2024, 23:03 Adrian Klaver, wrote: > On 1/3/24 09:24, arun chirappurath wrote: > > Hi Adrian, > > > > Thanks for your mail. > > > > Is this for all tables in the database or a subset? Yes > > Yes all tables or yes just some tables? > All tables.except some which has user details.

Re: Sample data generator for performance testing

On 1/3/24 09:24, arun chirappurath wrote: Hi Adrian, Thanks for your mail. Is this for all tables in the database or a subset? Yes Yes all tables or yes just some tables? Does it need to deal with foreign key relationships? No What are the sizes of the existing data and what size sample d

Re: Sample data generator for performance testing

Hi Adrian, Thanks for your mail. Is this for all tables in the database or a subset? Yes Does it need to deal with foreign key relationships? No What are the sizes of the existing data and what size sample data do you want to produce?1Gb and 1Gb test data. On Wed, 3 Jan, 2024, 22:40 Adrian Kla

Re: Sample data generator for performance testing

On 1/2/24 23:23, arun chirappurath wrote: Hi All, Do we have any open source tools which can be used to create sample data at scale from our postgres databases? Which considers data distribution and randomness Is this for all tables in the database or a subset? Does it need to deal with for

Sample data generator for performance testing

Hi All, Do we have any open source tools which can be used to create sample data at scale from our postgres databases? Which considers data distribution and randomness Regards, Arun

Re: Testing - Please ignore/delete this message

The way to check if your email was received by the list is to search for it in the archives. https://www.postgresql.org/search/?m=1 Please stop sending testing emails to the entire hundreds of thousands or millions of people on this list. David J. On Tuesday, January 2, 2024, Ray O'Do

Re: Testing - Please ignore/delete this message

On 02/01/2024 13:12, Arbol One wrote: Did it work? No idea - I ignored it...! :-) Ray. -- Raymond O'Donnell // Galway // Ireland r...@rodonnell.ie

Re: Testing - Please ignore/delete this message

Received! On Tue, Jan 2, 2024, 8:13 AM Arbol One wrote: > Did it work? > > -- > ArbolOne.ca > Using Fire Fox and Thunderbird. > ArbolOne is composed of students and volunteers dedicated to providing > free services to charitable organizations. > ArbolOne on Java Development is in progress [ í ]

Testing - Please ignore/delete this message

Did it work? -- ArbolOne.ca Using Fire Fox and Thunderbird. ArbolOne is composed of students and volunteers dedicated to providing free services to charitable organizations. ArbolOne on Java Development is in progress [ í ]

Re: Inquiry Regarding Initial Seed for pgsql Protocol Fuzz Testing

On 11/23/23 22:36, Cherry Pang wrote: Again please use Reply All and include the list in your responses. Ccing list. Sure, I'm interested in experimenting with SGFuzz, a tool mentioned in the 'Stateful Greybox Fuzzing' paper, to conduct fuzz testing on the PostgreSQL database

Re: Inquiry Regarding Initial Seed for pgsql Protocol Fuzz Testing

currently using them would help those that also do this to guide you. Adrian Klaver <mailto:adrian.kla...@aklaver.com>> 于2023年11月23日周四 23:54写道： On 11/22/23 22:56, Cherry Pang wrote: > hello! > I am a novice enthusiast in the field of fuzz testing and have an

Re: Inquiry Regarding Initial Seed for pgsql Protocol Fuzz Testing

On 11/22/23 22:56, Cherry Pang wrote: hello! I am a novice enthusiast in the field of fuzz testing and have an interest in conducting fuzz testing for the SQLite protocol. I understand that testing the logic bugs or crash bugs in Data Manipulation Language (DML) functionalities differs

Inquiry Regarding Initial Seed for pgsql Protocol Fuzz Testing

hello! I am a novice enthusiast in the field of fuzz testing and have an interest in conducting fuzz testing for the SQLite protocol. I understand that testing the logic bugs or crash bugs in Data Manipulation Language (DML) functionalities differs significantly, and as such, I am unsure about the

Re: Binding Postgres to port 0 for testing

in fun learning than reducing work :) Generally I would agree that reusing existing and testing code to run this would be better unless there's a really good reason not to do that. On Sun, Mar 26, 2023 at 7:27 PM Michael Paquier wrote: > On Sat, Mar 25, 2023 at 11:01:33AM -0600, Markus

Re: Binding Postgres to port 0 for testing

ion test framework for an application > that I > > am building. For this project I am planning to use PostgreSQL. > > > > For testing purposes I'd like to always start with an empty database, > > populate data, and, if the test was successful, delete everything

Re: Binding Postgres to port 0 for testing

On Sun, Mar 26, 2023 at 10:49:33PM -0600, Markus Pilman wrote: > I somehow didn't consider looking at the postgres tests, though it makes > sense that they need to solve this problem. If I read the perl code > correctly though it seems that this could, in theory, cause a race? The > script checks f

Re: Binding Postgres to port 0 for testing

On Sat, Mar 25, 2023 at 11:01:33AM -0600, Markus Pilman wrote: > Now the problem is that I need to find a TCP port for each running postgres > instance. There's multiple ways to do this, but by far the easiest one I > know is to bind to port 0. So my plan was to start postgres with "-p 0" and > the

Re: Binding Postgres to port 0 for testing

> On 25/03/2023 20:10 CET Markus Pilman wrote: > > Thanks for the suggestions. I didn't know about pg_virtualenv, that's > interesting. Though it seems to achieve something similar as to containerize > the test (potentially in a more platform independent way). Though it seems > pg_virtualenv is mo

Re: Binding Postgres to port 0 for testing

> On 25/03/2023 18:01 CET Markus Pilman wrote: > > I am building a simple integration test framework for an application that I > am building. For this project I am planning to use PostgreSQL. > > For testing purposes I'd like to always start with an empty database, >

Re: Binding Postgres to port 0 for testing

s your program with suitable environment variables to access that cluster, which includes choosing an available port. This was in fact made for integration testing, though I use it for quickly spinning up throwaway DBs for one-shot tools as well. bye, //mirabilos -- Infrastrukturexperte • tarent sol

Binding Postgres to port 0 for testing

Hi all, I am building a simple integration test framework for an application that I am building. For this project I am planning to use PostgreSQL. For testing purposes I'd like to always start with an empty database, populate data, and, if the test was successful, delete everything. These

Re: Slow down dev database transactions/second for testing?

On Sun, Feb 5, 2023 at 3:05 PM Erik Wienhold wrote: > > On 05/02/2023 23:17 CET Richard Brockie > wrote: > > > > I maintain a Django webapp that uses postgresql and can create > inefficient > > queries if I'm not careful. I'm looking for ways to mimic a congested db > > server in development to

Re: Slow down dev database transactions/second for testing?

> On 05/02/2023 23:17 CET Richard Brockie wrote: > > I maintain a Django webapp that uses postgresql and can create inefficient > queries if I'm not careful. I'm looking for ways to mimic a congested db > server in development to expose these queries. pgbench is what your looking for: https://ww

Slow down dev database transactions/second for testing?

Hi, I maintain a Django webapp that uses postgresql and can create inefficient queries if I'm not careful. I'm looking for ways to mimic a congested db server in development to expose these queries. The configuration of postgresql is complicated - is there a simple method by which I could, for ex

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

On 10/4/21 10:28 AM, Adrian Klaver wrote: On 10/4/21 10:10 AM, Shaozhong SHI wrote: Hello, Adrian Klaver, What is the robust way to upgrade Pandas? Carefully. The most recent version is 1.3.3, which is approximately 5 versions ahead of where you are now. The big jump is when Pandas went from

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

On 10/4/21 10:10 AM, Shaozhong SHI wrote: Hello, Adrian Klaver, What is the robust way to upgrade Pandas? Carefully. The most recent version is 1.3.3, which is approximately 5 versions ahead of where you are now. The big jump is when Pandas went from 0.25 to 1.0. See docs here: https://pan

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

Hello, Adrian Klaver, What is the robust way to upgrade Pandas? Regards, David On Monday, 4 October 2021, Adrian Klaver wrote: > On 10/4/21 9:20 AM, Shaozhong SHI wrote: > >> Hello, Adrian Klaver, >> >> Pandas version is 0.23.0. >> > > The reason the below does not work is method did not show up

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

On 10/4/21 9:20 AM, Shaozhong SHI wrote: Hello, Adrian Klaver, Pandas version is 0.23.0. The reason the below does not work is method did not show up until pandas 0.24.0. I used the following code: def psql_insert_copy(table, conn, keys, data_iter):     # gets a DBAPI connection that ca

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

> On Oct 4, 2021, at 10:20 AM, Shaozhong SHI wrote: > > Hello, Adrian Klaver, > > Pandas version is 0.23.0. > > I used the following code: > > def psql_insert_copy(table, conn, keys, data_iter): > # gets a DBAPI connection that can provide a cursor > dbapi_conn = conn.connection >

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

Hello, Adrian Klaver, Pandas version is 0.23.0. I used the following code: def psql_insert_copy(table, conn, keys, data_iter): # gets a DBAPI connection that can provide a cursor dbapi_conn = conn.connection with dbapi_conn.cursor() as cur: s_buf = StringIO() writer =

Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

On 10/4/21 8:44 AM, Shaozhong SHI wrote: Has anyone tested this one? A Fast Method to Bulk Insert a Pandas DataFrame into Postgres · Ellis Valentiner I tried psql_insert_copy method, but I got the fo

Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

Has anyone tested this one? A Fast Method to Bulk Insert a Pandas DataFrame into Postgres · Ellis Valentiner I tried psql_insert_copy method, but I got the following error message. to_sql() got an unexpec

Re: plpgsql unit testing and code coverage

ail.com> napsal: > >> Hello, >> >> I'm a fan of unit testing and related matters but have used it only on >> client applications, not on database implemented logic. I recently joined a >> project whit dozens of PL functions and procedures. >> >>

Re: plpgsql unit testing and code coverage

čt 31. 12. 2020 v 13:21 odesílatel Joao Miguel Ferreira < joao.miguel.c.ferre...@gmail.com> napsal: > Hello, > > I'm a fan of unit testing and related matters but have used it only on > client applications, not on database implemented logic. I recently joined a >

Re: plpgsql unit testing and code coverage

> On Dec 31, 2020, at 7:20 AM, Joao Miguel Ferreira > wrote: > > Hello, > > I'm a fan of unit testing and related matters but have used it only on client > applications, not on database implemented logic. I recently joined a project > whit dozens of PL func

plpgsql unit testing and code coverage

Hello, I'm a fan of unit testing and related matters but have used it only on client applications, not on database implemented logic. I recently joined a project whit dozens of PL functions and procedures. So, it would be great for me to find a way to execute unit tests on those function

Re: Highly academic: local etcd & Patroni Cluster for testing on a single host

Hi Ian, > On 26. Feb, 2020, at 09:27, Ian Barwick wrote: > It doesn't - it takes the tablespace location directly from the symlink in > the "pg_tblspc" > directory (since PostgreSQL 9.2), so you can manipulate those manually, > provided the server > isn't running of course. > > Not sure how th

Re: Highly academic: local etcd & Patroni Cluster for testing on a single host

Hi Alexander, > On 26. Feb, 2020, at 09:19, Alexander Kukushkin wrote: > That's not correct, Patroni will happily pick up the existing data directory. maybe I didn't express myself correctly. Of course it does. Otherwise replication wouldn't make sense. I meant, starting a Patroni replica for t

Re: Highly academic: local etcd & Patroni Cluster for testing on a single host

On 2020/02/26 16:55, Paul Förster wrote: Hi Ian, On 26. Feb, 2020, at 01:38, Ian Barwick wrote: Assuming the standby/replica is created using pg_basebackup, you can use the -T/--tablespace-mapping option to remap the tablespace directories. no, with Patroni, replicas are always initiated by

Re: Highly academic: local etcd & Patroni Cluster for testing on a single host

Hi, On Wed, 26 Feb 2020 at 08:55, Paul Förster wrote: > no, with Patroni, replicas are always initiated by Patroni. Patroni copies > the whole PGDATA including everything (postgresql.conf, etc.) in it to the > replica site. When launching Patroni for the first time, all you need is its > yaml

Re: Highly academic: local etcd & Patroni Cluster for testing on a single host

Hi Ian, > On 26. Feb, 2020, at 01:38, Ian Barwick wrote: > > Assuming the standby/replica is created using pg_basebackup, you can use the > -T/--tablespace-mapping option to remap the tablespace directories. no, with Patroni, replicas are always initiated by Patroni. Patroni copies the whole P

Re: Highly academic: local etcd & Patroni Cluster for testing on a single host

On 2020/02/26 0:41, Paul Förster wrote: Hi, I have set up an etcd & Patroni cluster on a single machine for testing purposes as follows: /data/pg01a/db as data directory for the first "node" /data/pg01b/db as data directory for the second "node" I have set up Patroni

Highly academic: local etcd & Patroni Cluster for testing on a single host

Hi, I have set up an etcd & Patroni cluster on a single machine for testing purposes as follows: /data/pg01a/db as data directory for the first "node" /data/pg01b/db as data directory for the second "node" I have set up Patroni to make each PostgreSQL database clu

testing post through gmane.io

gmane.org is now gmane.io hope this works

Re: testing in ESQL/C if a CUSROR "foo" is open?

El día viernes, diciembre 27, 2019 a las 06:55:22a. m. +0100, Matthias Apitz escribió: > > Hello, > > Is there any way (without looking up the name in table 'pg_cursors') to see > if a > cursor "foo" is still open? > I found this hint about 'pg_cursors' in stackoverflow: https://stackoverfl

testing in ESQL/C if a CUSROR "foo" is open?

Hello, Is there any way (without looking up the name in table 'pg_cursors') to see if a cursor "foo" is still open? Thanks matthias -- Matthias Apitz, ✉ g...@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub signature.asc Descripti

Re: Testing an extension against multiple versions of Postgresql

Thanks!! Rhys Peace & Love|Live Long & Prosper On Sat, Jul 13, 2019 at 3:15 AM Luca Ferrari wrote: > On Sat, Jul 13, 2019 at 8:03 AM Ian Barwick > wrote: > > > So the questions are: > > > Can I have make install & make installcheck run against multiple > versions at the same time or how do I

Re: Testing an extension against multiple versions of Postgresql

On Sat, Jul 13, 2019 at 8:03 AM Ian Barwick wrote: > > So the questions are: > > Can I have make install & make installcheck run against multiple versions > > at the same time or how do I tell the installcheck to run against the 11 > > server. > > Try setting relevant environment variables [*] f

Re: Testing an extension against multiple versions of Postgresql

On 7/13/19 10:55 AM, Rhys A.D. Stewart wrote: Greetings All, I have both postgresql versions 10 and 11 installed on my box. I'm working on an extension and just realized that 'make install' installs the extension to the 11 server, but 'make installcheck' runs against the 10 server (I had prev

Testing an extension against multiple versions of Postgresql

Greetings All, I have both postgresql versions 10 and 11 installed on my box. I'm working on an extension and just realized that 'make install' installs the extension to the 11 server, but 'make installcheck' runs against the 10 server (I had previously installed the extension there). Running psq

testing for DEFAULT insert value in ON CONFLICT DO UPDATE query

Hi Is there any way to tell if a conflicting row in an multi-line INSERT used the DEFAULT directive? I would like to be able to upsert a bunch of rows and only UPDATE the conflicting rows where the value set was not new - the way I do this for NULLable columns is to just write NULL in the INSERT

testing

Sorry, outlook is not showing all mails.  Trying this now.