pg_repack and locks

2025-01-13 Thread nicolas
modified in the source table during the repack. If I drop table repack tables, I will loose all data modifications done on source table how can I properly cleanup the database ? Hope this is clear and that somebody can help best raegards, Nicolas

Re: Failing streaming replication on PostgreSQL 14

2024-04-22 Thread Nicolas Seinlet
lp me locate the issue's origin? thanks, Nicolas. On Tuesday, April 16th, 2024 at 09:56, Nicolas Seinlet wrote: > > > Hello, > > > What exactly is "cyphered ZFS"? Can you reproduce the problem with some > > other filesystem? If it's somethin

Re: Failing streaming replication on PostgreSQL 14

2024-04-16 Thread Nicolas Seinlet
rom time to time, without knowing what triggers the error. thanks for helping, Nicolas. publickey - nicolas@seinlet.com - 0xCAEB7FAF.asc Description: application/pgp-keys signature.asc Description: OpenPGP digital signature

Re: Failing streaming replication on PostgreSQL 14

2024-04-15 Thread Nicolas Seinlet
On Monday, April 15th, 2024 at 14:36, Ron Johnson wrote: > On Mon, Apr 15, 2024 at 2:53 AM Nicolas Seinlet wrote: > > > Hello everyone, > > > > Since I moved some clusters from PostgreSQL 12 to 14, I noticed random > > failures in streaming replication. I

Failing streaming replication on PostgreSQL 14

2024-04-14 Thread Nicolas Seinlet
L solves the issue. We've added another secondary and noticed the issue can appear on one of the secondaries, not both at the same time. What can I do to detect the origin of this issue? Have a nice week, Nicolas. signature.asc Description: OpenPGP digital signature

Re: plan using BTree VS GIN

2023-06-25 Thread Nicolas Seinlet
On Friday, June 23rd, 2023 at 2:52 PM, Laurenz Albe wrote: > > > On Fri, 2023-06-23 at 12:08 +, Nicolas Seinlet wrote: > > > we faced an issue with a select query on a relatively large table on our > > database. > > The query involves one single tab

plan using BTree VS GIN

2023-06-23 Thread Nicolas Seinlet
n2  (cost=0.00..226.14 rows=19 width=0) (actual time=8.414..8.415 rows=0 loops=1)                            Index Cond: (unaccent((res_partner.vat)::text) ~~* '%nse%'::text)                            Buffers: shared hit=225 read=62                      ->   Bitmap Index Scan on res_partner_comp_reg_idx3  (cost=0.00..42.01 rows=654 width=0) (actual time=0.099..0.099 rows=0 loops=1)                             Index Cond: (unaccent((res_partner.company_registry)::text) ~~* '%nse%'::text)                            Buffers: shared hit=42  Planning Time: 20.921 ms   Execution Time: 496.296 ms (33 rows) How can we have PostgreSQL choose the second query plan? If we look at the expected VS actual rows, statistics look quite accurate. Thanks for reading, Nicolas. publickey - nicolas@seinlet.com - 0xCAEB7FAF.asc Description: application/pgp-keys signature.asc Description: OpenPGP digital signature

Re: More records after sort

2021-07-21 Thread Nicolas Seinlet
Thanks all, I'll try this on Monday when I go back to the office. Nicolas. ‐‐‐ Original Message ‐‐‐ On Wednesday, July 21st, 2021 at 02:55, Rob Sargent wrote: > > Query: > > > > INSERT INTO invl_aml_mapping_temp(invl_id, aml_id, cond) > > > >    

Re: More records after sort

2021-07-20 Thread Nicolas Seinlet
On Tuesday, July 20th, 2021 at 16:34, Tom Lane wrote: > Nicolas Seinlet nico...@seinlet.com writes: > > > I'm facing a strange behaviour and I don't understand why. From a wider > > query plan, https://explain.dalibo.com/plan/7yh ,a table is scanned and > &g

More records after sort

2021-07-20 Thread Nicolas Seinlet
del or full query. Thanks again for reading me, Nicolas. publickey - nicolas@seinlet.com - 0xCAEB7FAF.asc Description: application/pgp-keys signature.asc Description: OpenPGP digital signature

Re: second CTE kills perf

2021-06-24 Thread Nicolas Seinlet
Hi, thanks for all. I replaced row_number() with some computed int which speeds up a lot the query. ‐‐‐ Original Message ‐‐‐ On Tuesday, June 22nd, 2021 at 15:53, Tom Lane wrote: > Nicolas Seinlet nico...@seinlet.com writes: > > > I'm trying to understand this

second CTE kills perf

2021-06-22 Thread Nicolas Seinlet
AS (SELECT row_number() over(),x,y,z FROM cte1) SELECT * FROM cte2 WHERE x=32; The real examples, with query plans: https://explain.dalibo.com/plan/98A https://explain.dalibo.com/plan/o6X4 Thanks for your time, Nicolas Seinlet. publickey - nicolas@seinlet.com - 0xCAEB7FAF.asc Description: applicatio

RE: Open source licenses

2021-04-29 Thread DAVID Nicolas
"risk" by building from source ? Best regards, Nicolas DAVID WORKNC DENTAL Project Manager Manufacturing Intelligence division Hexagon E: nicolas.da...@hexagon.com HexagonMI.com CONFIDENTIALITY NOTICE: This email and any attachments may be confidential and protected by legal privilege

RE: Open source licenses

2021-04-07 Thread DAVID Nicolas
, Nicolas DAVID -Original Message- From: Laurenz Albe Sent: 06 April 2021 16:13 To: DAVID Nicolas ; Adrian Klaver ; pgsql-gene...@postgresql.org Subject: Re: Open source licenses This email is not from Hexagon's Office 365 instance. Please be careful while clicking links, op

RE: Open source licenses

2021-04-06 Thread DAVID Nicolas
st ? Best regards, Nicolas DAVID

Open source licenses

2021-03-18 Thread DAVID Nicolas
OpenSource license type for each component ? Or even, if possible, with the license file for each component ? Best regards, Nicolas DAVID WORKNC DENTAL Project Manager Manufacturing Intelligence division Hexagon E: nicolas.da...@hexagon.com<mailto:nicolas.da...@hexagon.com> Hexagon 440 Rou

RE: PG13 partitioned table logical replication

2020-09-10 Thread Nicolas Sornin
Hello Peter, That's what I thought. I'll find another way. Thank you for your time. Regards, Nicolas SORNIN    IT Team Lead This email message as well as all attachments are for the sole use of the intended recipient(s) and may contain confidential and privileged i

PG13 partitioned table logical replication

2020-09-10 Thread Nicolas Sornin
s expecting this use case to work given table names and column names/types are the same on both sides. Is this the intended behavior and simply out of the scope of the changes introduced by PG13 ? Thank you, Best regards, Nicolas SORNIN IT Team Lead This email message as well as all attachmen

Re: ERROR: COPY escape must be a single one-byte character (multi-delimiter appears to work on Postgres 9.0 but does not on Postgres 9.2)

2019-11-16 Thread Nicolas Paris
myself through yum. > > Any help would be greatly appreciated. > > Also, is there a way to copy the old Postgres server, dependencies, and > executables to our new server, in case the source was modified? > > Brandon Ragland > Software Engineer > BREAKFRONT SOFTWARE > Office: 704.688.4085 | Mobile: 240.608.9701 | Fax: 704.973.0607 -- nicolas

Re: How to import Apache parquet files?

2019-11-10 Thread Nicolas Paris
allocate enough resources to understand how to implement a parquet file import > with that. > > I really would like follow a person with much more knowledge than me about > either PostgreSQL or Apache parquet format instead of inventing a bad wheel. > > Any hints very welcome, > thank you very much for your attention! > John -- nicolas

announce: spark-postgres 3 released

2019-11-10 Thread Nicolas Paris
official repository: https://framagit.org/parisni/spark-etl/tree/master/spark-postgres And its mirror on microsoft github: https://github.com/EDS-APHP/spark-etl/tree/master/spark-postgres -- nicolas

[QUESTION] Set /MD flag on Windows Build?

2019-09-30 Thread Nicolas Lehman
Hello, Which line(s) in the perl build files would I modify to generate Visual Studio project files with the /MD flag set to include the vcruntime lib for example? Thank you, Nicolas

Re: Where **not** to use PostgreSQL?

2019-02-28 Thread Nicolas Grilly
On Thu, Feb 28, 2019 at 2:12 PM Chris Travers wrote: > Where I did this on the TB scale, we had some sort of ranking but it was > not based on ts_rank. > > On the PB scale systems I work on now, it is distributed, and we don't > order in PostgreSQL (or anywhere else, though if someone wants to wr

Re: Where **not** to use PostgreSQL?

2019-02-28 Thread Nicolas Grilly
. It's because the indexes don't contain the necessary information for ranking, and because of this the heap has to be consulted, which implies a lot of random IO. I'd be curious to know a bit more about your experience in this regard. Regards, Nicolas Grilly PS: A potential s

Re: multiple configurations with repmgr

2019-01-08 Thread Nicolas Karolak
As far as i know, repmgr work at the "cluster" level so you would need to run another postgres "cluster" instance (running on another port) and another repmgrd instance (which would load a configuration pointing to the new "cluster"). Regards, Nicolas KAROLAK | L

Re: Default Privilege Table ANY ROLE

2018-11-21 Thread Nicolas Paris
, but I wan't them to be able to access any table in that schema. Because many users are able to create tables in that schema, I have to write one ALTER DEFAULT PRIVILEGE foreach user. Any chance to have superuser per schema ? -- nicolas

Re: Default Privilege Table ANY ROLE

2018-11-15 Thread Nicolas Paris
On Wed, Nov 14, 2018 at 03:19:00PM +0100, Nicolas Paris wrote: > Hi > > I d'like my user be able to select on any new table from other users. > > > ALTER DEFAULT PRIVILEGES FOR ROLE "theowner1" IN SCHEMA "myschema" GRANT > > select ON TAB

Re: Default Privilege Table ANY ROLE

2018-11-14 Thread Nicolas Paris
oking for below (but is not allowed): > ALTER DEFAULT PRIVILEGES FOR ROLE *.* IN SCHEMA "myschema" GRANT select > ON TABLES TO "myuser" -- nicolas

Re: Default Privilege Table ANY ROLE

2018-11-14 Thread Nicolas Paris
On Wed, Nov 14, 2018 at 09:04:44PM +0100, Laurenz Albe wrote: > Nicolas Paris wrote: > > I d'like my user be able to select on any new table from other users. > > > > > ALTER DEFAULT PRIVILEGES FOR ROLE "theowner1" IN SCHEMA "myschema" >

Re: Default Privilege Table ANY ROLE

2018-11-14 Thread Nicolas Paris
On Wed, Nov 14, 2018 at 10:05:51AM -0600, Ron wrote: > On 11/14/2018 08:19 AM, Nicolas Paris wrote: > > Hi > > > > I d'like my user be able to select on any new table from other users. > > > Would ROLE Groups solve your problem? Maybe yes, not sure what i

Default Privilege Table ANY ROLE

2018-11-14 Thread Nicolas Paris
CHEMA "myschema" GRANT > select ON TABLES TO "myuser" > ... Do I really have to repeat the command for all users ? The problem is I have many user able to create tables and all of them have to read each other. Thanks -- nicolas

Re: Is there a way to speed up WAL replay?

2018-10-31 Thread Nicolas Grilly
This tool may be useful: https://github.com/joyent/pg_prefaulter Faults pages into PostgreSQL shared_buffers or filesystem caches in advance of WAL apply Nicolas On Wed, Oct 31, 2018 at 6:38 AM Torsten Förtsch wrote: > Hi, > > I am working on restoring a database from a base bac

Re: Full-text Search - Thesaurus relationships

2018-10-31 Thread Nicolas Paris
On Wed, Oct 31, 2018 at 10:49:04AM +0100, Laurenz Albe wrote: > Nicolas Paris wrote: > > > > The documentation[1] says thesaurus can include informations of terms > > > > relationships such broader terms, preferred terms ... > > > > I haven't been able t

Re: Full-text Search - Thesaurus relationships

2018-10-31 Thread Nicolas Paris
; > postgres. Is there any keyword to and associated syntax to make use of > > them ? > No, it should happen automatically. If "broader than" or "narrower than" have the same behavior than "is equivalent to" I cannot figure out what's the purpose of them. -- nicolas

Full-text Search - Thesaurus relationships

2018-10-30 Thread Nicolas Paris
[1]: https://www.postgresql.org/docs/current/static/textsearch-dictionaries.html#TEXTSEARCH-THESAURUS -- nicolas

Re: increasing HA

2018-09-05 Thread Nicolas Karolak
e primary but not according to the two other nodes, i'm fenced") Regards, Nicolas KAROLAK | SysAdmin 6-8, rue André Voguet - 94200 Ivry-sur-Seine +33 1 77 56 77 96 | www.ubicast.eu | www.ubicast.tv Le mer. 5 sept. 2018 à 18:39, Dmitri Maziuk a écrit : > > On Wed, 5 Sep 2018 17:45:05

Re: Multiple COPY on the same table

2018-08-20 Thread Nicolas Paris
> Can I split a large file into multiple files and then run copy using > each file. AFAIK, copy command locks the table[1] while there is no mention of this in the documentation[2]. > Will the performance boost by close to 4x?? You might be interested in the pbBulkInsert tool[3] that allows

Re: Using COPY to import large xml file

2018-06-25 Thread Nicolas Paris
2018-06-25 17:30 GMT+02:00 Anto Aravinth : > > > On Mon, Jun 25, 2018 at 8:54 PM, Anto Aravinth < > anto.aravinth@gmail.com> wrote: > >> >> >> On Mon, Jun 25, 2018 at 8:20 PM, Nicolas Paris >> wrote: >> >>> >>> 2018-06-2

Re: Using COPY to import large xml file

2018-06-25 Thread Nicolas Paris
2018-06-25 16:25 GMT+02:00 Anto Aravinth : > Thanks a lot. But I do got lot of challenges! Looks like SO data contains > lot of tabs within itself.. So tabs delimiter didn't work for me. I thought > I can give a special demiliter but looks like Postrgesql copy allow only > one character as delimit

Re: Load data from a csv file without using COPY

2018-06-19 Thread Nicolas Paris
hi AFAIK you can use copy from a jdbc command since copy allows to stream data (from stdin version) However while faster than INSERT INTO, this might lock the target table during the process 2018-06-19 22:16 GMT+02:00 Ravi Krishna : > In order to test a real life scenario (and use it for benchm

Re: Sort is generating rows

2018-06-10 Thread Nicolas Seinlet
Hi, a currency rate can have no company, and is then applicable to currencies which have no rate specific for the company. Le dim. 10 juin 2018 à 17:24, Adrian Klaver a écrit : > On 06/05/2018 07:58 AM, Nicolas Seinlet wrote: > > Hi, > > > > I've tried some tests, b

Re: Sort is generating rows

2018-06-05 Thread Nicolas Seinlet
Hi, I've tried some tests, by generating various datas in the res_currency_rate table. If I generate res_currency_rate rows for unsused currencies, this doesn't influence the execution time. if I generate more res_currency_rate for used currencies, this slower the query. If I generate 100 rates,

Re: Sort is generating rows

2018-06-05 Thread Nicolas Seinlet
l.order_id, t.uom_id, t.categ_id, s.name, s.date_order, s.confirmation_date, s.partner_id, s.user_id, s.state, s.company_id, s.pricelist_id, s.analytic_account_id, s.team_id, p.product_tmpl_id, partner.country_id, partner.commercial_partner_id; And thanks again for the help. Have a nice day,

Re: Sort is generating rows

2018-06-01 Thread Nicolas Seinlet
D (daterange(name, COALESCE(date_end, (now())::date)) @> (COALESCE((s.date_order)::timestamp with time zone, now()))::date)) Rows Removed by Filter: 502 Planning time: 5.731 ms Execution time: 8944.950 ms (45 rows) Have a nice day, Nicolas. 2018-

Sort is generating rows

2018-05-31 Thread Nicolas Seinlet
w, the more currency rates, the slowest the query. There's not that much currency rates (1k in this case), as you can only have one rate per day per currency. Have a nice day, Nicolas.

COPY error when \. char

2018-03-20 Thread Nicolas Paris
Hello I get an error when loading this kind of csv: > test.csv: "hello ""world"" " "\." "this works " "this \. does not" > table: create table test (field text); > sql: \copy test (field) from 'test.csv' CSV quote '"' ESCAPE '"'; ERROR: unterminated CSV quoted field CONTEXTE : COPY test, line

RE: Barman 2.3 errors

2018-02-14 Thread GALLIANO Nicolas
Hi, Just to say that i cannot using replication streaming but ssh shipping wal works … I’m trying barman product like that. Thanks nico De : GALLIANO Nicolas Envoyé : mardi 13 février 2018 10:15 À : Ahmed, Nawaz ; pgsql-gene...@postgresql.org Objet : RE: Barman 2.3 errors Hi 1/ thanks for

RE: Barman 2.3 errors

2018-02-13 Thread GALLIANO Nicolas
n byte See log file for more details. And in the log i still have the UnicodeDecodeError … On a post (https://sourceforge.net/p/pgbarman/tickets/88/) i’ve found that it’s a barman bug with a workaround … but the solution don’t work for me ... I’m still looking for a solution ☹ Thanks for y

Barman 2.3 errors

2018-02-12 Thread GALLIANO Nicolas
redundancy requirements: OK (have 0 backups, expected at least 0) pg_basebackup: OK pg_basebackup compatible: OK pg_basebackup supports tablespaces mapping: OK pg_receivexlog: OK pg_receivexlog compatible: OK receive-wal running: FAILED (See the Barman log file for more details) archiver errors: OK Have you ever had same problem with barman ? Thanks for you help. nicolas

Re: New Copy Formats - avro/orc/parquet

2018-02-11 Thread Nicolas Paris
Le 11 févr. 2018 à 22:19, Adrian Klaver écrivait : > On 02/11/2018 12:57 PM, Nicolas Paris wrote: > > Le 11 févr. 2018 à 21:53, Andres Freund écrivait : > > > On 2018-02-11 21:41:26 +0100, Nicolas Paris wrote: > > > > I have also the storage and network transfers

Re: New Copy Formats - avro/orc/parquet

2018-02-11 Thread Nicolas Paris
Le 11 févr. 2018 à 21:53, Andres Freund écrivait : > On 2018-02-11 21:41:26 +0100, Nicolas Paris wrote: > > I have also the storage and network transfers overhead in mind: > > All those new formats are compressed; this is not true for current > > postgres BINARY format and

Re: New Copy Formats - avro/orc/parquet

2018-02-11 Thread Nicolas Paris
Le 11 févr. 2018 à 21:03, Andres Freund écrivait : > > > On February 11, 2018 12:00:12 PM PST, Nicolas Paris > wrote: > >> > That is true, but the question is how significant the overhead is. > >If > >> > it's 50% then reducing it would make per

Re: New Copy Formats - avro/orc/parquet

2018-02-11 Thread Nicolas Paris
> > That is true, but the question is how significant the overhead is. If > > it's 50% then reducing it would make perfect sense. If it's 1% then no > > one if going to be bothered by it. > > I think it's pretty clear that it's going to be way way much more than > 1%. Good news but not sure to a

Re: New Copy Formats - avro/orc/parquet

2018-02-10 Thread Nicolas Paris
> > I d'found useful to be able to import/export from postgres to those modern > > data > > formats: > > - avro (c writer=https://avro.apache.org/docs/1.8.2/api/c/index.html) > > - parquet (c++ writer=https://github.com/apache/parquet-cpp) > > - orc (all writers=https://github.com/apache/orc) > >

New Copy Formats - avro/orc/parquet

2018-02-10 Thread Nicolas Paris
Hello I d'found useful to be able to import/export from postgres to those modern data formats: - avro (c writer=https://avro.apache.org/docs/1.8.2/api/c/index.html) - parquet (c++ writer=https://github.com/apache/parquet-cpp) - orc (all writers=https://github.com/apache/orc) Something like : COPY

psql format result as markdown tables

2018-01-13 Thread Nicolas Paris
Hello I wonder if someone knows how to configure psql to output results as markdown tables. Then instead of : SELECT * FROM (values(1,2),(3,4)) as t; column1 | column2 -+- 1 | 2 3 | 4 Get the result as : SELECT * FROM (values(1,2),(3,4)) as t; | colum

Re: Foreign Data Wrapper

2017-12-21 Thread Nicolas Paris
Le 21 déc. 2017 à 13:24, Virendra Shaktawat - Quipment India écrivait : > Quipment Logo > > Hello , > > > > I have stuck at foreign data wrapper. I am accessing the form MS Sql Server. > Foreign table has been created with data. unfortunately I am unable to perform > DML operation like insert,