Preserve attstattarget on REINDEX CONCURRENTLY

2021-02-04 Thread Ronan Dunklau
-- +-+-+-- date_trunc | timestamp without time zone | yes | date_trunc('day'::text, ts) | plain | btree, for table "public.t1" I'm attaching a patch possibly solving the problem, but maybe the proposed changes will be too int

Re: Preserve attstattarget on REINDEX CONCURRENTLY

2021-02-04 Thread Ronan Dunklau
Hmmm, that sure seems like a bug, or at least unexpected behavior (that I don't see mentioned in the docs). But the patch seems borked in some way: $ patch -p1 < ~/keep_attstattargets_on_reindex_concurrently.patch patch: Only garbage was found in the patch input. There seem to be strange

Re: Preserve attstattarget on REINDEX CONCURRENTLY

2021-02-04 Thread Ronan Dunklau
atch does that, and adds a test cheaper than what was > proposed. There is a minor release planned for next week, so I may be > better to wait after that so as we have enough time to agree on a > solution. Looks good to me ! Thank you. -- Ronan Dunklau

Re: Non-superuser subscription owners

2021-12-07 Thread Ronan Dunklau
e transfer of subscriptions to non-superuser owners. > 3) Allow the creation of subscriptions by non-superusers who are members of > some as yet to be created predefined role, say "pg_create_subscriptions" This roadmap seems sensible. -- Ronan Dunklau

Re: Use generation context to speed up tuplesorts

2021-12-08 Thread Ronan Dunklau
robably something we can improve here. I'll try to see if I can understand more precisely what is happening. -- Ronan Dunklau

Re: Use generation context to speed up tuplesorts

2021-12-16 Thread Ronan Dunklau
Le mercredi 8 décembre 2021, 22:07:12 CET Tomas Vondra a écrit : > On 12/8/21 16:51, Ronan Dunklau wrote: > > Le jeudi 9 septembre 2021, 15:37:59 CET Tomas Vondra a écrit : > >> And now comes the funny part - if I run it in the same backend as the > >> > >>

Re: Use generation context to speed up tuplesorts

2021-12-16 Thread Ronan Dunklau
Le jeudi 16 décembre 2021, 11:56:15 CET Ronan Dunklau a écrit : > I will follow up with a benchmark of the test sorting a table with a width > varying from 1 to 32 columns. > So please find attached another benchmark for that case. The 3 different patchsets tested are: - master

Re: Use generation context to speed up tuplesorts

2021-12-17 Thread Ronan Dunklau
Le jeudi 16 décembre 2021, 18:00:56 CET Tomas Vondra a écrit : > On 12/16/21 17:03, Ronan Dunklau wrote: > > Le jeudi 16 décembre 2021, 11:56:15 CET Ronan Dunklau a écrit : > >> I will follow up with a benchmark of the test sorting a table with a > >> width > &

Re: Use generation context to speed up tuplesorts

2021-12-17 Thread Ronan Dunklau
Le vendredi 17 décembre 2021, 09:08:06 CET Ronan Dunklau a écrit : > It is my understanding that malloc will try to compact memory by moving it > around. So the memory should be actually be released to the kernel at some > point. In the meantime, malloc can reuse it for our next invocati

Re: Use generation context to speed up tuplesorts

2021-12-17 Thread Ronan Dunklau
it, just not released as eagerly when it's allocated. Or do you want a benchmark with an even bigger initial block size ? With the growing blocks patch with a large initial size ? I can run either, I just want to understand what is interesting to you. One thing that would be interesting would be to trace the total amount of memory allocated in the different cases. This is something I will need to do anyway when I propose that patch; Best regards, -- Ronan Dunklau

Re: Use generation context to speed up tuplesorts

2022-01-07 Thread Ronan Dunklau
Le vendredi 7 janvier 2022, 13:03:28 CET Tomas Vondra a écrit : > On 1/7/22 12:03, Ronan Dunklau wrote: > > Le vendredi 31 décembre 2021, 22:26:37 CET David Rowley a écrit : > >> I've attached some benchmark results that I took recently. The > >> spreadsheet

Matching domains-over-enums to anyenum types

2022-01-10 Thread Ronan Dunklau
haviour for domains over ranges and multiranges, I don't see the harm in doing the same for domains over enums. What do you think ? -- Ronan Dunklau

Re: Proposal: More structured logging

2022-01-11 Thread Ronan Dunklau
gt; You should also update file-fdw.sgml - which I only think of since we forgot > in to update it before e568ed0eb and 0830d21f5. config.sgml should have a > comment as a reminder to do that. Done, and I added anoher commit per your suggestion to add this comment. Thank you for this re

Re: Proposal: More structured logging

2022-01-17 Thread Ronan Dunklau
Le samedi 15 janvier 2022, 07:09:59 CET Julien Rouhaud a écrit : > Hi, > > On Tue, Jan 11, 2022 at 11:05:26AM +0100, Ronan Dunklau wrote: > > Done, and I added anoher commit per your suggestion to add this comment. > > The cfbot reports that the patchset doesn'

Re: CDC feature request

2021-03-18 Thread Ronan Dunklau
That change table should have at lease few additional columns * Operation (I/D/U) * txid * Commit_time_stamp If you look at logical decoding, that's basically what you have, isn't it? It won't go into a table, but you can consume it into one if you want. Look at for example wal2json for exampl

Re: Delegating superuser tasks to new security roles (Was: Granting control of SUSET gucs to non-superusers)

2021-10-19 Thread Ronan Dunklau
ke a lot of sense, especially considering that now that we don't allow to run ALTER SUBSCRIPTION REFRESH in a function anymore, there is no way to delegate this to a non superuser (using a security definer function). Since it doesn't involve the rest of the patchset, patches 16, 17 and 18 could be separated in another thread / patchset. -- Ronan Dunklau

Re: pg_receivewal starting position

2021-10-19 Thread Ronan Dunklau
tions can always be lifted in the > > future. > > And marked as RwF as this was three weeks ago. Please feel free to > register a new entry if this is being worked on. > -- > Michael -- Ronan Dunklau>From 4147665664164eb597fdcc86637ec9c497c36660 Mon Sep 17 00:00:00 2001 Fr

Re: pg_receivewal starting position

2021-10-20 Thread Ronan Dunklau
Le mercredi 20 octobre 2021, 07:13:15 CEST Michael Paquier a écrit : > On Tue, Oct 19, 2021 at 05:32:55PM +0200, Ronan Dunklau wrote: > > Following recommendations, I stripped most of the features from the patch. > > For now we support only physical replication slots, and only prov

Re: pg_receivewal starting position

2021-10-20 Thread Ronan Dunklau
e switches, which was not covered before. So please find attached a new version with an additional patch for those tests, covering both "resume from last know archive" and "resume from the replication slots position" cases. -- Ronan Dunklau>From 5a47f17a17594cc171f744ce383ba82

Re: pg_receivewal starting position

2021-10-20 Thread Ronan Dunklau
Le jeudi 21 octobre 2021, 07:35:08 CEST Michael Paquier a écrit : > On Wed, Oct 20, 2021 at 02:58:26PM +0200, Ronan Dunklau wrote: > > After sending the previous patch suite, I figured it would be worthwhile > > to > > also have tests covering timeline switches, which w

Re: pg_receivewal starting position

2021-10-21 Thread Ronan Dunklau
Le jeudi 21 octobre 2021, 09:21:44 CEST Michael Paquier a écrit : > On Thu, Oct 21, 2021 at 08:29:54AM +0200, Ronan Dunklau wrote: > > Ok, do you want me to propose a different patch for previous versions ? > > That's not necessary. Thanks for proposing. > > > D

Re: pg_receivewal starting position

2021-10-25 Thread Ronan Dunklau
Le lundi 25 octobre 2021, 08:51:23 CEST Michael Paquier a écrit : > On Thu, Oct 21, 2021 at 10:36:42AM +0200, Ronan Dunklau wrote: > > Done. I haven't touched the timeline switch test patch for now, but I > > still > > include it here for completeness. > > As 00

Re: pg_receivewal starting position

2021-10-25 Thread Ronan Dunklau
all for your work on this patch. -- Ronan Dunklau

Re: Non-superuser subscription owners

2021-10-25 Thread Ronan Dunklau
tch looks good to me, and provides both better security (by closing the "dropping superuser role" loophole) and usefule features. -- Ronan Dunklau

Re: pg_receivewal starting position

2021-10-25 Thread Ronan Dunklau
Le lundi 25 octobre 2021, 09:40:10 CEST Michael Paquier a écrit : > On Mon, Oct 25, 2021 at 09:15:32AM +0200, Ronan Dunklau wrote: > > Does it make sense though ? The NULL slot_name case handling is pretty > > straight forward has it will be handled by string formatting, but in th

Re: pg_receivewal starting position

2021-10-25 Thread Ronan Dunklau
Le lundi 25 octobre 2021, 10:10:13 CEST Michael Paquier a écrit : > On Mon, Oct 25, 2021 at 09:50:01AM +0200, Ronan Dunklau wrote: > > Le lundi 25 octobre 2021, 09:40:10 CEST Michael Paquier a écrit : > >> On Mon, Oct 25, 2021 at 09:15:32AM +0200, Ronan Dunklau wrote: > &

Re: pg_receivewal starting position

2021-10-25 Thread Ronan Dunklau
; send a new patch for this part? Yes, I will try to simplify the logic of the patch I sent last week. I'll keep you posted here soon. -- Ronan Dunklau

Re: pg_receivewal starting position

2021-10-26 Thread Ronan Dunklau
Le mardi 26 octobre 2021, 08:27:47 CEST Ronan Dunklau a écrit : > Yes, I will try to simplify the logic of the patch I sent last week. I'll > keep you posted here soon. I was able to simplify it quite a bit, by using only one standby for both test scenarios. This test case verify t

Re: pg_receivewal starting position

2021-10-27 Thread Ronan Dunklau
s not incremented after we fetched the end lsn, and thus we would wait for quite a while. I fixed that too. Thank you for the review ! -- Ronan Dunklau>From 04747199b7be896a62021e4f064b2342234427d5 Mon Sep 17 00:00:00 2001 From: Ronan Dunklau Date: Tue, 26 Oct 2021 10:54:12 +0200 Subject: [PAT

Re: pg_receivewal starting position

2021-10-27 Thread Ronan Dunklau
Le mercredi 27 octobre 2021, 10:00:40 CEST Ronan Dunklau a écrit : > Le mercredi 27 octobre 2021, 04:17:28 CEST Kyotaro Horiguchi a écrit : > > +my @walfiles = glob "$slot_dir/*"; > > > > This is not used. > > Sorry, fixed in attached version. > > >

Re: pg_receivewal starting position

2021-10-28 Thread Ronan Dunklau
Le jeudi 28 octobre 2021, 14:31:36 CEST Michael Paquier a écrit : > On Wed, Oct 27, 2021 at 10:11:00AM +0200, Ronan Dunklau wrote: > > Sorry I sent an intermediary version of the patch, here is the correct > > one. > > While looking at this patch, I have figured out a sim

Re: pg_receivewal starting position

2021-10-29 Thread Ronan Dunklau
Le vendredi 29 octobre 2021, 04:27:51 CEST Michael Paquier a écrit : > On Thu, Oct 28, 2021 at 03:55:12PM +0200, Ronan Dunklau wrote: > > Interesting ideas, thanks. For the record, the time drops from ~4.5s to 3s > > on average on my machine. > > I think if you r

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2021-11-04 Thread Ronan Dunklau
Le jeudi 22 juillet 2021, 10:42:49 CET Ronan Dunklau a écrit : > Le jeudi 22 juillet 2021, 09:38:50 CEST David Rowley a écrit : > > On Thu, 22 Jul 2021 at 02:01, Ronan Dunklau wrote: > > > I tested the 0001 patch against both HEAD and my proposed bugfix for > > > postg

Parametrization and UNION in view

2018-11-14 Thread Ronan Dunklau
Hello, We've encountered a query which took forever on our database, and after investigating why I managed to reduce the test case to something simple. The problem is that the optimizer seems to fail to consider pushing a predicate down a "unionized" view: CREATE TABLE t1 AS SELECT i FROM genera

Re: scalability bottlenecks with (many) partitions (and more)

2024-01-29 Thread Ronan Dunklau
freed as easily, and you don't run into a pattern of moving the sbrk pointer up and down repeatedly. The automatic trade off between the mmap and trim thresholds is supposed to prevent that, but the way it is incremented means you can end in a bad place depending on your particular allocation patttern. Best regards, -- Ronan Dunklau

Re: scalability bottlenecks with (many) partitions (and more)

2024-01-29 Thread Ronan Dunklau
Le lundi 29 janvier 2024, 13:17:07 CET Tomas Vondra a écrit : > > Did you try running an strace on the process ? That may give you some > > hindsights into what malloc is doing. A more sophisticated approach would > > be using stap and plugging it into the malloc probes, for example > > memory_sbrk

Re: scalability bottlenecks with (many) partitions (and more)

2024-01-29 Thread Ronan Dunklau
Le lundi 29 janvier 2024, 15:59:04 CET Tomas Vondra a écrit : > I'm not sure work_mem is a good parameter to drive this. It doesn't say > how much memory we expect the backend to use - it's a per-operation > limit, so it doesn't work particularly well with partitioning (e.g. with > 100 partitions,

Re: Allow ordered partition scans in more cases

2023-02-22 Thread Ronan Dunklau
t type of sort will be performed ? It seems to underestimate the memory amount needed. I'm not sure it makes a real difference in real use cases though. Regards, -- Ronan Dunklau

Re: Exclusion constraints on partitioned tables

2023-03-20 Thread Ronan Dunklau
an updated patch with that change (also rebased). Thanks ! This looks fine to me like this. > > I also included a more specific error message. If we find a matching > column in the index but with the wrong operator, we should say so, and > not say there is no matching column. > I

Re: Failures in constraints regression test, "read only 0 of 8192 bytes"

2024-03-04 Thread Ronan Dunklau
o the FSM corruption issue I'm facing: https://www.postgresql.org/message-id/ 1925490.taCxCBeP46%40aivenlaptop So if you still have the data, it would be nice to see if you indeed have a corrupted FSM, and if you have indications when it happened. Best regards, -- Ronan Dunklau

Provide a pg_truncate_freespacemap function

2024-03-04 Thread Ronan Dunklau
-- Ronan Dunklau >From b3e28e4542311094ee7177b39cc9cdf3672d1b55 Mon Sep 17 00:00:00 2001 From: Ronan Dunklau Date: Fri, 1 Mar 2024 08:57:49 +0100 Subject: [PATCH] Provide a pg_truncate_freespacemap function. Similar to the pg_truncate_visibilitymap function, this one allows to avoid downtime to

Re: Provide a pg_truncate_freespacemap function

2024-03-06 Thread Ronan Dunklau
here we declare the function). Thank you for the review. Here is an updated patch for both of those. Best regards, -- Ronan>From 812061b47443ce1052f65ba2867223f9db2cfa18 Mon Sep 17 00:00:00 2001 From: Ronan Dunklau Date: Fri, 1 Mar 2024 08:57:49 +0100 Subject: [PATCH] P

Re: Failures in constraints regression test, "read only 0 of 8192 bytes"

2024-03-08 Thread Ronan Dunklau
d into the > root cause, or whether the commit maybe just made some pre-existing > issue easier to hit. Also, I haven't followed the discussion on the > pgsql-bugs thread [1], maybe there are some interesting findings. > If that happens only on HEAD and not on 16, and doesn'

Re: Ordering behavior for aggregates

2022-12-13 Thread Ronan Dunklau
lently ignore something the user has written. If the ordering doesn't > make sense, we should forbid it. It is allowed as of now, and so it would be a compatibility issue for queries existing in the wild. Ignoring it is just an optimization, just how we optimize away some joins entirely. -- Ronan Dunklau

Re: Ordering behavior for aggregates

2022-12-13 Thread Ronan Dunklau
o account for. I think the ability to mark certain aggregates as being able to completely ignore the ordering because they produce exactly the same results is still a useful optimization. -- Ronan Dunklau

Re: ORDER BY pushdowns seem broken in postgres_fdw

2022-03-31 Thread Ronan Dunklau
is is committable. No objections on my end. -- Ronan Dunklau

Re: LLVM 16 (opaque pointers)

2023-10-16 Thread Ronan Dunklau
Le vendredi 13 octobre 2023, 22:32:13 CEST Thomas Munro a écrit : > On Wed, Oct 11, 2023 at 10:31 PM Ronan Dunklau wrote: > > Le mercredi 11 octobre 2023, 10:59:50 CEST Thomas Munro a écrit : > > > The back-patch to 12 was a little trickier than anticipated, but after > &

Re: LLVM 16 (opaque pointers)

2023-10-11 Thread Ronan Dunklau
-$N in > case anyone has comments on those. For PG13 and PG12, it looks like the ExecEvalBoolSubroutineTemplate is not used anywhere, as ExecEvalBoolSubroutine was introduced in PG14 if I'm not mistaken. Best regards, -- Ronan Dunklau

SupportRequestSimplify and SQL SRF

2020-03-18 Thread Ronan Dunklau
Hello, I've been trying to play with support functions for a use-case of ours, and found some behaviors I don't know are expected or not. The use case: we have some complicated queries, where whole-branches of the execution tree could be cut if some things were evaluated at planning time. Take th

Re: SupportRequestSimplify and SQL SRF

2020-03-18 Thread Ronan Dunklau
> Hm. There was never really any expectation that support functions > would be attached to PL functions --- since you have to write the > former in C, it seems a little odd for the supported function not > to also be C. Perhaps more to the point though, what simplification > knowledge is this sup

Re: Proposal: More structured logging

2022-01-17 Thread Ronan Dunklau
Le lundi 17 janvier 2022, 09:18:04 CET Ronan Dunklau a écrit : > Le samedi 15 janvier 2022, 07:09:59 CET Julien Rouhaud a écrit : > > Hi, > > > > On Tue, Jan 11, 2022 at 11:05:26AM +0100, Ronan Dunklau wrote: > > > Done, and I added anoher commit per your

Re: Use generation context to speed up tuplesorts

2022-01-19 Thread Ronan Dunklau
c, to better isolate the performance gains expected from the generation allocator itself from the side effect of avoiding glibc's pattern of releasing memory back to the kernel too quickly. Julien, sorry for the confusion of adding that discussion and those patches to the same thread, but I don't really see a way of dissociating those two aspects. -- Ronan Dunklau

Re: Use generation context to speed up tuplesorts

2022-01-25 Thread Ronan Dunklau
Le jeudi 20 janvier 2022, 08:36:46 CET Ronan Dunklau a écrit : > Le jeudi 20 janvier 2022, 02:31:15 CET David Rowley a écrit : > > On Tue, 18 Jan 2022 at 19:45, Julien Rouhaud wrote: > > > I'm also a bit confused about which patch(es) should actually be > > > re

Re: Proposal: More structured logging

2022-01-27 Thread Ronan Dunklau
Le jeudi 27 janvier 2022, 08:15:01 CET Michael Paquier a écrit : > On Tue, Jan 18, 2022 at 06:46:03AM +0100, Ronan Dunklau wrote: > > Hum, there was a missing import in csvlog.c from the fix above. Sorry > > about > > that. > > + > > > You are also forge

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2022-11-07 Thread Ronan Dunklau
didn't have beforehand. But with this patch, we may actually replace a "hidden" incremental sort which was done in the agg codepath by a full sort. Best regards, -- Ronan Dunklau

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2022-11-07 Thread Ronan Dunklau
ng code for incremental sort was a bit too pessimistic. -- Ronan Dunklau

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2022-11-08 Thread Ronan Dunklau
aid of regressions, and having this overcharged just made us miss a new optimization without changing existing plans. With ordered aggregates, the balance is a bit trickier and we are at risk of either regressing on aggregate plans, or more common ordered ones. -- Ronan Dunklau

Re: Asynchronous execution support for Custom Scan

2022-11-22 Thread Ronan Dunklau
using an index looking for null values. If you want to do this, it's much faster to update rows in a range of block, performing a first series of batch updating all such block ranges, and then finally update the ones we missed transactionally (inserted in a block we already processed while in the middle of the batch, or in new blocks resulting from a relation extension). Best regards, -- Ronan Dunklau

Re: Asynchronous execution support for Custom Scan

2022-12-01 Thread Ronan Dunklau
> IIUC, we already can use ctid in the where clause on the latest > PostgreSQL, can't we? Oh, sorry, I missed the TidRangeScan. My apologies for the noise. Best regards, -- Ronan Dunklau

Re: Fix gin index cost estimation

2022-12-02 Thread Ronan Dunklau
instead of charging the quals to each tuple, charge them per entry only. We still charge cpu_index_tuple_cost per tuple though. With those changes, no need to tweak the magic number formula estimating the number of pages. Maybe we can come up with something better for

Re: Fix gin index cost estimation

2022-12-02 Thread Ronan Dunklau
should this > be dependent on number of search entries? Good point, multiplying it by the number of search entries would do the trick. Thank you for looking at this ! Regards, -- Ronan Dunklau

Re: Fix gin index cost estimation

2022-12-06 Thread Ronan Dunklau
Le vendredi 2 décembre 2022, 13:58:27 CET Ronan Dunklau a écrit : > Le vendredi 2 décembre 2022, 12:33:33 CET Alexander Korotkov a écrit : > > Hi, Ronan! > > Thank you for your patch. Couple of quick questions. > > 1) What magic number 50.0 stands for? I think we at least

Re: Exclusion constraints on partitioned tables

2023-01-24 Thread Ronan Dunklau
Le vendredi 16 décembre 2022, 06:11:49 CET Paul Jungwirth a écrit : > On 12/15/22 16:12, Tom Lane wrote: > >> This patch also requires the matching constraint columns to use equality > >> comparisons (`(foo WITH =)`), so it is really equivalent to the existing > >> b-tree rule. > > > > That's not

SQLFunctionCache and generic plans

2023-02-07 Thread Ronan Dunklau
would like to avoid ? Best regards, -- Ronan Dunklau

Re: A potential memory leak on Merge Join when Sort node is not below Materialize node

2022-09-29 Thread Ronan Dunklau
he function, but it seems to then only be used by heapam_index_validate_scan and percentile_cont_multi_final_common. This is from my investigation looking for references to the specialized version in the DWARF debug information. Regards, -- Ronan Dunklau

Re: A potential memory leak on Merge Join when Sort node is not below Materialize node

2022-09-29 Thread Ronan Dunklau
Le jeudi 29 septembre 2022, 16:10:03 CEST Tom Lane a écrit : > Ronan Dunklau writes: > >> Yeah, I think the same rules around scope apply as > >> tuplesort_gettupleslot() with copy==false. We could do it by adding a > >> copy flag to the existing functi

Re: Fix gin index cost estimation

2022-10-12 Thread Ronan Dunklau
;s a bogus way of thinking about it I'll proceed with what we agree on. -- Ronan Dunklau

Re: Using each rel as both outer and inner for JOIN_ANTI

2021-06-29 Thread Ronan Dunklau
Le mardi 29 juin 2021, 10:55:59 CEST Richard Guo a écrit : > On Tue, Jun 29, 2021 at 3:55 PM Emre Hasegeli wrote: > > > Thanks for the explanation. Attached is a demo code for the hash-join > > > case, which is only for PoC to show how we can make it work. It's far > > > from complete, at least we

Re: Removing unneeded self joins

2021-06-30 Thread Ronan Dunklau
something else like a view or a RLS policy. Maybe it would be worth it to allow spending a bit more time planning for those cases ? Regards, -- Ronan Dunklau

Re: Using each rel as both outer and inner for JOIN_ANTI

2021-07-01 Thread Ronan Dunklau
any more since the fact that the executor will stop > after the first match does not hold true. A brief thought show me that > we can use the same cost calculation as with right joins. Once you do that, you should also add test coverage for those new plans. Also consider adding a commitfest entry. Regards, -- Ronan Dunklau

Re: Using each rel as both outer and inner for JOIN_ANTI

2021-07-01 Thread Ronan Dunklau
Le jeudi 1 juillet 2021, 09:09:38 CEST Ronan Dunklau a écrit : > > Yes, thanks! I was making a big mistake here thinking the executor can > > stop after the first match. That's not true. We need to use each outer > > tuple to find all the matches and mark the corresponding h

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2021-07-02 Thread Ronan Dunklau
rious about the performance implication of that additional transition, and could not reproduce a signifcant difference. I may be doing something wrong: how did you highlight it ? Regards, -- Ronan Dunklau

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2021-07-04 Thread Ronan Dunklau
Le vendredi 2 juillet 2021, 10:39:44 CEST David Rowley a écrit : > On Fri, 2 Jul 2021 at 19:54, Ronan Dunklau wrote: > > I don't know if it's acceptable, but in the case where you add both an > > aggregate with an ORDER BY clause, and another aggregate without the >

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2021-07-05 Thread Ronan Dunklau
aster: 76.873 ms with david's patch: 61.105 with david's patch + mine: 62.672 ms -- Ronan Dunklau>From a833baf025f69762fb1f076bf1ef9c986dcbe824 Mon Sep 17 00:00:00 2001 From: Ronan Dunklau Date: Mon, 5 Jul 2021 12:45:26 +0200 Subject: [PATCH] Allow Sort nodes to use the fast &

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2021-07-05 Thread Ronan Dunklau
I attached a v2 version (with styles changes), please > take a look and can you repeat yours tests? Tested it quickly, and did not see any change performance wise that cannot be attributed to noise on my laptop but it's fine. Thank you for the fixes ! > > regards, > Ranier Vilela -- Ronan Dunklau

[PATCH] Use optimized single-datum tuplesort in ExecSort

2021-07-05 Thread Ronan Dunklau
Hello, While testing the patch "Add proper planner support for ORDER BY / DISTINCT aggregates" [0] I discovered the performance penalty from adding a sort node essentially came from not using the single-datum tuplesort optimization in ExecSort (contrary to the sorting done in ExecAgg). I origi

Re: Add proper planner support for ORDER BY / DISTINCT aggregates

2021-07-05 Thread Ronan Dunklau
> If you make a separate thread and CF entry, please CC me and add me as > a reviewer on the CF entry. Ok, I started a new thread and added it to the next CF: https:// commitfest.postgresql.org/34/3237/ -- Ronan Dunklau

Re: [PATCH] Use optimized single-datum tuplesort in ExecSort

2021-07-06 Thread Ronan Dunklau
Thank you for the review, I will address those shortly, but will answer some questions in the meantime. > > First, the changes are lacking any explanatory comments. Probably we > > should follow how nodeAgg does this and add both comments to the > > ExecSort function header as well as specific co

Re: [PATCH] Use optimized single-datum tuplesort in ExecSort

2021-07-07 Thread Ronan Dunklau
Le mardi 6 juillet 2021, 17:37:53 CEST James Coleman a écrit : > Yes and no. When incremental sort has to do a full sort there will > always be at least 2 attributes. But in prefix sort mode (see > prefixsort_state) only non-presorted columns are sorted (i.e., if > given a,b already sorted by a, th

Re: [PATCH] Use optimized single-datum tuplesort in ExecSort

2021-07-12 Thread Ronan Dunklau
Le lundi 12 juillet 2021, 15:11:17 CEST David Rowley a écrit : > On Wed, 7 Jul 2021 at 21:32, Ronan Dunklau wrote: > > In the meantime I fixed some formatting issues, please find attached a new > > patch. > > I started to look at this. Thank you ! I'm attaching a new v

Re: Removing unneeded self joins

2022-05-17 Thread Ronan Dunklau
t degenerate_case returns true when we don't have any additional base restrict info is also confusing, as well as the degenerate_case name. I'll update if I think of more interesting things to add. -- Ronan Dunklau

Re: Limiting memory allocation

2022-05-18 Thread Ronan Dunklau
instead of letting malloc do it itself, as we may have better knowledge of the memory allocations pattern than what malloc empirically discovers: in particular, we could lower work_mem, adjust the threshold and maybe even call malloc_trim ourselves when work_mem is lowered, to reduce the padding we may keep. > > So what do you propose PostgreSQL's response to high memory pressure to be? > > > Regards, Jan -- Ronan Dunklau

Re: Removing unneeded self joins

2022-05-19 Thread Ronan Dunklau
Le jeudi 19 mai 2022, 12:48:18 CEST Andrey Lepikhov a écrit : > On 5/17/22 19:14, Ronan Dunklau wrote: > > Le vendredi 13 mai 2022, 07:07:47 CEST Andrey Lepikhov a écrit : > >> New version of the feature. > >> Here a minor bug with RowMarks is fixed. A degenerat

Re: Removing unneeded self joins

2022-07-04 Thread Ronan Dunklau
Le jeudi 30 juin 2022, 16:11:51 CEST Andrey Lepikhov a écrit : > On 19/5/2022 16:47, Ronan Dunklau wrote: > > I'll take a look at that one. > > New version of the patch, rebased on current master: > 1. pgindent over the patch have passed. > 2. number of changed f

Re: Support for grabbing multiple consecutive values with nextval()

2022-07-08 Thread Ronan Dunklau
ndling the knowledge of the sequence details themselves, they can always wrap it in an aggregate: SELECT min(newvals), max(newvals) FROM nextvals() as newvals Regards, -- Ronan Dunklau

Re: Support for grabbing multiple consecutive values with nextval()

2022-07-13 Thread Ronan Dunklau
and assigning them to the individual records before sending them via COPY FROM would solve that for them. -- Ronan Dunklau

Fix gin index cost estimation

2022-08-03 Thread Ronan Dunklau
PV%40aivenronan#0c2498c6a85e31a589b3e9a6a3616c52 -- Ronan Dunklau>From 0aa1ff24e58234d759c07f4eeec163a82244be25 Mon Sep 17 00:00:00 2001 From: Ronan Dunklau Date: Wed, 6 Jul 2022 17:29:01 +0200 Subject: [PATCH v1] Fix gin costing. GIN index scans were not taking any descent CPU-based cost into

Re: pg_receivewal starting position

2021-08-26 Thread Ronan Dunklau
Le jeudi 29 juillet 2021, 11:09:40 CEST Ronan Dunklau a écrit : > Patch 0001 adds the new READ_REPLICATION_SLOT command. > It returns for a given slot the type, restart_lsn, flush_lsn, > restart_lsn_timeline and flush_lsn_timeline. > The timelines are determined by reading the curr

Re: pg_receivewal starting position

2021-08-30 Thread Ronan Dunklau
Le vendredi 27 août 2021, 05:44:32 CEST Michael Paquier a écrit : > On Thu, Aug 26, 2021 at 02:14:27PM +0200, Ronan Dunklau wrote: > > Following the discussion at [1], I refactored the implementation into > > streamutil and added a third patch making use of it in pg_basebackup >

Re: pg_receivewal starting position

2021-08-30 Thread Ronan Dunklau
Le samedi 28 août 2021, 14:10:25 CEST Bharath Rupireddy a écrit : > On Thu, Aug 26, 2021 at 5:45 PM Ronan Dunklau wrote: > > order to fail early if the replication slot doesn't exist, so please find > > attached v2 for that. > > Thanks for the patches. Here are some c

Re: pg_receivewal starting position

2021-08-31 Thread Ronan Dunklau
Le mardi 31 août 2021, 13:17:22 CEST Bharath Rupireddy a écrit : > On Mon, Aug 30, 2021 at 3:26 PM Ronan Dunklau wrote: > > Thank you for this review ! Please see the other side of the thread where > > I > > answered Michael Paquier with a new patchset, which includes some

Re: Proposal: More structured logging

2021-09-01 Thread Ronan Dunklau
Le mercredi 1 septembre 2021, 09:36:50 CEST Peter Eisentraut a écrit : > On 13.08.21 15:23, Ronan Dunklau wrote: > > The logging system already captures a lot of information in the ErrorData. > > But at present there is no way for a log message authors to include more > > m

Re: pg_receivewal starting position

2021-09-02 Thread Ronan Dunklau
Le jeudi 2 septembre 2021, 08:42:22 CEST Bharath Rupireddy a écrit : > On Thu, Sep 2, 2021 at 11:15 AM Kyotaro Horiguchi > > wrote: > > At Wed, 1 Sep 2021 10:30:05 +0530, Bharath Rupireddy > > wrote in> > > > On Mon, Aug 30, 2021 at 3:26 PM Ronan Dunklau wro

Re: pg_receivewal starting position

2021-09-02 Thread Ronan Dunklau
raised upthread, plus some tweaks for > things I bumped into to get the semantics of the command to what looks > like the right shape. Thanks, I was about to send a new patchset with basically the same thing. It would be nice to know we work on the same thing concurrently in the future to avoid duplicate efforts. I'll rebase and send the updated version for patches 0002 and 0003 of my original proposal once we reach an agreement over the behaviour / options of pg_receivewal. Also considering the number of different fields to be filled by the GetSlotInformation function, my local branch groups them into a dedicated struct which is more convenient than having X possibly null arguments. -- Ronan Dunklau

Re: improve pg_receivewal code

2021-09-02 Thread Ronan Dunklau
bs and spaces: + /* +* No valid data can be found in the existing output directory. +* Get start LSN position and current timeline ID from the server. +*/ And here it is not formatted properly: +static char *server_sysid = NULL; > > Regards, > Bharath Rupireddy. -- Ronan Dunklau

Re: pg_receivewal starting position

2021-09-03 Thread Ronan Dunklau
Le jeudi 2 septembre 2021, 10:37:20 CEST Michael Paquier a écrit : > On Thu, Sep 02, 2021 at 10:08:26AM +0200, Ronan Dunklau wrote: > > I could see the use for sending active_pid for use within pg_basebackup: > > at > > least we could fail early if the slot is already in

Re: pg_receivewal starting position

2021-09-05 Thread Ronan Dunklau
Le lundi 6 septembre 2021, 06:22:30 CEST Michael Paquier a écrit : > On Fri, Sep 03, 2021 at 11:58:27AM +0200, Ronan Dunklau wrote: > > 0002 for pg_receivewal tried to simplify the logic of information to > > return, by using a dedicated struct for this. This accounts for Bahrath&#

Re: pg_receivewal starting position

2021-09-06 Thread Ronan Dunklau
Le vendredi 3 septembre 2021 17:49:34 CEST, vous avez écrit : > On Fri, Sep 3, 2021 at 3:28 PM Ronan Dunklau wrote: > > There is still the concern raised by Bharath about being able to select > > the > > way to fetch the replication slot information for the user, and what >

Re: ORDER BY pushdowns seem broken in postgres_fdw

2021-09-06 Thread Ronan Dunklau
d fail running make installcheck-world. In any case, I just checked and running make installcheck-world doesn't produce any error. Since HEAD had moved a bit since the last version, I rebased the patch, resulting in the attached v7. Best regards, -- Ronan Dunklau >From ccfb0a3d7dae4

Re: ORDER BY pushdowns seem broken in postgres_fdw

2021-09-06 Thread Ronan Dunklau
Le lundi 6 septembre 2021, 11:25:39 CEST Zhihong Yu a écrit : > On Mon, Sep 6, 2021 at 1:17 AM Ronan Dunklau wrote: > > Le vendredi 3 septembre 2021, 22:54:25 CEST David Zhang a écrit : > > > The following review has been posted through the commitfest application: > > &

  1   2   >