Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-11-22 Thread Tomas Vondra
FYI I've marked the CF entry as withdrawn. I still think this (triggering prefetching in another exector node) has a lot of potential, and not only in the context of a nested loop. But the patch was just a quick & dirty experiment, I don't have time to work on this right now. No point in keeping t

Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-27 Thread Peter Geoghegan
On Tue, Aug 27, 2024 at 6:44 PM Tomas Vondra wrote: > > One reason to do it this way is because it cuts down on index descent > > costs, and other executor overheads. But it is likely that it will > > also make prefetching itself more effective, too -- just because > > prefetching will naturally e

Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-27 Thread Tomas Vondra
On 8/27/24 20:53, Peter Geoghegan wrote: > On Tue, Aug 27, 2024 at 2:40 PM Andres Freund wrote: >> Have you considered instead expanding the parameterized scan logic? Right now >> nestloop passes down values one-by-one via PARAM_EXEC. What if we expanded >> that to allow nodes, e.g. nestloop in

Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-27 Thread Tomas Vondra
On 8/27/24 20:40, Andres Freund wrote: > Hi, > > On 2024-08-26 18:06:04 +0200, Tomas Vondra wrote: >> I'm getting back to work on the index prefetching patch [1], but one >> annoying aspect of that patch is that it's limited to the context of a >> single executor node. It can be very effective whe

Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-27 Thread Peter Geoghegan
On Tue, Aug 27, 2024 at 2:40 PM Andres Freund wrote: > Have you considered instead expanding the parameterized scan logic? Right now > nestloop passes down values one-by-one via PARAM_EXEC. What if we expanded > that to allow nodes, e.g. nestloop in this case, to pass down multiple values > in one

Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-27 Thread Andres Freund
Hi, On 2024-08-26 18:06:04 +0200, Tomas Vondra wrote: > I'm getting back to work on the index prefetching patch [1], but one > annoying aspect of that patch is that it's limited to the context of a > single executor node. It can be very effective when there's an index > scan with many matches for

Re: PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-27 Thread Tomas Vondra
On 8/26/24 18:06, Tomas Vondra wrote: > > I just noticed there's a couple failures in the regression tests, if I > change the GUC to "true" by default. I haven't looked into that yet, but > I guess there's some mistake in resetting the child node, or something > like that. Will investigate. > Tu

PoC: prefetching data between executor nodes (e.g. nestloop + indexscan)

2024-08-26 Thread Tomas Vondra
Hi, I'm getting back to work on the index prefetching patch [1], but one annoying aspect of that patch is that it's limited to the context of a single executor node. It can be very effective when there's an index scan with many matches for a key, but it's entirely useless for plans with many tiny