+1 On Wed, Oct 21, 2026 at 1:29 AM Peter Toth <[email protected]> wrote:
> +1 > > On Wed, Oct 21, 2026 at 10:00 AM Kousuke Saruta <[email protected]> > wrote: > >> +1 >> >> >> 2026年10月21日(水) 15:09 Yang Jie <[email protected]>: >> >>> +1 >>> >>> On 2026/10/20 17:08:44 Anish Shrigondekar via dev wrote: >>> > +1 (non-binding) >>> > >>> > Thanks Jungtaek for driving this ! >>> > >>> > Thanks, >>> > Anish >>> > >>> > On Tue, Oct 20, 2026 at 10:01 AM Dongjoon Hyun <[email protected]> >>> wrote: >>> > >>> > > +1 (binding) >>> > > >>> > > Thank you for driving this, Jungtaek. On-demand lookups fill a real >>> gap >>> > > for Real-Time Mode, and the DSv2 sketch and the stream-static scope >>> address >>> > > my main concerns from the DISCUSS thread. >>> > > >>> > > I'd appreciate it if the doc could be updated to match what we >>> agreed in >>> > > the thread, so that it stays the reference for the implementation: >>> > > >>> > > - For sources supporting both `BATCH_READ` and `EXTERNAL_LOOKUP`, the >>> > > default stays the existing join strategies (Oct 15). Q4, Q6, and Q8 >>> still >>> > > say that Spark chooses the lookup join automatically, and the >>> sentence >>> > > about the default behavior in Appendix A is cut off. >>> > > - Stream-static joins fall back to `BATCH_READ` instead of failing >>> (Oct 8). >>> > > - The cache is tied to the task lifecycle, and the hint options >>> override >>> > > the SQL configs (Oct 8 and Oct 16). >>> > > >>> > > Dongjoon. >>> > > >>> > > >>> > > On 2026/10/20 12:51:57 Jungtaek Lim wrote: >>> > > > Starting from my +1 (non-binding) >>> > > > >>> > > > On Tue, Oct 20, 2026 at 12:04 PM Jungtaek Lim < >>> > > [email protected]> >>> > > > wrote: >>> > > > >>> > > > > Hi devs, >>> > > > > >>> > > > > I would live to start a vote on introducing external lookup >>> join, as >>> > > > > proposed. >>> > > > > >>> > > > > JIRA ticket: https://issues.apache.org/jira/browse/SPARK-60031 >>> > > > > SPIP doc: >>> > > > > >>> > > >>> https://docs.google.com/document/d/1fBPM5cku8UJXacG2fw9df1zqALJ-WFm8E9-b9oiFP5M/edit?tab=t.0 >>> > > > > Discussion thread: >>> > > > > >>> https://lists.apache.org/thread.html/7s6tgy9cm18jnzykr8htrtrw4nxyrhp1 >>> > > > > >>> > > > > The vote will be open for at least 72 hours, and passes if a >>> majority >>> > > +1 >>> > > > > PMC >>> > > > > votes are cast, with a minimum of 3 +1 votes. >>> > > > > >>> > > > > Please vote: >>> > > > > [ ] +1: Accept the proposal as an official SPIP >>> > > > > [ ] +0 >>> > > > > [ ] -1: I don't think this is a good idea because ... >>> > > > > >>> > > > > Thanks, >>> > > > > Jungtaek Lim (HeartSaVioR) >>> > > > > >>> > > > >>> > > >>> > > --------------------------------------------------------------------- >>> > > To unsubscribe e-mail: [email protected] >>> > > >>> > > >>> > >>> >>> --------------------------------------------------------------------- >>> To unsubscribe e-mail: [email protected] >>> >>>
