Help review the Spark change and let's get it in for 4.2, please. пн, 16 бер. 2026 р. о 21:28 Anurag Mantripragada < [email protected]> пише:
> Hi Szehon, > > Great timing. This is indeed the same feature Max intended to add via > Iceberg extensions. Supporting this directly in Spark is the correct > approach. I will update the Iceberg PR. We can likely close it and wait for > the Spark support to be implemented. > > ~ Anurag > > On Mon, Mar 16, 2026 at 1:17 PM Szehon Ho <[email protected]> wrote: > >> Hi all >> >> FYI, looks like Liangchi has a PR on the Spark side, is it related? >> https://github.com/apache/spark/pull/54809 >> <https://github.com/apache/spark/pull/54809>. >> >> Thanks >> Szehon >> >> On Mon, Mar 16, 2026 at 11:03 AM Anurag Mantripragada < >> [email protected]> wrote: >> >>> Hi Max, >>> >>> We discussed this PR during the Iceberg-Spark Community Sync >>> <https://docs.google.com/document/d/19nno1RoPznbbxKOZZddZNHHafa7XULjbN6RPExdr2n4/edit?tab=t.0#heading=h.rav6546y5se4>, >>> but I missed updating the PR with the details. The general conclusion from >>> the meeting was that the community is moving away from extensions because >>> they are fragile and difficult to maintain within Iceberg. However, I >>> personally believe that CTAS is useful, and we should consider adding it to >>> Spark if it is currently unsupported. >>> >>> I would like to hear from other Spark experts on this thread before we >>> decide whether to proceed. >>> >>> ~ Anurag >>> >>> On Sun, Mar 15, 2026 at 8:58 PM Max Konstantinov < >>> [email protected]> wrote: >>> >>>> Hello, >>>> >>>> Can anybody spend the time reviewing my PR for adding that feature? >>>> Not sure why it was ignored by original reviewers but let me know if >>>> it's obsolete, no longer needed, or so low priority that no one cares. >>>> >>>> https://github.com/apache/iceberg/pull/14269 >>>> >>>> >>>> Max. >>>> >>>
