Hi Szehon, Great timing. This is indeed the same feature Max intended to add via Iceberg extensions. Supporting this directly in Spark is the correct approach. I will update the Iceberg PR. We can likely close it and wait for the Spark support to be implemented.
~ Anurag On Mon, Mar 16, 2026 at 1:17 PM Szehon Ho <[email protected]> wrote: > Hi all > > FYI, looks like Liangchi has a PR on the Spark side, is it related? > https://github.com/apache/spark/pull/54809 > <https://github.com/apache/spark/pull/54809>. > > Thanks > Szehon > > On Mon, Mar 16, 2026 at 11:03 AM Anurag Mantripragada < > [email protected]> wrote: > >> Hi Max, >> >> We discussed this PR during the Iceberg-Spark Community Sync >> <https://docs.google.com/document/d/19nno1RoPznbbxKOZZddZNHHafa7XULjbN6RPExdr2n4/edit?tab=t.0#heading=h.rav6546y5se4>, >> but I missed updating the PR with the details. The general conclusion from >> the meeting was that the community is moving away from extensions because >> they are fragile and difficult to maintain within Iceberg. However, I >> personally believe that CTAS is useful, and we should consider adding it to >> Spark if it is currently unsupported. >> >> I would like to hear from other Spark experts on this thread before we >> decide whether to proceed. >> >> ~ Anurag >> >> On Sun, Mar 15, 2026 at 8:58 PM Max Konstantinov < >> [email protected]> wrote: >> >>> Hello, >>> >>> Can anybody spend the time reviewing my PR for adding that feature? >>> Not sure why it was ignored by original reviewers but let me know if >>> it's obsolete, no longer needed, or so low priority that no one cares. >>> >>> https://github.com/apache/iceberg/pull/14269 >>> >>> >>> Max. >>> >>
