Re: Spark Merge-on-Read Feature

2021-09-24 Thread Jack Ye
Sorry the link does not actually directly jump to the thread... it's the thread of [DISCUSS] Spark version support strategy. -Jack On Fri, Sep 24, 2021 at 10:32 AM Jack Ye wrote: > Hi Aman, > > Thank you for the interest! I would refer you to this mailing list > discussion thread: > https://mail

Re: Spark Merge-on-Read Feature

2021-09-24 Thread Jack Ye
Hi Aman, Thank you for the interest! I would refer you to this mailing list discussion thread: https://mail-archives.apache.org/mod_mbox/iceberg-dev/202109.mbox/browser for more details about Spark MoR support and why there is no PR open for that yet. The MoR compaction is tracked in a separated p

Spark Merge-on-Read Feature

2021-09-24 Thread Aman Rawat
Hello devs, We are trying to implement Spark support for the merge-on-read feature in Iceberg. Can you please share the elaborate plan here, ongoing work and tentative timelines for the same (both from spark and iceberg repos side). We are following the priority board that has been set up for this