Exactly ! Thanks for sharing !
I didn't find this page.
Thanks, so we have it :)
Regards
JB
On Thu, Sep 21, 2023 at 6:42 PM Ryan Blue wrote:
>
> Do you mean like this page?
> https://iceberg.apache.org/multi-engine-support/#current-engine-version-lifecycle-status
>
> On Thu, Sep 21, 2023 at 8
Do you mean like this page?
https://iceberg.apache.org/multi-engine-support/#current-engine-version-lifecycle-status
On Thu, Sep 21, 2023 at 8:52 AM Jean-Baptiste Onofré
wrote:
> Hi Ryan,
>
> Yes it makes sense. The way we discuss and decide the Spark versions
> is totally fine.
>
> My proposal
Hi Ryan,
Yes it makes sense. The way we discuss and decide the Spark versions
is totally fine.
My proposal was more to clearly announce the Spark/Flink/Java/Python
versions supported by Iceberg releases. I know that it's obvious on
the artifacts name (containing the spark/flink versions) as we sh
JB, I don't think that we need a policy on which Spark versions we intend
to keep. Having discussions like this are more effective. Just look at the
support for Spark 2.4, which we kept for a lot longer to help people
transition. Policy is a way of making decisions by algorithm and I don't
think we
+1 for removing Spark 3.1 and deprecating Spark 3.2
On Thu, Sep 21, 2023 at 10:44 AM Jean-Baptiste Onofré
wrote:
> Hi Anton,
>
> imho for 1.4.0, we can deprecate/remove Spark 3.1 support. As it's
> major release, we can remove old version support. Spark 3.1 users can
> still use Iceberg 1.3.x.
>
+1 on deprecating Spark 3.2
On Thu, Sep 21, 2023 at 10:48 AM Jean-Baptiste Onofré
wrote:
> Just to elaborate a bit :)
>
> - As Iceberg 1.4.0 is new "major" release, it's good time to
> deprecate/remove old version support (of Spark and other things)
> - Spark 3.2 users can still use previous Ice
Hi Ryan,
Thanks for the feedback. Unfortunately, I was not able to join the
Iceberg community sync meeting yesterday, I promise I will join the
next ones.
I think the proposal is very interesting and also the
discussion/comments in the document. I agree that some points should
be discussed furthe
Just to elaborate a bit :)
- As Iceberg 1.4.0 is new "major" release, it's good time to
deprecate/remove old version support (of Spark and other things)
- Spark 3.2 users can still use previous Iceberg version
- I will start a discussion about LTS policy with a clear "target"
support for our users
+1
Regards
JB
On Thu, Sep 21, 2023 at 12:01 AM Anton Okolnychyi
wrote:
>
> Shall we consider deprecating our Spark 3.2 support? That Spark version is no
> longer being maintained by the Spark community and is not under active
> development in Iceberg. It was released in October, 2021 and passe
Hi Anton,
imho for 1.4.0, we can deprecate/remove Spark 3.1 support. As it's
major release, we can remove old version support. Spark 3.1 users can
still use Iceberg 1.3.x.
That's why I proposed a LTS policy for our users, I will come with a
proposal about that.
Thanks !
Regards
JB
On Wed, Sep 2
10 matches
Mail list logo
