Hi Daniel,
Thanks for bringing up this discussion, I suppose the following PR should
be included in 1.2.1
https://github.com/apache/iceberg/pull/7153
Thanks,
Cheng Pan
On Apr 3, 2023 at 12:08:26, Daniel Weeks wrote:
> Hey Iceberg Community,
>
> I wanted to start a discussion aroun
mostly is: can it be fixed
by adding a spark configuration?
The OPTIONS way brings additional learning efforts to Spark users and how can
Spark administrators set them at cluster level?
Thanks,
Cheng Pan
> On Jun 17, 2023, at 04:01, Wing Yew Poon wrote:
>
> Hi,
> I recently put up
classifying a configuration into
SQLConf or OPTION?
Thanks,
Cheng Pan
> On Jul 5, 2023, at 16:26, Cheng Pan wrote:
>
> I would argue that the SQLConf way is more in line with Spark
> user/administrator habits.
>
> It’s a common practice that Spark administrators set configur
+1 (non-binding)
Integrated with Apache Kyuubi[1], the CI covers
- Iceberg Spark 3.3-3.5 with Scala 2.12
- Iceberg Spark 3.5 with Scala 2.13
[1] https://github.com/apache/kyuubi/pull/6361
Thanks,
Cheng Pan
On 2024/05/01 17:25:08 Amogh Jahagirdar wrote:
> Hi Everyone,
>
> I propos
A basic question, is iceberg-hive-metastore considered part of the
"Hive module"?
I suppose that HMS 2.x is still widely used. AFAIK, the current
iceberg-hive-metastore is compatible with HMS 2.1+, based on Iceberg
and Spark CI, I also suppose it works well with Java 8 to 21.
Thanks,
Hope this can get in.
https://github.com/apache/iceberg/pull/3203
Thanks,
Cheng Pan
On Thu, Oct 21, 2021 at 11:34 AM Reo Lei wrote:
> Thanks Kyle for syncing this!
>
> I think PR#3240 should be include in this release. Because in our Dingding
> group, we have received feedback fro
+1 (non-binding)
The integration test based on the master branch of Apache Kyuubi
(Incubating) passed.
https://github.com/apache/incubator-kyuubi/pull/1338
Thanks,
Cheng Pan
On Fri, Nov 5, 2021 at 1:19 PM Kyle Bendickson wrote:
>
>
> +1 (binding)
>
> - Validated checksums,
+1 (non-binding)
Passed integration test[1] w/ Apache Kyuubi
[1] https://github.com/apache/incubator-kyuubi/pull/3810
Thanks,
Cheng Pan
On Nov 23, 2022 at 16:13:34, Ajantha Bhat wrote:
> +1 (non-binding)
>
> - verified tests against spark-3.3 runtime jar with Nessie catalog.
>
FYI, I just identified a Parquet data loss issue(newly introduced in 1.14.0),
and I confirmed it affects the Spark use cases, I’m not sure if it also affects
Iceberg cases.
https://github.com/apache/parquet-java/issues/3040
Thanks,
Cheng Pan
> On Oct 31, 2024, at 06:06, Russell Spit
se jars
and run full Iceberg tests makes more sense?
Thanks,
Cheng Pan
user upgrade Hive 4 to gain the built-in Iceberg support?
Thanks,
Cheng Pan
> On Nov 20, 2024, at 12:47, Manu Zhang wrote:
>
> Hi all,
>
> We previously reached consensus[1] to deprecate Hive 2 in 1.7 and drop in
> 1.8. However, when working on the removal PR[2], multiple t
able to use the
latest Spark version combined with Iceberg.
[1] https://github.com/apache/iceberg/pull/11731
Thanks,
Cheng Pan
> On Dec 17, 2024, at 17:58, Jean-Baptiste Onofré wrote:
>
> That works for me. In the meantime, I will draft a proposal (in terms
> of content) for 1
+1 (non-binding)
Pass integration test with Apache Kyuubi
Thanks,
Cheng Pan
> On Jan 28, 2025, at 07:13, Russell Spitzer wrote:
>
> +1 (binding)
>
> Checked licensing and sha and gpg sig
>
> On Mon, Jan 27, 2025 at 3:02 PM Fokko Driesprong <mailto:fo...@apache.org
+1 to start 1.7.2 RC ASAP, we should have this release to make the latest
Iceberg compatible with the latest Spark 3.5.4. I also request a release on 1.6
branch with [1] to take care of Java 8 users.
[1] https://github.com/apache/iceberg/pull/11731
Thanks,
Cheng Pan
> On Jan 13, 2025, at
> Spark can be configured to use a different version
It’s not true. IsolatedClassLoader only supports Spark Hive session catalog and
Iceberg always uses Spark built-in Hive jars, namely, Hive 2.3.9 for Spark 3.x
and Hive 2.3.10 for Spark 4.0
Thanks,
Cheng Pan
> On May 21, 2025, at
15 matches
Mail list logo
