ated
> implementations in Hive and Iceberg if we upgrade iceberg-hive3 to
> iceberg-hive4?
>
> On Fri, Nov 22, 2024 at 5:18 PM Fokko Driesprong wrote:
>
>> I agree with Péter, that sounds like the right approach to me as well.
>>
>> Kind regards,
>> Fokk
testing matrix where some tests are
>>> run with both Hive 3 and Hive 4, and some tests are run with only Hive3
>>> (older Spark versions which does not support Hive 4)
>>>
>>> Thanks Manu for driving this!
>>> Peter
>>>
>>> Manu Zhang
sion from
>> the Spark runtime.
>
>
> Firstly, upgrading from Hive 2 to Hive 4 is a huge change, and I expect
> compatibility to be much better once Iceberg and Spark are both on Hive 4.
>
> Secondly, the coupling can be loosed if we are moving toward the REST
> catalog.
>
>
@Manu: What will be the end result? Do we have to use the same Hive version
in Iceberg as it is defined by Spark? I think we should make sure that the
Iceberg Hive version is independent from the version used by Spark
On Mon, Dec 16, 2024, 21:58 rdb...@gmail.com wrote:
> > I'm not sure there's a
h them.
> Otherwise, we need to ask users to exclude hive libraries from Spark and
> ship iceberg-spark runtime with Iceberg's hive dependencies.\
>
> Regards,
> Manu
>
> On Wed, Dec 18, 2024 at 9:08 PM Péter Váry
> wrote:
>
>> @Manu: What will be the end result?
