Re: Hive 3.1.3 Hadoop Compatability

2023-12-25 Thread Takanobu Asanuma
BigTop supports a specific version stack with some patches in place. It should be helpful for you. - Currently, the master branch consists of Hadoop-3.3.6, Hive-3.1.3, Tez-0.10.2. - https://github.com/apache/bigtop/blob/master/bigtop.bom - Hive patches: https://github.com/apache/bigtop/tree/ma

Re: Hive 3.1.3 Hadoop Compatability

2023-12-22 Thread Austin Hackett
Many thanks for clarifying Ayush - much appreciated > On 22 Dec 2023, at 08:41, Ayush Saxena wrote: > > Ideally the hadoop should be on 3.1.0 only, that is what we support, > rest if there are no incompatibilities it might or might not work with > higher versions of hadoop, we at "hive" don't

Re: Hive 3.1.3 Hadoop Compatability

2023-12-22 Thread Ayush Saxena
Ideally the hadoop should be on 3.1.0 only, that is what we support, rest if there are no incompatibilities it might or might not work with higher versions of hadoop, we at "hive" don't claim that it can work, mostly it will create issues with hadoop-3.3.x line due to thirdparty libs and stuff like

Re: Hive 3.1.3 Hadoop Compatability

2023-12-21 Thread Austin Hackett
Hi Ayush Many thanks for your response. I’d really appreciate a clarification if that’s OK? Does this just mean that the Hadoop 3.1.0 libraries need to be deployed with Hive, or does it also mean the Hadoop cluster itself cannot be on a version later than 3.1.0 (if using Hive 3.1.3). For exam

Re: Hive 3.1.3 Hadoop Compatability

2023-12-21 Thread Ayush Saxena
Hi Austin, Hive 3.1.3 & 4.0.0-alpha-1 works with Hadoop-3.1.0 HIve 4.0.0-alpha-2 & 4.0.0-beta-1 works with Hadoop-3.3.1 The upcoming Hive 4.0 GA release would be compatible with Hadoop-3.3.6 -Ayush On Thu, 21 Dec 2023 at 17:39, Austin Hackett wrote: > > Hi List > > I was hoping that someone mi

Hive 3.1.3 Hadoop Compatability

2023-12-21 Thread Austin Hackett
Hi List I was hoping that someone might be able to clarify which Hadoop versions Hive 3.1.3 is compatible with? https://hive.apache.org/general/downloads/ says that Hive release 3.1.3 works with Hadoop 3.x.y which is straightforward enough. However, I notice the 4.0.0 releases only work with H