I've observed the hive-exec:3.x version, where in the 3.1.0 version, I found the core classifier library. When we can expect a similar core classifier library in the 4.1.0 version.
On Wed, Apr 17, 2024 at 4:14 AM Ayush Saxena <ayush...@gmail.com> wrote: > Some can't be relocated, it is pretty challenging to relocate them, one I > remember is calcite, I tried that here: > https://issues.apache.org/jira/browse/HIVE-23772 & it didn't work, I am > not sure if things have changed now. > > Relocated dependencies shouldn't be problematic I believe, having jars > shaded but not relocated is problematic in some cases, you can't get rid of > them via exclusion and then they tend to create classpath conflicts, we are > exploring ways to get Spark move from 2.3.9 to 4.0, Our initial hunch is > that it would be quite challenging without a hive-exec slim jar which > doesn't have these dependencies or has minimal shading. > > -Ayush > > On Tue, 16 Apr 2024 at 21:07, László Bodor <bodorlaszlo0...@gmail.com> > wrote: > >> isn't this as simple to solve as relocating joda (or what causes problems >> in general)? I cannot recall when and why we removed the core jar, and I'm >> not against it, but I feel that relocating something that is already shaded >> in the uber jar is much easier >> >> looks like we shade a lot: >> https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1032 >> but relocate only a few: >> https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1110 >> >> we already have a huge uber jar due to including everything, I feel >> relocation doesn't make it any worse >> relocation is only dangerous if the relocated classes are present in >> hive-exec public method signatures (TODO check joda from this aspect) >> >> Mergu Ravi <mergu.r...@gaianconsultants.com.invalid> ezt írta (időpont: >> 2024. ápr. 16., K, 17:21): >> >>> When can we expect the core jar for 4.0.0 version. >>> >>> On Tue, Apr 16, 2024 at 4:57 PM Denys Kuzmenko <dkuzme...@apache.org> >>> wrote: >>> >>>> Hi Ravi, >>>> >>>> hive-exec is the uber jar, the same thing is done in Hive-3.x. We are >>>> considering restoring the hive-core jar that only has classes from ql >>>> >>>> On 2024/04/16 06:24:20 Mergu Ravi wrote: >>>> > Hi Hive Team, >>>> > >>>> > I'm currently using the Hive 4.0.0 libraries and facing an issue with >>>> the >>>> > hive-exec:4.0.0 library. It seems that the Joda-Time library is >>>> bundled >>>> > within it, preventing me from excluding it and using my existing >>>> Joda-Time >>>> > library. Could you please provide insight into why this bundling has >>>> been >>>> > implemented? Additionally, is there any plan to unbundle the Joda-Time >>>> > library in future releases? >>>> > >>>> > -- >>>> > >>>> > Thanks & Regards, >>>> > >>>> > >>>> > <http://www.gaiansolutions.com/> >>>> > Ravi Mergu >>>> > SMTS-2 >>>> > o: +91 40 64535355 >>>> > m: +91 9959618687 >>>> > w: www.gaiansolutions.com >>>> > >>>> > <http://www.facebook.com/GaianConsultants> >>>> > <http://www.linkedin.com/company/gaian-consultants/> >>>> > <http://twitter.com/gaianconsultant?lang=en> >>>> > >>>> > *Please consider the environment before printing this email.* This >>>> message >>>> > contains confidential information and is intended only for the >>>> individual >>>> > named. If you are not the named addressee you should not disseminate, >>>> > distribute or copy this e-mail >>>> > >>>> >>> >>> >>> -- >>> >>> Thanks & Regards, >>> >>> >>> <http://www.gaiansolutions.com/> >>> Ravi Mergu >>> SMTS-2 >>> o: +91 40 64535355 >>> m: +91 9959618687 >>> w: www.gaiansolutions.com >>> >>> <http://www.facebook.com/GaianConsultants> >>> <http://www.linkedin.com/company/gaian-consultants/> >>> <http://twitter.com/gaianconsultant?lang=en> >>> >>> *Please consider the environment before printing this email.* This >>> message contains confidential information and is intended only for the >>> individual named. If you are not the named addressee you should not >>> disseminate, distribute or copy this e-mail >>> >>> -- Thanks & Regards, <http://www.gaiansolutions.com/> Ravi Mergu SMTS-2 o: +91 40 64535355 m: +91 9959618687 w: www.gaiansolutions.com <http://www.facebook.com/GaianConsultants> <http://www.linkedin.com/company/gaian-consultants/> <http://twitter.com/gaianconsultant?lang=en> *Please consider the environment before printing this email.* This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail