[
https://issues.apache.org/jira/browse/HIVE-21737?focusedWorklogId=507890&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507890
]
ASF GitHub Bot logged work on HIVE-21737:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 05/Nov/20 00:51
Start Date: 05/Nov/20 00:51
Worklog Time Spent: 10m
Work Description: sunchao commented on pull request #1635:
URL: https://github.com/apache/hive/pull/1635#issuecomment-722056258
> I got a 404 error now (before it was a sockets error who aborted the
access eagerly).
It's weird, and I'm not sure how access is managed there. FWIW, here's the
error message:
```
Caused by: java.lang.ClassNotFoundException:
org.xerial.snappy.SnappyInputStream
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
... 19 more
```
so you may need to double check dependencies and perhaps add the missing
snappy one.
> I am not sure if I understand. I upgraded Avro to the latest stable
release (1.10.0) but I expect this will trigger the failures previously
discussed in the ticket (on ill defined schemas on avro_deserialize_map_null.q,
parquet_map_null.q) and fixed by AVRO-2817 but that require of the 1.10.1
release.
Seems this only triggers when you have "default:null" in schema? I don't see
we're doing that in Hive though.
> Great to see #1621 merged, is there already a PR to cherry-pick that one
into branch-2.3? Do you want me to do that?
I suppose however we might require also the changes on TypeInfoToSchema from
this PR too to make it also forward compatible because the Field constructor
with JsonNode as a parameter is not available after Avro 1.9.
Not yet, yeah feel free to do that. Have you got a chance to test this
against Spark with a upgraded Parquet version?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 507890)
Time Spent: 2h (was: 1h 50m)
> Upgrade Avro to version 1.10.0
> ------------------------------
>
> Key: HIVE-21737
> URL: https://issues.apache.org/jira/browse/HIVE-21737
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Reporter: Ismaël Mejía
> Assignee: Fokko Driesprong
> Priority: Major
> Labels: pull-request-available
> Attachments:
> 0001-HIVE-21737-Make-Avro-use-in-Hive-compatible-with-Avr.patch
>
> Time Spent: 2h
> Remaining Estimate: 0h
>
> Avro >= 1.9.x bring a lot of fixes including a leaner version of Avro without
> Jackson in the public API and Guava as a dependency. Worth the update.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
