Re: Query Failures

2020-02-11 Thread Pau Tallada
Hi, Do you have more complete tracebacks? Missatge de Charles Givre del dia dt., 11 de febr. 2020 a les 2:54: > Hello Everyone! > I recently joined a project that has a Hive/Impala installation and we are > experience a significant number of query failures. We are using an older > version of H

Issues with aggregating on map values

2020-02-11 Thread Nakul Khanna (BLOOMBERG/ LONDON)
Creating the table CREATE TABLE foo (tags MAP, size int); INSERT INTO foo VALUES (map("country", "USA"), 10), (map("country", "USA"), 20), (map("country", "UK"), 30); SELECT * FROM foo ++---+ | foo.tags | foo.size | ++---

Re: Is there any way to find Hive query to Datanucleus queries mapping

2020-02-11 Thread Chinna Rao Lalam
Thanks Zoltan for the prompt reply, I have checked the code with your insights, Yes with this call we can get the information like below. Using this data we can add a log for each HIVESql overall how much time spent in metadata operations. metadata.Hive: Time spent in each metastore function (ms

Re: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.

2020-02-11 Thread Bernard Quizon
Hi. We fixed the issue by patching protobuf-java-2.5.0.jar, we changed CodedInputStream.DEFAULT_SIZE_LIMIT to 1GB. Uploaded the patched version on our servers and added the location of the aforementioned jar to the *tez.cluster.additional.classpath.prefix* (tez-site.xml) to /path/to/patched/protob