[blocker] ArrayIndexoutofbound in a hive query

Hi, We are facing issue with our hive query with ArrayIndexoutofbound exception. I have tried googling out and I see many users facing the same error, but no solution yet. This is a blocker for our production and we really need help on this. We are using Hive version : 1.3.0. Our query is doing

Re: Regarding query in HiveResultSet

are you writing your java code using hive or you are writing hive query? On Fri, Jul 31, 2015 at 11:13 AM, Renuka Be wrote: > Hi Folks, > > I want to find Max value from the HiveResult. There is option listed in > HiveResultSet properties "HiveResultSet.Max()". When i use this > 'HiveResultSet.M

Regarding query in HiveResultSet

Hi Folks, I want to find Max value from the HiveResult. There is option listed in HiveResultSet properties "HiveResultSet.Max()". When i use this 'HiveResultSet.Max()' it throws exception. Error : At least one object must implement IComparable. Is there any way to find Min, Max from the HiveResu

Hive debug in eclipse

Hi Everyone, I am currently stepping through Hive test cases to understand the code flow. For debugging, I launch the UTs through “mvnDebug” and use the remote debugging feature in eclipse to introduce break points and do line-by-line execution. Such a strategy seems to have a pitfall; whenever I

External sorted tables

We are trying to create a external table in hive. This data is sorted, so wanted to tell hive about this. When I do, it complains about parsing the create. > CREATE EXTERNAL TABLE IF NOT EXISTS store.testing ( ... . . . . . . . . . . . . . . . . . . .> timestamp bigint, ...) . . . . . . . . . .

Re: Verifying that a query uses orc bloom filters, orc storage indexes

First, you need to know the total record number of your table. After processing the query, then you can get the input record number of MapReduce job from the counter "RECORDS_IN" of Hive or "Map input records" of Map-Reduce Framework. If the input number is much smaller than the total number, it s

View debug logs

Hello everyone, How do I view the logs generated using "log4j" logger while running the query tests from "itest/qtest" ? Also, how to set the log4j properties, since I need to view the most detailed logs. Thanks, Raajay

Re: ISO-8859 character support in HIve

++ On Jul 30, 2015, at 02:24 PM, murali parimi wrote: Hello Team, I am trying to load some data encoded in ISO-8859 into hive tables. Version: 0.13. The ascents and special symbols allowed in this character set are coming as some junk when I query this table. The SERDE is ORC. Did you ever

ISO-8859 character support in HIve

Hello Team, I am trying to load some data encoded in ISO-8859 into hive tables. Version: 0.13. The ascents and special symbols allowed in this character set are coming as some junk when I query this table. The SERDE is ORC. Did you ever faced similar issue? Does hive has any support of specify

Semantic Analysis Run Through

Hello, I am currently playing around with Hive Semantic Analysis code, to understand how DAGs or Map Reduce plans are generated from Abstract Syntax Trees. The idea is to explore various possible DAGs and compare their performance based on execution run time. The function "analyzeInternal" seems

Re: Verifying that a query uses orc bloom filters, orc storage indexes

If you are using tez, you can verify that using counters that gets printed after query execution. You need set hive.tez.exec.print.summary=true for tez to print counters after execution. Thanks Prasanth On Jul 30, 2015, at 9:31 AM, Jörn Franke mailto:jornfra...@gmail.com>> wrote: Hi, Is the

Verifying that a query uses orc bloom filters, orc storage indexes

Hi, Is there any official way to verify that a query leveraged orc bloom filters or orc indexes? For example, number of bytes (rows) not processed thanks to bloom filters or storage indexes? Some indicators in the explain output? Thank you. Best reagrds

Re: Perl-Hive connection

On 29 Jul 2015, at 9:42, siva kumar wrote: Hi folks, I need to set up a connection between perl and hive using thrift. Can anyone sugggest me the steps involved in making this happen?. Thanka and regrads, siva. Hi, check out http://search.cpan.org/~dmor/Thrift-API-HiveClient2/l

Re: Computation timeout

Hmm, if you did see it somewhere please let us know. I verified the defaults in copies of HiveConf.java for releases up to 1.1.0: HiveConf-branches> grep 'hive.server2.session.check.interval' * branch14-HiveConf.java: HIVE_SERVER2_SESSION_CHECK_INTERVAL("hive.server2.session.check.interval", "0m

Re: Computation timeout

Indeed, I was checking this out on the exact same page, but I'm almost convinced that I saw on a documentation that the default value was 3000 for the check.interval. As I can't find it again, let's say I was tired and my eyes betrayed me. Thanks a lot, Loïc Loïc CHANEL Engineering student at T

Re: Computation timeout

You're right about the typos, but both parameters have defaults of 0 ms: - hive.server2.session.check.interval - hive.server2.idle.operation.timeout

Re: Computation timeout

My bad, I think I just mixed up the properties. At the end of the day, everything seems to work as you described. Thanks a lot ! Loïc Loïc CHANEL Engineering student at TELECOM Nancy Trainee at Worldline - Villeurbanne 2015-07-30 9:31 GMT+02:00 Loïc Chanel : > Rats, I think I just figured i

Re: Computation timeout

Rats, I think I just figured it out. #2 Is NEGATIVE 3000, right ? I set it to positive yesterday. As for #1, I think it is the default value, so I am not sure I have to set it. Can you confirm that there is a typo on the name of your properties (missing last letter) and that is not the actual name