reflect UDF can't handle both String and int

2012-10-25 Thread Alexander Ershov
Query select reflect('java.lang.Integer', 'parseInt', 'a', 16) from src limit 1; throws java.lang.NoSuchMethodException: java.lang.Integer.parseInt(null, int) A bug or a feature?

Re: HIVE mappers eat a lot of RAM

2012-03-21 Thread Alexander Ershov
val option wants it to do. So I set hive.groupby.mapaggr.checkinterval=1000. Worked like a charm. Thanks. 2012/3/20 Alexander Ershov > I said it wrong: what really bothers me is not 500MB of RAM usage - it's > that mapper starting as 70-200Mb happy chimp becomes 500MB-600MB > b

Re: HIVE mappers eat a lot of RAM

2012-03-20 Thread Alexander Ershov
0G of data you are having just 7 mappers, need to increase the > number of mappers for better parallelism. > > Regards > Bejoy > > ------ > *From:* Alexander Ershov > *To:* user@hive.apache.org > *Sent:* Tuesday, March 20, 2012 4:13 PM > *Sub

HIVE mappers eat a lot of RAM

2012-03-20 Thread Alexander Ershov
Hiya, I'm using HIVE 0.7.1 with 1) moderate 50GB table, let's call it `temp_view` 2) query: select max(length(get_json_object(json, '$.user_id'))) from temp_view. From my point of view this query is a total joke, nothing serious. Query runs just fine, everyone's happy. But I have massive memory