Re: pass new job name to tez

In GenTezProcContext, you can find "new TezWork(conf.getVar(HiveConf.ConfVars.HIVEQUERYID))" part. And the final name is name + ":" + (++counter); Thanks, Navis 2014-07-10 12:43 GMT+09:00 Grandl Robert : > Hi guys, > > I am trying to identify a DAG in Tez with a different id, based on job > nam

pass new job name to tez

Hi guys, I am trying to identify a DAG in Tez with a different id, based on job name(for e.g. query55.sql from hive-testbench) + input size. So my new identifier should be for example query55_2048MB. It seems that a DAG in tez, already takes a name which comes from a jobPlan.getName() passed

Re: Hive UDF performance issue

Hive cross product stinks . I have a map reduce job that will do it On Wednesday, July 9, 2014, Navis류승우 wrote: > Yes, 2M x 1M makes 2T pairing in single reducer. > > Thanks, > Navis > > > 2014-07-10 1:50 GMT+09:00 Malligarjunan S >: > >> Hello All, >> Is that the expected behavior from hive to

Re: Hive-0.12.0 cannot load data from hdfs

Can you please share the command which you are trying to run. Thanks On Thu, Jul 10, 2014 at 10:32 AM, wenlong...@changhong.com < wenlong...@changhong.com> wrote: > Hi guys, > > Is anybody can tell me , why my hive(0.12.0) cannot load data from hdfs > where the filename is the same. > But I ca

Re: Hive UDF performance issue

Yes, 2M x 1M makes 2T pairing in single reducer. Thanks, Navis 2014-07-10 1:50 GMT+09:00 Malligarjunan S : > Hello All, > Is that the expected behavior from hive to take so much of time? > > > Thanks and Regards, > Sankar S > > > On Tue, Jul 8, 2014 at 11:23 PM, Malligarjunan S > wrote: > >> H

Hive-0.12.0 cannot load data from hdfs

Hi guys, Is anybody can tell me , why my hive(0.12.0) cannot load data from hdfs where the filename is the same. But I cat load data from local file system. thanks

[no subject]

Hi guys, I am trying to identify a DAG in Tez with a different id, based on job name(for e.g. query55.sql from hive-testbench) + input size. So my new identifier should be for example query55_2048MB. It seems that a DAG in tez, already takes a name which comes from a jobPlan.getName() passed

Re: Error while renaming Partitioned column name

I mistook as renaming the partition value. Hive lets you change the value of a partition column, in your case it would have been: ALTER TABLE siplogs_partitioned PARTITION (str_date='old date value',str_hour='old hour value') RENAME TO PARTITION (str_date='new date value',str_hour='new hour value')

Re: Error while renaming Partitioned column name

whats your table DDL? On Wed, Jul 9, 2014 at 11:03 PM, Manish Kothari wrote: > Thanks Dipesh. > > > > Here is what I tried : - > > > > ALTER TABLE siplogs_partitioned PARTITION > (pcol1='str_hour',pcol2='str_date') RENAME TO PARTITION > (pcol1='call_hour',pcol2='call_date'); > > > > When I run

RE: Error while renaming Partitioned column name

Thanks Dipesh. Here is what I tried : - ALTER TABLE siplogs_partitioned PARTITION (pcol1='str_hour',pcol2='str_date') RENAME TO PARTITION (pcol1='call_hour',pcol2='call_date'); When I run the above command I am getting the error below : - FAILED: Execution Error, return code 1 from org.apache

Hive -> pass new job name to tez

Hi guys, I am trying to identify a DAG in Tez with a different id, based on job name(for e.g. query55.sql from hive-testbench) + input size. So my new identifier should be for example query55_2048MB. It seems that a DAG in tez, already takes a name which comes from a jobPlan.getName() passed

Re: Hive UDF performance issue

Hello All, Is that the expected behavior from hive to take so much of time? Thanks and Regards, Sankar S On Tue, Jul 8, 2014 at 11:23 PM, Malligarjunan S wrote: > Hello All, > > Can any one help me to answer to my question posted on Stackoverflow? > http://stackoverflow.com/questions/24416373

Re: Error while renaming Partitioned column name

Here is an example: ALTER TABLE alter_rename_partition PARTITION (pCol1='old_part1', pcol2='old_part2') RENAME TO PARTITION (pCol1='new_part1', pcol2='new_part2'); On Wed, Jul 9, 2014 at 9:20 AM, Manish Kothari wrote: > Hi, > > > > I have a table name siplogs_partitioned which is partitioned

Error while renaming Partitioned column name

Hi, I have a table name siplogs_partitioned which is partitioned by columns str_date(DATE) and str_hour(INT). I want to rename the partitioned columns to call_date and call_hour. I am using the below command to alter the partitioned column name: - ALTER TABLE siplogs_partitioned PARTITION str_

Re: Possible memory leak with 0.13 and JDBC

Could you try to remove ATSHooks in hive-site.xml? Looks strange. Thanks, Navis 2014-07-08 18:51 GMT+09:00 jonas.partner : > Hi Navis, > > after a run to the point where we are seeing exceptions we see the below > > num #instances #bytes class name > ---

Storage index table in HBase

Hi,experts: I want to storage hive index table in HBase to improve index performance. I do it like this : CREATE INDEX idx_number on table my_hive_table (number) as 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' with DEFERRED REBUILD STORED BY 'org.apache.hadoop.hive.hbase

Re: Hive UDF performance issue

It's cross producting. Not strange taking so much time even with small tables. Thanks, Navis 2014-07-09 2:53 GMT+09:00 Malligarjunan S : > Hello All, > > Can any one help me to answer to my question posted on Stackoverflow? > http://stackoverflow.com/questions/24416373/hive-udf-performance-too-