Re: Measuring the execution time of Hive queries through Ambari

2020-06-30 Thread Mich Talebzadeh
Many thanks to all. We will consider these options one by one. Regards, . LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * *Disclaimer:* Use it at your own risk.

Hive 4.0

2020-06-30 Thread Theyaa Matti
There are many Jiras that are tagged for Hive 4.0 release. Are there any timelines when Hive 4 will be released please?

AW: Error with hive-staging.staging

2020-06-30 Thread Julien Tane
The query looks like this: INSERT overwrite TABLE our_schema.our_table SELECT wh.* FROM our_schema.our_table wh LEFT JOIN our_schema.our_table p ON p.product_id = wh.product_id WHERE p.is_deleted = FALSEOR p.is_deleted IS NULL it is a non transactional table. could it

Error with hive-staging.staging

2020-06-30 Thread Julien Tane
Hello, we are having trouble with a query which exits infrequently: org.apache.hadoop.hive.ql.exec.tez.MergeFileRecordProcessor.close(MergeFileRecordProcessor.java:180)\n\t... 17 more\nCaused by: java.io.IOException: hdfs://ourserver:8020/apps/hive/warehouse/our_schema.db/our_table/.hive-stag

AW: Measuring the execution time of Hive queries through Ambari

2020-06-30 Thread Julien Tane
Hi Mich, Again Ambari is only a cluster management framework. Not a complete GUI. It can have plugins like things like views. On Ambari you can have different Stacks. which correspond to the available services for a given services, and which you can install, start and stop. First of all, whi

Re: Measuring the execution time of Hive queries through Ambari

2020-06-30 Thread Zoltan Haindrich
Hey Mich! I don't know which version you use (HDP-3+?) - but you might want to see if "Data Analytics Studio" is available for that version; it could give similar insights as TezUI had. cheers, Zoltan On 6/22/20 2:23 PM, Mich Talebzadeh wrote: HiĀ  Julien. It is as I see is standard Ambari.

LineageLogger can't getEdges

2020-06-30 Thread change val
hi,all: I want to change LineageLogger code to output more log info . The hive version I am using is 2.3.6 I create a new mvn project and cp LineageLogger code to my own class named MyLineage. Then I add my code to output more log info ,last I build a new jar. but when I config it to ,the log f