[HIVE-LLAP ]Tez Shuffle Handler

2020-07-16 Thread Manoj Kumar
anager.(ShuffleManager.java:264)* at org.apache.tez.runtime.library.input.UnorderedKVInput.start(UnorderedKVInput.java:146) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:277) ... 9 more Regards, Manoj Kumar

Re: loading native library in hive UDF

2020-04-14 Thread Manoj Kumar
le internet but > got nothing helpful. Have you got any idea of this? > > By the way, I add an archive file (*.tar.gz) by using ADD ARCHIVE > *.tar.gz, it seems that this file is not unarchived automatically. I am > also confused. > > Thank you. > > Best > > BIN > -- Regards, Manoj Kumar

Re: Hive on Tez vs Impala

2019-04-15 Thread Manoj Murumkar
If we install our own build of Hive, we'll be out of support from CDH. Tez is not supported anyway and we're not touching any CDH bits, so it's not a big issue to have our own build of Tez engine. > On Apr 15, 2019, at 9:20 PM, Gopal Vijayaraghavan wrote: > > > Hi, > >>> However, we have bu

Re: Hive on Tez vs Impala

2019-04-15 Thread Manoj Murumkar
No, not yet. However, we have built Tez on CDH and it runs just fine. Following blog summarizes part of the work (bit old, we currently run Tez 0.9.1 on CDH 5.16.1). https://blog.upala.com/2017/03/04/setting-up-tez-on-cdh-cluster/ Blog says use ATS from open source hadoop, which will not work if

Fwd: Enabling Tez-UI on CDH 5.8

2017-02-21 Thread Manoj Murumkar
Trying hive user group. Has anyone set Tez UI on CDH? If yes, what were the steps? Appreciate any help. -- Forwarded message -- From: Manoj Murumkar Date: Thu, Feb 16, 2017 at 12:02 PM Subject: Enabling Tez-UI on CDH 5.8 To: u...@tez.apache.org Hi, Wondering if anyone has

Re: Hive transactions not working

2016-11-16 Thread Manoj Murumkar
By default, I have these: hadoop.proxyuser.hive.hosts=* hadoop.proxyuser.hive.groups=* Also, I have impersonation enabled. These settings should have made the compaction to run without issues, but does not. What am I missing? On Wed, Nov 16, 2016 at 6:00 PM, Manoj Murumkar wrote: > Okay, m

Re: Hive transactions not working

2016-11-16 Thread Manoj Murumkar
op (e.g., for Hadoop 2.5.1 it is at Hadoop in Secure Mode <http://hadoop.apache.org/docs/r2.5.1/hadoop-project-dist/hadoop-common/SecureMode.html> ). On Wed, Nov 16, 2016 at 5:43 PM, Manoj Murumkar

Re: Hive transactions not working

2016-11-16 Thread Manoj Murumkar
| +---+--+++-+---++--+ However, I don't see cleaner actually run in hive logs (I am looking for a string like "compactor.Cleaner"). On Wed, Nov 16, 2016 at 5:30 PM, Manoj Murumkar wrote: > Quick update: > > After each compaction, files under base directory (for th

Re: Hive transactions not working

2016-11-16 Thread Manoj Murumkar
oblem. Am I understanding this feature correctly in assuming so? On Wed, Nov 16, 2016 at 5:24 PM, Manoj Murumkar wrote: > Hi, > > We are trying to implement transaction feature in hive. I created >

Hive transactions not working

2016-11-16 Thread Manoj Murumkar
/user/hive/warehouse/txntest.db/txntab3/delta_021_021 -rw-r--r-- 3 nex37045 hive 201206 2016-11-16 20:46 /user/hive/warehouse/txntest.db/txntab3/delta_021_021/bucket_0 Thanks, Manoj

Re: mapreduce.job.queuename doesn't work with hiveserver2

2016-11-10 Thread Manoj Murumkar
Chen, I am facing the same issue. Did you find a workaround? On Fri, Oct 10, 2014 at 11:51 AM, Chen Song wrote: > Thanks for the reply. I am using Hue so I may need to find a way to hack > this into Hue. > > On Fri, Oct 10, 2014 at 7:39 AM, Navdeep Agrawal < > navdeep_agra...@symantec.com> wrot

Add keys to column family in HBase through Hive/Python

2015-04-22 Thread Manoj Venkatesh
ovide an option to add a key to a column family. Does anybody know of a better way of achieving this with Python, say libraries or through other means. Thanks in advance, Manoj PS: I have posted the question on Hadoop and HBase forums too, still no luck. Trying in the hive forum too. The info

Suppress deprecated INFO message on hive startup

2014-09-24 Thread Manoj Prasad
How do I suppress deprecated INFO on hive startup? -bash-4.1$ hive 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.max.split.size i

Count (Distinct Case When...)

2014-09-12 Thread Manoj Bharadwaj
t find any support on the web for this - hence the question to the group. Links/reading material appreciated Thanks! Manoj

Re: Yarn Containers using all the space

2014-08-16 Thread Manoj
Tweak parameters to control container memory allocation. Take a look at this: http://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/ > On Aug 16, 2014, at 12:58 PM, karthik Srivasthava > wrote: > > Thanks manoj for ur response. > > But i struggle to run anot

Re: Yarn Containers using all the space

2014-08-16 Thread Manoj
Look into setting up yarn queues and quotas. > On Aug 16, 2014, at 8:15 AM, karthik Srivasthava > wrote: > > I am using TEZ as Hive Execution Engine. When i run a query , Yarn Containers > are using all the space available in node. This doesnt allow another query to > run. Am i missing any co