How to set Hive Cli memory through templeton

Hi, I am trying to set the hive client memory through templeton. I can achieve this through Ambari by overwriting the HADOOP_CLIENT_OPTS in the hive-env template. How do I overwrite the environment variables of hive through templeton? Any response will be much appreciated Thanks Ranjan

Hive conditional join question

Hi, I have two hive tables and I want to do a join only if both the tables have data in them. I don't want the join to happen if one of the table is empty. I tried exploring case statement with the intention that I would do something like select count(*) as val case when val > 0 then else end fro

RE: Oversized container estimation

container. Single node with 96GB could fit in 32 containers. ~Rajesh.B On Sat, Nov 26, 2016 at 7:31 AM, Ranjan Banerjee wrote: > Hi Rajesh, >Thanks a lot for the insight. When you mean CPU are you referring > to the vcore of yarn? > The yarn min contain

RE: Oversized container estimation

min-container size. If you have only 32 CPU in your system, this would end up over subscribing a lot and could adversely impact job performance). ~Rajesh.B On Fri, Nov 25, 2016 at 11:03 PM, Ranjan Banerjee wrote: > Hi everyone, > I have a cluster where each container is configured at 4GB and som

Oversized container estimation

Hi everyone, I have a cluster where each container is configured at 4GB and some of my queries are getting over in 30 to 40 seconds. This leads me to believe that I have too much memory for my containers and I am thinking of reducing the container size to 1.5GB(hive.tez.container.size) but I am

RE: Remote debugging of HIVE code from Intellij

e of these, so you could test yourself. I am fairly new too, but happy to help :) Peter > On Sep 9, 2016, at 12:07 AM, Ranjan Banerjee wrote: > > Hi Peter, >Thank you so much for pointing it out. I ran -Dtest=TestCliDriver and it > worked! > On a sidenote I would

RE: Remote debugging of HIVE code from Intellij

run in your case. Regards, Peter > On Sep 8, 2016, at 4:08 AM, Ranjan Banerjee wrote: > > Hi, > I am trying to remote debug HIVE code from Intellij. Here are my steps: > 1)In HIVE folder: mvn clean install -Dskiptests 2)cd itests/qtest > 3)mvn clean install -Ds

Remote debugging of HIVE code from Intellij

Hi, I am trying to remote debug HIVE code from Intellij. Here are my steps: 1)In HIVE folder: mvn clean install -Dskiptests 2)cd itests/qtest 3)mvn clean install -Dskiptests 4)mvn -Dmaven.surefire.debug -Dtest=TestPositiveCliDriver -Dqfile=acid_bucket_pruning.q I have setup the remot