Benchmarking framework for Hive ACID

2017-09-28 Thread Krishnanand Khambadkone
Hello,  Are there any frameworks available to benchmark Hive ACID functionality?  

Benchmarking Hive ACID functionality

2017-09-25 Thread Krishnanand Khambadkone
Are there any frameworks like TPC-DS to benchmark Hive ACID functionality?

Error when running TPCDS query with Hive+LLAP

2017-09-25 Thread Krishnanand Khambadkone
Hi, I am trying to run one of the TPC-DS  queries, query25 against a 25GB dataset (my instance memory size is 64GB) and I get this error, Caused by: org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionError: VectorMapJoin Hash table loading exceeded memory limits. estimatedMemoryUsage:

hive-testbench - Hive + TEZ TPC-DS job gets stuck

2017-09-23 Thread Krishnanand Khambadkone
Hi,  I am trying to run a small 4GB TPC-DS test using the hortonworks hive-testbench framework.  I am initiating a small $GB test.  It completes the   data generation to /tmp but gets stuck  when creating the ORC table for the very first store_sales table.  It has been running for the past 2 hour

TEZ job spawning only 1 container and 1 core

2017-09-22 Thread Krishnanand Khambadkone
Hi,  I am running a Hive query and I am seeing some strange behavior.  When I ran it with map reduce as the execution engine, it was spawning close to 40 containers.  I have switched the engine to TEZ and now the very same query is running with only 1 container and it keeps running for ever.   H

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-19 Thread Krishnanand Khambadkone
like this should be functional by now.DO NOT USE SPARK ON HIVE.Instead use Tez on Hive. Hernan On Monday, April 17, 2017 3:45 PM, Krishnanand Khambadkone wrote: Hi,   I am trying to run Hive queries by using Spark as the execution engine.   I am following the instructions on this page

Error with Hive 2.1.1 and Spark 2.1

2017-04-17 Thread Krishnanand Khambadkone
Hi,   I am trying to run Hive queries by using Spark as the execution engine.   I am following the instructions on this page, https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started When I try to run my query which is. a simple count(*) command, I get this error, Failed