Re: Error: java.io.IOException: java.lang.RuntimeException: ORC split generation failed with exception: java.lang.NoSuchMethodError

2019-07-19 Thread Mich Talebzadeh
Hi, Thanks my Hadoop is hadoop version WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. *Hadoop 3.1.0* Source code repository https://github.com/apache/hadoop -r 16b70619a24cdcf5d3b0fcf4b58ca77238ccbe6d Compiled by centos on 2018-03-30T00:00Z Compiled with pr

Re: Error: java.io.IOException: java.lang.RuntimeException: ORC split generation failed with exception: java.lang.NoSuchMethodError

2019-07-19 Thread Gopal Vijayaraghavan
Hi, > java.lang.NoSuchMethodError: > org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I > (state=,code=0) Are you rolling your own Hadoop install? https://issues.apache.org/jira/browse/HADOOP-14683 Cheers, Gopal

Re: Error Starting hive thrift server, hive 3 on Hadoop 3.1

2018-07-04 Thread Lefty Leverenz
Mich, here's how you can get write access to the Hive wiki: About This Wiki -- How to get permission to edit . -- Lefty On Wed, Jul 4, 2018 at 2:59 AM Mich Talebzadeh wrote: > Sure will do

Re: Error Starting hive thrift server, hive 3 on Hadoop 3.1

2018-07-03 Thread Mich Talebzadeh
Sure will do Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk

Re: Error Starting hive thrift server, hive 3 on Hadoop 3.1

2018-07-03 Thread Jörn Franke
It would be good if you can document this on the Hive wiki so that other users know it. On the other hand there is Apache Bigtop which tests integration of various Big Data components - but it is complicated. Behind a big data distribution there is a lot of effort. > On 3. Jul 2018, at 23:08,

Re: Error Starting hive thrift server, hive 3 on Hadoop 3.1

2018-07-03 Thread Mich Talebzadeh
Resolved this by getting rid of HADOOP_CLASSPATH that I had to add to make Hbase 2 work with Hadoop 3.1. It did not help and I had to revert back to Hbase 1.2.6. But left that CLASSPATH in ENV file. This is becoming retrofitting issues where making an artefact work with Hadoop impacts other artefa

Re: error when beeline connecting to hiveserver2

2018-04-25 Thread 侯宗田
Hi, Antal Thank you, I have followed some web guide and set hive2 transport mode to http, then the port number become 10001. I changed it back and set the proxy username in hdfs and it worked. Regards, Hou > 在 2018年4月25日,下午6:23,Antal Sinkovits 写道: > > Hi, > > First of all, I would check if t

Re: error when beeline connecting to hiveserver2

2018-04-25 Thread Antal Sinkovits
Hi, First of all, I would check if the HiveServer2 is running, and listens on the given port. E.g: lsof -i -P |grep java You should see something like: java 33169 asinkovits 349u IPv6 0x 0t0 TCP *:1 (LISTEN) java 33169 asinkovits 350u IPv6 0x

Re: error when beeline connecting to hiveserver2

2018-04-24 Thread 侯宗田
Thank you very much for your reply, I have changed the port number and set the thrift.bind.host to localhost. But I still get the error, do you have some ideas about this? beeline> !connect jdbc:hive2://localhost:1 anonymous anonymous Connecting to jdbc:hive2://localhost:1 /04/24 16:13:5

Re: error when beeline connecting to hiveserver2

2018-04-23 Thread Johannes Alberti
You should connect by default to 1, the webui port is not the port beeline connects with. Regards, Johannes Sent from my iPhone > On Apr 23, 2018, at 6:38 AM, 侯宗田 wrote: > > Hi, > > I have started hiveserver2 and try to connect it with beeline using the > following command: > >!connect j

Re: Error "Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient"

2017-11-27 Thread Vihang Karajgaonkar
You might want to check the HiveServer2 log which should have the complete exception trace to understand why it is not able to create a MetastoreClient. On Sun, Nov 26, 2017 at 3:48 PM, Marco wrote: > Hi Fabricio, did you solve this ? > > Looks that your Hive is not accessing the MetaStore datab

Re: Error "Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient"

2017-11-21 Thread Furcy Pin
Hi, I recommend you try using HiveServer2 and beeline as explained here: https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-RunningHiveServer2andBeeline.1 In particular, please make sure you have run "bin/schematool -dbType derby -initSchema" and that it returned succe

Re: Error when running TPCDS query with Hive+LLAP

2017-09-25 Thread Gopal Vijayaraghavan
> Caused by: > org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionError: > VectorMapJoin Hash table loading exceeded memory limits. > estimatedMemoryUsage: 1644167752 noconditionalTaskSize: 463667612 > inflationFactor: 2.0 threshold: 927335232 effectiveThreshold: 927335232 Most lik

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-19 Thread Krishnanand Khambadkone
It is complaining about a missing class file SparkJavaListener which was removed starting version 2.x of Spark.  Supposedly will be re-instated in 2.2.0.   On Monday, April 17, 2017 6:22 PM, hernan saab wrote: hernan saab (hernan_javier_s...@yahoo.com) is not on your Guest List | Ap

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread hernan saab
Edward,Consider putting together a project at the time of documentation. This way, users at least know all the variables that you use to prove a particular configuration works.Use GIT, its a simple revision control tool that developers at the Hive community should get confortable with. It should

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread Edward Capriolo
On Tue, Apr 18, 2017 at 3:32 PM, hernan saab wrote: > The effort of configuring an apache big data system by hand for your > particular needs is equivalent to herding rattlesnakes and cats into one > small room. > The documentation is poor and most of the time the community developers > don't rea

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread hernan saab
The effort of configuring an apache big data system by hand for your particular needs is equivalent to herding rattlesnakes and cats into one small room.The documentation is poor and most of the time the community developers don't really feel like helping you.Use Ambari or any other orchestratio

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread Vihang Karajgaonkar
+sergio Thank you for pointing this out. Based on what I see here https://github.com/apache/hive/blob/branch-2.1/pom.xml#L179 Hive 2.1 supports Sparks 1.6. There is a JIRA to add support for Spark 2.0 https://issues.apache.org/jira/browse/HIVE-14029 but that is available from Hive 2.2.x I have cr

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-17 Thread hernan saab
IMO, that page is a booby trap for the newbies to make them waste their time needlessly.As far as I know Hive on Spark does not work today.I would be the reason that page still stays on is because there is a level of shame in the Hive dev community that a feature like this should be functional b

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-26 Thread satyajit vegesna
perator > limit: -1 > Processor Tree: > ListSink > > Any suggestion in debugging this issue is appreciated. > > > Regards, > Satyajit. > > > > > On Wed, Oct 26, 2016 at 3:34 PM, Eugene Koifman > wrote: > >> If you can run this, then it’s sa

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-26 Thread satyajit vegesna
ting_id = ml.id left > outer join attribute a on a.id = ml.standard_status > > Eugene > > From: satyajit vegesna > Date: Wednesday, October 26, 2016 at 2:14 PM > To: "user@hive.apache.org" , Eugene Koifman < > ekoif...@hortonworks.com> > Cc: "d...

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-26 Thread Eugene Koifman
Koifman mailto:ekoif...@hortonworks.com>> Cc: "d...@hive.apache.org<mailto:d...@hive.apache.org>" mailto:d...@hive.apache.org>> Subject: Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine. Hi Eugene, PFB Transaction table in green a

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-26 Thread satyajit vegesna
PFB EXPLAIN PLAN from hive, and query has issues at stage-14, i have also run another query which also fail in stage, *Map Reduce Local Work.* STAGE DEPENDENCIES: Stage-13 is a root stage , consists of Stage-1 Stage-1 Stage-10 depends on stages: Stage-1 , consists of Stage-15, Stage-2 Sta

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-26 Thread satyajit vegesna
Hi Eugene, PFB Transaction table in green and parquet tables in yellow, INSERT INTO access_logs.crawlstats_dpp PARTITION(day="2016-10-23") select pra.url as prUrl,pra.url_type as urlType,CAST(pra.created_at AS timestamp) as prCreated, CAST(pra.updated_at AS timestamp) as prUpdated, CAST(ml.create

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-25 Thread Eugene Koifman
Which of your tables are are transactional? Can you provide the DDL? I don’t think “File does not exist” error is causing your queries to fail. It’s an INFO level msg. There should be some other error. Eugene From: satyajit vegesna mailto:satyajit.apas...@gmail.com>> Reply-To: "user@hive.ap

RE: Error running SQL query through Hive JDBC

2016-08-05 Thread Markovitz, Dudu
05, 2016 11:08 PM To: user@hive.apache.org Subject: RE: Error running SQL query through Hive JDBC Below is the code snippet with the SQL query which I am running. The same query is running fine through Hive CLI. String sql = " SELECT TBL_CODE FROM DB.CODE_MAP WH

RE: Error running SQL query through Hive JDBC

2016-08-05 Thread Amit Bajpai
e.printStackTrace(); } From: Markovitz, Dudu [mailto:dmarkov...@paypal.com] Sent: Friday, August 05, 2016 3:04 PM To: user@hive.apache.org Subject: RE: Error running SQL query through Hive JDBC Can you please share the query? From: Amit Bajpai [mai

RE: Error running SQL query through Hive JDBC

2016-08-05 Thread Markovitz, Dudu
Can you please share the query? From: Amit Bajpai [mailto:amit.baj...@flextronics.com] Sent: Friday, August 05, 2016 10:40 PM To: user@hive.apache.org Subject: Error running SQL query through Hive JDBC Hi, I am getting the below error when running the SQL query through Hive JDBC. Can suggestion

Re: Error while running Hive on Microsoft Azure HDInsight Hadoop Linux Cluster

2016-06-02 Thread Gopal Vijayaraghavan
> it gives me the following error "FAILED: ParseException line 24:0 >missing EOF at 'format' near')'". Sounds like a file line ending problem - are you sure the file isn't in a different line ending mode? > -- The following lines describe the format and location of the file You can try removing

Re: Error in Hive on Spark

2016-03-22 Thread Stana
Hi, Xuefu You are right. Maybe I should launch spark-submit by HS2 or Hive CLI ? Thanks a lot, Stana 2016-03-22 1:16 GMT+08:00 Xuefu Zhang : > Stana, > > I'm not sure if I fully understand the problem. spark-submit is launched in > the same host as your application, which should be able to acc

Re: Error selecting from a Hive ORC table in Spark-sql

2016-03-21 Thread Mich Talebzadeh
sounds like with ORC transactional table this happens When I create that table as ORC but non transactional it works! Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Error selecting from a Hive ORC table in Spark-sql

2016-03-21 Thread Eugene Koifman
The system thinks t2 is an Acid table but the files on disk don’t follow the convention acid system would expect. Perhaps Xuefu Zhang would know more on Spark/Aicd integration. From: Mich Talebzadeh mailto:mich.talebza...@gmail.com>> Reply-To: "user@hive.apache.org"

Re: Error in Hive on Spark

2016-03-20 Thread Stana
Does anyone have suggestions in setting property of hive-exec-2.0.0.jar path in application? Something like 'hiveConf.set("hive.remote.driver.jar","hdfs://storm0:9000/tmp/spark-assembly-1.4.1-hadoop2.6.0.jar")'. 2016-03-11 10:53 GMT+08:00 Stana : > Thanks for reply > > I have set the property s

Re: Error in Hive on Spark

2016-03-10 Thread Stana
Thanks for reply I have set the property spark.home in my application. Otherwise the application threw 'SPARK_HOME not found exception'. I found hive source code in SparkClientImpl.java: private Thread startDriver(final RpcServer rpcServer, final String clientId, final String secret) throw

Re: [Error] : while registering Hbase table with hive

2016-03-03 Thread Swagatika Tripathy
Hi Divya, Can you paste the Hive table structure as well as HBASE table structure? Regards, Swagatika On Mon, Feb 29, 2016 at 8:51 AM, Divya Gehlot wrote: > Hi, > I trying to register a hbase table with hive and getting following error : > > Error while processing statement: FAILED: Execution

Re: error while defining custom schema in Spark 1.5.0

2015-12-25 Thread Ted Yu
The error was due to blank field being defined twice. On Tue, Dec 22, 2015 at 12:03 AM, Divya Gehlot wrote: > Hi, > I am new bee to Apache Spark ,using CDH 5.5 Quick start VM.having spark > 1.5.0. > I working on custom schema and getting error > > import org.apache.spark.sql.hive.HiveContext >>

Re: Error

2015-12-16 Thread Jörn Franke
Do you have the create table statement? The sqoop command ? > On 17 Dec 2015, at 07:13, Trainee Bingo wrote: > > Hi All, > > I have a sqoop script which brings data from oracle and dumps it to HDFS. > Then that data is exposed to hive external table. But when I do : > hive> select * from ; >

Re: ERROR util.SparkUncaughtExceptionHandler: Uncaught exception in thread Thread

2015-11-26 Thread Dasun Hegoda
Any updates guys? On Thu, Nov 26, 2015 at 10:20 AM, Dasun Hegoda wrote: > Anything? > > On Tue, Nov 24, 2015 at 11:49 PM, Dasun Hegoda > wrote: > >> I'm using *apache-hive-1.2.1-bin *with *spark-1.5.1-bin-hadoop2.6 *on >> top of >> *hadoop-2.7.1 *. Any idea how to fix this error? >> >> On Tue,

Re: ERROR util.SparkUncaughtExceptionHandler: Uncaught exception in thread Thread

2015-11-25 Thread Dasun Hegoda
Anything? On Tue, Nov 24, 2015 at 11:49 PM, Dasun Hegoda wrote: > I'm using *apache-hive-1.2.1-bin *with *spark-1.5.1-bin-hadoop2.6 *on top > of > *hadoop-2.7.1 *. Any idea how to fix this error? > > On Tue, Nov 24, 2015 at 11:43 PM, Mich Talebzadeh > wrote: > >> Which version of Hive are you u

Re: ERROR util.SparkUncaughtExceptionHandler: Uncaught exception in thread Thread

2015-11-24 Thread Dasun Hegoda
I'm using *apache-hive-1.2.1-bin *with *spark-1.5.1-bin-hadoop2.6 *on top of *hadoop-2.7.1 *. Any idea how to fix this error? On Tue, Nov 24, 2015 at 11:43 PM, Mich Talebzadeh wrote: > Which version of Hive are you using? > > > > Mich Talebzadeh > > > > *Sybase ASE 15 Gold Medal Award 2008* > >

RE: ERROR util.SparkUncaughtExceptionHandler: Uncaught exception in thread Thread

2015-11-24 Thread Mich Talebzadeh
Which version of Hive are you using? Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s Guide to U

Re: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-11 Thread Daniel Haviv
Hi Prasanth, Can you elaborate on what does the hive.merge.orcfile.stripe.level parameter affext? Thank you for your help. Daniel Sent from my iPhone > On 8 בספט׳ 2015, at 17:48, Prasanth Jayachandran > wrote: > > hive.merge.orcfile.stripe.level

RE: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-08 Thread Yehuda Finkelstein
ndran'; 'user@hive.apache.org'; 'user@hive.apache.org ' *Cc:* Daniel Haviv *Subject:* RE: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table The hive version is 0.14 I will try

RE: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-08 Thread Yehuda Finkelstein
-group.com *Subject:* Re: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table What hive version are you using? Can you disable automerging of files and see if that works? set hive.merge.orcfile.stripe.level to false

Re: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-08 Thread Prasanth Jayachandran
What hive version are you using? Can you disable automerging of files and see if that works? set hive.merge.orcfile.stripe.level to false. Also set hive.merge.mapfiles to false and hive.merge.mapredfiles to false so that slow merging is also disabled. On Tue, Sep 8, 2015 at 5:29 AM -0700, "

Re: Error communicating with metastore

2015-08-21 Thread Sarath Chandra
Thanks for all who replied. After several retries in vain, I felt the issue might be because of version mismatch. So I took Hadoop 2.7.1, Spark 1.3.1 and Hive 1.2.1. Tried with these combination and I could successfully test the hive transactions without any issue. Regards, Sarath. On Fri, Aug 7

Re: Error starting the Hive Shell

2015-08-14 Thread Praveen Sripati
I have `export SPARK_HOME=/home/analysis/Installations/spark-1.4.1-bin-hadoop1` in my .bashrc. Once I comment it out, it works fine. Thanks, Praveen On Fri, Aug 14, 2015 at 10:19 AM, Jörn Franke wrote: > Maybe there is another older log4j library in the classpath? > > Le ven. 14 août 2015 à 5:3

Re: Error starting the Hive Shell

2015-08-13 Thread Jörn Franke
Maybe there is another older log4j library in the classpath? Le ven. 14 août 2015 à 5:34, Praveen Sripati a écrit : > Hi, > > I installed Java 1.8.0_51, Hadoop 1.2.1 and Hive 1.2.1 on Ubuntu 14.04 64 > bit, I do get the below exception when I start the hive shell or the > beeline. How do I get a

Re: Error Fetching results: java.io.EOFException

2015-08-11 Thread Prem Yadav
Please check hive logs and post a few lines before the stacktrace. I have seen this error sometimes due to permissions issue. On Tue, Aug 11, 2015 at 9:32 AM, Matthias Kricke wrote: > Hi, > > > > I’m using Hive 0.14.0.2.2.6.0-2800. When sending queries I get this stack > trace: > > 2015-08-11 07

Re: Error communicating with metastore

2015-08-07 Thread Alan Gates
What version of Hive did you say you were using? In 0.14 we switched to make sure all jdbc connections are either serializable or read_committed, yet the error message below seems to indicate you're seeing a connection request that doesn't match this. The only other thing I know to try i swit

Re: Error communicating with metastore

2015-08-07 Thread kulkarni.swar...@gmail.com
Sarath, I assume that the failure you are seeing doesn't happen immediately? The current timeout on the client is set to 5 minutes. A socket timeout usually means that the client timed out before it can even get a response from the server. So the server could either be very busy doing something if

Re: Error communicating with metastore

2015-08-07 Thread Sarath Chandra
Thanks Eugene, Alan. @Alan, As suggested checked the logs, here is what I found - - On starting metastore server, I'm seeing following messages in the log file - *2015-08-07 18:32:56,678 ERROR [Thread-7]: compactor.Initiator (Initiator.java:run(134)) - Caught an exception in the main loop

Re: Error communicating with metastore

2015-08-04 Thread Alan Gates
Ok, the next step is to look at the logs from your Hive metastore server and see exactly what's happening. The error you're seeing is from the client. On your metastore server there should be logs with the same timestamp giving details on why the transaction operation failed. Alan. Sarath

Re: Error communicating with metastore

2015-08-04 Thread Eugene Koifman
ser@hive.apache.org>" mailto:user@hive.apache.org>> Date: Monday, August 3, 2015 at 8:02 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: Error communicating with metastore Thanks Alan. Yes I've run metastore scripts

Re: Error communicating with metastore

2015-08-03 Thread Sarath Chandra
Thanks Alan. Yes I've run metastore scripts for oracle instance. Infact I've removed my previous metastore and created a fresh one by running the schema creation script for 1.2.1. I've looked into the new schema and able to see the table TXNS. I've also removed the hdfs location "/user/hive/wareho

Re: Error communicating with metastore

2015-08-03 Thread Alan Gates
Did you run the hive metastore upgrade scripts for your oracle instance? This error message usually means the transaction related tables have not been created in your database. Somewhere in your distribution there should be a set of upgrade scripts. Look for scripts of the form: scripts/me

Re: Error communicating with metastore

2015-08-03 Thread Sarath Chandra
Thanks Sharath for your reply. I'm specifying these parameters already. I've followed the documentation at https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions But it still throws me this error On Mon, Aug 3, 2015 at 8:45 PM, Sharath Punreddy wrote: > Here is another one: > > http

Re: Error communicating with metastore

2015-08-03 Thread Sharath Punreddy
Check out: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.1/bk_dataintegration/content/ch_using-hive-transactions.html You need to specify the following properties as well: - hive.txn.driver - hive.compactor.initiator.on - hive.compactor.worker.threads On Mon, Aug 3,

Re: Error: java.lang.RuntimeException: org.apache.hive.com/esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 380

2015-07-16 Thread Xuefu Zhang
Same as https://issues.apache.org/jira/browse/HIVE-11269? On Thu, Jul 16, 2015 at 7:25 AM, Anupam sinha wrote: > Hi Guys, > > I am writing the simple hive query,Receiving the following error > intermittently. This error > presents itself for 30min-2hr then goes away. > > Appreciate your help to

Re: Error using UNION ALL operator on tables of different storage format !!!

2015-06-18 Thread Xuefu Zhang
Sounds like a bug. However, could you reproduce with the latest Hive code? --Xuefu On Thu, Jun 18, 2015 at 8:56 PM, @Sanjiv Singh wrote: > Hi All > > I was trying to combine records of two tables using UNION ALL. > One table testTableText is on TEXT format and another table testTableORC > is on

Re: error on hive insert query

2015-06-16 Thread Jianfeng (Jeff) Zhang
You can refer to the following link to figure out whether this is tez problem https://cwiki.apache.org/confluence/display/TEZ/How+to+Diagnose+Tez+App Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "u...@tez.apache.org

Re: error on hive insert query

2015-06-16 Thread Hitesh Shah
Unless you can pinpoint the problem to something Tez specific, hive-specific questions might be better off being asked on user@hive initially as there is a larger group there that understands Hive as compared to the Tez community. FWIW, TezTask error 1 means “something in the Hive layer using T

Re: Error : "Cannot create a path from empty string"

2015-05-15 Thread Viral Bajaria
Sorry for the delay in responding. I am not trying to run a separate job/query on the intermediate output of another job/query. The error is happening in a multi-job mapreduce query. When one step finishes, the next step is trying to read the output of the previous job and fails with the "can not

Re: Error : "Cannot create a path from empty string"

2015-05-13 Thread unmesha sreeveni
On Thu, May 7, 2015 at 9:57 PM, Viral Bajaria wrote: > Since the output is from an intermediate step it was already cleaned up > and I wasn't able to check. ​So that means , path will be empty right. So the stack trace says right. ​java.lang.IllegalArgumentException: Can not create a Path from

RE: Error : "Cannot create a path from empty string"

2015-05-07 Thread Viral Bajaria
7/‎2015 3:16 AM To: "User - Hive" Subject: Re: Error : "Cannot create a path from empty string" Did you checked the Path?Whether it is empty or contain contents? On Thu, May 7, 2015 at 1:42 PM, Viral Bajaria wrote: Hi, We are facing a weird error in a multi-stage mapreduce

Re: Error : "Cannot create a path from empty string"

2015-05-07 Thread unmesha sreeveni
Did you checked the Path?Whether it is empty or contain contents? On Thu, May 7, 2015 at 1:42 PM, Viral Bajaria wrote: > Hi, > > We are facing a weird error in a multi-stage mapreduce job (> 10 jobs). > > A few stages run fine and then randomly 1 of the job would fail with the > following error

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
Yep a true gem ☺ From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Friday, April 17, 2015 2:03 PM To: user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 It always surprises how many parameters are around for different metastores ☺ I use Oracle as my Metastore the

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Mich Talebzadeh
esponsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 17 April 2015 19:56 To: user@hive.apache.org Subject: RE: Error wh

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
, Gary From: Gary Clark [mailto:gcl...@neces.com] Sent: Friday, April 17, 2015 1:33 PM To: user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 2015-04-17 08:24:12,858 DEBUG [HiveServer2-Handler-Pool: Thread-23]: transport.TSaslTransport (TSaslTransport.java:open(243)) - opening

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
mailto:gcl...@neces.com] Sent: Friday, April 17, 2015 12:57 PM To: user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 Thanks Mich good test. [root@localhost root]# telnet 127.0.0.1 1 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. Yes all go

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
apache.org Subject: RE: Error when connecting Hue to HiveServer2 OK so both are running and up (metastore on 9083 and hiveserver on 1 Try doing telnet hostname 1 Can you connect like below (mine runs on 10010 ☺) hduser@rhes564::/home/hduser> telnet rhes564 10010 Trying 50.140.197.217...

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Mich Talebzadeh
ient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 17 April 2015 17:39 To: user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
HiveServer2 is running. Cheers, Gazza From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Friday, April 17, 2015 11:36 AM To: user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 Hi Gary, Is your hiverserver2 running OK. How did you start it? $HIVE_HOME/bin/hiveserver2

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Mich Talebzadeh
Hi Gary, Is your hiverserver2 running OK. How did you start it? $HIVE_HOME/bin/hiveserver2 & What do you when you run the command below? I assume that your hiveserver is running on port 1? netstat -alnp|egrep 'Local|1|9083' HTH Mich Talebzadeh http://taleb

Re: error: Failed to create spark client. for hive on spark

2015-03-02 Thread Xuefu Zhang
It seems that the remote spark context failed to come up. I saw you're using Spark standalone cluster. Please make sure spark cluster is up. You may try spark.master=local first. On Mon, Mar 2, 2015 at 5:15 PM, scwf wrote: > yes, have placed spark-assembly jar in hive lib folder. > > hive.log---

Re: error: Failed to create spark client. for hive on spark

2015-03-02 Thread scwf
yes, have placed spark-assembly jar in hive lib folder. hive.log--- bmit.2317151720491931059.properties --class org.apache.hive.spark.client.RemoteDriver /opt/cluster/apache-hive-1.2.0-SNAPSHOT-bin/lib/hive-exec-1.2.0-SNAPSHOT.jar --remote-host M151 --remote-port 56996 --conf hive.spark.clien

Re: error: Failed to create spark client. for hive on spark

2015-03-02 Thread Xuefu Zhang
Could you check your hive.log and spark.log for more detailed error message? Quick check though, do you have spark-assembly.jar in your hive lib folder? Thanks, Xuefu On Mon, Mar 2, 2015 at 5:14 AM, scwf wrote: > Hi all, > anyone met this error: HiveException(Failed to create spark client.) >

Re: Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread r7raul1...@163.com
Use yarn logs -applicationId to see detail log. r7raul1...@163.com From: Jadhav Shweta Date: 2015-02-26 15:00 To: user Subject: Re: ERROR OutOfMemoryError: Java heap space Hi, I tried running same query from Simple JDBC Client instead of Spring Batch framework its was working fine. But

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Jadhav Shweta
To: "user@hive.apache.org" From: Vaibhav Gumashta Date: 02/26/2015 02:08AM Subject: Re: ERROR OutOfMemoryError: Java heap space Hi, auth=nosasl should be only provided in JDBC url if "hive.server2.authentication” is explicitly set to NOSASL in your hive-site. Otherwise, the jd

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Vaibhav Gumashta
ailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: ERROR OutOfMemoryError: Java heap space Is your problem solved? Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 4:17 PM, Srinivas Thunga mailto:srinivas.thu...@gmail.com>> wrote: Hi, Yo

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Srinivas Thunga
; >> >> -Srinivas Thunga wrote: - >> To: "user@hive.apache.org" >> From: Srinivas Thunga >> Date: 02/25/2015 03:45PM >> >> Subject: Re: ERROR OutOfMemoryError: Java heap space >> >> not required. Make sure there will not be

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Srinivas Thunga
wing error for large data set > > Thanks > Shweta Jadhav > > > > -Srinivas Thunga wrote: - > To: "user@hive.apache.org" > From: Srinivas Thunga > Date: 02/25/2015 03:45PM > > Subject: Re: ERROR OutOfMemoryError: Java heap space > > not req

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Jadhav Shweta
Query is working fine if i have small data set in same table. But its throwing error for large data set Thanks Shweta Jadhav -Srinivas Thunga wrote: - To: "user@hive.apache.org" From: Srinivas Thunga Date: 02/25/2015 03:45PM Subject: Re: ERROR OutOfMemoryError: Java heap

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Srinivas Thunga
8GB ram. > I read somewhere that we should mention auth=noSasl in hive jdbc url. Is > it necessary > > Thanks > Shweta Jadhav > > > > -Jadhav Shweta wrote: - > To: user@hive.apache.org > From: Jadhav Shweta > Date: 02/25/2015 02:54PM > > Subject: Re:

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Jadhav Shweta
hweta Date: 02/25/2015 02:54PM Subject: Re: ERROR OutOfMemoryError: Java heap space I am running the query using spring batch framework. Thanks Shweta Jadhav -Srinivas Thunga wrote: - To: "user@hive.apache.org" From: Srinivas Thunga Date: 02/25/2015 02:43PM Sub

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Jadhav Shweta
I am running the query using spring batch framework. Thanks Shweta Jadhav -Srinivas Thunga wrote: - To: "user@hive.apache.org" From: Srinivas Thunga Date: 02/25/2015 02:43PM Subject: Re: ERROR OutOfMemoryError: Java heap space Hi, Might be problem in your code. Generally

Re: Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread r7raul1...@163.com
Try select * from table limit 1; r7raul1...@163.com From: Jadhav Shweta Date: 2015-02-25 17:38 To: user Subject: Re: ERROR OutOfMemoryError: Java heap space Hi I have installed apache hive 0.13.0. I have configured metastore as postgres db. Query is working fine in beeline command line

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Srinivas Thunga
red metastore as postgres db. > Query is working fine in beeline command line interface but giving Heap > space error while executing using JDBC java client. > > Thanks > Shweta Jadhav > > -Srinivas Thunga wrote: - > To: "user@hive.apache.org" > From: Srin

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Jadhav Shweta
e.org" From: Srinivas Thunga Date: 02/25/2015 02:32PM Subject: Re: ERROR OutOfMemoryError: Java heap space Hi, Let me know how you configured Hive? R u using cloudera? If you are installed Hive separately then have you configured Metastore? Thanks & Regards, Srinivas T On Wed, Feb 25

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Srinivas Thunga
Hi, Let me know how you configured Hive? R u using cloudera? If you are installed Hive separately then have you configured Metastore? *Thanks & Regards,* *Srinivas T* On Wed, Feb 25, 2015 at 2:27 PM, Jadhav Shweta wrote: > Hi > > I am running simple select query > > select * from table; >

Re: ERROR OutOfMemoryError: Java heap space

2015-02-25 Thread Jadhav Shweta
Hi I am running simple select query select * from table; thanks Shweta Jadhav -Srinivas Thunga wrote: - To: "user@hive.apache.org" From: Srinivas Thunga Date: 02/25/2015 01:09PM Subject: Re: Hi,  Can  you place the query as well which you are trying? Thanks & Regards, Sriniva

Re: Error in running udf that interacts with hive jdbc client

2014-10-03 Thread reena upadhyay
Hi Jason, Thanks for the reply :) Map reduce jobs were not able to find the third party jars, this was causing the exceptions. I have placed all the dependent third party jar's inside haddop_home/lib. By doing so, the issue is solved. Thanks, Reena Upadhyay On Fri, Oct 3, 2014 at 1:16 AM, Jason

Re: Error in running udf that interacts with hive jdbc client

2014-10-02 Thread Jason Dere
It looks like the issue is here at the bottom of the list of stack traces, where it can't resolve the HiveDriver class. I think only hive-exec.jar is shipped as part of a map/reduce job, you would have to make sure hive-jdbc is in the class path during the map/reduce jobs. Are you sure your UDF

Re: Error while executing Jobs in Hive

2014-09-22 Thread Knowledge gatherer
Hi, The /tmp folder is already there with 777 permission. Thanks, KG On Sun, Sep 21, 2014 at 11:42 PM, Abirami V wrote: > Do you have hdfs://hostname:9000/tmp directory in hdfs. if not create > /tmp directory in hdfs and make it writable by giving 777 > > Thanks, > Abirami > > On Sun, Sep

Re: Error while executing Jobs in Hive

2014-09-21 Thread Abirami V
Do you have hdfs://hostname:9000/tmp directory in hdfs. if not create /tmp directory in hdfs and make it writable by giving 777 Thanks, Abirami On Sun, Sep 21, 2014 at 3:06 AM, Knowledge gatherer < knowledge.gatherer@gmail.com> wrote: > Whenever I am running a hive query - select * from ta

Re: error on show databases

2014-08-11 Thread Subramanian, Sanjay (HQP)
;user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: error on show databases The below change in configuration parameter in hive-site.xml fixed the issue hive.metastore.schema.verification false It was TRUE earlier later i changed

Re: error on show databases

2014-08-07 Thread Rahul Channe
The below change in configuration parameter in hive-site.xml fixed the issue hive.metastore.schema.verification false It was TRUE earlier later i changed it to False. Not sure if its an issue with Hive or expected behaviour Even ,when i tried to start metastore following error popped up

RE: Error when altering table not in default database

2014-08-06 Thread sky88088
Thank you! It works. Best Regards,ypg Date: Wed, 6 Aug 2014 15:48:57 -0400 Subject: Re: Error when altering table not in default database From: leftylever...@gmail.com To: user@hive.apache.org ALTER TABLE does not yet take a database qualifier on the table name, but it will soon (see HIVE

Re: error on show databases

2014-08-06 Thread Divakar Reddy
It seems your hive metastore is down. restart it and try again. Thanks, Divakar On Wed, Aug 6, 2014 at 9:13 PM, Rahul Channe wrote: > Hi All, > > I am getting following error > > hive> show databases; > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask. java.

Re: error on show databases

2014-08-06 Thread Andrew Mains
Can you check the hive logs (which should be located in /tmp//hive.log )? See https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-ErrorLogs There ought to be a more specific error there. Andrew On 8/6/14, 6:13 PM, Rahul Channe wrote: Hi All, I am getting following

  1   2   3   >