Re: Job aborted due to stage failure

Hi,Lefty Currently, I have some other things to do, I'm going to edit wikidocs tomorrow thanks Yuemeng On 2014/12/5 9:59, Lefty Leverenz wrote: Yuemeng, you can find out how to edit wikidocs here: About This Wiki

Re: Job aborted due to stage failure

Yuemeng, you can find out how to edit wikidocs here: About This Wiki . -- Lefty On Wed, Dec 3, 2014 at 10:05 PM, Xuefu Zhang wrote: > Hi Yuemeng, > > I'm glad that Hive on Spark finally work

Re: Job aborted due to stage failure

Hi Yuemeng, I'm glad that Hive on Spark finally works for you. As you know, this project is still in development and yet to be released. Thus, please forgive about the lack of proper documentation. We have a "Get Started" page that's linked in HIVE-7292. If you can improve the document there, it w

Re: Job aborted due to stage failure

hi,thanks a lot for your help,with your help ,my hive-on-spark can work well now it take me long time to install and deploy.here are some advice,i think we need to improve the installation documentation, allowing users to use the least amount of time to compile and install 1)add which spark ver

Re: Job aborted due to stage failure

When you build Spark, remove -Phive as well as -Pyarn. When you run hive queries, you may need to run "set spark.home=/path/to/spark/dir"; Thanks, Xuefu On Tue, Dec 2, 2014 at 6:29 PM, yuemeng1 wrote: > hi,XueFu,thanks a lot for your help,now i will provide more detail to > reproduce this ssue

Re: Job aborted due to stage failure

hi,XueFu,thanks a lot for your help,now i will provide more detail to reproduce this ssue: 1),i checkout a spark branch from hive github(https://github.com/apache/hive/tree/spark on Nov 29,becasue of for version now it will give something wrong about:Caused by: java.lang.RuntimeException: Unabl

RE: Job aborted due to stage failure

unsubscribe From: yuemeng1 [mailto:yueme...@huawei.com] Sent: Tuesday, December 2, 2014 5:14 AM To: user@hive.apache.org Subject: Re: Job aborted due to stage failure hi,XueFu i checkout a spark branch from sparkgithub(tags:v1.2.0-snapshot0)and i compare this spark's pom.xml with spark-p

Re: Job aborted due to stage failure

Could you provide details on how to reproduce the issue? such as the exact spark branch, the command to build Spark, how you build Hive, and what queries/commands you run. We are running Hive on Spark all the time. Our pre-commit test runs without any issue. Thanks, Xuefu On Tue, Dec 2, 2014 at

Re: Job aborted due to stage failure

hi,XueFu i checkout a spark branch from sparkgithub(tags:v1.2.0-snapshot0)and i compare this spark's pom.xml with spark-parent-1.2.0-SNAPSHOT.pom(get from http://ec2-50-18-79-139.us-west-1.compute.amazonaws.com/data/spark_2.10-1.2-SNAPSHOT/org/apache/spark/spark-parent/1.2.0-SNAPSHOT/),and the

Re: Job aborted due to stage failure

hi,i checkout a spark 1.2 branch from spark github,and built,then copy spark assembly jar into Hive lib directory,but when i run this qeury ,it still give me this error. i am very confused,how can i let hive on spark work! On 2014/12/2 13:39, Xuefu Zhang wrote: You need to build your spark asse

Re: Job aborted due to stage failure

You need to build your spark assembly from spark 1.2 branch. this should give your both a spark build as well as spark-assembly jar, which you need to copy to Hive lib directory. Snapshot is fine, and spark 1.2 hasn't been released yet. --Xuefu On Mon, Dec 1, 2014 at 7:41 PM, yuemeng1 wrote: >

Re: Job aborted due to stage failure

hi.XueFu, thanks a lot for your inforamtion,but as far as i know ,the latest spark version on github is spark-snapshot-1.3,but there is no spark-1.2,only have a branch-1.2 with spark-snapshot-1.2,can u tell me which spark version i should built,and for now,that's spark-assembly-1.2.0-SNAPSHO

Re: Job aborted due to stage failure

It seems that wrong class, HiveInputFormat, is loaded. The stacktrace is way off the current Hive code. You need to build Spark 1.2 and copy spark-assembly jar to Hive's lib directory and that it. --Xuefu On Mon, Dec 1, 2014 at 6:22 PM, yuemeng1 wrote: > hi,i built a hive on spark package and