hi,all
i execute a sql on hive on spark,the comand like:
select distinct st.sno,sname from student st join score sc
on(st.sno=sc.sno) where sc.cno IN(11,12,13) and st.sage > 28;(some days
ago this sql can work )
but it give me some Info in hive shell :
Query Hive on Spark job[0] stages:
0
St
hi,all
i will write a wiki docs about how to install and deploy hive on
spark,and hope to get access to hive wiki,and my Confluence usename is
yuemeng1.
Thus,
please forgive about the lack of proper documentation. We have a
"Get Started" page that's linked in HIVE-7292. If you can improve
the document there, it would be very helpful for other Hive users.
Thanks,
Xuefu
On Wed, Dec 3, 2014 at 5:42 PM, yue
as well as -Pyarn. When you run
hive queries, you may need to run "set spark.home=/path/to/spark/dir";
Thanks,
Xuefu
On Tue, Dec 2, 2014 at 6:29 PM, yuemeng1 <mailto:yueme...@huawei.com>> wrote:
hi,XueFu,thanks a lot for your help,now i will provide more detail
to
i checkout a spark branch of hive today,and built with commad:
mvn clean package -DskipTests -Phadoop-2 -Pdist
after i run commad in hive bin:
/opt/hispark/apache-hive-0.15.0-SNAPSHOT-bin/bin # ./hive --auxpath
/opt/hispark/spark/assembly/target/scala-2.10/spark-assembly-1.2.0-hadoop2.4.0.jar
it
n how to reproduce the issue? such as the
exact spark branch, the command to build Spark, how you build Hive,
and what queries/commands you run.
We are running Hive on Spark all the time. Our pre-commit test runs
without any issue.
Thanks,
Xuefu
On Tue, Dec 2, 2014 at 4:13 AM, yuemeng1 <
wrote:
You need to build your spark assembly from spark 1.2 branch. this
should give your both a spark build as well as spark-assembly jar,
which you need to copy to Hive lib directory. Snapshot is fine, and
spark 1.2 hasn't been released yet.
--Xuefu
On Mon, Dec 1, 2014 at 7:41 PM, yuemeng
assembly from spark 1.2 branch. this
should give your both a spark build as well as spark-assembly jar,
which you need to copy to Hive lib directory. Snapshot is fine, and
spark 1.2 hasn't been released yet.
--Xuefu
On Mon, Dec 1, 2014 at 7:41 PM, yuemeng1 <mailto:yueme...@huawei.com
hi,i use git checkout a spark branch of hive today,and i think it's the
latest version.and it's pom.xml file include:
1.4
10.11.1.1
after i built ,a derby-10.11.1.1.jar in
apache-hive-0.15.0-SNAPSHOT-bin/lib ,but when i run
hive --auxpath spark assembly jar home.
it give follow error:
i get a spark-1.1.0-bin-hadoop2.4
from(http://ec2-50-18-79-139.us-west-1.compute.amazonaws.com/data/) and
replace the Spark 1.2.x assembly with
http://ec2-50-18-79-139.us-west-1.compute.amazonaws.com/data/spark-assembly-1.2.0-SNAPSHOT-hadoop2.3.0-cdh5.1.2.jar,but
when i run a query about join,i
fu
On Mon, Dec 1, 2014 at 6:22 PM, yuemeng1 <mailto:yueme...@huawei.com>> wrote:
hi,i built a hive on spark package and my spark assembly jar is
spark-assembly-1.2.0-SNAPSHOT-hadoop2.4.0.jar,when i run a query
in hive shell,before execute this query,
i set all the requ
hi,i built a hive on spark package and my spark assembly jar is
spark-assembly-1.2.0-SNAPSHOT-hadoop2.4.0.jar,when i run a query in hive
shell,before execute this query,
i set all the require which hive need with spark.and i execute a join
query :
select distinct st.sno,sname from student st j
12 matches
Mail list logo
