Pig on mapreduce depends on MR historyserver ?

2015-01-16 Thread canan chen
I try to run pig on mapreduce, but would meet the following error if I didn't start mr history server. But I can run hive on mapreduce without MR historyserver, not sure why pig on mapreduce on MR historyserver. As my understanding historyserver is used for recovery, so it should be OK without hist

Re: Pig on mapreduce depends on MR historyserver ?

2015-01-27 Thread canan chen
Has anyone experience this ? Thanks On Fri, Jan 16, 2015 at 7:28 PM, canan chen wrote: > I try to run pig on mapreduce, but would meet the following error if I > didn't start mr history server. > But I can run hive on mapreduce without MR historyserver, not sure why pig > o

How to run pig on spark ?

2016-12-20 Thread canan chen
I try to run pig on spark. But hit the following error. Could anyone help me on that ? And BTW where can I find document about how to use pig on spark. 16/12/21 11:11:44 ERROR pig.Main: org.apache.pig.PigException: ERROR 2040: Unknown exec type: SPARK at org.apache.pig.ExecTypeProvider.selectExec

Re: How to run pig on spark ?

2016-12-20 Thread canan chen
g-on-apache-spark/ > > Hope this helps > > > Thanks, > Divya > > On 21 December 2016 at 11:13, canan chen wrote: > > > I try to run pig on spark. But hit the following error. Could anyone help > > me on that ? And BTW where can I find document about how to u

How to publish pig maven jars to local ?

2016-12-25 Thread canan chen
I made some changes on pig and want to publish pig as maven jars to local. I run 'ant mvn-build', but get the following errors, could anyone guide me how to publish maven jar ? Thanks [javac] /Users/hadoop/github/pig/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigSplit.java:5