>>> Details at logfile: /home/pig/pig_1448425672112.log You need to check the log file for details
On Wed, Nov 25, 2015 at 1:57 PM, Divya Gehlot <[email protected]> wrote: > Hi, > > > As a beginner ,I have below queries on Spork(Pig on Spark). > I have cloned git clone https://github.com/apache/pig -b spark . > 1.On which version of Pig and Spark , Spork is being built ? > 2. I followed the steps mentioned in https://issues.apache.org/ji > ra/browse/PIG-4059 and try to run simple pig script just like Load the > file and dump/store it. > Getting errors : > >> > grunt> A = load '/tmp/words_tb.txt' using PigStorage('\t') as > (empNo:chararray,empName:chararray,salary:chararray); > grunt> Store A into > '/tmp/spork'; > > 2015-11-25 05:35:52,502 [main] INFO > org.apache.pig.tools.pigstats.ScriptState - Pig features used in the > script: UNKNOWN > 2015-11-25 05:35:52,875 [main] WARN > org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already > been initialized > 2015-11-25 05:35:52,883 [main] INFO > org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - Not MR > mode. RollupHIIOptimizer is disabled > 2015-11-25 05:35:52,894 [main] INFO > org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - > {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, > GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, > MergeFilter, MergeForEach, PartitionFilterOptimizer, > PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, > SplitFilter, StreamTypeCastInserter]} > 2015-11-25 05:35:52,966 [main] INFO > org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not > set... will not generate code. > 2015-11-25 05:35:52,983 [main] INFO > org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - add > Files Spark Job > 2015-11-25 05:35:53,137 [main] INFO > org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - Added > jar pig-0.15.0-SNAPSHOT-core-h2.jar > 2015-11-25 05:35:53,138 [main] INFO > org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - Added > jar pig-0.15.0-SNAPSHOT-core-h2.jar > 2015-11-25 05:35:53,138 [main] INFO > org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - > Converting operator POLoad (Name: A: > Load(/tmp/words_tb.txt:PigStorage(' ')) - scope-29 Operator Key: scope-29) > 2015-11-25 05:35:53,205 [main] ERROR org.apache.pig.tools.grunt.Grunt - > ERROR 2998: Unhandled internal error. Could not initialize class > org.apache.spark.rdd.RDDOperationScope$ > Details at logfile: /home/pig/pig_1448425672112.log > > > Can you please help me in pointing whats wrong ? > > Appreciate your help . > > Thanks, > > Regards, > > Divya > -- Best Regards Jeff Zhang
