Exactly what you would expect if you pasted parameters in Grunt:
Russells-MacBook-Pro:pig-trunk rjurney$ bin/pig -l /tmp -x local -v -w
Warning: $HADOOP_HOME is deprecated.
13/01/05 13:52:32 WARN util.PropertiesUtil: /Users/rjurney/.pigrc exists
but will be deprecated soon. Use conf/pig.properties instead!
2013-01-05 13:52:32,033 [main] INFO org.apache.pig.Main - Apache Pig
version 0.11.0-SNAPSHOT (rexported) compiled Jan 05 2013, 13:39:15
2013-01-05 13:52:32,033 [main] INFO org.apache.pig.Main - Logging error
messages to: /private/tmp/pig_1357422752017.log
2013-01-05 13:52:32,229 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to hadoop file system at: file:///
2013-01-05 13:52:32.295 java[25424:1203] Unable to load realm info from
SCDynamicStore
grunt> /* Setup for Piggybank */
grunt> %default PIGGYBANK_LIB '/me/Software/pig/contrib/piggybank/java'
2013-01-05 13:52:32,413 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 1000: Error during parsing. Encountered " <PATH> "%default "" at line
2, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"describe" ...
"aliases" ...
"explain" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"run" ...
"exec" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
2013-01-05 13:52:32,413 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.tools.pigscript.parser.ParseException: Encountered " <PATH>
"%default "" at line 2, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"describe" ...
"aliases" ...
"explain" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"run" ...
"exec" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.generateParseException(PigScriptParser.java:1180)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.handle_invalid_command(PigScriptParser.java:996)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:557)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> REGISTER $PIBBYBANK_LIB/piggybank.jar
2013-01-05 13:52:32,458 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 101: file '$PIBBYBANK_LIB/piggybank.jar' does not exist.
2013-01-05 13:52:32,458 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 101: file
'$PIBBYBANK_LIB/piggybank.jar' does not exist.
at
org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:794)
at org.apache.pig.impl.io.FileLocalizer.fetchFiles(FileLocalizer.java:746)
at org.apache.pig.PigServer.registerJar(PigServer.java:458)
at
org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:433)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:445)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt>
grunt> /* Setup for Avro */
grunt> %default PIG_LIB '/me/Software/pig/build/ivy/lib/Pig';
2013-01-05 13:52:32,461 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 1000: Error during parsing. Encountered " <PATH> "%default "" at line
3, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"describe" ...
"aliases" ...
"explain" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"run" ...
"exec" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
2013-01-05 13:52:32,461 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.tools.pigscript.parser.ParseException: Encountered " <PATH>
"%default "" at line 3, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"describe" ...
"aliases" ...
"explain" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"run" ...
"exec" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.generateParseException(PigScriptParser.java:1180)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.handle_invalid_command(PigScriptParser.java:996)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:557)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> REGISTER $PIG_LIB/avro-1.5.3.jar
2013-01-05 13:52:32,491 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 101: file '$PIG_LIB/avro-1.5.3.jar' does not exist.
2013-01-05 13:52:32,491 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 101: file
'$PIG_LIB/avro-1.5.3.jar' does not exist.
at
org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:794)
at org.apache.pig.impl.io.FileLocalizer.fetchFiles(FileLocalizer.java:746)
at org.apache.pig.PigServer.registerJar(PigServer.java:458)
at
org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:433)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:445)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> REGISTER $PIG_LIB/json-simple-1.1.jar
2013-01-05 13:52:32,517 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 101: file '$PIG_LIB/json-simple-1.1.jar' does not exist.
2013-01-05 13:52:32,517 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 101: file
'$PIG_LIB/json-simple-1.1.jar' does not exist.
at
org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:794)
at org.apache.pig.impl.io.FileLocalizer.fetchFiles(FileLocalizer.java:746)
at org.apache.pig.PigServer.registerJar(PigServer.java:458)
at
org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:433)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:445)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> DEFINE AvroStorage
org.apache.pig.piggybank.storage.avro.AvroStorage();
grunt>
grunt> /* Setup for MongoDB */
grunt> $default MONGO_LIB '/me/Software/mongo-hadoop/'
2013-01-05 13:52:32,827 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 1000: Error during parsing. Encountered " <PATH> "$default "" at line
4, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"describe" ...
"aliases" ...
"explain" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"run" ...
"exec" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
2013-01-05 13:52:32,828 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.tools.pigscript.parser.ParseException: Encountered " <PATH>
"$default "" at line 4, column 1.
Was expecting one of:
<EOF>
"cat" ...
"clear" ...
"fs" ...
"sh" ...
"cd" ...
"cp" ...
"copyFromLocal" ...
"copyToLocal" ...
"dump" ...
"describe" ...
"aliases" ...
"explain" ...
"help" ...
"history" ...
"kill" ...
"ls" ...
"mv" ...
"mkdir" ...
"pwd" ...
"quit" ...
"register" ...
"rm" ...
"rmf" ...
"set" ...
"illustrate" ...
"run" ...
"exec" ...
"scriptDone" ...
"" ...
"" ...
<EOL> ...
";" ...
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.generateParseException(PigScriptParser.java:1180)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.handle_invalid_command(PigScriptParser.java:996)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:557)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> REGISTER $MONGO_LIB/mongo-2.10.1.jar
2013-01-05 13:52:32,847 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 101: file '$MONGO_LIB/mongo-2.10.1.jar' does not exist.
2013-01-05 13:52:32,847 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 101: file
'$MONGO_LIB/mongo-2.10.1.jar' does not exist.
at
org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:794)
at org.apache.pig.impl.io.FileLocalizer.fetchFiles(FileLocalizer.java:746)
at org.apache.pig.PigServer.registerJar(PigServer.java:458)
at
org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:433)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:445)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> REGISTER $MONGO_LIB/core/target/mongo-hadoop-core-1.1.0-SNAPSHOT.jar
2013-01-05 13:52:32,865 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 101: file
'$MONGO_LIB/core/target/mongo-hadoop-core-1.1.0-SNAPSHOT.jar' does not
exist.
2013-01-05 13:52:32,865 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 101: file
'$MONGO_LIB/core/target/mongo-hadoop-core-1.1.0-SNAPSHOT.jar' does not
exist.
at
org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:794)
at org.apache.pig.impl.io.FileLocalizer.fetchFiles(FileLocalizer.java:746)
at org.apache.pig.PigServer.registerJar(PigServer.java:458)
at
org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:433)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:445)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> REGISTER $MONGO_LIB/pig/target/mongo-hadoop-pig-1.1.0-SNAPSHOT.jar
2013-01-05 13:52:32,883 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 101: file '$MONGO_LIB/pig/target/mongo-hadoop-pig-1.1.0-SNAPSHOT.jar'
does not exist.
2013-01-05 13:52:32,883 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 101: file
'$MONGO_LIB/pig/target/mongo-hadoop-pig-1.1.0-SNAPSHOT.jar' does not exist.
at
org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:794)
at org.apache.pig.impl.io.FileLocalizer.fetchFiles(FileLocalizer.java:746)
at org.apache.pig.PigServer.registerJar(PigServer.java:458)
at
org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:433)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:445)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:538)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Details also at logfile: /private/tmp/pig_1357422752017.log
grunt> DEFINE MongoStorage com.mongodb.hadoop.pig.MongoStorage();
grunt>
On Sat, Jan 5, 2013 at 1:51 PM, Prashant Kommireddi <[email protected]>wrote:
> What are the errors with .pigbootup?
>
> On Sun, Jan 6, 2013 at 3:19 AM, Russell Jurney <[email protected]
> >wrote:
>
> > I need to run these things as Pig boots, and have them work in Grunt:
> >
> > /* Setup for Piggybank */
> > %default PIGGYBANK_LIB '/me/Software/pig/contrib/piggybank/java'
> > REGISTER $PIBBYBANK_LIB/piggybank.jar
> >
> > /* Setup for Avro */
> > %default PIG_LIB '/me/Software/pig/build/ivy/lib/Pig';
> > REGISTER $PIG_LIB/avro-1.5.3.jar
> > REGISTER $PIG_LIB/json-simple-1.1.jar
> > DEFINE AvroStorage org.apache.pig.piggybank.storage.avro.AvroStorage();
> >
> > /* Setup for MongoDB */
> > $default MONGO_LIB '/me/Software/mongo-hadoop/'
> > REGISTER $MONGO_LIB/mongo-2.10.1.jar
> > REGISTER $MONGO_LIB/core/target/mongo-hadoop-core-1.1.0-SNAPSHOT.jar
> > REGISTER $MONGO_LIB/pig/target/mongo-hadoop-pig-1.1.0-SNAPSHOT.jar
> > DEFINE MongoStorage com.mongodb.hadoop.pig.MongoStorage();
> >
> >
> > However, when I place them in ~/.pigrc and start Pig 0.10... nothing
> > happens. When I run Pig 0.11, nothing happens.
> >
> > I have gone through half a dozen JIRAs, and not one specifies how this
> > interface works, or how to load libraries when Grunt starts. Should I be
> > using .pigbootup - and Pig 0.11? That throws tons of errors.
> >
> > How can I write a script that doesn't require a Grunt user to customize
> the
> > path to his pig installation EACH AND EVERY TIME they use grunt?
> > -----------------------
> >
> > --
> > Russell Jurney twitter.com/rjurney
> > [email protected]<
> >
> https://mail.google.com/mail/?view=cm&fs=1&tf=1&[email protected]
> > >
> > datasyndrome.com
> >
>
--
Russell Jurney twitter.com/rjurney [email protected] datasyndrome.com
