Nulls should be fine. This error usually shows up when one of the
types is something Pig doesn't now how to handle. It knows Integer,
Long, Float, Double, String, DataByteArray, Tuple, Bag, and
Map<String, Object>. Different types for different records should be
fine.
Alan.
On Mar 29, 2011, at 2:08 PM, Xavier Stevens wrote:
So it looks like the problem might be that one of the keys in the map
has a null value. Is that just not supported in Pig or is that a bug?
-Xavier
On 3/29/11 2:02 PM, Xavier Stevens wrote:
The value is a mixture of types. I'll go through and spit out what
types
it has and get back to you.
Thanks Alan.
On 3/29/11 1:56 PM, Alan Gates wrote:
What are you putting in as the value of the map? From the error it
looks like your passing in a datatype Pig doesn't understand, and
when
it tries to write it out to the screen it doesn't know how to.
Alan.
On Mar 29, 2011, at 1:34 PM, Xavier Stevens wrote:
I'm currently getting a really weird error coming from one of my
eval
functions. It expects a tuple where the first element is a string
and
then outputs a Map<String,Object> as a result. I put in some
debug code
and I can see the value I get is what I expect and that the
resulting
map size is 35 elements. Anyone seen a problem like this before?
Thanks,
-Xavier
Pig script line:
genmap = FOREACH raw GENERATE
com.mozilla.pig.eval.json.JsonMap(processed_json) AS
processed_json_map:map[];
Log file:
ERROR 2997: Unable to recreate exception from backed error:
java.io.IOException: java.lang.RuntimeException: Unexpected data
type -1
found in stream.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
Unable
to open iterator for alias genmap. Backend error : Unable to
recreate
exception from backed error: java.io.IOException:
java.lang.RuntimeException: Unexpected data type -1 found in
stream.
at org.apache.pig.PigServer.openIterator(PigServer.java:742)
at
org
.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:
612)
at
org
.apache
.pig
.tools
.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
at
org
.apache
.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
at
org
.apache
.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:76)
at org.apache.pig.Main.run(Main.java:465)
at org.apache.pig.Main.main(Main.java:107)
Caused by: org.apache.pig.backend.executionengine.ExecException:
ERROR
2997: Unable to recreate exception from backed error:
java.io.IOException: java.lang.RuntimeException: Unexpected data
type -1
found in stream.
at
org
.apache
.pig
.backend
.hadoop
.executionengine
.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:221)
at
org
.apache
.pig
.backend
.hadoop
.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:
154)
at
org
.apache
.pig
.backend
.hadoop
.executionengine
.mapReduceLayer
.MapReduceLauncher.launchPig(MapReduceLauncher.java:337)
at
org
.apache
.pig
.backend
.hadoop
.executionengine.HExecutionEngine.execute(HExecutionEngine.java:
378)
at
org
.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:
1198)
at org.apache.pig.PigServer.storeEx(PigServer.java:874)
at org.apache.pig.PigServer.store(PigServer.java:816)
at org.apache.pig.PigServer.openIterator(PigServer.java:728)
... 7 more
