Re: Unexpected data type -1 found in stream

Tue, 29 Mar 2011 15:40:44 -0700 

If you turn your ArrayList into a bag it should be happy.

Alan.

On Mar 29, 2011, at 3:34 PM, Xavier Stevens wrote:


It probably wasn't the null values actually. It didn't like having
ArrayList values in a map.


-Xavier

On 3/29/11 2:08 PM, Xavier Stevens wrote:

So it looks like the problem might be that one of the keys in the map
has a null value. Is that just not supported in Pig or is that a bug?

-Xavier

On 3/29/11 2:02 PM, Xavier Stevens wrote:
The value is a mixture of types. I'll go through and spit out what types 
it has and get back to you.

Thanks Alan.


On 3/29/11 1:56 PM, Alan Gates wrote:

What are you putting in as the value of the map?  From the error it
looks like your passing in a datatype Pig doesn't understand, and when 
it tries to write it out to the screen it doesn't know how to.

Alan.

On Mar 29, 2011, at 1:34 PM, Xavier Stevens wrote:
I'm currently getting a really weird error coming from one of my eval functions. It expects a tuple where the first element is a string and then outputs a Map<String,Object> as a result. I put in some debug code and I can see the value I get is what I expect and that the resulting 
map size is 35 elements. Anyone seen a problem like this before?

Thanks,

-Xavier

Pig script line:

genmap = FOREACH raw GENERATE
com.mozilla.pig.eval.json.JsonMap(processed_json) AS
processed_json_map:map[];

Log file:

ERROR 2997: Unable to recreate exception from backed error:
java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 
found in stream.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias genmap. Backend error : Unable to recreate 
exception from backed error: java.io.IOException:
java.lang.RuntimeException: Unexpected data type -1 found in stream. 
  at org.apache.pig.PigServer.openIterator(PigServer.java:742)
  at
org .apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java: 612) 
  at
org .apache .pig .tools .pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303) 

  at
org .apache .pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 165) 

  at
org .apache .pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 141) 

  at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:76)
  at org.apache.pig.Main.run(Main.java:465)
  at org.apache.pig.Main.main(Main.java:107)
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 
2997: Unable to recreate exception from backed error:
java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 
found in stream.
  at
org .apache .pig .backend .hadoop .executionengine .mapReduceLayer.Launcher.getErrorMessages(Launcher.java:221) 

  at
org .apache .pig .backend .hadoop .executionengine.mapReduceLayer.Launcher.getStats(Launcher.java: 154) 

  at
org .apache .pig .backend .hadoop .executionengine .mapReduceLayer .MapReduceLauncher.launchPig(MapReduceLauncher.java:337) 

  at
org .apache .pig .backend .hadoop .executionengine.HExecutionEngine.execute(HExecutionEngine.java: 378) 

  at
org .apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java: 1198) 
  at org.apache.pig.PigServer.storeEx(PigServer.java:874)
  at org.apache.pig.PigServer.store(PigServer.java:816)
  at org.apache.pig.PigServer.openIterator(PigServer.java:728)
  ... 7 more

Reply via email to