It probably wasn't the null values actually. It didn't like having ArrayList values in a map.
-Xavier On 3/29/11 2:08 PM, Xavier Stevens wrote: > So it looks like the problem might be that one of the keys in the map > has a null value. Is that just not supported in Pig or is that a bug? > > -Xavier > > On 3/29/11 2:02 PM, Xavier Stevens wrote: >> The value is a mixture of types. I'll go through and spit out what types >> it has and get back to you. >> >> Thanks Alan. >> >> >> On 3/29/11 1:56 PM, Alan Gates wrote: >>> What are you putting in as the value of the map? From the error it >>> looks like your passing in a datatype Pig doesn't understand, and when >>> it tries to write it out to the screen it doesn't know how to. >>> >>> Alan. >>> >>> On Mar 29, 2011, at 1:34 PM, Xavier Stevens wrote: >>> >>>> I'm currently getting a really weird error coming from one of my eval >>>> functions. It expects a tuple where the first element is a string and >>>> then outputs a Map<String,Object> as a result. I put in some debug code >>>> and I can see the value I get is what I expect and that the resulting >>>> map size is 35 elements. Anyone seen a problem like this before? >>>> >>>> Thanks, >>>> >>>> -Xavier >>>> >>>> Pig script line: >>>> >>>> genmap = FOREACH raw GENERATE >>>> com.mozilla.pig.eval.json.JsonMap(processed_json) AS >>>> processed_json_map:map[]; >>>> >>>> Log file: >>>> >>>> ERROR 2997: Unable to recreate exception from backed error: >>>> java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 >>>> found in stream. >>>> >>>> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable >>>> to open iterator for alias genmap. Backend error : Unable to recreate >>>> exception from backed error: java.io.IOException: >>>> java.lang.RuntimeException: Unexpected data type -1 found in stream. >>>> at org.apache.pig.PigServer.openIterator(PigServer.java:742) >>>> at >>>> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:612) >>>> at >>>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303) >>>> >>>> at >>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165) >>>> >>>> at >>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141) >>>> >>>> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:76) >>>> at org.apache.pig.Main.run(Main.java:465) >>>> at org.apache.pig.Main.main(Main.java:107) >>>> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR >>>> 2997: Unable to recreate exception from backed error: >>>> java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 >>>> found in stream. >>>> at >>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:221) >>>> >>>> at >>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:154) >>>> >>>> at >>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:337) >>>> >>>> at >>>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:378) >>>> >>>> at >>>> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1198) >>>> at org.apache.pig.PigServer.storeEx(PigServer.java:874) >>>> at org.apache.pig.PigServer.store(PigServer.java:816) >>>> at org.apache.pig.PigServer.openIterator(PigServer.java:728) >>>> ... 7 more >>>>
