Does streaming python UDF (http://pig.apache.org/docs/r0.14.0/udf.html#python-udfs) works? It use streaming plus the boilerplate code to convert stdin/stdout to python data according to schema.
Daniel On 1/26/15, 1:02 AM, "Niels Basjes" <[email protected]> wrote: >Hi, > >I'm working on a custom Loader and for one of the usecases I want to be >able to return a typed map. So essentially a map where each element has a >specific schema (tuple/bag). > >I.e. something like this: > http://pig.apache.org/docs/r0.13.0/basic.html#map-schema > b = stream a through `cat` as (m:*map[{(i:int,j:chararray)}]*); -- Map >value is bag > >Possibly I will need a deeper nesting level (i.e. tuple in a bag in a >bag). > >What I am looking for is preferably an existing opensource Loader that >does >this so I can see which API methods must be called where to achieve this >correctly. > >Thanks. > >-- >Best regards > >Niels Basjes
