Sequence File SerDe issue: org.apache.hadoop.io.Text appearing where they shouldn't be

2013-03-11 Thread James Kebinger
Hello everyone, I have an odd problem I'm trying to track down. I have a sequence file with Protobufs wrapped in writables, where we write the length of the protobuf byte array as an int and then write the byte array. I have two different base classes of these, and so I test for those; there should

What is "emptyFile" doing in my input splits?

2013-03-11 Thread James Kebinger
Following up my previous email about my SerDe not working when it encounters Text it should be encountering, I noticed a difference in the input splits of tasks where the SerdeFailed and those where it succeeds: the failure cases have this mysterious "emptyFile". How can I make emptyFile take a hi