That does not really make sense. Your breaking the layered approache. InputFormats read/write data, serdes interpret data based on the table definition. its like asking "Why can't my input format run assembly code?"
On Tue, May 28, 2013 at 11:42 AM, Owen O'Malley <omal...@apache.org> wrote: > > > > On Tue, May 28, 2013 at 7:59 AM, Peter Marron < > peter.mar...@trilliumsoftware.com> wrote: > >> Hi,**** >> >> ** ** >> >> Hive 0.10.0 over Hadoop 1.0.4.**** >> >> ** ** >> >> Further to my filtering questions of before.**** >> >> I would like to be able to access the table properties from inside my >> custom InputFormat.**** >> >> I’ve done searches and there seem to be some other people who have had a >> similar problem.**** >> >> The closest I can see to a solution is to use **** >> >> MapredWork mrwork = >> Utilities.getMapRedWork(configuration);**** >> >> but this fails for me with the error below.**** >> >> I’m not truly surprised because I and trying to make sure that my query** >> ** >> >> runs without a map/reduce and some of the e-mails suggest that in this >> case:**** >> >> ** ** >> >> “…no mapred job is >> run, so this trick doesn't work (and instead, the Configuration object >> can be used, since it's local).”**** >> >> ** ** >> >> Any pointers would be very much appreciated. >> > > Yeah, as you discovered, that only works in the MapReduce case and breaks > on cases like "select count(*)" that don't run in MapReduce. > > I haven't tried it, but it looks like the best you can do with the current > interface is to implement a SerDe which is passed the table properties in > initialize. In terms of passing it to the InputFormat, I'd try a thread > local variable. It looks like the getRecordReader is called soon after the > serde.initialize although I didn't do a very deep search of the code. > > -- Owen > > >
