Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-19 Thread Chris Teoh
bug and fixing time. > At the same time, your inputformat should have either default values for > configuration or where not possible throw an exception if expected > configuration is it there. > > > On 19 Dec 2016, at 07:53, Chris Teoh wrote: > > > > Thanks Jorn.

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
check the source code of the serde you used. > > > On 19 Dec 2016, at 07:22, Chris Teoh wrote: > > > > rows. >

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
table using the same input format but different value for the "myinputformat.setting1" setting. Kind Regards Chris On Mon, 19 Dec 2016 at 17:08 Jörn Franke wrote: > What is the create table statement? Do you parse the tblproperties in the > HiveSerde? Do you have exceptions in

TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
Hi there, Can anyone confirm whether TBLPROPERTIES in DDLs are ignored by custom inputformats in the context of a UDAF? I've written a custom input format and it works with a SELECT * but when I do anything more like SELECT count(*) it returns 0. INSERT INTO SELECT * FROM doesn't appear to ins

Hive unit testing in other projects

2016-08-09 Thread Chris Teoh
Hi folks, I'm working on a Sqoop patch that imports to Hive and am wondering what's the easiest way to incorporate a unit test that uses a mini Hive server without requiring a full dependency on Hive project? Kind Regards Chris