Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
Thanks Jorn. I don't understand how my select * is correctly reading my table property then if I'm just using default serde. On Mon., 19 Dec. 2016 at 5:36 pm, Jörn Franke wrote: > You have to write a custom hiveserde format to pass tblproperties as > inputformat properties, but check the source

[jira] [Created] (HIVE-15463) EncodedReaderImpl::readEncodedColumns in io elevator path printing lots of logs

2016-12-18 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HIVE-15463: --- Summary: EncodedReaderImpl::readEncodedColumns in io elevator path printing lots of logs Key: HIVE-15463 URL: https://issues.apache.org/jira/browse/HIVE-15463 P

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Jörn Franke
You have to write a custom hiveserde format to pass tblproperties as inputformat properties, but check the source code of the serde you used. > On 19 Dec 2016, at 07:22, Chris Teoh wrote: > > rows.

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
Hi Jorn, Create external table 'mytable' ( mydata string) row format serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' stored as inputformat 'com.hello.world.myinputformat' outputformat 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' location '/tmp/mysampledata' TBLPROPERTIES

Re: TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Jörn Franke
What is the create table statement? Do you parse the tblproperties in the HiveSerde? Do you have exceptions in the log? > On 19 Dec 2016, at 07:02, Chris Teoh wrote: > > Hi there, > > Can anyone confirm whether TBLPROPERTIES in DDLs are ignored by custom > inputformats in the context of a UDAF

TBLPROPERTIES appears to be ignored by custom inputformats

2016-12-18 Thread Chris Teoh
Hi there, Can anyone confirm whether TBLPROPERTIES in DDLs are ignored by custom inputformats in the context of a UDAF? I've written a custom input format and it works with a SELECT * but when I do anything more like SELECT count(*) it returns 0. INSERT INTO SELECT * FROM doesn't appear to ins

Re: Naveen Gangam has become a Hive Committer

2016-12-18 Thread Sharath Babu Basavaraja
Congrats Naveen! --Sharath On Sat, Dec 17, 2016 at 11:16 PM Lefty Leverenz wrote: > Congratulations Naveen! > > -- Lefty > > > > > On Fri, Dec 16, 2016 at 10:10 AM, Xuefu Zhang wrote: > > Bcc: dev/user > > > > > > Hi all, > > > > > > It's my honor to announce that Apache Hive PMC has voted on

Re: Review Request 54771: Capture additional metadata to replicate a simple insert at destination

2016-12-18 Thread Vaibhav Gumashta
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54771/ --- (Updated Dec. 19, 2016, 12:26 a.m.) Review request for hive, Sushanth Sowmyan a

[jira] [Created] (HIVE-15462) Failing test: TestCliDriver::udf_sort_array.q

2016-12-18 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HIVE-15462: --- Summary: Failing test: TestCliDriver::udf_sort_array.q Key: HIVE-15462 URL: https://issues.apache.org/jira/browse/HIVE-15462 Project: Hive Issue Type:

[hive/tez] discussions for HIVE-15444, tez.queue.name is invalid after tez job running on CLI

2016-12-18 Thread Hui Fei
hi all, I running tez job on CLI First i set tez.queue.name. Then i run a job After running job successfully, tez.queue.name is null. I dig the source code, conf.unset(TezConfiguration.TEZ_QUEUE_NAME) is called after session started, why is that? link is https://issues.apache.org/jira/browse/HIVE