> I don't see anything in the HiveServer2 log when I do SELECT
> count(*).
The count(*) should not be running on the HiveServer2, unlike the SELECT *.
SELECT * takes a short-cut by which it skips the entire "cluster" part of Hive
and runs the InputFormat locally in HiveServer2.
You might be
Thanks Jorn.
I do see the inputformat logging the settings in HiveServer2 logs when I do
SELECT * . I don't see anything in the HiveServer2 log when I do SELECT
count(*). I assume it must be somewhere in the lower levels or because the
count function does some other thing. I also tried writing my
I assume it is related to lazy evaluation by the serde but this would require
investigation of the source code and log files.
If there is no exception in the log files then you forgot to log them (bad!).
Use sonarqube or similar to check your source code related to those kind of
mistakes - save
Thanks Jorn.
I don't understand how my select * is correctly reading my table property
then if I'm just using default serde.
On Mon., 19 Dec. 2016 at 5:36 pm, Jörn Franke wrote:
> You have to write a custom hiveserde format to pass tblproperties as
> inputformat properties, but check the source
You have to write a custom hiveserde format to pass tblproperties as
inputformat properties, but check the source code of the serde you used.
> On 19 Dec 2016, at 07:22, Chris Teoh wrote:
>
> rows.
Hi Jorn,
Create external table 'mytable' ( mydata string)
row format serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
stored as inputformat 'com.hello.world.myinputformat'
outputformat 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
location '/tmp/mysampledata'
TBLPROPERTIES
What is the create table statement? Do you parse the tblproperties in the
HiveSerde? Do you have exceptions in the log?
> On 19 Dec 2016, at 07:02, Chris Teoh wrote:
>
> Hi there,
>
> Can anyone confirm whether TBLPROPERTIES in DDLs are ignored by custom
> inputformats in the context of a UDAF
