[
https://issues.apache.org/jira/browse/HIVE-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Panagiotis Garefalakis resolved HIVE-25505.
-------------------------------------------
Resolution: Fixed
> Incorrect results with header. skip.header.line.count if first line is blank
> ----------------------------------------------------------------------------
>
> Key: HIVE-25505
> URL: https://issues.apache.org/jira/browse/HIVE-25505
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Reporter: Steve Carlin
> Assignee: Panagiotis Garefalakis
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> aAtable with header. skip.header.line.count=1 does not skip the first line if
> it is blank, except in a fetch task.
> To reproduce, create a csv table, ans set header. skip.header.line.count=1 in
> table properties.
> In the table location, create a single file, with a blank (empty) first line,
> and say 2 further lines.
> If you do a select * on it, you see 2 rows (correct)
> If you do select count(*) on it, you get 3 (incorrect)
> {code:java}
> CREATE EXTERNAL TABLE `testcase1`(id int, name string) ROW FORMAT SERDE
> 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
> LOCATION '${system:test.tmp.dir}/testcase1'
> TBLPROPERTIES ("skip.header.line.count"="1");
> SET hive.fetch.task.conversion = more;
> select * from testcase1;
> select count(*) from testcase1;
> set hive.fetch.task.conversion=none;
> select * from testcase1;
> select count(*) from testcase1;
> Test file:
> 1,2019-12-31
> 2,2019-12-31
> 3,2019-12-31
> Should both yield (with the above test file):
> #### A masked pattern was here ####
> 1 2019-12-31
> 2 2019-12-31
> 3 2019-12-31
> 3
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
