> > 'skip.header.line.count'='1',
Trying removing that config option.
I've definitely seen footer markers disabling file splitting, possibly header
also does.
Cheers,
Gopal
ping..
On 1/24/2017 10:37 AM, Mahender Sarangam wrote:
> Here are the table properties
>
> TBLPROPERTIES (
> 'numFiles'='1',
> 'serialization.null.format'='',
> 'skip.header.line.count'='1',
> 'totalSize'='20971513935',
> 'transient_lastDdlTime'='1485091440');
>
>
> On 1/24/20
Here are the table properties
TBLPROPERTIES (
'numFiles'='1',
'serialization.null.format'='',
'skip.header.line.count'='1',
'totalSize'='20971513935',
'transient_lastDdlTime'='1485091440');
On 1/24/2017 10:27 AM, Mahender Sarangam wrote:
> When i see properties of external table,
Here is the screenshot
[cid:part1.CDBA25BE.CDE6CB4A@outlook.com]
On 1/24/2017 10:27 AM, Mahender Sarangam wrote:
When i see properties of external table, STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
On 1/23/2017 2:25 PM, Gopal Vijayaraghavan wrote:
We have 20 GB txt File,
When i see properties of external table, STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
On 1/23/2017 2:25 PM, Gopal Vijayaraghavan wrote:
>> We have 20 GB txt File, When we have created external table on top of 20
>> Gb file, we see Tez is creating only one mapper.
> For an u
> We have 20 GB txt File, When we have created external table on top of 20
> Gb file, we see Tez is creating only one mapper.
For an uncompressed file, that is very strange. Is this created as "STORED AS
TEXTFILE" or some other strange format?
Cheers,
Gopal
