5 17:04:08 -0800
To: mailto:user@hive.apache.org>>
Subject: Re: Hive Insert overwrite creating a single file with large block size
You can control block size by setting dfs.block.size. However, I think you
might be asking how to control the size of and number of files generated on
insert. Is that co
You can control block size by setting dfs.block.size. However, I think you
might be asking how to control the size of and number of files generated on
insert. Is that correct?
On Fri, Jan 9, 2015 at 4:41 PM, Buntu Dev wrote:
> I got a bunch of small Avro files (<5MB) and have a table against tho
I got a bunch of small Avro files (<5MB) and have a table against those
files. I created a new table and did an 'INSERT OVERWRITE' selecting from
the existing table but did not find any option to provide the file block
size. It currently creates a single file per partition.
How do I specify the ou
