You can control block size by setting dfs.block.size. However, I think you might be asking how to control the size of and number of files generated on insert. Is that correct?
On Fri, Jan 9, 2015 at 4:41 PM, Buntu Dev <buntu...@gmail.com> wrote: > I got a bunch of small Avro files (<5MB) and have a table against those > files. I created a new table and did an 'INSERT OVERWRITE' selecting from > the existing table but did not find any option to provide the file block > size. It currently creates a single file per partition. > > How do I specify the output block size during the 'INSERT OVERWRITE'? > > Thanks! > -- Slava Markeyev | Engineering | Upsight <http://www.linkedin.com/in/slavamarkeyev> <http://www.linkedin.com/in/slavamarkeyev>
