Re: hive.merge properties with RCFile

2012-06-18 Thread Edward Capriolo
This will not work. set hive.merge.size.per.task=28*1024*1024; It has to be a number. On Mon, Jun 18, 2012 at 2:46 PM, Benyi Wang wrote: > I try to use Hive merge options to merge the smallfiles into a large files > using the following query. It is working well except that I cannot control > th

hive.merge properties with RCFile

2012-06-18 Thread Benyi Wang
I try to use Hive merge options to merge the smallfiles into a large files using the following query. It is working well except that I cannot control the output file size. I cannot explain why the output files are always 256MB using the following hive.merge.size.per.task and hive.merge.smallfiles.a