Re: How to configure Hive to use CombineFileInputFormat in case of too many small files

2011-04-08 Thread Michael Jiang
the file sizes. I haven't tried it but i guess its > there in this page. > > -- > *From:* Michael Jiang > *To:* user@hive.apache.org > *Cc:* V.Senthil Kumar > *Sent:* Fri, April 8, 2011 11:56:21 AM > *Subject:* Re: How to configure Hive to us

Re: How to configure Hive to use CombineFileInputFormat in case of too many small files

2011-04-08 Thread Michael Jiang
it can > always be manually set to HiveInputFormat. > > > > > -- > *From:* Michael Jiang > *To:* user@hive.apache.org > *Sent:* Fri, April 8, 2011 11:34:58 AM > *Subject:* How to configure Hive to use CombineFileInputFormat in case of > too many small files >

Re: How to configure Hive to use CombineFileInputFormat in case of too many small files

2011-04-08 Thread V.Senthil Kumar
. From: Michael Jiang To: user@hive.apache.org Sent: Fri, April 8, 2011 11:34:58 AM Subject: How to configure Hive to use CombineFileInputFormat in case of too many small files Could not find the instructions regarding this to avoid performance issues when too many

How to configure Hive to use CombineFileInputFormat in case of too many small files

2011-04-08 Thread Michael Jiang
Could not find the instructions regarding this to avoid performance issues when too many mappers have to be created for every small file. Thanks!