hive.compactor.delta.num.threshold<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.compactor.delta.num.threshold> controls when compaction is triggered. If you don't have enough delta files it won't run.
Assuming you have compactions running on other tables/partitions, things must be configured properly. If you use Alter Table to launch compaction, it should just do it, w/o paying attention to thresholds. From: Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>> Reply-To: "u...@hive.apache.org<mailto:u...@hive.apache.org>" <u...@hive.apache.org<mailto:u...@hive.apache.org>> Date: Wednesday, November 18, 2015 at 10:48 AM To: "u...@hive.apache.org<mailto:u...@hive.apache.org>" <u...@hive.apache.org<mailto:u...@hive.apache.org>> Cc: "dev@hive.apache.org<mailto:dev@hive.apache.org>" <dev@hive.apache.org<mailto:dev@hive.apache.org>> Subject: Re: hive transaction strange behaviour can you send ls -l on the partition where you expect a base and don't see it? From: Sanjeev Verma <sanjeev.verm...@gmail.com<mailto:sanjeev.verm...@gmail.com>> Reply-To: "u...@hive.apache.org<mailto:u...@hive.apache.org>" <u...@hive.apache.org<mailto:u...@hive.apache.org>> Date: Tuesday, November 17, 2015 at 10:27 PM To: "u...@hive.apache.org<mailto:u...@hive.apache.org>" <u...@hive.apache.org<mailto:u...@hive.apache.org>> Cc: "dev@hive.apache.org<mailto:dev@hive.apache.org>" <dev@hive.apache.org<mailto:dev@hive.apache.org>> Subject: Re: hive transaction strange behaviour Any help will be much appreciated.Thanks On Tue, Nov 17, 2015 at 2:39 PM, Sanjeev Verma <sanjeev.verm...@gmail.com<mailto:sanjeev.verm...@gmail.com>> wrote: Thank Elliot, Eugene I am able to see the Base file created in one of the partition, seems the Compactor kicked in and created it but it has not created base files in rest of the partition where delta files still exists.why compactor has not picked the other partition, when and how these partition will be picked up for compaction. Thanks On Sat, Nov 14, 2015 at 11:01 PM, Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>> wrote: When Compaction process runs, it will create base directory. https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration at a minimum you need hive.compactor.initiator.on<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.compactor.initiator.on>=true and hive.compactor.worker.threads<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.compactor.worker.threads>>0 Also, see https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AlterTable/PartitionCompact on how to trigger compaction manually. Eugene From: Sanjeev Verma <sanjeev.verm...@gmail.com<mailto:sanjeev.verm...@gmail.com>> Reply-To: "u...@hive.apache.org<mailto:u...@hive.apache.org>" <u...@hive.apache.org<mailto:u...@hive.apache.org>> Date: Thursday, November 12, 2015 at 11:41 PM To: "u...@hive.apache.org<mailto:u...@hive.apache.org>" <u...@hive.apache.org<mailto:u...@hive.apache.org>>, "dev@hive.apache.org<mailto:dev@hive.apache.org>" <dev@hive.apache.org<mailto:dev@hive.apache.org>> Subject: hive transaction strange behaviour I have enable the hive transaction and able to see the delta files created for some of the partition but i dont not see any base file created yet.it<http://yet.it> seems strange to me seeing so many delta files without any base file. Could somebody let me know when Base file created. Thanks
