Re: How to enable compaction for table with external data?

2015-09-15 Thread Sachin Pasalkar
compactor on your metastore thrift server? To do this you need to set a couple of values in the metastore's hive-site.xml: hive.compactor.initiator.on=true hive.compactor.worker.threads=1 # or more Alan. [cid:part1.07070900.07000506@gmail.com] Sachin Pasalkar<mailto:sachin_pasal...@sy

How to enable compaction for table with external data?

2015-09-14 Thread Sachin Pasalkar
Hi, We are writing direct orc file from storm topology instead of using hive streaming (Due to performance issue with our data). However, we want to compact the data. So we have added the "NO_AUTO_COMPACTION"=“false” option in table which we created to read data(1.6 GB scattered in multiple sm