Re: Bulk loading and index

2016-07-03 Thread Simon Wang
Thanks, James. I created JIRA created at PHOENIX-3032 . I am currently looking into the code and see if I can make this change. How would you suggest the logic should be? Having spent a few hours reading the code, I am considering a workflow

Re: Bulk loading and index

2016-06-27 Thread James Taylor
Tongzhou, Please file a JIRA for supporting ALTER INDEX REBUILD ASYNC. This would be a good addition and not very difficult to implement. Contributions are, of course, always welcome. Regards, James On Sun, Jun 26, 2016 at 2:45 AM, Ankit Singhal wrote: > HI Tongzhou, > > May be you can tryi

Re: Bulk loading and index

2016-06-25 Thread Ankit Singhal
HI Tongzhou, May be you can trying dropping the current index and after your upload is completed, you can create a async index. Then you can use IndexTool to rebuild your index from start. source:- https://phoenix.apache.org/secondary_indexing.html CREATE INDEX async_index ON my_schema.my_table

Re: Bulk loading and index

2016-06-25 Thread Tongzhou Wang (Simon)
Hi Josh, First, thanks for the response. As far as I can tell, a disabled index cannot be directly changed to USABLE. It must be rebuilt first. I am aware that I can do ALTER INDEX REBUILD. But, if I understand correctly, this is single thread and slow. I'm wondering if I can use the Ind

Re: Bulk loading and index

2016-06-25 Thread Josh Elser
Hi Tongzhou, Maybe you can try `ALTER INDEX index ON table DISABLE`. And then the same command with USABLE after you update the index. Are you attempting to do this incrementally? Like, a bulk load of data then a bulk load of index data, repeat? Regarding the TTL, I assume so, but I'm not ce

Bulk loading and index

2016-06-23 Thread Tongzhou Wang
Hi all, I am writing to ask if there is a way to disable an index, then update it through the MapReduce job (IndexTool). I want to bulk load a huge amount of data, but index maintaining makes it very slow. It would be great if I can disable an index, load data, then use a MapReduce job to update i