Hi all If anyone can provide some information as to which part of the phoenix code we need to check to see how parallel execution is performed.
Thanks again Sanooj On 20 Oct 2016 11:31 a.m., "Sanooj Padmakumar" <p.san...@gmail.com> wrote: > Hi James, > > We are loading data from Phoenix tables into in-memory database. Based on > the query we are finding the number of phoenix input splits (similar to > what happens inside phoenix MR) and loads the data into in-memory database > in parallel. So we are looking for ways to further parallelize the scan of > a larger region. > > As you mentioned phoenix does this for all its queries. Can you please > provide pointers to the phoenix code where this happens ? > > Thanks for the prompt response. > > Thanks > Sanooj Padmakumar > > On Wed, Oct 19, 2016 at 11:22 PM, James Taylor <jamestay...@apache.org> > wrote: > >> Hi Sanooj, >> I'm not sure what you mean by "loading data in our HBase table into >> in-memory", but Phoenix queries tables in parallel, even within a region >> depending on how you've configured statistics and guideposts as described >> here: http://phoenix.apache.org/update_statistics.html >> >> Thanks, >> James >> >> >> On Wednesday, October 19, 2016, Sanooj Padmakumar <p.san...@gmail.com> >> wrote: >> >>> Hi All >>> >>> >>> We are are loading data in our HBase table into in-memory. For this we >>> provide a start row and end row and scan the hbase regions. Is there a way >>> we can scan a big region in parallel to fasten this whole process ? Any >>> help/pointers on this will be of great help. >>> >>> -- >>> Thanks, >>> Sanooj Padmakumar >>> >> > > > -- > Thanks, > Sanooj Padmakumar >
