Re: Making HBase easier to understand

2013-07-14 Thread Azuryy Yu
impressive. thanks On Jul 15, 2013 9:00 AM, "kulkarni.swar...@gmail.com" < kulkarni.swar...@gmail.com> wrote: > Hello all, > > In order to help understand the intricacies of HBase, I started a small pet > project to depict some of the more complicated concepts graphically so as > to make them easi

Re: Making HBase easier to understand

2013-07-14 Thread Asaf Mesika
Very cute. On Monday, July 15, 2013, anil gupta wrote: > Hey Swarnim, > > Really nice work. Keep on going! > > ~Anil > > > > On Sun, Jul 14, 2013 at 5:59 PM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com > wrote: > > > Hello all, > > > > In order to help understand the intricacies of

Re: Scanner problem after bulk load hfile

2013-07-14 Thread Rohit Kelkar
Thanks Amit, I am also using 0.94.2 . I am also pre-splitting and I tried the table.clearRegionCache() but still doesn't work. - R On Sun, Jul 14, 2013 at 3:45 AM, Amit Sela wrote: > If new regions are created during the bulk load (are you pre-splitting ?), > maybe try myTable.clearRegionCache

Re: the scan will be executed parallel if not use coprocessor?

2013-07-14 Thread ramkrishna vasudevan
The HBase by default does not use parallel scanning mechanism. It is sequential. There are some JIRA that try to implement scanning in parallel on the regions. HBASE-1935 is one such idea. Projects like phoenix uses Coprocessors to scan the regions in parallel and the results are returned to the

Re: Making HBase easier to understand

2013-07-14 Thread anil gupta
Hey Swarnim, Really nice work. Keep on going! ~Anil On Sun, Jul 14, 2013 at 5:59 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Hello all, > > In order to help understand the intricacies of HBase, I started a small pet > project to depict some of the more complicated co

Re: the scan will be executed parallel if not use coprocessor?

2013-07-14 Thread ch huang
phoenix is using coprocessor internal On Sun, Jul 14, 2013 at 11:15 PM, Asaf Mesika wrote: > To my knowledge, scan is not parallel, hence the speed of queries of > Impala, Phoenix, and other similar projects. > > On Saturday, July 13, 2013, ch huang wrote: > > > hi ted ,for example i have a tabl

Making HBase easier to understand

2013-07-14 Thread kulkarni.swar...@gmail.com
Hello all, In order to help understand the intricacies of HBase, I started a small pet project to depict some of the more complicated concepts graphically so as to make them easier to grasp. My current effort can be found here[1]. I'll continue adding stuff to it as and when I get a chance. Hope

Re: Calculating size in HBase.

2013-07-14 Thread Asaf Mesika
If you get KeyValue object by the client, then you have its size for free (it's the size of its internal byte array) - so why is it time consuming? On Fri, Jul 5, 2013 at 2:23 AM, Bikash Agrawal wrote: > Hi , > > Need to calculate data size in HBase. I can do it by using KV length. But > it is t

Re: the scan will be executed parallel if not use coprocessor?

2013-07-14 Thread Asaf Mesika
To my knowledge, scan is not parallel, hence the speed of queries of Impala, Phoenix, and other similar projects. On Saturday, July 13, 2013, ch huang wrote: > hi ted ,for example i have a table with 10 regions, if i offer the > condition hit the data of 8 regions,is it different do it use oragin

Re: HBase issues since upgrade from 0.92.4 to 0.94.6

2013-07-14 Thread lars hofhansl
Checked now. It is 0.94.6.1 - Original Message - From: lars hofhansl To: "user@hbase.apache.org" Cc: Sent: Sunday, July 14, 2013 6:55 AM Subject: Re: HBase issues since upgrade from 0.92.4 to 0.94.6 Didn't check, but I sincerely hope that CDH 4.3.0 ships with HBase 0.94.6.1 (and no

Re: HBase issues since upgrade from 0.92.4 to 0.94.6

2013-07-14 Thread lars hofhansl
Didn't check, but I sincerely hope that CDH 4.3.0 ships with HBase 0.94.6.1 (and not 0.94.6). From: David Koch To: user@hbase.apache.org Sent: Friday, July 12, 2013 3:09 AM Subject: HBase issues since upgrade from 0.92.4 to 0.94.6 Hello, NOTE: I posted the sam

Re: Scanner problem after bulk load hfile

2013-07-14 Thread Amit Sela
If new regions are created during the bulk load (are you pre-splitting ?), maybe try myTable.clearRegionCache() after the bulk load (or even after the pre-splitting if you do pre-split). This should clear the region cache. I needed to use this because I am pre-splitting my tables for bulk load. BTW