Re: Data locality in HBase

2012-06-26 Thread Ben Kim
cks of the HFile are stored across two different > >> datanodes (hadoop-145 and hadoop-143). > >> > >> Let say a map task runs on hadoop-145 and needs to access the block 7. > Then > >> the map task needs to remotely access the block 7 on hadoop-143 server.

Re: Data locality in HBase

2012-06-21 Thread Michael Segel
;> the map task needs to remotely access the block 7 on hadoop-143 server. >> Almost half of the data blocks are stored & accessed remotely. Referring >> from the above example, It's hard to say that the data locality is being >> applied to HBase. >> >>

Re: Data locality in HBase

2012-06-21 Thread Lars George
e: > >> Hi Ben, >> >> See inline... >> >> On Jun 15, 2012, at 6:56 AM, Ben Kim wrote: >> >>> Hi, >>> >>> I've been posting questions in the mailing-list quiet often lately, and >>> here goes another one about d

Re: Data locality in HBase

2012-06-20 Thread Ted Yu
the mailing-list quiet often lately, and > > here goes another one about data locality > > I read the excellent blog post about data locality that Lars George wrote > > at http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html > > > > I understand data locali

Re: Data locality in HBase

2012-06-20 Thread Ben Kim
Ben Kim wrote: > > > Hi, > > > > I've been posting questions in the mailing-list quiet often lately, and > > here goes another one about data locality > > I read the excellent blog post about data locality that Lars George wrote > > at http://www.lar

Re: Data locality in HBase

2012-06-15 Thread Lars George
orge wrote > at http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html > > I understand data locality in hbase as locating a region in a region-server > where most of its data blocks reside. The opposite is happening, i.e. the region server process triggers for all data it writes to

Data locality in HBase

2012-06-14 Thread Ben Kim
Hi, I've been posting questions in the mailing-list quiet often lately, and here goes another one about data locality I read the excellent blog post about data locality that Lars George wrote at http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html I understand data locali