Re: How to designTemporal table in Hbase

t;col2" for > "col1" in date range between "From_Date" and "To_Date"? > > > On 5/31/16, Mohammad Tariq wrote: > > Hi Subhash, > > > > What would be your query pattern like? > > > > > > > > [image: http://] &g

Re: How to designTemporal table in Hbase

Hi Subhash, What would be your query pattern like? [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Tue, May 31, 2016 at 11:48 PM, Subhash Pophale wrote: > Hi All, > > I am new to Hbase database. I am planning to create rather mimic table > in RDBMS w

Re: Type of filter to use

Hi Rajesh, To begin with I would suggest you to rethink about your key design. If you are getting a lot of data(which I assume you do) then this type of keys could lead you to region hotspotting . Coming back to your original question you could a

Re: Rowkey design

Hi Marko, Scan expects complete start and end row keys, IIRC. Order would anyway get disturbed as you are salting your keys. [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Mon, Nov 30, 2015 at 1:19 PM, Marko Dinic wrote: > Hi Ted, > > Thank you for th

Re: Rowkey design

Hi Marko, You could add the place(and unit as well) to your key if that's not making it very long. And then use RowFilter with SubstringComparator to get the desired rows. [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Mon, Nov 30, 2015 at 3:49 AM, Mark

Re: [ANNOUNCE] HBase 0.94.21 is available for download

+1. Thank you HBase team for your continuous efforts and support. [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Thu, Jul 3, 2014 at 10:05 PM, lars hofhansl wrote: > The HBase Team is pleased to announce the immediate release of HBase > 0.94.21.

Re: Invitation to connect on LinkedIn

You need to use JM's address instead of hbase mailing list. *Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com <http://cloudfront.blogspot.com>* On Thu, Jun 19, 2014 at 1:22 PM, rakesh rakshit wrote: > Friend, I guess you are mistaken. I am not Jean-Marc whom you are ex

Re: [ANNOUNCE] HBase 0.94.19 is available for download

Great job guys. +1 :) Warm Regards, Tariq cloudfront.blogspot.com On Tue, Apr 29, 2014 at 3:56 AM, lars hofhansl wrote: > The HBase Team is pleased to announce the immediate release of HBase > 0.94.19. > Download it from your favorite Apache mirror [1]. This release has also > been pushed to A

Re: Scan vs map-reduce

Well, it depends. Could you please provide some more details?It will help us in giving a proper answer. Warm Regards, Tariq cloudfront.blogspot.com On Mon, Apr 14, 2014 at 11:38 AM, Li Li wrote: > I have a full table scan which cost about 10 minutes. it seems a > bottleneck for our application

Re: HBase read operation document/help...

Just to add on to Ted's comment, ROOT has been dropped. META locations are now directly stored in ZK. See this ticketfor more. Warm Regards, Tariq cloudfront.blogspot.com On Wed, Feb 26, 2014 at 12:54 AM, Ted Yu wrote: > You may have read http:

Re: Need Help on hbase error: The znode for the -ROOT- region doesn't exist!

Hello there, Looks like some problem with RS holding the -ROOT-. Please make sure it's up and running. Showing us the logs would be helpful. Warm Regards, Tariq cloudfront.blogspot.com On Sat, Aug 31, 2013 at 5:14 AM, S. Zhou wrote: > I wrote a java program which connects to hbase (I am using

Re: how to export data from hbase to mysql?

My 2 cents : 1- Map your table to a Hive table and do the export using Sqoop. 2- Export the table to a file first, and then export it using Sqoop. Warm Regards, Tariq cloudfront.blogspot.com On Wed, Aug 28, 2013 at 7:12 PM, Shahab Yunus wrote:

Re: Hitting HBASE-7693 with hbase-0.94.9

t; split location causing the JobTracker to incorrectly match map jobs to > data-local map slots. > > So it seems that the problem you encountered was different. > > Cheers > > On Thu, Aug 1, 2013 at 5:18 PM, Mohammad Tariq wrote: > > > Hello list, > > > >

Re: Pagination with HBase

Hello Jonathan, You might have to pay special attention to the OFFSET part though. OFFSET of nth row will not remain n forever. As you insert new rows ordering will get changed as rows are not arranged in the order of insertion in HBase. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Aug

Hitting HBASE-7693 with hbase-0.94.9

Hello list, Although the issue has been fixed, it looks like i'm hitting it. *Environment :* hadoop-1.1.2 hbase-0.94.9 OS X 10.8.4 (12E55) I'd really appreciate if somebody could throw some light. Here is the trace I see when I run my MR job ag

Re: puzzle about hbase row update

Yes, it is for the cell. As Ram sir has specified, there are no updates in HBase per se. You either put a new version or delete the old data and put the new data in the same cell. Along with the link specified by Ram sir, I would suggest you to go through this as well : http://hbase.apache.org/book

Re: how can i improve sequence write speed?

Hello there, I'm sorry I didn't quite get it. What do you mean by "sequence write speed"? If you are looking for ways to improve HBase writes, you might find this useful : http://hbase.apache.org/book/perf.writing.html Warm Regards, Tariq cloudfront.blogspot.com On Mon, Jul 1, 2013 at 9:

Re: Installing HBase, what jar files from Hadoop need to match?

Hello there, I don't think it is necessary anymore. It was the case for older versions of hadoop and hbase. Both these projects are much more mature now and work perfectly well without any jar transfer from one to another. But if you still face nay problem try copying hadoop-core and commo

Re: how many severs in a hbase cluster

pient. If you have received this message in error, or are not the named > recipient(s), please immediately notify the sender by return email, and > delete all copies of this message. > > > On Sat, Jun 22, 2013 at 10:05 AM, Mohammad Tariq > wrote: > > > Yeah, I forg

Re: how many severs in a hbase cluster

> failure will be an issue. You need to have an odd number of ZK > > servers... > > > > Also, if you don't run MR jobs, you don't need the TT and JT... Else, > > everything below is correct. But there is many other options, all > > depend on your needs

Re: how many severs in a hbase cluster

ta size, I am not sure, there will be any problem in hbase when it runs > compaction and split in regions. > > Oh, you already have heavyweight's input :). >> >> Thanks JM. >> >> Warm Regards, >> Tariq >> cloudfront.blogspot.com >> >> &g

Re: how many severs in a hbase cluster

Oh, you already have heavyweight's input :). Thanks JM. Warm Regards, Tariq cloudfront.blogspot.com On Sat, Jun 22, 2013 at 8:05 PM, Mohammad Tariq wrote: > Hello there, > > IMHO, 5-8 servers are sufficient enough to start with. But it's > all relative to the

Re: how many severs in a hbase cluster

Hello there, IMHO, 5-8 servers are sufficient enough to start with. But it's all relative to the data you have and the intensity of your reads/writes. You should have different strategies though, based on whether it's 'read' or 'write'. You actually can't define 'big' in absolute terms. My

Re: Create table with coprocessors from hbase shell

ty. If > we dont have it then we should try to add it. Opinions? > > Thanks, > Anil Gupta > > > > > On Wed, Jun 12, 2013 at 7:33 PM, Mohammad Tariq > wrote: > > > Hello Anil and Michael, > > > > As of hbase-0.94.4 it is not possible to create

Re: Create table with coprocessors from hbase shell

Hello Anil and Michael, As of hbase-0.94.4 it is not possible to create a table with co-proc using create command through shell. Though alter has the option to add a co-proc. hbase> alter 't1', METHOD => 'table_att', 'coprocessor'=>'hdfs:///foo.jar|com.foo.FooRegionObserver|1001|arg1=1,arg2

Re: Best practices for loading data into hbase

I am sorry to barge in when heavyweights are already involved here. But, just out of curiosity, why don't you use Sqoop to import the data directly from your existing systems into HBase instead of first taking the dump and then doing the import. Sqoop allows us to do incr

Re: Not able to connect to Hbase remotly

Hello Vimal, I am sorry for being unresponsive. I have been travelling like crazy since last few days. Proper *name resolution* is a must for smooth HBase interaction. That is why it better to have the IP address along with hostname in your /etc/hosts file. Warm Regards, Tariq cloudfront.blo

Re: Unknown process in listing of "jps" command

Hello VImal, HQuorumPeer=ZK Main=Eclipse or something(i feel) Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:01 PM, Vimal Jain wrote: > Hi, > I have configured Hadoop and Hbase successfully ( i think so ) . I tried > creating some tables and it works fine.

Re: Not able to connect to Hbase remotly

Hello Vimal, Add the IP and hostname of your HBase machine into the hosts file of your client machine and see if it helps. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 4:38 PM, Vimal Jain wrote: > Hi Jyothi, > I am running my hbase in pseudo distributed mode so

Re: HBase is not running.

, logging to > > /media/alternative-storage-do-not-touch/hbase-0.94.7/logs/hbase-ysg-master-ysg.connect.out > > No real problems or error or warnings... but it does not have the same > output that you have in your blog... perhaps that's an issue? > > > On Tue, May 21,

Re: PleaseHoldException when Master is clearly running as JPS

ed, May 22, 2013 at 2:48 AM, Jay Vyas wrote: > https://gist.github.com/anonymous/5623327 <-- all logs for starting up > hbase and master > > > On Tue, May 21, 2013 at 5:13 PM, Mohammad Tariq > wrote: > > > No prob. I was referring to this : > > > > 127

Re: HBase is not running.

; > > On Tue, May 21, 2013 at 4:21 PM, Mohammad Tariq > wrote: > > > sure.. > > > > Warm Regards, > > Tariq > > cloudfront.blogspot.com > > > > > > On Wed, May 22, 2013 at 1:48 AM, Yves S. Garret > > wrote: > > > > >

Re: PleaseHoldException when Master is clearly running as JPS

of 7 failed; retrying after sleep of 1002 > > > > On Tue, May 21, 2013 at 4:57 PM, Mohammad Tariq > wrote: > > > OK..You already have your hostname in there. But it is appearing twice. > > Comment out "127.0.0.1 hbase-master". This might be a reason. I did

Re: PleaseHoldException when Master is clearly running as JPS

at 2:21 AM, Jay Vyas wrote: > Hi kevin : So you don't have any region servers defined in your /etc/hosts > ? > > > On Tue, May 21, 2013 at 4:46 PM, Mohammad Tariq > wrote: > > > Sorry, my bad. By that I meant "127.0.0.1hostname"..To me it seems > l

Re: PleaseHoldException when Master is clearly running as JPS

the top seems redundant... > right? I did so but still no luck :(. > > 1) OS? This is fedora 16. > > 2) any thoughts on why the "PleaseHoldException" is being triggered ? > > > > > On Tue, May 21, 2013 at 4:32 PM, Mohammad Tariq > wrote: > > >

Re: PleaseHoldException when Master is clearly running as JPS

localdomain4 > #::1 localhost localhost.localdomain localhost6 > localhost6.localdomain6 > 127.0.0.1 hbase-master > 192.168.122.200 hbase-master > 192.168.122.201 hbase-regionserver1 > 192.168.122.202 hbase-regionserver2 > 192.168.122.203 hbase-regionserver3 > > >

Re: PleaseHoldException when Master is clearly running as JPS

Hello Jay, Please change the line containing "127.0.1.1" in your /etc/hosts to "127.0.0.1" and see if it works. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 1:47 AM, Jay Vyas wrote: > Hi folks: > > Hope someone can shed some light on this - > > I cannot run "hbase

Re: HBase is not running.

sure.. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 1:48 AM, Yves S. Garret wrote: > Hello, > > No, still having issues. I'll give you some more details in a second. > > > On Tue, May 21, 2013 at 4:07 PM, Mohammad Tariq > wrote: > >

Re: HBase is not running.

>> http://bin.cakephp.org/view/629885150 > >>> > >>> This is what happens when I run "hadoop version": > >>> $ hadoop version > >>> Hadoop 1.0.4 > >>> Subversion > >>> https://svn.apache.org/repos/asf/hadoop/common/branch

Re: Does Hbase read .bashrc file??

13 at 1:14 AM, Amandeep Khurana > > wrote: > > > > > The start script is a shell script and it forks a new shell when the > > > script is executed. That'll source the bashrc file. > > > > > > On May 11, 2013, at 12:39 PM, Mohammad Tariq > wr

Re: Does Hbase read .bashrc file??

for the NN neglecting the properties set in hbase-site.xml. And once I commented out HADOOP_HOME in bashrc, everything started behaving just perfectly. Thank you. Warm Regards, Tariq cloudfront.blogspot.com On Sun, May 12, 2013 at 2:02 AM, Stack wrote: > On Sat, May 11, 2013 at 1:02 PM, M

Re: Does Hbase read .bashrc file??

at 1:14 AM, Amandeep Khurana wrote: > The start script is a shell script and it forks a new shell when the > script is executed. That'll source the bashrc file. > > On May 11, 2013, at 12:39 PM, Mohammad Tariq wrote: > > > Hello list, > > > > Does

Does Hbase read .bashrc file??

Hello list, Does Hbase read the environment variables set in *~/.bashrc*file everytime I issue *bin/start-hbase.sh*??What could be the possible reasons for that?Specially if I have a standalone setup on my local FS. Thank you so much for your time. Warm Regards, Tariq cloudfront.blogs

Re: HBase Support

gt; > > > >hbase.master > >127.0.0.1:6 > >The host and port that the HBase master runs > > at. > > > > > > > >zookeeper.session.timeout > >18 > > > > > > > > hbase.zookeeper.property

Re: HBase Support

aju wrote: > Thank you Tariq, > > Have checked Hbase Master Logs(Which i have Provided to you). > Did you find any clue to identify what is the Problem. > > Thanks & Regards > Raju. > > > On Fri, May 10, 2013 at 7:01 PM, Mohammad Tariq > wrote: > > &g

Re: HBase Support

/127.0.0.1:2181, sessionid = > 0x13e8d9972b4, negotiated timeout = 4 > > > > and kindly Tell me Where I can Found Zookeeper logs. > > Thanks & Regards. > Raju. > > > On Fri, May 10, 2013 at 4:14 PM, Mohammad Tariq > wrote: > > > Hello Raju, > >

Re: HBase Support

Hello Raju, This means that there is some problem with the connection between HMaster and ZK. Make sure all your Hbase daemons are running fine. Which version are you using?Also showing complete HMaster and ZK logs would be helpful. Warm Regards, Tariq cloudfront.blogspot.com On Fri, May

Re: Hbase Guidance.

I don't get the logic behind asking the same question multiple times with different names. Warm Regards, Tariq cloudfront.blogspot.com On Thu, May 9, 2013 at 6:30 PM, naga raju wrote: > Hi all, > > I am New to Hbase(Hadoop), and i am working on hbase with standalone > mode.My java applicatio

Re: HBase Support

Hello Raju, Please find my answers embedded below : 1.what are the causes of Client session timed out.(and client session scenario) >> There could be several reasons. You network is totally down, you have exceeded the maximum no. of clients allowed at a time, you are facing network congest

Re: Export / Import and table splits

Hello JM, You might find these post by Lars useful : http://www.larsgeorge.com/2009/01/changing-hbase-tables-in-code.html http://www.larsgeorge.com/2009/05/hbase-schema-manager.html I'm not sure whether this is exactly what you need, but I feel you could use something like this to achieve your

Re: HBase is not running.

e two paths be one in the same? I'd like to just > dump everything into one directory if that's possible. > > > On Wed, May 1, 2013 at 10:15 PM, Mohammad Tariq > wrote: > > > hbase.rootdir the directory HBase writes data to. I you are planning to > > have a

Re: HBase is not running.

ank you for your help. > >> > >> > >> On Wed, May 1, 2013 at 4:39 PM, shashwat shriparv < > >> dwivedishash...@gmail.com> wrote: > >> > >>> Commment out everything in /etc/host file add 127.0.0.1 localhost and > >>> then try. &

Re: HBase is not running.

Hello Yves, I think by that JM means that you should first make sure that all you Hbase daemons are running fine. The webUI is a pretty convenient tool which allows you to monitor everything in a simpler way. If you are able to see the webUI properly, it means everything is in place and you

Re: HBase and Datawarehouse

Sorry for the late response. I totally agree with Anil. If you have warehousing needs, I would also suggest Hive. You could easily map your Hbase tables to your Hive tables and crunch crunch the data. It would save you from writing lengthy and tedious MR jobs. And as Anil has said Pig is another go

Re: HBase and Datawarehouse

*Database(SQL, NoSQL, Graph, Document etc etc)* 1. Used for Online Transactional Processing (OLTP) but can be used for other purposes such as Data Warehousing. This records the data from the user for history. 2. The tables and joins are complex since they are normalized (for RDMS).

Re: HBase is not running.

zookeeper qorum yet. > >> > >> Yes, can you share the entire hbase-ysg-master-ysg.connect.log file? > >> Not just the first lines. Or what you sent is already all? > >> > >> So what have you done yet? Downloaded 0.94, extracted it, set

Re: HBase is not running.

Hello Yves, The log seems to be incomplete. Could you please the complete logs?Have you set the "hbase.zookeeper.quorum "property properly?Is your Hadoop running fine? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Fri, Apr 26, 2013 at 2:00 AM, Yves S. Garret wrot

Re: Hbase question

Hello Rami, Hbase is not built on top of Hadoop. Hdfs is not a must, but provided you a better storage option(courtesy Hdfs's distributed style storage, scalability etc). You could use it with other FS as well, even with your local FS. And you could definitely use MR jobs to efficiently han

Re: regionserver stucking

You could make use of jVisualVM as well. Comes in quite handy. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Wed, Apr 17, 2013 at 2:05 PM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Just do jstack with pid. > > Regards > Ram > > > On Wed, Apr 17,

Re: HBase random read performance

Hello Ankit, How exactly are you trying to fetch the data?Some tips to enhance the reads could be : Use of scan caching. Good rowkey design. Use of block cache. Properly closing HTable and ResultScanner. Use of bloom filters. Use of Filters to limit the search. Proper use of compression. Use JB

Re: Hbase restart issues

Hello Rishabh, Is your NN able to come out of the safemode by itself? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Apr 1, 2013 at 12:19 PM, Rishabh Agrawal < rishabh.agra...@impetus.co.in> wrote: > Hello > > Whenever, I stop Hbase and Hadoop gracefully

Re: connecting Hbase using java

have you added the required jars?also, it's better to add zookeeper related props in the config file. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Sat, Mar 30, 2013 at 8:19 PM, Ted Yu wrote: > What packages were not accessible ? > > Most people use Eclipse for develop

Re: Unable to start regionserver in distributed mode

also make sure that you have proper name resolution as it is vital for a healthy Hbase operation. Sometimes even after configuring everything perfectly Hbase refuses to work as intended just because of improper name resolution. Add the actual host name along with their IPs in the /etc/hosts file.

Re: HBase Writes With Large Number of Columns

Hello Pankaj, What is the configuration which you are using?Also, the H/W specs? Maybe tuning some of these would make things faster. Although amount of data being inserted is small, the amount of metadata being generated would be higher. Now, you have to generate the key+qualifier+TS triplet

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

an I connect to it from a remote client in > > standalone mode? > > Thanks, > Pal > > On Wed, Mar 20, 2013 at 2:09 AM, Mohammad Tariq wrote: > >> >> Yes. Either add "192.168.1.102 localhost" here or just change your config >> propert

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

; shall I set the config files so everywhere it references to debian-vm? > I will try it tomorrow, because it's getting late here. > > Pal > > On Wed, Mar 20, 2013 at 1:56 AM, Mohammad Tariq > wrote: > > I said this as I saw 127.0.0.1 in your configuration file.

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

8.0.101 (I'm not sure, but you will see it in the zookeeper > log) > > I know it works, because http://debian-vm:60010 comes up from Host os > > On Wed, Mar 20, 2013 at 1:30 AM, Mohammad Tariq > wrote: > > Hello Pal, > > > > Add 127.0.0.1 along with the

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

Hello Pal, Add 127.0.0.1 along with the hostname of your vm, where you are running your Hbase, into its /etc/hosts file. You are running Hbase in pseudo distributed mode, but the logs show that the connection request is going to some other IP. Warm Regards, Tariq https://mtariq.jux.com/ cloud

Re: Hbase in Pseudo distributed mode getting problems

Hello Sam, Don't remove that line from /etc/hosts file, instead change it to "127.0.0.1 YOUR_HOST_NAME". And restart all the processes. BTW, which link have you followed? It seems you have forgotten to paste it. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Th

Re: does hbase master need to be a hadoop datanode as well?

are running HBase. > > Reason is, if you are running in long GCs, ZK might miss the heartbeats and > thinks servers are down. So safer to run same separately if you can. > > JM > > 2013/2/22 Mohammad Tariq > > > Hello Kaven, > > > > It's not all n

Re: does hbase master need to be a hadoop datanode as well?

Hello Kaven, It's not all necessary to run HM on server running DN. Actually it's not advisable to do so, as HM has high memory requirements and running other daemons on the same machine may lead you to problems. The basic cluster setup, which people normally use looks somewhat like this :

Re: Rowkey design question

estamp > > > > then the rowkeys are probably evenly distributed but how would I > > perform then a scan restricted to a special time range? > > > > > > 2013/2/19 Mohammad Tariq >: > > > No. before the timestamp. All the row keys which are ide

Re: HBase unknown table problem

Hello Anand, Are your regionservers running fine? Have a look over the logs and see if you find something unusual there. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Wed, Feb 20, 2013 at 6:41 PM, anand nalya wrote: > Hi, > > I've created a table in HBase. After

Re: Rowkey design question

imestamp > > then the rowkeys are probably evenly distributed but how would I > perform then a scan restricted to a special time range? > > > 2013/2/19 Mohammad Tariq : > > No. before the timestamp. All the row keys which are identical go to the > > same region. This is the

Re: Rowkey design question

m> wrote: > Hey Tariq, > > thanks for your quick answer. I'm not sure if I got the idea in the > seond part of your answer. You mean if I use a timestamp as a rowkey I > should append a hash like this: > > 135727920+MD5HASH > > and then the data would be distrib

Re: Rowkey design question

Hello Paul, Try this and see if it works : scan.setStartRow(Bytes.toBytes(startDate.getTime() + "")); scan.setStopRow(Bytes.toBytes(endDate.getTime() + 1 + "")); Also try not to use TS as the rowkey, as it may lead to RS hotspotting. Just add a hash to your rowkeys so that data

Re: Row Key Design in time based aplication

Hello Mehmet, If ProjectIds are sequential, then it is definitely not a feasible approach. Division is just to make sure that all the regions are evenly loaded. You can create pre-splitted tables to avoid the region hotspotting. Alternatively hash your rowkeys so that all the regionservers receiv

Re: MapReduce to load data in HBase

ion Json files aggregated. One > Json per line. I need to process this file and store all values into HBase. > > Thanking You, > > > > > On Thu, Feb 7, 2013 at 12:59 PM, Mohammad Tariq > wrote: > > > Good point sir. If Pig fits into Panshul's requirements then i

Re: searching functionality in Hbase

Hello Dastagiri, Search is actually Get or Scan+some condition. You have Hbase Filters and Co-proc. You can use indexing for faster results(search). Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, Feb 7, 2013 at 5:43 PM, Dastagiri S Shaik < dastagiri.sh...@mant

Re: MapReduce to load data in HBase

Good point sir. If Pig fits into Panshul's requirements then it's a much better option. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, Feb 7, 2013 at 5:25 PM, Damien Hardy wrote: > Hello, > Why not using a PIG script for that ? > make the json file available on HDF

Re: cluster monitoring

Hello Rita, Monitoring at what level?Do you want to print the roewkeys while you are processing or is it something else? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Tue, Feb 5, 2013 at 6:57 PM, Rita wrote: > hi, > > is it possible to see what keys are being h

Re: Start key and End key in HBase

Just to add to whatever Anoop sir has said, the row corresponding to the endkey is not included in the result set by default. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 12:38 PM, Anoop Sam John wrote: > When you do a scan with out specifying any

Re: Start key and End key in HBase

It signifies start and end of the table regions, it is used in doing range queries. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 10:11 AM, wrote: > Hi all, > Can anyone let me know what is the use of Start key and End key in > HBase. > > > Rega

Re: Hbase Read/Write throughput measure

; > >>>> > > > >>>>The directory shared by region servers. > > > >>>> > > > >>>> > > > >>>> > > > >>>>hbase.master > > > >>>>192.

Re: Hbase Read/Write throughput measure

0.1.4/hbase-binding/conf directory. HTH Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 12:17 AM, Mohammad Tariq wrote: > Hello Dalia, > > Me and Anil are talking about this : > > 1 - git clone http://github.com/brianfrankcoop

Re: Hbase Read/Write throughput measure

t;>>> Date: Sun, 3 Feb 2013 13:54:28 +0530 > >>>>> Subject: Re: Hbase Read/Write throughput measure > >>>>> To: user@hbase.apache.org > >>>>> > >>>>> Hello Dalia, > >>>>> > >>>&

Re: Hbase Read/Write throughput measure

> understand the output ;) > > > > > > > > > > This is how I just tried it from my HBase directory: > > > > > bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation randomRead > 10 > > > > > > > > > > And t

Re: Hbase Read/Write throughput measure

/Hbase/PerformanceEvaluation > > > > > > > > But how to use the commands there is no clue, note that I am using > cloudera > > > > manager. > > > > > > > > The other yahoo link I couldn't understand how to use it. > > > &

Re: Parallel scan in HBase

Do you need to scan each n every row within that range?Or you need specific rows based on some filter? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Fri, Feb 1, 2013 at 9:16 PM, lars hofhansl wrote: > The scan contract in HBase is that all rows are returned in order, s

Re: Parallel scan in HBase

Hello Farrokh, Scans work sequentially with one region after the other. Scans from client side do not go to regionservers in parallel. And, for the second question, the code will run at the client side. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Fri, Feb 1, 2013

Re: Hbase Read/Write throughput measure

Hello Dalia, I think the easiest way to measure the read/write throughput is to use "PerformanceEvaluation" tool that comes with the Hbase distribution. It spawns a map-reduce job to do the reads/writes in parallel. Apart from this there are several other ways to benchmark your Hbase clu

Re: Pagination with HBase - getting previous page of data

I'm kinda hesitant to put my leg in between the pros ;)But, does it sound sane to use PageFilter for both rows and columns and having some additional logic to handle the 'nth' page logic?It'll help us in both kind of paging. On Wednesday, January 30, 2013, Jean-Marc Spaggiari wrote: > Hi Anil, >

Re: Indexing Hbase Data

see how you can get faster results than indexing the > content as the row key in another table. Access is direct after that. > > What do you mean with "faster resuls"? To build the index? Or to read > through it? > > JM > > 2013/1/28, Mohammad Tariq : > > Thank

Re: New htable slow

It does. These excerpts from Hbase Definitive Guide might help you in a better fashion : "HTablePool: Instead of creating an HTable instance for every request from your client application, it makes much more sense to create one initially and subsequently reuse them. The primary reason for doing so

Re: Indexing Hbase Data

e first and then get the main table row key. > First this should help, later can make this more better by using > coprocessors. > > Regards > Ram > > On Mon, Jan 28, 2013 at 5:25 PM, Mohammad Tariq > wrote: > > > Hello Viral, > > > > Thank you so

Re: New htable slow

Use "HTbalePool" instead and see if it gives you better performance. Creating an HTable instance is a fairly expensive operation that takes a few seconds to complete. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Jan 28, 2013 at 5:35 PM, Lsshiu wrote: > > > Hi Tar

Re: Indexing Hbase Data

. > > -Viral > > On Mon, Jan 28, 2013 at 3:45 AM, Mohammad Tariq > wrote: > > > Hello list, > > > > I would like to have some suggestions on Hbase data indexing. > What > > would you prefer? I never faced such requirement till now. This i

Indexing Hbase Data

Hello list, I would like to have some suggestions on Hbase data indexing. What would you prefer? I never faced such requirement till now. This is the first time when there is a need of indexing, so thought of getting some expert comments and suggestions. Thank you so much for your precio

Re: New htable slow

Hi there, Do you have too many Htable instances opened simultaneously?It's not advisable to do so. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Jan 28, 2013 at 5:00 PM, Lsshiu wrote: > Hi > In my 0.90.6 hbase environment , each time when I try "new htable

Re: paging results filter

.apache.org > > Subject: Re: paging results filter > > > > I don't see a way of specifying which page of resluts I want. For > example, > > if I want page 3 with page size of 20 (only results 41-60), I don't see > how > > PageFilter can be config

  1   2   3   4   >