Re: Uneven write request to regions

2013-11-15 Thread Ted Yu
bq. all regions of that customer Since the rowkey starts with , any single customer would only span few regions (normally 1 region), right ? On Fri, Nov 15, 2013 at 9:56 PM, Asaf Mesika wrote: > But when you read, you have to approach all regions of that customer, > instead of pinpointing just

Re: Uneven write request to regions

2013-11-15 Thread Asaf Mesika
Hi tom , Isn't the Bucket we use the same thing? So if I understand correctly you are not using automatic splitting, but do this throughout a manual process or a process running along HBase? Regarding recommendation of merge of empty regions - how did merge regions? I thought this capability exists

Re: Uneven write request to regions

2013-11-15 Thread Asaf Mesika
But when you read, you have to approach all regions of that customer, instead of pinpointing just one which contains that hour you want for example. On Friday, November 15, 2013, Ted Yu wrote: > bq. you must have your customerId, timestamp in the rowkey since you query > on it > > Have you looked

Re: Uneven write request to regions

2013-11-15 Thread Tom Brown
We have solved this by prefixing each key with a single byte. The byte is based on a very simple 8-bit hash of the record. If you know exactly which row you are looking for you can rehash your row to create the true key. Scans are a little more complex because you have to issue 256 scans instead o

Re: Uneven write request to regions

2013-11-15 Thread Ted Yu
bq. you must have your customerId, timestamp in the rowkey since you query on it Have you looked at this API in Scan ? public Scan setTimeRange(long minStamp, long maxStamp) Cheers On Fri, Nov 15, 2013 at 1:28 PM, Asaf Mesika wrote: > The problem is that I do know my rowkey design, and it

Re: Uneven write request to regions

2013-11-15 Thread Asaf Mesika
The problem is that I do know my rowkey design, and it follows people's best practice, but generates a really bad use case which I can't seem to know how to solve yet. The rowkey as I said earlier is: So when ,for example, you have 1000 customer, and bucket ranges from 1 to 16, you eventually end

Re: is there any way to copy data from one table to another while updating rowKey??

2013-11-15 Thread Asher
T Vinod Gupta writes: > > I am badly stuck and can't find a way out. i want to change my rowkey > schema while copying data from 1 table to another. but a map reduce job to > do this won't work because of large row sizes (responseTooLarge errors). so > i am left with a 2 steps processing of exp

RE: Unable to connect to remote hbase from java client program

2013-11-15 Thread Vladimir Rodionov
You misspelled hbase.zookeeper.quorum (dot at the end) config.set("hbase.zookeeper.quorum.", "10.219.47.22"); Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: yogeshgupta [gyog

Re: Unable to connect to remote hbase from java client program

2013-11-15 Thread Rajendra Manjunath
Hi yogi, Can check the port once is it 2180 or default 2181 Regards M R On Friday, November 15, 2013, yogeshgupta wrote: > Hi I am trying to connect to hbase in a remote machine from my java > program. > But I am getting connection refused error. On looking at the error I think > it is trying t

Unable to connect to remote hbase from java client program

2013-11-15 Thread yogeshgupta
Hi I am trying to connect to hbase in a remote machine from my java program. But I am getting connection refused error. On looking at the error I think it is trying to connect to my localhost instead of the remote machine. My configuration is like- Configuration config = HBaseConfiguration.create

Re: HBase with multiple interfaces

2013-11-15 Thread Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN)
That code can be traced down to: public static String[] getHosts(String strInterface, String nameserver) throws UnknownHostException { String[] ips = getIPs(strInterface); Vector hosts = new Vector(); for (int ctr = 0; ctr < ips.length; ctr++) try { hosts.add(reverseD

Re: HBase with multiple interfaces

2013-11-15 Thread Jean-Marc Spaggiari
Hum. I don't know why I was not able to find it before. Sorry about that. Have you tried to directly call reverseDns from a small java class on your server to see what is returned? 2013/11/15 Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN) > Asaf: > > What doesn't work is that the RegionServers bind

Re: HBase with multiple interfaces

2013-11-15 Thread Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN)
Asaf: What doesn't work is that the RegionServers bind to the IP that the hostname maps to in /etc/hosts and not to the specified interface. I've this in hbase-site.xml: hbase.master.dns.interface eth0 hbase.regionserver.dns.interface eth0 This however has

Re: HBase with multiple interfaces

2013-11-15 Thread Jean-Marc Spaggiari
Asaf, which HBase version are you using? Also, hae you tried without those properties? 2013/11/15 Asaf Mesika > We are using both of the following > properties: hbase.regionserver.dns.interface, base.master.dns.interface. > Both set to the interface name we want. We have two interfaces as you >