Re: RS storage capacity mismatches

2014-08-22 Thread Sean Busbey
Hi Ted! HBase doesn't currently take local node resources into account when balancing across region servers. There's currently some discussion on HBASE-11780 about building this funtionality[1]. I'm sure they'd love more input or details about the scale you'd need to work at. -Sean [1]: https:/

Re: Compilation error: HBASE 0.98.4 with Snappy

2014-08-26 Thread Sean Busbey
Hi Arthur! Our Snappy build instructions are currently out of date and I'm working on updating them[1]. In short, I don't think there are any special build steps for using snappy. I'm still working out what needs to be included in our instructions for local and cluster testing. If you use the te

Re: Nested data structures examples for HBase

2014-09-10 Thread Sean Busbey
Hi Stephen! Have you taken a look at Apache Gora? It uses Avro for its data model, which supports nested data structures, and can store in a variety of backing stores, including HBase. -Sean On Tue, Sep 9, 2014 at 4:20 PM, Stephen Boesch wrote: > Thanks Michael, yes cells are byte[]; therefor

Re: Custom Filter on hbase Column

2014-09-11 Thread Sean Busbey
I filed HBASE-11950 to get some details added to the book on this topic[1]. Nishanth, could you follow that ticket and give feedback on whatever update ends up proposed? [1]: https://issues.apache.org/jira/browse/HBASE-11950 On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu wrote: > See http://search-ha

Re: Migration from 0.92 to 0.98

2014-09-16 Thread Sean Busbey
Hi Flavio, Since you're using a vendor-supplied distribution of HBase, here are some docs from that vendor: * http://tiny.cloudera.com/cdh4_to_cdh5_upgrade * http://tiny.cloudera.com/cdh4_to_cdh5_hbase_upgrade If something goes wrong with those instructions, I'd recommend using vendor-specific c

Re: Is there any way to truncate the hbase table but keep all the regions

2014-09-27 Thread Sean Busbey
The patches you're looking for are under HBASE-5525. It's all shell-side changes so it should be relatively easy to get working. On Sat, Sep 27, 2014 at 9:13 PM, Weichen YE wrote: > Hi,Jean-Marc, > > Thank you very much for you reply. You really solve my problem ! >I`m using HBase0

Re: Is there any way to truncate the hbase table but keep all the regions

2014-09-27 Thread Sean Busbey
patch for 0.94 posted on HBASE-12113 On Sun, Sep 28, 2014 at 12:03 AM, lars hofhansl wrote: > If you have a patch I am happy to commit it to 0.94 (if it's not too > invasive). > > -- Lars > > > > > From: Weichen YE > To: "user@hbase.apache.org" > Sent: Saturda

Re: Access hbase remotely from java client

2014-09-29 Thread Sean Busbey
Does the IP you listed properly handle DNS resolution? You should make sure forward and reverse look up work properly for hosts used. Generally you should also configure things via host name and not IP address. On Mon, Sep 29, 2014 at 8:17 AM, SACHINGUPTA wrote: > java client > > package com.ex

Re: Access hbase remotely from java client

2014-09-29 Thread Sean Busbey
What does the "hostname" command return on the master? Do you have any backup-masters configured? What is the contents of your regionservers file? On Mon, Sep 29, 2014 at 9:55 AM, SACHINGUPTA wrote: > yes > > On Monday 29 September 2014 08:18 PM, Sean Busbey wrote: > >

Re: Access hbase remotely from java client

2014-09-29 Thread Sean Busbey
the hbase of cloudera vm remotely > > On Monday 29 September 2014 08:38 PM, Sean Busbey wrote: > >> What does the "hostname" command return on the master? >> >> Do you have any backup-masters configured? >> >> What is the contents of your regionservers

Re: HBase 0.98.6.1 maven dependency

2014-09-30 Thread Sean Busbey
For 0.98.x you should use hbase - client. See the FAQ item on updating a maven managed project from 0.94 to 0.98: http://hbase.apache.org/book.html#d0e22846 -- Sean On Sep 30, 2014 7:20 AM, "innowireless TaeYun Kim" < taeyun@innowireless.co.kr> wrote: > Hi, > > > > I'm relatively new to HB

Re: Anyone good with JRuby?

2014-10-04 Thread Sean Busbey
presuming the file can file in memory, you can just use the Ruby IO/File method to read the entire thing. Note that the version of JRuby used with the HBase shell is fixed at Ruby 1.8: buffer = IO.read("/home/roger/Downloads/test.jpg") ref: http://ruby-doc.org/core-1.8.7/IO.html#method-c-read O

Re: How to make a given table spread evenly across the cluster

2014-10-05 Thread Sean Busbey
Can you put your log4j settings for master in a pastebin and send us the link? -- Sean On Oct 5, 2014 8:22 PM, "Tao Xiao" wrote: > Hi Ted, > > Actually there is no more contents in the master log --- what you > saw is the snippet of master log from the time I executed "*balancer*" to > the end

RE: HBase read performance

2014-10-13 Thread Sean Busbey
Yes, please file a JIRA and attach the test there. -- Sean On Oct 13, 2014 10:22 PM, "Khaled Elmeleegy" wrote: > Actually, it's very easy to reproduce. I have a simple program that > reproduces it if run against a simple toy cluster with one RS. If shared > the program with Ted. I can file a ji

Re: when will hbase create the zookeeper znode 'root-region-server’ is created? Hbase 0.94

2014-10-16 Thread Sean Busbey
On Thu, Oct 16, 2014 at 2:18 AM, Liu, Ming (HPIT-GADSC) wrote: > > > By the way, I cannot find anywhere to download a 0.94.5 hbase source code, > can anyone tell me if there is somewhere I can find it? > > I know old version is obsolete , but this is not for production, but for > research, so ple

Re: YCSB load data stucked

2014-10-21 Thread Sean Busbey
As an aside, if there are changes we'd like to see in YCSB upstream has started taking patches again with a bit of prodding. On Tue, Oct 21, 2014 at 9:23 PM, Ted Yu wrote: > Once you clone ycsb, you should build it with your choice of 0.98 > > Here's thread where Andrew mentioned his ycsb repo:

Re: Similar Column names in creation of HBase table

2014-10-23 Thread Sean Busbey
Thanks for the heads up. This sounds like a bug. I've filed HBASE-12329 to track the problem in both the API and the shell. Please follow that ticket if you'd like updates. https://issues.apache.org/jira/browse/HBASE-12329 On Thu, Oct 23, 2014 at 8:45 AM, Ted Yu wrote: > Interesting. > > Using

Re: error in installing and starting hbase

2014-10-26 Thread Sean Busbey
It looks like you're in a home directory, but start-hbase.sh is in your path. What manner of installation did you use? -- Sean On Oct 26, 2014 6:45 AM, "beeshma r" wrote: > Hi Ted > > i now trying to install hbase in my ubuntu.i struck here with this problem > > $start-hbase.sh > > > Error: C

Re: Connection via API to Hbase installation - java.lang.NoClassDefFoundError: org/apache/commons/lang/ArrayUtils

2014-10-27 Thread Sean Busbey
Hi Benjamin, This is expected behavior. Commons Lang 3 is not backwards compatible with Commons Lang 2.x. They use different java packages in an effort to ease projects that have to rely on both while transitioning. -Sean On Mon, Oct 27, 2014 at 9:50 AM, Sznajder ForMailingList < bs4mailingl...

Re: How to deploy coprocessor via HDFS

2014-10-27 Thread Sean Busbey
Are you attempting to add the coprocessor via hbase-site.xml or via the shell? If the HBase Shell, check out chapter 13.3.2 in the ref guide[1]. It walks through loading an example. The given file path is just a URL that gets handed directly to Hadoop's Path class, so the example you gave would ma

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
In the 0.94.x API, Put implemented Writable[1]. This meant that MR code, like yours, could use it as a Key or Value between Mapper and Reducer. In 0.96 and later APIs, Put no longer directly implements Writable[2]. Instead, HBase now includes a Hadoop Seriazliation implementation. Normally, this w

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
.. so many changes... ((( > > > 2014-11-03 0:41 GMT+03:00 Sean Busbey : > > > In the 0.94.x API, Put implemented Writable[1]. This meant that MR code, > > like yours, could use it as a Key or Value between Mapper and Reducer. > > > > In 0.96 and later APIs,

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 3:53 PM, Serega Sheypak wrote: > P.S. > HFileOutputFormat is also deprecated... so many changes... ((( > > Incidentally, you should consider switching to HFileOutputFormat2, since you rely on the version that has a Mapper outputting Put values instead of KeyValue the impac

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 4:11 PM, Serega Sheypak wrote: > Sean, I've started to catch that serialization problem on unit-test level > while using mrunit. > I don't see any possibility to call > HFileOutputFormat.configureIncrementalLoad > before mrunit mocking stuff. > I was workngi w/o any problem

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 4:14 PM, Serega Sheypak wrote: > Cool, is it this stuff? > http://hbase.apache.org/book/hfilev2.html > > No, that's all details on the update to the backing HFile format that started in HBase 0.92. The change in output format is detailed here: http://hbase.apache.org/apido

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 5:09 PM, Ted Yu wrote: > bq. context.write(hbaseKey, put); //Exception here > > I am not mrunit expert. But as long as you call the following method prior > to the above method invocation, you should be able to proceed: > > conf.setStrings("io.serializations", conf.get(

Re: No FileSystem for scheme: file

2014-11-05 Thread Sean Busbey
How are you submitting the job? How are your cluster configuration files deployed (i.e. are you using CM)? On Wed, Nov 5, 2014 at 8:50 AM, Tim Robertson wrote: > Hi all, > > I'm seeing the following > java.io.IOException: No FileSystem for scheme: file > at org.apache.hadoop.fs.FileSystem.get

Re: No FileSystem for scheme: file

2014-11-05 Thread Sean Busbey
es.jar > org.gbif.metrics.cube.occurrence.backfill.Backfill > > Thanks, > Tim > > > On Wed, Nov 5, 2014 at 4:30 PM, Sean Busbey wrote: > > > How are you submitting the job? > > > > How are your cluster configuration files deployed (i.e. are you using > CM

Re: Unable to see hbase 0.98 jars in mirror website

2014-11-06 Thread Sean Busbey
Please note that downloading directly from the ASF archive is discouraged as it puts a burden on ASF infra. Using it while we work through the issue with mirrors is fine. Work on fixing the mirrors can be followed on this jira: https://issues.apache.org/jira/browse/HBASE-12436 On Thu, Nov 6, 2014

Re: Logging for HBase tests

2014-11-14 Thread Sean Busbey
You needn't specify the log4j configuration file, the one in hbase-server/src/test/resources will get put in the test classpath for you. The default appender in that file is on stderr, which surefire will swallow somewhere in the temp directory it creates for running things. Usually when I need l

Re: java.lang.NoClassDefFoundError: com/google/protobuf/ZeroCopyLiteralByteString

2014-11-17 Thread Sean Busbey
Vendor specific problems related to Cloudera should be sent to Cloudera's community mechanism: https://community.cloudera.com/ On Mon, Nov 17, 2014 at 9:33 AM, Ted Yu wrote: > Have you posted this question on Cloudera mailing list ? > > Cheers > > On Mon, Nov 17, 2014 at 12:45 AM, antarktika w

Re: how to redirect hbase testcase log to stdin or other file?

2014-11-24 Thread Sean Busbey
If what you want from the output is something written by a logger, you can make all tests log to a file by passing in -Dhbase.root.logger=LEVEL,DFRA (where LEVEL is a log4j level i.e. DEBUG). Here's a conversation that goes into more detail: *http://s.apache.org/axq * If

Re: Can't enable table after rebooting hbase

2014-11-24 Thread Sean Busbey
Also if you're relying on the local filesystem, what OS and filesystem. -- Sean On Nov 24, 2014 11:26 PM, "lars hofhansl" wrote: > Please tell us what happened. Exceptions, error messages, anything in the > logs, anything on the overview pages, etc, etc? > -- Lars > From: guxiaobo1982 >

Re: Is there anyway I can list out history of transitions made by a region?

2014-12-01 Thread Sean Busbey
Is this something we should be adding to our AUDIT log? On Sun, Nov 30, 2014 at 10:07 PM, Ted Yu wrote: > To my knowledge, there is no such tool. > > You can grep master log for region A which would give you history of the > region's movement. > > Cheers > > On Sun, Nov 30, 2014 at 7:35 PM, gome

Re: What companies are using HBase to serve a customer-facing product?

2014-12-05 Thread Sean Busbey
Hi Jeremy! We'll probably need more information to answer your questions. In particular, what kind of read or write SLA are you looking to meet? At what scale of concurrent users? What size of retrievals? Normally, "customer facing application" means something in the human interactive time scale

Re: 0.94 going forward

2014-12-15 Thread Sean Busbey
Does replication and snapshot export work from 0.94.6+ to a 0.96 or 0.98 cluster? Presuming it does, shouldn't a site be able to use a multiple cluster set up to do a cut over of a client application? That doesn't help with needing downtime for to do the eventual upgrade, but it mitigates the imp

Re: HBase with opentsdb creates huge .tmp file & runs out of hdfs space

2015-01-13 Thread Sean Busbey
what are the configuration settings for * dfs.data.dir / dfs.datanode.data.dir * dfs.datanode.du.reserved For each of the directories in the first list, can you get the output of "tune2fs -l" ? Can you get us any non-default settings for the hbase cluster and table? Are you using compression on

Re: HBase with opentsdb creates huge .tmp file & runs out of hdfs space

2015-01-13 Thread Sean Busbey
Hiya! You'll have to post the config file somewhere (e.g. http://apaste.info/) and then provide a link to it. ASF mailing lists strip out attachments. On Tue, Jan 13, 2015 at 4:34 PM, sathyafmt wrote: > yes, painful :-) > > This happens at a customer deployment & the next time I hit this I'll g

Re: HBase with opentsdb creates huge .tmp file & runs out of hdfs space

2015-01-13 Thread Sean Busbey
On Tue, Jan 13, 2015 at 5:44 PM, Sean Busbey wrote: > Hiya! > > You'll have to post the config file somewhere (e.g. http://apaste.info/) > and then provide a link to it. ASF mailing lists strip out attachments. > > > Never mind me; I see the configs now. :/ -- Sean

Re: Reduce logging of HBaseTestingUtility(Silent mode?)

2015-02-19 Thread Sean Busbey
Hi Anil! You can control what gets logged by selectively changing log levels in your log4j.properties file for tests. For some suggestions, check out the one used in hbase-server/src/test/resources/log4j.properties [1]: 57

Re: Reduce logging of HBaseTestingUtility(Silent mode?)

2015-02-19 Thread Sean Busbey
On Thu, Feb 19, 2015 at 2:20 PM, Sleiman Jneidi wrote: > I usually have a class called BaseTest that every test class extends and I > configure me logging there. > > > public class BaseTest { > > @BeforeClass > public static void init(){ > BasicConfigurator.configure(); >

Re: table splitting - how to check

2015-02-25 Thread Sean Busbey
You can get the list of splits from the shell, but only by peeking behind the curtain of the API. jruby-1.7.3 :012 > create 'example_table', 'f1', SPLITS => ["10", "20", "30", "40"] 0 row(s) in 0.5500 seconds => Hbase::Table - example_table jruby-1.7.3 :013 > get_table('example_table').table.get

Re: HBase scan time range, inconsistency

2015-02-25 Thread Sean Busbey
Are you writing any Deletes? Are you writing any duplicates? How is the partitioning done? What does the entire key structure look like? Are you doing the column filtering with a custom filter or one of the prepackaged ones? On Wed, Feb 25, 2015 at 12:57 PM, Stephen Durfey wrote: > > > > What

Re: oldWALs: what it is and how can I clean it?

2015-03-11 Thread Sean Busbey
Thanks for the follow up Liam! I'll add this as a bug against CDH. On Wed, Mar 11, 2015 at 3:58 PM, Liam Slusser wrote: > I just wanted to update this thread as after more investigation I've > figured out why my oldWALs folder wasn't being cleaned up. I had a look at > the code to ReplicationLo

Re: oldWALs: what it is and how can I clean it?

2015-03-11 Thread Sean Busbey
ar 11, 2015 at 4:02 PM, Sean Busbey wrote: > Thanks for the follow up Liam! I'll add this as a bug against CDH. > > On Wed, Mar 11, 2015 at 3:58 PM, Liam Slusser wrote: > >> I just wanted to update this thread as after more investigation I've >> figured out why my

Re: oldWALs: what it is and how can I clean it?

2015-03-11 Thread Sean Busbey
On Wed, Mar 11, 2015 at 4:24 PM, Liam Slusser wrote: > Sean - > > Very likely. Funny the Cloudera manager 5.2.1 was able to upgrade to > CDH5.3 with parcels and I just noticed now that is saying CDH5.3.2 is > available for download. So while it might not a "supported configuration" > they sure

Re: HBase Question

2015-03-13 Thread Sean Busbey
We usually try to have a shell way of doing all public facing operations. In particular, I'd say if something shows up in the ref guide[1] without a shell way to do it, I'd consider it a bug. The one big caveat is that the shell is not performant for doing data inserts or fetching. Those functions

Re: Standalone == Dev Only?

2015-03-13 Thread Sean Busbey
On Fri, Mar 13, 2015 at 2:41 PM, Michael Segel wrote: > > In stand alone, you’re writing to local disk. You lose the disk you lose > the data, unless of course you’ve raided your drives. > Then when you lose the node, you lose the data because its not being > replicated. While this may not be a m

Re: Strange issue when DataNode goes down

2015-03-16 Thread Sean Busbey
Can you post some redacted log files from the period after the data node failed, up to the restart? -- Sean On Mar 16, 2015 8:41 AM, "Dejan Menges" wrote: > Hi All, > > We have a strange issue with HBase performance (overall cluster > performance) in case one of datanodes in the cluster unexpec

Re: Splitting up an HBase Table into partitions

2015-03-17 Thread Sean Busbey
You should ask for a RegionLocator if you want to know the boundaries of all the regions in a table final Connection connection = ConnectionFactory.createConnection(config); try { final RegionLocator locator = connection.getRegionLocator(TableName.valueOf("myTable")); final Pair startEndKe

Re: RecoverableZooKeeper: Unable to create ZooKeeper Connection

2015-03-20 Thread Sean Busbey
Please post a link to log files. On Fri, Mar 20, 2015 at 4:30 AM, san89kalp wrote: > I am struggling for getting my HBase shell running. It throws me the above > exception in subject line. I have checked that hbase-site.xml matches > perfectly with hadoop one. Please help. > I am attaching the t

Re: Zookeeper Error

2015-03-25 Thread Sean Busbey
Your configuration has conflicting parameters. One set of them tells HBase that it should run ZK and the other that you are going to run ZK yourself and HBase can rely on it. The failure you see is because the parameters for "HBase can rely on the ZK that is running over here" wins. * hbase.zooke

Re: [ANNOUNCE] Sean Busbey joins the Apache HBase PMC

2015-03-27 Thread Sean Busbey
Thanks everyone for making me feel so welcome! -- Sean On Mar 26, 2015 10:26 AM, "Andrew Purtell" wrote: > On behalf of the Apache HBase PMC I"m pleased to announce that Sean Busbey > has accepted our invitation to become a PMC member on the Apache HBase > project. Sea

Re: Can't connect to hbase via phoenix client

2015-03-27 Thread Sean Busbey
What version of hbase are you using? Can you pastebin your hbase-site.xml? -- Sean On Mar 27, 2015 12:47 AM, "James Teng" wrote: > HI, > i tried to connect to local deployed hbase with my codes below, but can't > connect to it successfully. and attach the log data i can see from hbase > side.

Re: Hbase 1.0 Distributed Mode:Issue:Master is initializing

2015-04-03 Thread Sean Busbey
you should check the master's log for what is causing it to be delayed in starting. A few configuration errors: 1) zk dataDir in hbase configs hbase.zookeeper.property.dataDir /hadoop/hdfs/zookeeper/data/zk1 This property is not needed, because you have specified a ZK quorum a

Re: Hbase 1.0 Distributed Mode:Issue:Master is initializing

2015-04-03 Thread Sean Busbey
It should be hbase.rootdir hdfs://mycluster/hbase On Fri, Apr 3, 2015 at 11:19 AM, sridhararao mutluri wrote: > Hi Sean, > Thanks for your speedy reply. > We are suing hadoop HA with namespace "mycluster". > Please suggest below property value like this: > hbase.rootdir > hdfs://mycluste

RE: Hbase 0.98 Distributed Mode with hadoop 2.6 HA:Issues of Hbase

2015-04-09 Thread Sean Busbey
Please post a link to updated master logs. -- Sean On Apr 9, 2015 5:50 AM, "sridhararao mutluri" wrote: > Hi Esteban, > > We increased maximum files and with reboot ulimit -n shows across all > clusters > > [hadoop@solix1 bin]$ ulimit -n > 65535 > > But unluckily we are getting same error now a

Re: Rowkey design question

2015-04-11 Thread Sean Busbey
Lars, Andrew, Michael, This particular discussion isn't bearing fruit for the user@hbase audience. If you wish to continue it, especially with the current tone, please do so on dev@. Michael, IANAL but the ASF offers indemnification as a means of encouraging development and adoption of the projec

Re: toStringBinary output is painful

2015-04-13 Thread Sean Busbey
It does not bother just you. :) Can we bound where all this shows up? In most cases we can address compatibility concerns by making a new API and transitioning to it as the guidelines allow for breakage. That generally means sooner is better than later; our next big effort to make sure obsolete t

Re: HBase Filesystem Adapter

2015-04-30 Thread Sean Busbey
On Thu, Apr 30, 2015 at 10:19 AM, Stack wrote: > On Thu, Apr 30, 2015 at 6:35 AM, Buğra Çakır < > bugra.ca...@oranteknoloji.com> > wrote: > > > Hi, > > > > > > I would like to use HBase with distributed filesystems other > > > > than HDFS. Are there any plans for developing filesystem > > > > ada

Re: Using 1.1.0RC0 in your maven project (was [VOTE] First release candidate for HBase 1.1.0 (RC0) is available)

2015-04-30 Thread Sean Busbey
+dev@hbase -user@hbase to bcc Adding thread to dev@hbase and moving user@hbase to bcc. Please keep discussion on how to test the RC and make use of it in downstream projects on the dev list. On Thu, Apr 30, 2015 at 12:48 PM, Nick Dimiduk wrote: > I've updated Stack's "hbase-downstreamer" projec

Re: HBase Filesystem Adapter

2015-04-30 Thread Sean Busbey
This thread is starting to sound like a new section for the ref guide. :) -- Sean On Apr 30, 2015 1:07 PM, "Jerry He" wrote: > We've also made HBase running on IBM GPFS. > http://en.wikipedia.org/wiki/IBM_General_Parallel_File_System > > We have a Hadoop FileSystem implementation that translate

Re: HBase Filesystem Adapter

2015-04-30 Thread Sean Busbey
On Apr 30, 2015 4:11 PM, "Enis Söztutar" wrote: > > This is a nice topic. Let's put it on the ref guide. > > Hbase on Azure FS is GA, and there has already been some work for > supporting HBase on the Hadoop native driver. > From this thread, my gathering is that, HBase should run on HDFS, MaprFS,

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-05-01 Thread Sean Busbey
On Thu, Apr 30, 2015 at 6:48 PM, Andrew Purtell wrote: > We could patch our POMs to reference the hadoop-minikdc artifact > independently of the rest of the Hadoop packages. It's standalone and > rarely changes. > > > +1. I've been using HBase to test Hadoop changes for isolating dependencies fro

Re: HBase shell noninteractive mode

2015-05-05 Thread Sean Busbey
Hi Akmal, Unfortunately there is not. Right now that feature is only slated for HBase 2.0 IIRC, but we should be able to get it into an earlier version. I'll open a backport JIRA. Do you know when you'll be able to upgrade next? -- Sean On May 5, 2015 4:18 AM, "Akmal Abbasov" wrote: > Hi, > H

Re: HBase shell noninteractive mode

2015-05-05 Thread Sean Busbey
e time for now. > So the only solution in that case would be to parse the output of the > HBase shell command? > Thank you. > > Regards, > Akmal Abbasov > > > On 05 May 2015, at 15:25, Sean Busbey wrote: > > > > Hi Akmal, > > > > Unfortunately there

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-05-05 Thread Sean Busbey
15 4:17 PM, "Nick Dimiduk" wrote: > So what's the conclusion here? Are we dropping 2.2 support or updating the > poms and sinking the RC? > > On Fri, May 1, 2015 at 7:47 AM, Sean Busbey wrote: > > > On Thu, Apr 30, 2015 at 6:48 PM, Andrew Purtell > > w

Re: Hbase 1.0 Distributed Mode:Issue:Master is initializing

2015-05-14 Thread Sean Busbey
Hi Sridhar! Please be sure to copy your responses to user@hbase and not just an individual. The attached log shows that your master service does not see any Region Servers as available. You should check the logs for the region servers to see why they aren't starting. On Sat, Apr 4, 2015 at 11:37

Re: Re: How to know the root reason to cause RegionServer OOM?

2015-05-18 Thread Sean Busbey
On Mon, May 18, 2015 at 11:47 AM, Andrew Purtell wrote: > You need to not overcommit memory on servers running JVMs for HDFS and > HBase (and YARN, and containers, if colocating Hadoop MR). Sum the -Xmx > parameter, the maximum heap size, for all JVMs that will be concurrently > executing on the

Re: Where can I find the document for specific version of hbase api ?

2015-05-18 Thread Sean Busbey
Thanks for pinging us on this. There's currently an open jira for properly providing access to 0.98, 1.0, and 1.1 specific javadocs[1]. Unfortunately, no one has had the time to take care of things yet. You can follow that ticket if you'd like to know when there's movement. For now, your only opt

Re: DNS mismatch between master and regionserver causes doubly registered regionservers

2015-05-22 Thread Sean Busbey
On Fri, May 22, 2015 at 2:34 PM, Ted Yu wrote: > bq. hbase-1.1.0.1 > > To my knowledge, latest release was 1.1.0. The release before that was > 1.0.1 > > Can you clarify ? > > Thanks > > The 1.1.0.1 release votes all passed. I don't think the announcement has gone out yet because we were waiting

Re: HBase and Hive integration

2015-06-05 Thread Sean Busbey
+user@hive -user@hbase to bcc Hi! This question is better handled by the hive user list, so I've copied them in and moved the hbase user list to bcc. On Fri, Jun 5, 2015 at 12:54 PM, Buntu Dev wrote: > Hi - > > Newbie question: I got Hive and HBase on different clusters and say all the > appro

Re: Reminder: 1.2 branching

2015-06-08 Thread Sean Busbey
2015 7:55 PM, "Nick Dimiduk" wrote: > You may want to give a heads-up on user@ and phoenix lists as well so that > folks have a chance to push their open tickets. > > On Mon, Jun 8, 2015 at 5:32 PM, Sean Busbey wrote: > > > Hi all! > > > > Just a qui

Re: Where can I find the apidoc for newer version of Hbase?

2015-06-13 Thread Sean Busbey
What version are you looking for, specifically? If you download a binary artifact, it will have a copy of the javadocs for that version. If you download a source artifact, you can build the javadocs using the "site" maven goal. On Sat, Jun 13, 2015 at 8:33 PM, guxiaobo1982 wrote: > Hi, > > > I c

Re: HBase Shell : NoMethodError: undefined method `getTerminal' for Java::Jline::Terminal:Module

2015-06-18 Thread Sean Busbey
it sounds like a different version of jruby and/or jline is on your classpath. Are you attempting to use HBase with anything else, for example Apache Phoenix? On Wed, Jun 17, 2015 at 6:23 PM, Arthur Chan wrote: > Hi, > > > My compilation is successful, HBase-0.98.12.1 > > [INFO] > --

[DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

2015-06-30 Thread Sean Busbey
(I took the liberty of moving us off of Ted's feature discussion thread) A three month ban sounds better than a permanent ban. But it still seems likely to just result in the ban-ee walking away from teh community or escalating. Would we consider enforcing moderation on posts for the three month

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

2015-06-30 Thread Sean Busbey
On Tue, Jun 30, 2015 at 7:58 PM, lars hofhansl wrote: > Moderating is better than outright banning, I think.While Micheal is > sometimes infuriating, he's also funny and smart. > Can we have a group of moderators? I'd volunteer, but not if I'm the only > one. > > So far we have both you and I wil

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

2015-07-01 Thread Sean Busbey
On Wed, Jul 1, 2015 at 7:15 AM, Ted Malaska wrote: > Should I start a new Thread to talk about multi client? > > I sorry this all had to happen on my thread. I hope I didn't cause it. > > My goal is simple I would like to set up some thing that would help HBase > compete in the multi cluster up

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

2015-07-01 Thread Sean Busbey
On Wed, Jul 1, 2015 at 7:19 AM, Shahab Yunus wrote: > I am a very new here and also my contribution to the mailing list has been > limited as well. I am not even a committer. But I have been following and > reading the mailing list for a while. So given that, I am taking the > liberty and chiming

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

2015-07-01 Thread Sean Busbey
; > Cc: "d...@hbase.apache.org" > > > > > Sent: Tuesday, June 30, 2015 12:25 PM > > > > > Subject: Re: [DISCUSS] correcting abusive behavior on mailing lists > > was > > > > (Re: [DISCUSS] Multi-Cluster HBase Client) > > > > &g

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

2015-07-01 Thread Sean Busbey
would not vote in favor. I very likely would vote "-0 I think moderating his messages will suffice, but acknowledge the community does not want that." On Wed, Jul 1, 2015 at 12:23 PM, Sean Busbey wrote: > I would not vote -1 on a 3 month ban. It doesn't look like we have &

[ANNOUNCE] YCSB 0.2.0 Release

2015-07-07 Thread Sean Busbey
On behalf of the development community, I am pleased to announce the release of YCSB version 0.2.0. Highlights: * Apache Cassandra 2.0 CQL support * Apache HBase 1.0 support * Apache Accumulo 1.6 support * MongoDB - support for all production versions released since 2011 * Tarantool 1.6 support *

Re: [ANNOUNCE] YCSB 0.2.0 Release

2015-07-07 Thread Sean Busbey
On Tue, Jul 7, 2015 at 11:48 PM, 김영우 wrote: > Congratulations, nice work! > > BTW, just curious whether the 0.2 release supports HBase 0.9x (especially > 0.98.x) or not. From 'Known Issues' of the release, it sounds like HBase > 0.94 ~ 98 does not work with 0.2 release properly. Please let me kno

Re: [DISCUSS] Bumping Thrift to 0.9.2 in branch-1

2015-07-08 Thread Sean Busbey
Would this aim for 1.3 or 1.2? -- Sean On Jul 8, 2015 1:42 PM, "Srikanth Srungarapu" wrote: > Hi Folks, > > Currently, HBase is using Thrift 0.9.0 version, with the latest version > being 0.9.2. Currently, the HBase Thrift gateway is vulnerable to crashes > due to THRIFT-2660

Re: [DISCUSS] Bumping Thrift to 0.9.2 in branch-1

2015-07-08 Thread Sean Busbey
On Wed, Jul 8, 2015 at 11:12 PM, Srikanth Srungarapu wrote: > @Sean, I'm thinking of getting this in for 1.3 and master. Do you think we > should also get this in for 1.2 release line? > > We're a bit too close to 1.2 for my comfort in changing the thrift library version, given their history of b

Re: Can't run hbase testing util cluster using CDH 5.4.4

2015-07-19 Thread Sean Busbey
If your problem is specific to a vendor release, please seek assistance with the vendor in question. That is, if you can change to the Apache HBase release the vendor distro uses as a foundation (in the case of CDH5.4.4 that's HBase 1.0.0) and the problem persists, then user@hbase is happy to help

Re: [DISCUSS] Split up the book again?

2015-07-30 Thread Sean Busbey
The need to update the javadocs published on the site is a long standing issue. Please keep discussion for it on its jira: https://issues.apache.org/jira/browse/HBASE-13140 (there's also a workaround provided) On Thu, Jul 30, 2015 at 12:23 PM, anil gupta wrote: > http://hbase.apache.org/apidoc

Re: [DISCUSS] Split up the book again?

2015-07-30 Thread Sean Busbey
I personally like using the single-page version and tended to do so when we had both by-chapter and whole book. IIRC, asciidoc can make the per-chapter version. I think there was some reasoning from Misty on not enabling it by default, but I can't find the jira/thread at the moment. What if inste

Re: Full GC on client may lead to empty scan results

2015-07-30 Thread Sean Busbey
This sounds similar to HBASE-13262, but on versions that expressly have that fix in place. Mind putting up a jira with the problem reproduction? On Thu, Jul 30, 2015 at 1:13 PM, James Estes wrote: > All, > > If a full GC happens on the client when a scan is in progress, the scan can > be missin

Re: Full GC on client may lead to empty scan results

2015-07-31 Thread Sean Busbey
lently failing the scan? > > James > > > On Thu, Jul 30, 2015 at 5:13 PM, Sean Busbey wrote: > > > This sounds similar to HBASE-13262, but on versions that expressly have > > that fix in place. > > > > Mind putting up a jira with the problem reproduction? >

Re: ERROR: Can't get master address from ZooKeeper; znode data == null

2015-08-04 Thread Sean Busbey
The current error message essentially means "I looked in ZooKeeper can can't tell if the master is running". can you list the current processes and see if the HMaster is present? (use jps -lm) can you check the log for HMaster to see if it thinks the master is up and active? can you check the HM

Re: HBASE-14317 and 1.1.3

2015-09-04 Thread Sean Busbey
that's been the only jira holding up 1.2 RC0. I would expect anything else worthy of a .3 would similarly impact 1.2. On Fri, Sep 4, 2015 at 10:11 AM, Nick Dimiduk wrote: > Hi folks, > > I know we just got through voting periods on three patch releases, but > HBASE-14317 is looking pretty bad by

Re: HBase and Spark

2015-12-12 Thread Sean Busbey
Hi! Unfortunately, hbase-spark support is not yet available from the Apache HBase project. The jira for tracking efforts to get the hbase-spark module working with branch-1 and released can be followed, it's HBASE-14160. In the mean-time, I believe the "Spark on HBase" project, which was the sta

Re: HBase and Spark

2015-12-12 Thread Sean Busbey
Sorry I forgot to mention, if you'd like to help out on getting the hbase-spark code working well on branch-1 feel free to head over to the dev@hbase mailing list. On Sat, Dec 12, 2015 at 12:57 PM, Sean Busbey wrote: > Hi! > > Unfortunately, hbase-spark support is not yet avai

[ANNOUNCE] Apache HBase 1.2.0 is now available for download

2016-02-23 Thread Sean Busbey
The HBase team is happy to announce the immediate availability of HBase 1.2.0. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn more

Re: How to find versions 0.95 through 1.3 of the HBase reference (book)?

2016-03-02 Thread Sean Busbey
In general the book is kept covering versions 0.98+. Our release process for a new minor release line even involves copying the then-current contents of the master branch version of the book (what you see on the site). Is there something in particular you're looking for? On Wed, Mar 2, 2016 at 6:

Re: HBase poor write performance

2016-03-08 Thread Sean Busbey
On Tue, Mar 8, 2016 at 8:28 AM, Akmal Abbasov wrote: > Hi, > I'm testing HBase to choose the right hardware configurations for a heavy > write use case. I'm testing using YCSB. > The cluster consist of 2 masters, and 5 regionservers(4 cores, 14GB ram, > 4x512GB SSD). > I've created a new table in

Re: Ruby gem of Apache Phoenix: https://rubygems.org/gems/ruby-phoenix/versions/0.0.8

2016-03-08 Thread Sean Busbey
Hi Anil! You should contact the Apache Phoenix community for this question. Details on subscribing to their user list can be found here: http://mail-archives.apache.org/mod_mbox/phoenix-user/ On Tue, Mar 8, 2016 at 4:54 PM, anil gupta wrote: > Hi, > > One of our ruby apps might be using this

Re: Spark on Hbase

2016-03-09 Thread Sean Busbey
Hi Rachana! Better support for Spark users who wish to interact with HBase hasn't made it into an HBase release yet. It's still in our development area awaiting the last few touches before it makes it into our release line. Our last goal was to get it into the upcoming HBase 1.3. If you are relyi

Re: How to Intgrate HBase With SparkStreaming

2016-03-10 Thread Sean Busbey
Hi Rachana! For help with vendor provided add-ons, please use the given vendor's support mechanism. For things in Cloudera Labs, your best best for a starting place is: http://community.cloudera.com/t5/Cloudera-Labs/bd-p/ClouderaLabs On Thu, Mar 10, 2016 at 6:36 AM, Rachana Srivastava < racha

  1   2   3   >