Re: Hbase Migrations

2021-04-16 Thread Mallikarjun
> hbase org.apache.hadoop.hbase.mapreduce.SyncTable --sourcezkcluster= > $src_zk_addr *--dryrun=true* hdfs://$src_hdfs_ip:8020$hash_table_full_path > '$full_table_name' '$full_table_name' *If your source cluster < 2.1 (No serial replication)* you will have some

Re: HBase Operating System compatabiliity

2021-04-19 Thread Mallikarjun
Doesn't java philosophy of `*write once and run anywhere*` apply to hbase/hadoop? We have deployed our production setup on Debian 7/8/9 at different points of time. --- Mallikarjun On Tue, Apr 20, 2021 at 10:05 AM Debraj Manna wrote: > Hi > > Can someone let me know

Re: [SURVEY] The current usage of favor node balancer across the community

2021-04-26 Thread Mallikarjun
sted: 6k Tables Hosted: 87 Capacity: 250 TB (100TB used) --- Mallikarjun On Mon, Apr 26, 2021 at 9:15 AM 张铎(Duo Zhang) wrote: > As you all know, we always want to reduce the size of the hbase-server > module. This time we want to separate the balancer related code to another >

Re: [SURVEY] The current usage of favor node balancer across the community

2021-04-26 Thread Mallikarjun
Inline reply On Tue, Apr 27, 2021 at 1:03 AM Stack wrote: > On Mon, Apr 26, 2021 at 12:30 PM Stack wrote: > > > On Mon, Apr 26, 2021 at 8:10 AM Mallikarjun > > wrote: > > > >> We use FavoredStochasticBalancer, which by description says the same > t

Re: HotSpot detection/mitigation worker?

2021-05-17 Thread Mallikarjun
a 3 digit prefix based on table region range (000 - 999), would translate to *115-0QUPHSBTLGM* with murmurhash --- Mallikarjun On Tue, May 18, 2021 at 1:33 AM Bryan Beaudreault wrote: > Hey all, > > We run a bunch of big hbase clusters that get used by hundreds of product > teams for a

Re: HotSpot detection/mitigation worker?

2021-05-19 Thread Mallikarjun
Agree. It solves the problem in terms of randomizing distribution, but does not increase cardinality. On Tue, May 18, 2021 at 6:29 PM Bryan Beaudreault wrote: > Hi Mallikarjun, thanks for the response. > > I agree that it is hard to fully mitigate a bad rowkey design. We do make >

Re: Number of Regions with small Tables

2021-07-12 Thread Mallikarjun
. --- Mallikarjun On Mon, Jul 12, 2021 at 2:48 PM Christian Pfarr wrote: > Hello @all, > > i´ve a quesion regarding controlling the number of regions on small tables > in HBase. > But first i have to give you some hints about our Usecase. > > We´ve built a lambda architecture wit

Re: My Hbase replication is not working

2021-12-12 Thread Mallikarjun
Which version of hbase are you using? Is your replication serial enabled? --- Mallikarjun On Sun, Dec 12, 2021 at 1:54 PM Hamado Dene wrote: > Hi Hbase community, > > On our production installation we have two hbase clusters in two different > datacenters.The primary datacenter re

Re: My Hbase replication is not working

2021-12-12 Thread Mallikarjun
| Table Cfs | Exclude Table > Cfs | > | replicav1 | acv-db10-hn,acv-db11-hn,acv-db12-hn:2181:/hbase | | ENABLED > | true | UNLIMITED | true > > | > > Il domenica 12 dicembre 2021, 09:39:44 CET, Mallikarjun < > mallik.v.ar...@gmail.com> ha scritto: > > Wh

Re: My Hbase replication is not working

2021-12-12 Thread Mallikarjun
le utility" what do you mean?I am new to Hbase, > I am not yet familiar with all Hbase tools. > > > > Il domenica 12 dicembre 2021, 10:15:01 CET, Mallikarjun < > mallik.v.ar...@gmail.com> ha scritto: > > We have faced issues with serial replication when one

Re: My Hbase replication is not working

2021-12-12 Thread Mallikarjun
manually or the moment I disable serial mode, the regionservers will start > replicating from where they were blocked? > > > Il domenica 12 dicembre 2021, 10:55:05 CET, Mallikarjun < > mallik.v.ar...@gmail.com> ha scritto: > > https://hbase.apache.org/book.html#hashtab

Re: My Hbase replication is not working

2021-12-12 Thread Mallikarjun
6482 > > For serial replication, if we miss some wal files, it usually causes > replication to be stuck... > > Mallikarjun 于2021年12月12日周日 18:19写道: > > > Sync table is to be run manually when you think there can be > > inconsistencies between the 2 clusters only for sp

Re: Sync two cluster

2022-01-23 Thread Mallikarjun
You can do this several ways. I recommend you can do following way 1. Stop and remove existing replication. 2. Setup replication again and disable it temporarily 3. Export snapshot to secondary cluster. 4. Delete the table there. And restore from export snapshot 5. Enable replication. 6. You can c

Re: Hbase export snapshot

2022-02-09 Thread Mallikarjun
if there are no references for these files (which won't be created until snapshot is completed). *Fix*: Increase the above configuration value to how long export snapshot takes and then restart hmaster. Later on you can revert back. --- Mallikarjun On Wed, Feb 9, 2022 at 7:15 PM Hamado Den

Re: HBase Backup and Restore

2022-07-12 Thread Mallikarjun
3.0.0 should be the first release to include Backup and Restore. So far there are no releases. On Tue, Jul 12, 2022, 10:26 PM anup ahire wrote: > Hello, > > I am trying to understand, why is > https://github.com/apache/hbase/tree/master/hbase-backup part of master > but > getting left out from r

Re: HBase Backup and Restore

2022-07-12 Thread Mallikarjun
Backport is possible. We have backported to 2.1.x and using it. Waiting for some PRs to merge so that I can put some effort in getting the backport available for active 2.x releases. On Tue, Jul 12, 2022, 10:42 PM anup ahire wrote: > Thanks Mallikarjun. Will it be possible to backport this

HBase Blogs

2025-03-18 Thread Mallikarjun
t; - HBase Compaction Manager <https://blog.flipkart.tech/hbase-compaction-manager-8974d1a74a22> Presentations: - Multi Tenancy — Apache Hbase <https://www.youtube.com/watch?v=K5aVH86-USI> --- Mallikarjun