Andor Molnar created HBASE-29960:
------------------------------------
Summary: java.lang.IllegalStateException: Should not call create
writer on secondary replicas or in read-only mode
Key: HBASE-29960
URL: https://issues.apache.org/jira/browse/HBASE-29960
Project: HBase
Issue Type: Sub-task
Components: master
Reporter: Andor Molnar
Assignee: Anuj Sharma
Unable to start Master on secondary replica cluster after some time. RS aborted
previously.
{noformat}
2026-03-04T19:35:49,601 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1]
regionserver.HStore: Created cacheConfig: cacheDataOnRead=true,
cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false,
cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for
column family state of region 1595e783b53d99cd5eef43b6debb2682
2026-03-04T19:35:49,603 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1]
compactions.CompactionConfiguration: size [minCompactSize:128 MB,
maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files
[minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio
5.000000; throttle point 2684354560; major period 604800000, major jitter
0.500000, min locality to compact 0.000000; tiered compaction: max_age
9223372036854775807, incoming window min 6, compaction policy for tiered window
org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy,
single output for minor true, compaction window factory
org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory,
region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName state
2026-03-04T19:35:49,603 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1]
regionserver.HStore: Store=1595e783b53d99cd5eef43b6debb2682/state, memstore
type=DefaultMemStore, storagePolicy=NONE, verifyBulkLoads=false,
parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE
2026-03-04T19:35:49,603 INFO [master/hbase-docker-2:16000:becomeActiveMaster]
regionserver.HRegion: Replaying edits from
file:/data-store/wal/MasterData_replica1/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/hbase-docker-2%2C16000%2C1772646163525.1772646165655
2026-03-04T19:35:49,641 INFO [master/hbase-docker-2:16000:becomeActiveMaster]
regionserver.HRegion: Flushing 1595e783b53d99cd5eef43b6debb2682 4/4 column
families, dataSize=10.48 KB heapSize=14.86 KB
2026-03-04T19:35:49,648 WARN [master/hbase-docker-2:16000:becomeActiveMaster]
regionserver.HRegion: Failed initialize of region=
master:store,,1.1595e783b53d99cd5eef43b6debb2682., starting to roll back
memstore
org.apache.hadoop.hbase.DroppedSnapshotException: region:
master:store,,1.1595e783b53d99cd5eef43b6debb2682.
at
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:3168)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2810)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEditsIfAny(HRegion.java:5608)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:1051)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:985)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7876)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegionFromTableDir(HRegion.java:7831)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:363)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:518)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:155)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1025)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2582)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:635)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
~[hbase-common-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at java.lang.Thread.run(Thread.java:840) ~[?:?]
Caused by: java.lang.IllegalStateException: Should not call create writer on
secondary replicas or in read-only mode
at
org.apache.hadoop.hbase.regionserver.storefiletracker.StoreFileTrackerBase.createWriter(StoreFileTrackerBase.java:145)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.StoreEngine.createWriter(StoreEngine.java:220)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.StoreFlusher.createWriter(StoreFlusher.java:76)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher.flushSnapshot(DefaultStoreFlusher.java:62)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:835)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:1986)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
at
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:3102)
~[hbase-server-4.0.0-alpha-1-SNAPSHOT.jar:4.0.0-alpha-1-SNAPSHOT]
... 14 more{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
