AFAIK we have not seen this issue before. Will take a look at this. Regards, Eric
On Fri, Oct 14, 2016 at 1:03 PM, Kapil Goyal <goy...@vmware.com> wrote: > Thanks Anil. > > Is this a known issue and is there any documentation on it? Does this > issue not impact Geode? > > Regards > Kapil > > From: Anilkumar Gingade <aging...@pivotal.io> > Reply-To: "user@geode.incubator.apache.org" <user@geode.incubator.apache. > org> > Date: Friday, October 14, 2016 at 10:59 AM > To: "user@geode.incubator.apache.org" <user@geode.incubator.apache.org> > Subject: Re: GemFire persisted data corruption - how to debug? > > Kapil, > > This is related to GemFire 8.2. If its a critical issue, please reach-out > to GemFire support so that it will be tracked and addressed in time. > > Can you see this with Geode versions, this helps to eliminate/identify the > version where the issues i happening. > > Is it possible for you to share your .xml and persistent files? > > Thanks, > -Anil. > > > > > On Thu, Oct 13, 2016 at 6:46 PM, Kapil Goyal <goy...@vmware.com> wrote: > >> Hi Folks, >> >> >> >> I am doing some crash testing with a single cache node of GemFire, where >> I power off the VM where cache is running and then bring it back up. Upon >> restart, GemFire refuses to come up with this error: >> >> >> >> Caused by: java.lang.NullPointerException >> >> at com.gemstone.gemfire.internal.util.concurrent.CustomEntryCon >> currentHashMap.keyHash(CustomEntryConcurrentHashMap.java:228) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.AbstractRegionEntry$Hash >> RegionEntryCreator.keyHashCode(AbstractRegionEntry.java:934) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.util.concurrent.CustomEntryCon >> currentHashMap.get(CustomEntryConcurrentHashMap.java:1447) >> ~[gemfire-8.2.0.2.jar:?] >> >> at >> com.gemstone.gemfire.internal.cache.AbstractRegionMap.getEntry(AbstractRegionMap.java:368) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.AbstractLRURegionMap.get >> Entry(AbstractLRURegionMap.java:47) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.PlaceHolderDiskRegion.ge >> tDiskEntry(PlaceHolderDiskRegion.java:93) ~[gemfire-8.2.0.2.jar:?] >> >> at >> com.gemstone.gemfire.internal.cache.Oplog.readModifyEntry(Oplog.java:2779) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.Oplog.readCrf(Oplog.java:1957) >> ~[gemfire-8.2.0.2.jar:?] >> >> at >> com.gemstone.gemfire.internal.cache.Oplog.recoverCrf(Oplog.java:2270) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.PersistentOplogSet.recov >> erOplogs(PersistentOplogSet.java:459) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.PersistentOplogSet.recov >> erRegionsThatAreReady(PersistentOplogSet.java:367) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.DiskStoreImpl.recoverReg >> ionsThatAreReady(DiskStoreImpl.java:2065) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.DiskStoreImpl.initialize >> IfNeeded(DiskStoreImpl.java:2052) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.DiskStoreImpl.doInitialR >> ecovery(DiskStoreImpl.java:2057) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.DiskStoreFactoryImpl.cre >> ate(DiskStoreFactoryImpl.java:135) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.xmlcache.CacheCreation.c >> reateDiskStore(CacheCreation.java:650) ~[gemfire-8.2.0.2.jar:?] >> >> at >> com.gemstone.gemfire.internal.cache.xmlcache.CacheCreation.create(CacheCreation.java:425) >> ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.xmlcache.CacheXmlParser. >> create(CacheXmlParser.java:331) ~[gemfire-8.2.0.2.jar:?] >> >> at com.gemstone.gemfire.internal.cache.GemFireCacheImpl.loadCac >> heXml(GemFireCacheImpl.java:4248) ~[gemfire-8.2.0.2.jar:?] >> >> at >> org.springframework.data.gemfire.CacheFactoryBean.init(CacheFactoryBean.java:306) >> ~[spring-data-gemfire-1.5.2.RELEASE.jar:1.5.2.RELEASE] >> >> at >> org.springframework.data.gemfire.CacheFactoryBean.getObject(CacheFactoryBean.java:455) >> ~[spring-data-gemfire-1.5.2.RELEASE.jar:1.5.2.RELEASE] >> >> >> >> It hints at GemFire data on disk being corrupted, so I used 'gfsh' to >> verify: >> >> >> >> gfsh>validate offline-disk-store --name=nsxDiskStore >> --disk-dirs=/common/nsxapi/data/self >> >> >> >> Validating nsxDiskStore >> >> /nsx_sys/ArrayListIDPriorityModel: entryCount=0 >> >> /nsx_sys/Crl: entryCount=0 >> >> /nsx_sys/Certificate: entryCount=1 >> >> …… >> >> Error in validating disk store nsxDiskStore is : null >> >> >> >> This confirms that the disk-store is corrupted, but doesn't give any more >> information to debug this further. How do I go about debugging this? Have >> you seen this before and are there any fixes/workarounds available? >> >> >> >> Thanks >> >> Kapil >> > >