489MB key seems huge. Unlikely it’s really that large. If it’s happening on multiple servers it’d be interesting to see the schema and/or saved cache file if it’s not incredibly sensitive
> On Jan 23, 2020, at 3:48 AM, Shalom Sagges <shalomsag...@gmail.com> wrote: > > > Hi All, > > Cassandra 3.11.4. > On one of our clusters, during startup, I see two types of "Harmless error" > notification regarding the keycache: > > Server 1: > > INFO [pool-3-thread-1] 2020-01-23 04:34:46,167 AutoSavingCache.java:263 - > Harmless error reading saved cache /path/to/saved_caches/KeyCache-e.db > java.lang.NegativeArraySizeException: null > at > org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:401) > at > org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:472) > at > org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:220) > at > org.apache.cassandra.cache.AutoSavingCache$3.call(AutoSavingCache.java:165) > at > org.apache.cassandra.cache.AutoSavingCache$3.call(AutoSavingCache.java:161) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > INFO [pool-3-thread-1] 2020-01-23 04:34:46,168 AutoSavingCache.java:174 - > Completed loading (188 ms; 10916 keys) KeyCache cache > > > Server 2: > > INFO [pool-3-thread-1] 2020-01-15 11:18:35,797 AutoSavingCache.java:263 - > Harmless error reading saved cache /path/to/saved_caches//KeyCache-e.db > java.io.IOException: Corrupted key cache. Key length of 489735494 is longer > than maximum of 65535 > at > org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:469) > at > org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:220) > at > org.apache.cassandra.cache.AutoSavingCache$3.call(AutoSavingCache.java:165) > at > org.apache.cassandra.cache.AutoSavingCache$3.call(AutoSavingCache.java:161) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > INFO [pool-3-thread-1] 2020-01-15 11:18:35,799 AutoSavingCache.java:174 - > Completed loading (285 ms; 20681 keys) KeyCache cache > > The KeyCache size is a lot less than max default (100MB). So does this mean > that the key itself is the culprit? > > I'd really appreciate some guidance on what this message actually means in > the logs during startup and what problems may arise from it. > I see that one of the nodes experiences high CPU load and even gets kernel > panic from time to time, so I want to understand if the above may cause such > issues. > > Thanks a lot! >
