We are using 3.11.1 (which we recently upgraded from 3.11.0) and just
started experimenting with LeveledCompactionStrategy. After loading data
for 24 hours, we started getting the following error:
ERROR [CompactionExecutor:628] 2017-10-27 11:58:21,748
CassandraDaemon.java:228 - Exception in thread
Thread[CompactionExecutor:628,1,main] java.lang.UnsatisfiedLinkError: no
nio in java.library.path
This seems strange that we would encounter this kind error and are
wondering if we might be missing some Java classes not included in the
install or what else we might have done wrong.
It looks like writes to the cluster may have slowed to about 1/4 what it
had been doing sometime around the time when we started seeing this error.
We would be grateful for any pointers as to what to look at.
-- Thanks --
PS Following is more detail that might be helpful
We are running OpenJDK 8 on CentOS 7.
Following is the full traceback:
ERROR [CompactionExecutor:628] 2017-10-27 11:58:21,748
CassandraDaemon.java:228 - Exception in thread
Thread[CompactionExecutor:628,1,main]
java.lang.UnsatisfiedLinkError: no nio in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
~[na:1.8.0_144]
at java.lang.Runtime.loadLibrary0(Runtime.java:870) ~[na:1.8.0_144]
at java.lang.System.loadLibrary(System.java:1122) ~[na:1.8.0_144]
at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:612)
~[na:1.8.0_144]
at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:609)
~[na:1.8.0_144]
at java.security.AccessController.doPrivileged(Native Method)
~[na:1.8.0_144]
at sun.nio.fs.UnixCopyFile.<clinit>(UnixCopyFile.java:609)
~[na:1.8.0_144]
at
sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
~[na:1.8.0_144]
at java.nio.file.Files.move(Files.java:1395) ~[na:1.8.0_144]
at
org.apache.cassandra.io.util.FileUtils.atomicMoveWithFallback(FileUtils.java:207)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.io.util.FileUtils.renameWithConfirm(FileUtils.java:189)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.io.util.FileUtils.renameWithConfirm(FileUtils.java:177)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.io.sstable.metadata.MetadataSerializer.rewriteSSTableMetadata(MetadataSerializer.java:160)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.io.sstable.metadata.MetadataSerializer.mutateLevel(MetadataSerializer.java:136)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:165)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.LeveledManifest.replace(LeveledManifest.java:201)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.LeveledCompactionStrategy.replaceSSTables(LeveledCompactionStrategy.java:327)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.CompactionStrategyManager.handleListChangedNotification(CompactionStrategyManager.java:494)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.CompactionStrategyManager.handleNotification(CompactionStrategyManager.java:555)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.lifecycle.Tracker.notifySSTablesChanged(Tracker.java:410)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doCommit(LifecycleTransaction.java:227)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.io.sstable.SSTableRewriter.doCommit(SSTableRewriter.java:206)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.doCommit(CompactionAwareWriter.java:105)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:200)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.finish(Transactional.java:185)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.finish(CompactionAwareWriter.java:121)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:220)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:85)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:61)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:268)
~[apache-cassandra-3.11.1.jar:3.11.1]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_144]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_144]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[na:1.8.0_144]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[na:1.8.0_144]
at
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
[apache-cassandra-3.11.1.jar:3.11.1]
at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_144]
