Navina, I created a pull request some time back and it's still probably the easiest way to see what I changed. Let me know if you still prefer a patch file attachment.
https://github.com/apache/samza/pull/6 Thanks, Edi On Tue, Feb 9, 2016 at 6:09 PM, Navina Ramesh <nram...@linkedin.com.invalid> wrote: > Thanks, Edi. > Not sure why we are running into this problem yet again. Looks like it has > to be a combination of OS and java options to reproduce this, related to > SAMZA-836. > Can you please attach the patch that you were trying with the latest repo? > it could be a different code path in the library that is causing this > issue. > > Navina > > On Tue, Feb 9, 2016 at 2:06 PM, Edi Bice <edi.b...@gmail.com> wrote: > > > Hi Navina, > > > > I did indeed came across the long thread dealing with this. And yes, > things > > were working fine after the rocksdb upgrade to 3.13.1 which I'm still > > using. Not sure what I changed that's causing this. I did merge latest > from > > upstream into my repo as well as exposed some RocksDb config though the > > failing jobs are not using. > > > > I'm using Red Hat Enterprise Linux 6.6 (gcc 4.4) and Oracle Java 8. > > > > Did open a JIRA: > > > > https://issues.apache.org/jira/browse/SAMZA-870 > > > > Edi > > > > On Mon, Feb 8, 2016 at 1:05 PM, Navina Ramesh > <nram...@linkedin.com.invalid > > > > > wrote: > > > > > Hi Edi, > > > I have seen this issue only before the rocksdb upgrade when the build > was > > > running on Linux boxes. > > > > > > What OS are you running on? And can you confirm the rocksdb version? > > > > > > If you are running on Linux with the correct version of rocksdb, please > > > open a JIRA ticket. I will try to reproduce on my end. > > > > > > Thanks! > > > Navina > > > > > > On Mon, Feb 8, 2016 at 6:33 AM, Edi Bice <edi.b...@gmail.com> wrote: > > > > > > > I'm running the latest master with a small patch of mine allowing for > > > > additional RocksDb config options. I deleted ~/.m2 and gradle cache > to > > > > avoid some issues I was running into. After rebuilding Samza, I'm > > getting > > > > the following exception on all my jobs: > > > > > > > > org.apache.samza.SamzaException: Error opening RocksDB store > > > > xxx/Partition_6, received the following exception from RocksDB > > > > org.rocksdb.RocksDBException: Invalid argument: Compression type > Snappy > > > is > > > > not linked with the binary. > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore$.openDB(RocksDbKeyValueStore.scala:81) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore.db$lzycompute(RocksDbKeyValueStore.scala:103) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore.db(RocksDbKeyValueStore.scala:103) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore.flush(RocksDbKeyValueStore.scala:195) > > > > at > > > > org.apache.samza.storage.kv.LoggedStore.flush(LoggedStore.scala:107) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.SerializedKeyValueStore.flush(SerializedKeyValueStore.scala:117) > > > > at > > > > org.apache.samza.storage.kv.CachedStore.flush(CachedStore.scala:194) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.NullSafeKeyValueStore.flush(NullSafeKeyValueStore.scala:82) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.KeyValueStorageEngine.flush(KeyValueStorageEngine.scala:123) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.KeyValueStorageEngine.close(KeyValueStorageEngine.scala:135) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.kv.KeyValueStorageEngine.stop(KeyValueStorageEngine.scala:129) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193) > > > > at > scala.collection.Iterator$class.foreach(Iterator.scala:727) > > > > at > > scala.collection.AbstractIterator.foreach(Iterator.scala:1157) > > > > at > > > > > > scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.TaskStorageManager.stopStores(TaskStorageManager.scala:193) > > > > at > > > > > > > > > > > > > > org.apache.samza.storage.TaskStorageManager.stop(TaskStorageManager.scala:197) > > > > at > > > > > > > > > > > > > > org.apache.samza.container.TaskInstance.shutdownStores(TaskInstance.scala:203) > > > > at > > > > > > > > > > > > > > org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689) > > > > at > > > > > > > > > > > > > > org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689) > > > > at > scala.collection.Iterator$class.foreach(Iterator.scala:727) > > > > at > > scala.collection.AbstractIterator.foreach(Iterator.scala:1157) > > > > at > > > > > > scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206) > > > > at > > > > > > > > > > > > > > org.apache.samza.container.SamzaContainer.shutdownStores(SamzaContainer.scala:689) > > > > at > > > > > org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:568) > > > > at > > > > > > > > > > > > > > org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:93) > > > > at > > > > > > org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:67) > > > > at > > > > org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala) > > > > > > > > > > > > > > > > -- > > > Navina R. > > > > > > > > > -- > Navina R. >
