Re: SIGSEGV in RocksDB when killing jobs

2016-09-14 Thread Tommy Becker
Thanks for the reply, Yi. It does indeed work if we remove calls to KeyValueStore.close(). As for why we're doing that, again mostly just for housekeeping. I haven't seen any guidance either way on whether StreamTasks should close the stores they use, and was unaware this was automatic. We can

Re: SIGSEGV in RocksDB when killing jobs

2016-09-14 Thread Yi Pan
Hi, Tommy, Thanks for reporting this. Definitely we can be more defensive in coding here. I just wonder what's the specific reason for you to call RocksDB store close() explicitly? As you see that SamzaContainer#shutdownStores already calling flush() and close() automatically. Does it work for you

SIGSEGV in RocksDB when killing jobs

2016-09-14 Thread Tommy Becker
While testing with Samza 0.10.1 I noticed the following crash whenever I would kill a job that uses a RocksDB store: # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x7eff66b6c27e, pid=20315, tid=139636974364416 # # JRE version: Java(TM) SE Runtim