Re: RocksDB TTL not working

2016-03-11 Thread Yi Pan
Hi, Rohit, The log for RocksDB should show whether the compact happened or not. You can find the log in the container's runtime state-store directory here: /state///LOG My guess is that you might not have enough entries / writes to trigger the compaction yet. You can reach out to RocksDB communit

Re: RocksDB TTL not working

2016-03-11 Thread Rohit Bansal
I waited for a considerable timing, around 15-20 minutes. There were no logs of compaction though. How can I check if compaction occured or not ? On Sat, Mar 12, 2016 at 1:04 AM, Yi Pan wrote: > Hi, Rohit, > > RocksDB TTL is best-effort: > https://github.com/facebook/rocksdb/wiki/Time-to-Live. A

Re: RocksDB TTL not working

2016-03-11 Thread Yi Pan
Hi, Rohit, RocksDB TTL is best-effort: https://github.com/facebook/rocksdb/wiki/Time-to-Live. And the expired records are removed during compaction. I wonder in your test case whether the compaction has ever happened. How long did you wait to see whether records are gone or not? -Yi On Thu, Mar

Re: RocksDB TTL not working

2016-03-10 Thread Rohit Bansal
Navina, Please find my configurations file below - # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to

Re: RocksDB TTL not working

2016-03-10 Thread Navina Ramesh
Hi Rohit, Are you running samza 0.10.0 or the latest from trunk? It will be helpful to paste your config here. Please do not attach it to the email because the mail server filters attachments. Thanks! Navina On Thu, Mar 10, 2016 at 3:05 AM, Rohit Bansal wrote: > Hi, > > My messages are not get