Hi, Rohit,
The log for RocksDB should show whether the compact happened or not. You
can find the log in the container's runtime state-store directory here:
/state///LOG
My guess is that you might not have enough entries / writes to trigger the
compaction yet. You can reach out to RocksDB communit
Hi, Jack,
There have been asks similar to yours, like SAMZA-427. As fixed in
SAMZA-59, we also included metrics to report the count of deserialization
errors. If you are asking about the actual message that caused the error to
be reported, there has to be a different way. Options are:
1) write the
Hi all,
I have a StreamTask that uses *JsonSerde* to parse the input from a Kafka
topic. I notice that when the input is not a valid json, the task fails
with an exception on json parsing. If I use
*task.drop.deserialization.errors=**true*
in the configuration then the malformed json will be dr
Hi,
I am talking about REST APIs at this page :-
https://samza.apache.org/learn/documentation/0.10/jobs/web-ui-rest-api.html
How can I execute following rest calls :-
/metrics HahsMap that represents metrics for every 60 seconds.
/task-context HashMap that provides information about task context
Hi, Rohit,
On Thu, Mar 10, 2016 at 9:53 PM, Rohit Bansal
wrote:
> 1) Is it possible to analyze the metrics (graphs of messages , disk space
> and other details for performance / status check) ? In Application master
> in YARN UI, it contains only config information and not much details. Also,
>
I waited for a considerable timing, around 15-20 minutes. There were no
logs of compaction though. How can I check if compaction occured or not ?
On Sat, Mar 12, 2016 at 1:04 AM, Yi Pan wrote:
> Hi, Rohit,
>
> RocksDB TTL is best-effort:
> https://github.com/facebook/rocksdb/wiki/Time-to-Live. A
Hi, Rohit,
RocksDB TTL is best-effort:
https://github.com/facebook/rocksdb/wiki/Time-to-Live. And the expired
records are removed during compaction.
I wonder in your test case whether the compaction has ever happened. How
long did you wait to see whether records are gone or not?
-Yi
On Thu, Mar
