RE: [SAMZA-690] Changelog topic creation should not be in the container code

Hi Yi, Thank you for your quick response! Your suggestions make a lot of sense, and I will begin implementing them right away : ) Met vriendelijke groet / Kind regards, Robert Žuljević Software Developer Address: Trifkovicev trg 6, 21000 Novi Sad, Serbia Tel.: +31 20 6701 947 | +381 21 2155 50

Review Request 35918: Monitoring page for REST API and the dashboard

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35918/ --- Review request for samza. Repository: samza Description --- Added new mo

Samza and sliding window

Hello, My apologies if I have raised it earlier. Here is the use case: I have a stream that is partitioned based on application name. I want to be able to count hte number of events happening for that particular application in the past 5 minutes (sliding window) and update either another topic or a

Re: Review Request 35918: SAMZA-709 Monitoring page for REST API and the dashboard

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35918/ --- (Updated June 26, 2015, 11:50 a.m.) Review request for samza. Summary (update

Re: what does the utilization metric in SamzaContainerMetrics show?

Thanks for your prompt reply. I just don’t see when will there be an idle time that is not added to the activeMs but is counted in the totalMs. Because as far as I can tell, if one of the process,window, or commit takes more time it will be reflected in the activeMs value as well. On 6/25/15, 7

Re: Samza and sliding window

Hi Shekar, Need a little more clarification. What do you mean by "a local cache"? Is it a db like MySQL, something like RocksDB, or even just in-memory? When you say "another topic", is this the topic consumed by the same Samza job as your 5-minutes-job, or in a separate job? What is the relatio

Best way to log from inside a Samza task?

Hello, I am working on a basic Samza task that pulls from one Kafka topic and writes to another. This task runs in Yarn but the Output topic does not contain any data.  In order to troubleshoot this more effectively I would like to log the incoming message as my example below. Ideally, I wou

Re: Best way to log from inside a Samza task?

Hey Jason, If you configure log4j as described here: http://samza.apache.org/learn/documentation/0.9/jobs/logging.html Your log statements will wind up in the samza-container logs which you can get to via the application maste

Re: Best way to log from inside a Samza task?

I was almost there. Got it now. Thanks for your help Rick.  Cheers,  Jason On Friday, Jun 26, 2558 at 11:43, Rick Mangi , wrote: Hey Jason, If you configure log4j as described here: http://samza.apache.org/learn/documentation/0.9/jobs/logging.html

[CANCEL][VOTE] Apache Samza 0.9.1 RC0

As discussed, this vote has been CANCELED. On 25 June 2015 at 16:34, Yan Fang wrote: > no objection from me. :) > > Thanks, > > Fang, Yan > yanfang...@gmail.com > > On Thu, Jun 25, 2015 at 4:18 PM, Yi Pan wrote: > >> Hi, all, >> >> I have been preparing for the new 0.9.1 RC1 and it is close to b

Review Request 35933: SAMZA-449 Expose RocksDB statistic

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35933/ --- Review request for samza. Repository: samza Description --- RocksDB stat

Re: Samza and sliding window

Yan, *What do you mean by "a local cache"? Is it a db like MySQL, something likeRocksDB, or even just in-memory?* Local cache as in Redis *When you say "another topic", is this the topic consumed by the same Samzajob as your 5-minutes-job, or in a separate job? What is the relationbetween the

Re: Best way to log from inside a Samza task?

If you do something like this in your log4j.xml the root controls samza’s logging and the logger controls your own… I haven’t managed to get the imx configuration working yet. > On Jun 26, 2015, at 1:50 PM, ja...@marketingscience.co wrote: >

Triggering emits for streaming window aggregates

Hi Julian, Even though this is a general question across all the streaming aggregates which utilize GROUP BY clause and a monotonic timestamp field for specifying the window, but I am going to stick to most basic example (which is from Calcite Streaming document). SELECT STREAM FLOOR(rowtime TO H

Re: Samza and sliding window

Hi Shekar, You can use Samza's local storage ( http://samza.apache.org/learn/documentation/0.9/container/state-management.html) to keep the window state and windowing ( http://samza.apache.org/learn/documentation/0.9/container/windowing.html) capabilities to handle the window advancement. During a

Re: Triggering emits for streaming window aggregates

Hi, Milinda, I thought that in your example, the ordering field is given in GROUP BY. Are we missing a way to pass the ordering field(s) to the LogicalAggregate? -Yi On Fri, Jun 26, 2015 at 10:49 AM, Milinda Pathirage wrote: > Hi Julian, > > Even though this is a general question across all th

Re: Samza and sliding window

Thanks Milinda. Is this feature available on 0.8 version of Samza? - Shekar On Fri, Jun 26, 2015 at 11:24 AM, Milinda Pathirage wrote: > Hi Shekar, > > You can use Samza's local storage ( > > http://samza.apache.org/learn/documentation/0.9/container/state-management.html > ) > to keep the windo

Re: Samza and sliding window

Never mind. I see it here: http://samza.apache.org/learn/documentation/0.8/container/windowing.html Thanks again Milinda. - Shekar On Fri, Jun 26, 2015 at 11:39 AM, Shekar Tippur wrote: > Thanks Milinda. > Is this feature available on 0.8 version of Samza? > > - Shekar > > On Fri, Jun 26, 201

Re: Triggering emits for streaming window aggregates

Hi Yi, In this specific case ordering is declared in the schema. Quoting from Calcite documentation Monotonic columns need to be declared in the schema. The monotonicity is enforced when records enter the stream and assumed by queries that read from that stream. We recommend

Re: Review Request 35918: SAMZA-709 Monitoring page for REST API and the dashboard

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35918/#review89590 --- docs/learn/documentation/versioned/jobs/web-ui-rest-api.md (line 33