Re: New Samza blog published - http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node

Ed, Nice work. On Tue, Aug 25, 2015 at 10:48 PM, Roger Hoover wrote: > Thanks for sharing! > > Tao, did you use YARN to run 15 containers or is there a way to have them > statically divide up the tasks? > > > > On Mon, Aug 24, 2015 at 12:03 PM, Ed Yakabosky < > eyakabo...@linkedin.com.invalid>

Re: New Samza blog published - http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node

Thanks for sharing! Tao, did you use YARN to run 15 containers or is there a way to have them statically divide up the tasks? On Mon, Aug 24, 2015 at 12:03 PM, Ed Yakabosky < eyakabo...@linkedin.com.invalid> wrote: > Hi Samza open source, > > I want to share that Tao Feng >

Re: Why do I always receive waring email?

I actually do not know... I receive it frequently as well... But since I still can get emails, ignoring it Fang, Yan yanfang...@gmail.com On Tue, Aug 25, 2015 at 1:59 PM, Selina Tech wrote: > Dear all: > > I received a few warning email as below. Does anyone know how should I > avoid t

Re: Keep samza container logs from being deleted

Also, I have YARN aggregated enabled. But because logs are gone locally, after the job is killed or failed. I don't have aggregated logs on HDFS. On Tue, Aug 25, 2015 at 5:39 PM, Chen Song wrote: > Thanks Navina. > > What I found is that containers logs were gone after days locally even > when t

Re: Keep samza container logs from being deleted

Thanks Navina. What I found is that containers logs were gone after days locally even when the job is still running. Chen On Mon, Aug 3, 2015 at 6:06 PM, Navina Ramesh wrote: > Hi Chen, > You can set the yarn.nodemanage.delete.debug-delay-sec config in > yarn-site.xml, in order to retain the l

Re: question on commit on changelog

Hi, Chen, The at-least-once semantics is always guaranteed by committing the offsets at the last step in the commit. Hence, flushing to local disk, changelog and output topics always need to succeed before the offsets are committed to checkpoint. If anything fails in-between, the offset will not b

Why do I always receive waring email?

Dear all: I received a few warning email as below. Does anyone know how should I avoid those waring email? Sincerely, Selina - -- - - - - - - Hi! This is the ezmlm program. I'm managing the dev@samza.apache.org mailing list. I'm working for my owner, who can be reached at dev-ow...@samza.a

Re: question on commit on changelog

Thanks Yi. Another follow up question. If 'checkpoint' and 'changelog' is managed separately (according to your explanation above), how do we support at least once processing? For example, what if the task commits offsets to checkpoint topic but the producer doesn't send all data in its buffer to

Re: Review Request 37604: SAMZA-760 Samza Container should catch Throwables instead of just catching Exceptions

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37604/ --- (Updated Aug. 25, 2015, 11:48 a.m.) Review request for samza. Changes ---

Re: SAMZA build failing!!!

Hi Raja, Which OS are you using? I suspect that the OS you are using is Windows. I see that one of the tests fails with the message: org.junit.ComparisonFailure: expected:<[/tmp/testing/state/testStore/]Partition_1> but was:<[\tmp\testing\state\testStore\]Partition_1> The only difference is in the

RE: SAMZA build failing!!!

Great! I shall try and keep the forum posted. Thanks. Regards, Raja Mahesh Aravapalli. -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com.INVALID] Sent: Tuesday, August 25, 2015 12:31 PM To: dev@samza.apache.org Subject: Re: SAMZA build failing!!! Yes! I don't think

Re: SAMZA build failing!!!

Yes! I don't think we have support building samza on Windows. The reason you see this error is due to getCanonicalPath() in this line - https://github.com/apache/samza/blob/master/samza-core/src/test/scala/org/apache/samza/config/factories/TestPropertiesConfigFactory.scala#L34 I believe on window