Re: How do you serve the data computed by Samza?

2015-03-27 Thread Shekar Tippur
Felix/Jordan, 1 - 2 is exactly what I was looking for as well. I want to expose webservices call to Kafka/samza. As there is no concept of a session, I was wondering how to send back enriched data to the web services request. Or am I way off on this? Meaning, is this a completely wrong use case to

RE: How do you serve the data computed by Samza?

2015-03-27 Thread Felix GV
Hi Jordan, Thanks for your response (: I think I might not have done a good job at explaining the use case I'm interested in. The use case is the following: Samza does some computation (joins, counts, pattern detection, whatever the case may be...) and the output of that computation needs to b

Re: [VOTE] Apache Samza 0.9.0 RC0

2015-03-27 Thread Chris Riccomini
Hey Yan, Yea, could we delay until Monday? I have been doing a lot of burn-in, and have found some issues with the torture tests in SAMZA-394. The issues appear to be with the tests themselves, not data-loss/correctness issues in Samza, but I just want to make sure. Planning to run the burn-in ove

Re: [VOTE] Apache Samza 0.9.0 RC0

2015-03-27 Thread Jakob Homan
That would be great. I've been trying to get to this but have failed. I can definitely look at the release tomorrow. -jg On 27 March 2015 at 16:08, Yan Fang wrote: > Hi guys, > > It has been 72 hours. We got +1 from Yi Pan. Do we extend the voting to > this weekend ? > > Thanks, > Fang, Yan > y

Re: [VOTE] Apache Samza 0.9.0 RC0

2015-03-27 Thread Yan Fang
Hi guys, It has been 72 hours. We got +1 from Yi Pan. Do we extend the voting to this weekend ? Thanks, Fang, Yan yanfang...@gmail.com +1 (206) 849-4108 On Thu, Mar 26, 2015 at 11:07 PM, Yi Pan wrote: > I have ran the integration test suite w/ 0.9.0-rc0. There were some issues > related w/ the

Re: How do you serve the data computed by Samza?

2015-03-27 Thread Jordan Shaw
Felix, Here are my thoughts below 1 - 2) I think so far a majority of samza applications are internal so far. However I've developed a Samza Publisher for PubNub that would allow you to send data from process or window out over a Data Stream Network. Right now it looks something like this: (.send

How do you serve the data computed by Samza?

2015-03-27 Thread Felix GV
Hi Samza devs, users and enthusiasts, I've kept an eye on the Samza project for a while and I think it's super cool! I hope it continues to mature and expand as it seems very promising (: One thing I've been wondering for a while is: how do people serve the data they computed on Samza? More spe

Re: java.lang.NoClassDefFoundError on Yarn job

2015-03-27 Thread Chris Riccomini
Hey Jordi, "No FileSystem for scheme: http" means that your YARN NMs aren't configured with the http filesystem in your core-site.xml: fs.http.impl org.apache.samza.util.hadoop.HttpFileSystem As documented here: http://samza.apache.org/learn/tutorials/0.8/run-in-multi-

RE: Execute a Task Periodically rather than through a stream of events

2015-03-27 Thread Garry Turkington
Hi Phill, So to understand you want the ability to have a task method executed based on a variable timer for each stored message? There isn't direct support for that type of processing. One way of getting close may be to have your task implement WindowableTask(1) and in the window() method lo

Execute a Task Periodically rather than through a stream of events

2015-03-27 Thread Phill Tomlinson
Hi, I was wondering if it I was possible to execute a Samza task/stream on a periodic timer, rather than ingesting from a specific data source? My use case is if there is a stream that deals with certain events these events can store some state in a tasks local database. These events that go in

RE: java.lang.NoClassDefFoundError on Yarn job

2015-03-27 Thread Jordi Blasi Uribarri
I thought it was working, but not really. The job runs and I can see it on the web admin. But when it has to process a message it fails, It goes down and I get this exception: Application application_1427403490569_0002 failed 2 times due to AM Container for appattempt_1427403490569_0002_02

RE: java.lang.NoClassDefFoundError on Yarn job

2015-03-27 Thread Jordi Blasi Uribarri
Solved. My aplication was using 0.9.0 version of yarn. When downgraded to 0.8.0 it worked. Thanks, Jordi -Mensaje original- De: Jordi Blasi Uribarri [mailto:jbl...@nextel.es] Enviado el: viernes, 27 de marzo de 2015 9:05 Para: dev@samza.apache.org Asunto: RE: java.lang.NoClassDefFound

RE: java.lang.NoClassDefFoundError on Yarn job

2015-03-27 Thread Jordi Blasi Uribarri
I did the steps that were included in the case and I am getting the same error. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:191) at org.apac