Re: [VOTE] Apache Samza 0.9.0 RC0

2015-03-31 Thread Ash W Matheson
Of say yes, is been a few days with little traffic on the topic. On Mar 31, 2015 9:18 AM, "Chris Riccomini" wrote: > Hey all, > > Is the vote done? > > Cheers, > Chris > > On Mon, Mar 30, 2015 at 2:10 PM, Chris Riccomini > wrote: > > > +1 > > > > 1. Validated hello-samza works with 0.9.0 Maven b

Re: New to Samza/Yarn and having Kafka issues

2015-03-24 Thread Ash W Matheson
y patch regarding exactly that problem - > config validation. > > On Mon, Mar 23, 2015 at 10:04 PM, Ash W Matheson > wrote: > > > just to clarify, adding: > > > > serializers.registry.string.class=org.apache.samza. > > serializers.StringSerdeFactory > > syste

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
got the start of a java based DataPusher built as well. On Mon, Mar 23, 2015 at 9:40 PM, Ash W Matheson wrote: > Huzzah! I ... have ... text showing! > > This has been enough of a trial that I think I'll convert this into a very > simple sample project for the repo, if you guys

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
yTopic', can you try setting the > > string serialization in your config ? > > > > > serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory > > > > systems.kafka.streams.myTopic.samza.msg.serde=string > > > > > > On Mon, Mar

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
ng serialization in your config ? > > > serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory > > systems.kafka.streams.myTopic.samza.msg.serde=string > > > On Mon, Mar 23, 2015 at 9:17 PM, Ash W Matheson > wrote: > > > m

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
more info - new exception message: Exception in thread "main" org.apache.samza.system.SystemConsumersException: Cannot deserialize an incoming message. Updated the diff in pastebin with the changes. On Mon, Mar 23, 2015 at 8:41 PM, Ash W Matheson wrote: > Gah! Yeah, those were

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
move those lines as well? > > Navina > > On 3/23/15, 8:31 PM, "Ash W Matheson" wrote: > > >Just looking at the diff I posted and it's: > > > > > > 1. try { > > 2. - Map parsedJsonObject = > >parse(event.getRawEvent(

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
nObject = parse( event.getRawEvent()); I've removed the Map and added two System.out.println calls. So no, there shouldn't be any reference to Map parsedJsonObject = parse(event.getRawEvent()); in the source java file. On Mon, Mar 23, 2015 at 7:42 PM, Ash W Matheson wrote: > I'm i

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
ache.samza.container.TaskInstance$$anonfun$process$1.apply$mcV$sp(Tas > kInstance.scala:133) > > Did you make the changes to fix this error? Your patch doesn¹t seem to > have that. > Line 38 Map jsonObject = (Map) > envelope.getMessage(); > > > > Lmk so I can investigate f

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
If anyone's interested, I've posted a diff of the project here: http://pastebin.com/6ZW6Y1Vu and the python publisher here: http://pastebin.com/2NvTFDFx if you want to take a stab at it. On Mon, Mar 23, 2015 at 6:04 PM, Ash W Matheson wrote: > Ok, so very simple test, all runni

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
:290) I changed the systems.kafka.samza.msg.serde=json to 'string' a while back, but that caused a separate exception. However that was many, MANY attempts ago. On Mon, Mar 23, 2015 at 5:23 PM, Ash W Matheson wrote: > Ahh, I was going to add it to the run-class.sh script. > &

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
t; > > > On Mon, Mar 23, 2015 at 5:23 PM, Ash W Matheson > wrote: > > > Ahh, I was going to add it to the run-class.sh script. > > > > Yeah, it's already there by default: > > > > > > # Metrics >

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
trics metrics.reporter.jmx.class=org.apache.samza.metrics.reporter.JmxReporterFactory So, where would I see those metrics? On Mon, Mar 23, 2015 at 5:15 PM, Ash W Matheson wrote: > read: I'm a C++ programmer looking at Java for the first time in > 10 years > > On Mon, Mar 23, 2015 at 5:13 PM, A

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
read: I'm a C++ programmer looking at Java for the first time in > 10 years On Mon, Mar 23, 2015 at 5:13 PM, Ash W Matheson wrote: > I'm assuming I have Jmx defined ... where would that get set? > > On Mon, Mar 23, 2015 at 5:08 PM, Chinmay Soman > wrote: > >&g

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
is the > process method is not being called because somehow there's no incoming > data. I could be totally wrong of course. > > On Mon, Mar 23, 2015 at 4:28 PM, Ash W Matheson > wrote: > > > Just to be clear, here's what's changed from the default

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
ject.put("time", event.getTime()); // collector.send(new OutgoingMessageEnvelope(new SystemStream("kafka", "wikipedia-edits"), parsedJsonObject)); as well as the aforementioned changes to the log4j.xml file. The data pushed into the 'myTopic' topic is nothing more tha

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
you have been using hello samza, it should > have pulled it from Maven. > > Thanks, > Naveen > > On Mar 22, 2015, at 10:35 AM, Ash W Matheson > wrote: > > > Hey all, > > > > Evaluating Samza currently and am running into some odd issues. > >

Re: New to Samza/Yarn and having Kafka issues

2015-03-23 Thread Ash W Matheson
le consumer from > whatever node is processing your job. > > Other than that - we'll have to go back to debug mode to get more info. > > On Sun, Mar 22, 2015 at 7:21 PM, Ash W Matheson > wrote: > > > looks like somewhere between Friday and today some security sett

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
81 and 9092 on that remote host ? > Also, you might try giving an IP address instead. > > On Sun, Mar 22, 2015 at 1:24 PM, Ash W Matheson > wrote: > > > OK, so the logs are much more detailed and useful, but it's not making > any > > more sense: > > > > 2

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
e confused because I'm pushing data (from that python script) using the machine I'm running this test on. I'll do some more digging and report back the results. On Sun, Mar 22, 2015 at 11:55 AM, Ash W Matheson wrote: > Ignore that last email - was reading the page stupidly. > >

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
Ignore that last email - was reading the page stupidly. On Sun, Mar 22, 2015 at 11:52 AM, Ash W Matheson wrote: > Is there any easy way to do that without recompiling samza? I'm trying to > localize that into the 'hello-samza' and looking at > http://samza.apache.org/le

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
). On Sun, Mar 22, 2015 at 11:37 AM, Ash W Matheson wrote: > Sure - I'll do that in a bit and send it up to pastebin. > > On Sun, Mar 22, 2015 at 11:35 AM, Chinmay Soman > wrote: > >> Can you please enable debug level logging and paste the log? >> >> On Su

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
Sure - I'll do that in a bit and send it up to pastebin. On Sun, Mar 22, 2015 at 11:35 AM, Chinmay Soman wrote: > Can you please enable debug level logging and paste the log? > > On Sun, Mar 22, 2015 at 11:28 AM, Ash W Matheson > wrote: > > > No, it's behin

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
And the two hosts are the same - I should have clarified that. On Sun, Mar 22, 2015 at 11:28 AM, Ash W Matheson wrote: > No, it's behind some corporate stuff - I just redacted it so I could share > it up. > > On Sun, Mar 22, 2015 at 11:17 AM, Chinmay Soman > wrote: > &

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
typos. Are the 2 above hosts the same ? > > On Sun, Mar 22, 2015 at 11:08 AM, Ash W Matheson > wrote: > > > Also, here's the producer: http://pastebin.com/qMNJabTZ > > > > > > On Sun, Mar 22, 2015 at 10:57 AM, Ash W Matheson > > > wrote: > > &g

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
Also, here's the producer: http://pastebin.com/qMNJabTZ On Sun, Mar 22, 2015 at 10:57 AM, Ash W Matheson wrote: > Yep, first thing I checked (got bitten by that earlier in the week with no > data actually in the topic). > > On Sun, Mar 22, 2015 at 10:56 AM, Chinmay Soman >

Re: New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
--zookeeper localhost:2181 > --topic myTopic > > ./deploy/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181 > --topic myTopic --from-beginning > > I've seen cases where if the Kafka broker isn't shutdown properly, > something like this happens. > >

New to Samza/Yarn and having Kafka issues

2015-03-22 Thread Ash W Matheson
Hey all, Evaluating Samza currently and am running into some odd issues. I'm currently working off the 'hello-samza' repo and trying to parse a simple kafka topic that I've produced through an extenal java app (nothing other than a series of sentences) and it's failing pretty hard for me. The bas