Best way to log from inside a Samza task?

2015-06-26 Thread jason
);           collector.send(new OutgoingMessageEnvelope(OUTPUT_STREAM, msg));   } } Thanks,  Jason

Re: Best way to log from inside a Samza task?

2015-06-26 Thread jason
I was almost there. Got it now. Thanks for your help Rick.  Cheers,  Jason On Friday, Jun 26, 2558 at 11:43, Rick Mangi , wrote: Hey Jason, If you configure log4j as described here: http://samza.apache.org/learn/documentation/0.9/jobs/logging.html <http://samza.apache.

Re: Best way to log from inside a Samza task?

2015-07-01 Thread jason
keeper to see the messages in the originating topic they never make it to the destination and I am trying to find out why.  Thanks for your help, Jason On Friday, Jun 26, 2558 at 12:03, Rick Mangi , wrote: If you do something like this in your log

Re: Need Help with Samza - Changelog System

2016-02-05 Thread Jason Erickson
(ConsoleConsumer.scala:47) at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala) On Fri, Feb 5, 2016 at 3:42 PM, Ramesh Bhojan wrote: > Jason, > Can we please share more information about the exact stack trace and the > job configuration, especially the Kafka producer configuration for the &g

Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
I have a puzzling issue with one of my samza tasks. It works correctly except for messages on one partition. I have 9 partitions on the topic. If I send 1000 messages, I only receive about 890 of them. I have checked with kafka-console-consumer with partition keys that I know don’t get processed by

Re: Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
ion 0 But the number is steadily increasing (not a fixed amount, but consistently going up). I hope this gives a clue. On Mon, Apr 25, 2016 at 2:33 PM Jason Erickson wrote: > I have a puzzling issue with one of my samza tasks. It works correctly > except for messages on one partition. I h

Re: Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
I am running it with ThreadJobFactory. On Mon, Apr 25, 2016 at 4:34 PM Jason Erickson wrote: > I have a bit more information from the debug logs. For the partition that > isn't working (Partition 4), I see messages like this > from org.apache.samza.checkpoint.kafka.KafkaChe

Re: Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
o see what the > jobmodel is. > > On Mon, Apr 25, 2016 at 2:33 PM, Jason Erickson > wrote: > > > I have a puzzling issue with one of my samza tasks. It works correctly > > except for messages on one partition. I have 9 partitions on the topic. > If > > I send 1000

Re: Samza task not receiving on one partition

2016-04-29 Thread Jason Erickson
large enough value to consume each of the messages on the partition and restarted the job, it picked up where it had left off and everything started working as expected. ​ On Mon, Apr 25, 2016 at 6:41 PM Jason Erickson wrote: > My earlier answer to this was replying to the wrong message. I

Re: Samza task not receiving on one partition

2016-05-01 Thread Jason Erickson
Will do. On Fri, Apr 29, 2016 at 5:31 PM Yi Pan wrote: > Hi, Jason, > > Sorry to hear that it caused you a long time to figure this out. Could you > open a JIRA on this issue s.t. we can do some further investigation to see > whether there is explicit indication from Kafka c

Re: Java 8, RocksDB and Samza 0.10.0

2016-05-18 Thread Jason Erickson
We have had this issue, too. Did you only see the issue when you migrated to Java 8, or did you migrate to Java 8 and Samza 0.10 at the same time? On Tue, May 17, 2016 at 12:09 PM Louis Calisi wrote: > Hi, > > We are upgrading our pre-production environment to Java 8 and Samza 0.10. > We are us

Re: Java 8, RocksDB and Samza 0.10.0

2016-05-20 Thread Jason Erickson
be an issue with running inside a CDH 5.4.4 > container. > > I’d appreciate any help :-). > > > > Thanks, Louis > > > > > > > > > > > > On 5/18/16, 11:25 AM, "Jason Erickson" wrote: > > > > >We have had this issue, too.