Re: Java 8, RocksDB and Samza 0.10.0

2016-05-20 Thread Jason Erickson
be an issue with running inside a CDH 5.4.4 > container. > > I’d appreciate any help :-). > > > > Thanks, Louis > > > > > > > > > > > > On 5/18/16, 11:25 AM, "Jason Erickson" wrote: > > > > >We have had this issue, too.

Re: Java 8, RocksDB and Samza 0.10.0

2016-05-18 Thread Jason Erickson
We have had this issue, too. Did you only see the issue when you migrated to Java 8, or did you migrate to Java 8 and Samza 0.10 at the same time? On Tue, May 17, 2016 at 12:09 PM Louis Calisi wrote: > Hi, > > We are upgrading our pre-production environment to Java 8 and Samza 0.10. > We are us

Re: Samza task not receiving on one partition

2016-05-01 Thread Jason Erickson
onsumer on this problem > and we can report correctly? > > -Yi > > On Fri, Apr 29, 2016 at 2:45 PM, Jason Erickson > wrote: > > > The issue was that there was a message that exceeded the default > > max.message.bytes for a kafka consumer. But rather than give any sort

Re: Samza task not receiving on one partition

2016-04-29 Thread Jason Erickson
large enough value to consume each of the messages on the partition and restarted the job, it picked up where it had left off and everything started working as expected. ​ On Mon, Apr 25, 2016 at 6:41 PM Jason Erickson wrote: > My earlier answer to this was replying to the wrong message. I

Re: Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
o see what the > jobmodel is. > > On Mon, Apr 25, 2016 at 2:33 PM, Jason Erickson > wrote: > > > I have a puzzling issue with one of my samza tasks. It works correctly > > except for messages on one partition. I have 9 partitions on the topic. > If > > I send 1000

Re: Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
I am running it with ThreadJobFactory. On Mon, Apr 25, 2016 at 4:34 PM Jason Erickson wrote: > I have a bit more information from the debug logs. For the partition that > isn't working (Partition 4), I see messages like this > from org.apache.samza.checkpoint.kafka.KafkaChe

Re: Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
ion 0 But the number is steadily increasing (not a fixed amount, but consistently going up). I hope this gives a clue. On Mon, Apr 25, 2016 at 2:33 PM Jason Erickson wrote: > I have a puzzling issue with one of my samza tasks. It works correctly > except for messages on one partition. I h

Samza task not receiving on one partition

2016-04-25 Thread Jason Erickson
I have a puzzling issue with one of my samza tasks. It works correctly except for messages on one partition. I have 9 partitions on the topic. If I send 1000 messages, I only receive about 890 of them. I have checked with kafka-console-consumer with partition keys that I know don’t get processed by

Re: Need Help with Samza - Changelog System

2016-02-05 Thread Jason Erickson
;> >> http://stackoverflow.com/questions/35168641/is-there-a-configuration-setting-to-allow-large-values-in-my-samza-store >> >> Thanks, >> Ramesh >> > > -- Thanks, Jason Erickson