Issue with corrupt message in Topic

2015-07-21 Thread Nicolas Phung
d an old topic talking about it but with no further step to resolve the issue. Do you have any informations regarding this ? Is it possible in Kafka to somehow reread the topic and drop corrupt message ? Regards, Nicolas PHUNG

Re: broker data directory

2015-07-21 Thread Nicolas Phung
Yes indeed. # A comma seperated list of directories under which to store log files log.dirs=/var/lib/kafka You can put several disk/partitions too. Regards, On Tue, Jul 21, 2015 at 4:37 PM, Yuheng Du wrote: > Just wanna make sure, in server.properties, the configuration > log.dirs=/tmp/kafka-

Re: KafkaProducer Retries in .9.0.1

2016-04-20 Thread Nicolas Phung
. I'm going to take a look if someone else has filed a related issue about it. Regards, Nicolas PHUNG On Thu, Apr 7, 2016 at 5:15 AM, christopher palm wrote: > Hi Thanks for the suggestion. > I lowered the broker message.max.bytes to be smaller than my payload so > th

Re: KafkaProducer Retries in .9.0.1

2016-04-20 Thread Nicolas Phung
> retriable errors. If a message is too large, retrying won't help (it will > still be too large). However, if a leader is not available, then a retry > will happen as the leader may be available then. > > Ismael > > On Wed, Apr 20, 2016 at 1:00 PM, Nicolas Phung > wro

Questions relating KStream-KTable join with Kafka-Streams

2016-07-19 Thread Nicolas PHUNG
hanks. Regards, Nicolas PHUNG

Re: Questions relating KStream-KTable join with Kafka-Streams

2016-07-20 Thread Nicolas PHUNG
n (ie, lookup for both directions), you can > > either use a KTable-KTable or KStream-KStream join. Not sure, if this > > might work for your use case. > > > > -Matthias > > > > > > On 07/19/2016 01:36 PM, Nicolas PHUNG wrote: > > > Hi, > > >

Re: Questions relating KStream-KTable join with Kafka-Streams

2016-07-20 Thread Nicolas PHUNG
join missed that was in the record stream (+you can't specify a windows for a KStream-KTable). On Wed, Jul 20, 2016 at 11:14 AM, Nicolas PHUNG wrote: > Hi, > > Thank you for your answer @Matthias. Indeed, I need a kind of symmetric > join. However, KStream-KStream join doesn'

Re: Questions relating KStream-KTable join with Kafka-Streams

2016-07-21 Thread Nicolas PHUNG
your same piece of > code), whereas the KStream is unbounded and hence you need to window it in > order to materialize it so that if there is a late record from the KTable, > it may still find the matching record from the windowed KStream. Is that > right? > > > Guozhang &