Yea, however I don't get async behavior. When kafka is down the log blocks, which is kinda nasty to my app.
On Tue Feb 24 2015 at 2:27:09 PM Joe Stein <joe.st...@stealth.ly> wrote: > Producer type isn't needed anymore with the new producer so in the the > logger properties just leave that out in 0.8.2 and it should work. > > On Tue, Feb 24, 2015 at 2:24 PM, Joe Stein <joe.st...@stealth.ly> wrote: > > > Interesting, looks like a breaking change from 0.8.1 > > https://github.com/apache/kafka/blob/0.8.1/core/src/ > main/scala/kafka/producer/KafkaLog4jAppender.scala > > to 0.8.2 > > https://github.com/apache/kafka/blob/0.8.2/core/src/ > main/scala/kafka/producer/KafkaLog4jAppender.scala > > > > On Tue, Feb 24, 2015 at 2:21 PM, Joe Stein <joe.st...@stealth.ly> wrote: > > > >> and kafka too :) > >> > >> On Tue, Feb 24, 2015 at 2:21 PM, Joe Stein <joe.st...@stealth.ly> > wrote: > >> > >>> are you including > >>> https://github.com/stealthly/scala-kafka/blob/master/build.gradle#L122 > >>> in your project? > >>> > >>> ~ Joe Stein > >>> - - - - - - - - - - - - - - - - - > >>> > >>> http://www.stealth.ly > >>> - - - - - - - - - - - - - - - - - > >>> > >>> On Tue, Feb 24, 2015 at 2:02 PM, Scott Chapman <sc...@woofplanet.com> > >>> wrote: > >>> > >>>> Yea, when I try to set type to async (exactly like the example) I get: > >>>> log4j:WARN No such property [producerType] in > >>>> kafka.producer.KafkaLog4jAppender. > >>>> > >>>> On Tue Feb 24 2015 at 1:35:54 PM Joe Stein <joe.st...@stealth.ly> > >>>> wrote: > >>>> > >>>> > Here is sample log4j.properties > >>>> > https://github.com/stealthly/scala-kafka/blob/master/src/tes > >>>> > t/resources/log4j.properties#L54-L67 > >>>> > > >>>> > I _almost_ have always pulled the class > >>>> > https://github.com/apache/kafka/blob/0.8.2/core/src/main/ > >>>> > scala/kafka/producer/KafkaLog4jAppender.scala > >>>> > internal > >>>> > to private repo and changed it as things came up... e.g. > setSource(), > >>>> > setTags() blah blah... > >>>> > > >>>> > Paul Otto has an open source version > >>>> > https://github.com/potto007/kafka-appender-layout that you could > try > >>>> out > >>>> > too that he built to tackle some of the layout things. > >>>> > > >>>> > ~ Joe Stein > >>>> > - - - - - - - - - - - - - - - - - > >>>> > > >>>> > http://www.stealth.ly > >>>> > - - - - - - - - - - - - - - - - - > >>>> > > >>>> > On Mon, Feb 23, 2015 at 4:42 PM, Alex Melville <amelvi...@g.hmc.edu > > > >>>> > wrote: > >>>> > > >>>> > > ^^ I would really appreciate this as well. It's unclear how to get > >>>> log4j > >>>> > > working with Kafka when you have no prior experience with log4j. > >>>> > > > >>>> > > On Mon, Feb 23, 2015 at 4:39 AM, Scott Chapman < > >>>> sc...@woofplanet.com> > >>>> > > wrote: > >>>> > > > >>>> > > > Thanks. But we're using log4j. I tried setting the type to async > >>>> but it > >>>> > > > generated a warning of no such field. Is there any real > >>>> documentation > >>>> > on > >>>> > > > the log4j appender? > >>>> > > > > >>>> > > > On Mon Feb 23 2015 at 2:58:54 AM Steven Schlansker < > >>>> > > > sschlans...@opentable.com> wrote: > >>>> > > > > >>>> > > > > We just configure our logback.xml to have two Appenders, an > >>>> > > AsyncAppender > >>>> > > > > -> KafkaAppender, and FileAppender (or ConsoleAppender as > >>>> > appropriate). > >>>> > > > > > >>>> > > > > AsyncAppender removes more failure cases too, e.g. a health > >>>> check > >>>> > > hanging > >>>> > > > > rather than returning rapidly could block you application. > >>>> > > > > > >>>> > > > > On Feb 22, 2015, at 11:26 PM, anthony musyoki < > >>>> > > anthony.musy...@gmail.com > >>>> > > > > > >>>> > > > > wrote: > >>>> > > > > > >>>> > > > > > Theres also another one here. > >>>> > > > > > > >>>> > > > > > https://github.com/danielwegener/logback-kafka-appender. > >>>> > > > > > > >>>> > > > > > It has a fallback appender which might address the issue of > >>>> Kafka > >>>> > > being > >>>> > > > > > un-available. > >>>> > > > > > > >>>> > > > > > > >>>> > > > > > On Mon, Feb 23, 2015 at 9:45 AM, Steven Schlansker < > >>>> > > > > > sschlans...@opentable.com> wrote: > >>>> > > > > > > >>>> > > > > >> Here’s my attempt at a Logback version, should be fairly > >>>> easily > >>>> > > > ported: > >>>> > > > > >> > >>>> > > > > >> https://github.com/opentable/ > otj-logging/blob/master/kafka/ > >>>> > > > > src/main/java/com/opentable/logging/KafkaAppender.java > >>>> > > > > >> > >>>> > > > > >> On Feb 22, 2015, at 1:36 PM, Scott Chapman < > >>>> sc...@woofplanet.com> > >>>> > > > > wrote: > >>>> > > > > >> > >>>> > > > > >>> I am just starting to use it and could use a little > >>>> guidance. I > >>>> > was > >>>> > > > > able > >>>> > > > > >> to > >>>> > > > > >>> get it working with 0.8.2 but am not clear on best > >>>> practices for > >>>> > > > using > >>>> > > > > >> it. > >>>> > > > > >>> > >>>> > > > > >>> Anyway willing to help me out a bit? Got a few questions, > >>>> like > >>>> > how > >>>> > > to > >>>> > > > > >>> protect applications from when kafka is down or > unreachable. > >>>> > > > > >>> > >>>> > > > > >>> It seems like a great idea for being able to get logs from > >>>> > existing > >>>> > > > > >>> applications to be collected by kafka. > >>>> > > > > >>> > >>>> > > > > >>> Thanks in advance! > >>>> > > > > >> > >>>> > > > > >> > >>>> > > > > > >>>> > > > > > >>>> > > > > >>>> > > > >>>> > > >>>> > >>> > >>> > >> > > >
