I downloaded the latest 0.8 snapshot and I want to build using Maven:
./sbt make-pom
Generates a bunch of pom.xml files but when I try to open one of them in
IntelliJ they are not recognized. Do I need to do any other step? Which
pom do I need to open?
Thanks!
Florin
Thanks Dragos, I've been using that plugin before, that will work on a
developer's machine when you try to build and debug the project but I also
need this to work with my automated build system.
That's why I need maven to work.
I've made a bit more progress:
> cd kafka
> ./sbt make-pom
> cd core
Hello Kafka wizards!
Congratulations on achieving beta on the 0.8 release! We've been waiting too
long for it!
I have two questions regarding the high level consumer in 0.8 used from scala:
I found this example on how to use the high level consumer from Java:
https://cwiki.apache.org/confluence
This might work OK for 0.7 but you might run into trouble with 0.8 when
replication is enabled. Make sure you test all the different scenarios for
failure. See the previous discussion thread "Kafka 0.8 Failover Behavior".
Let us know how it works for you.
Cheers!
Florin
On 6/24/13 4:21 AM, "Han
I got the same error but I think I had a different issue than you: My code
was written for kafka 0.7 and when I switched to 0.8 I changed the
"zk.connect" property to "metadata.broker.list" but left it with the same
value (which was of course the zookeeper's host and port). In other words
a "pilot
oducerConfig.(ProducerConfig.scala:66)
>> at kafka.producer.ProducerConfig.(ProducerConfig.scala:56)
>> at com.pearson.firehose.KafkaProducer.(KafkaProducer.java:21)
>> at com.pearson.firehose.KafkaProducer.main(KafkaProducer.java:40)
>>
>> So we just added 'me
Quick search for "kafka s3 consumer" brings up a bunch of Github projects.
If you don't like any, I would write a kafka consumer in java that writes
to s3. Probably less than 200 lines of code.
F.
On 6/25/13 1:50 PM, "Alan Everdeen" wrote:
>In my application, I have logs that are sent as kafka
Hello,
I'm going through a series of tests with Kafka 0.8 to see what the failure
cases are. One simple scenario is this:
1. Launch Zookeeper
2. Launch my consumer (written in scala) but don't launch a Kafka broker (I am
not using replication in my configuration).
What happens in this particul
Thanks Jay, this is helpful information. Controlling when offsets are committed
is possible only with the SimpleConsumer, correct? I believe that the
ConsumerConnector (the high level consumer) commits the offsets automatically.
It would be nice to have a hook into it that I can override to let
Yes, I think these are two separate issues.
F.
On 7/16/13 11:32 AM, "Joel Koshy" wrote:
>From a user's perspective, ConsumerRebalanceException is a bit cryptic
>-I think the other thread was to provide a more informative message
>and also be able to recover when a broker does come up (fixed in
You can set the "consumer.timeout.ms" to have a ConsumerTimeoutException thrown
if the broker doesn't respond within that time period:
var done = False
val consumerIterator = initConsumer()
while(true) {
try {
val messageAndMetadata = consumerIterator.next() //
gt;> Kafka code cleanly loaded to Intellij after doing "./sbt gen-idea".
>>> Were
>>>> you able to do that successfully?
>>>>
>>>> Thanks,
>>>>
>>>> Jun
>>>>
>>>>
>>>> On Wed, Jun 12, 201
Does anybody on the Kafka team have any insight into this issue? I'm
stuck, so any help is very much appreciated.
Thanks!
Florin
On 8/7/13 12:07 AM, "Florin Trofin" wrote:
>An update on this issue: I still can't build the 0.8 branch using Maven.
>My automated bui
13 matches
Mail list logo
