Hello,
I'm having trouble with commitAsync() not updating my partition offsets. I
pre-populate 1,000,000 strings on topic 'lowercaseStrings' across 4 partitions.
I check the offsets and they're fine--250K records/partition.
Then I run some code that uses a single-thread with blocking queue to
Hmm... gist didn't come thru for some reason.Trying agin:
gist.github.com/gzoller/93fe2392fd3606bcb3b879e4ab2f8f6e
From: Greg Zoller
To: "users@kafka.apache.org"
Sent: Thursday, April 7, 2016 5:25 PM
Subject: [0.9.0.1] Having problems with commitAsync() not updating of
Hello,
I'm trying to run the latest master build in github. I've got producer code
like below:
val props = Map( "bootstrap.servers" -> host, "key.serializer" ->
"org.apache.kafka.common.serialization.ByteArraySerializer",
"value.serializer" -> "org.apache.kafka.common.seriali
Sorry the formatting was all messed up.I re-tested this code with 0.9.0.1 and
it worked fine--KafkaProducer closed and committed the number of records
expected into the partitions.
So this seems like a SNAPSHOT issue. Will continue looking.
From: Greg Zoller
To: "users@kafka.apach
So I rebuilt last night with the latest from master branch.
Unfortunately same problem--producer doesn't seem to commit/close(). After
inserting a few records (which *seem* to go ok), close() times out and no
offsets are updated--still set to 0.
Any ideas?Thanks,Greg
From: Greg Z
:
{lowercaseStrings=LEADER_NOT_AVAILABLE}org.apache.kafka.common.errors.TimeoutException:
Failed to update metadata after 59860 ms.
From: Ismael Juma
To: users@kafka.apache.org; Greg Zoller
Sent: Wednesday, April 13, 2016 5:54 PM
Subject: Re: [0.10.1.0-SNAPSHOT] KafkaProducer.close() not co
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:155) at
java.lang.Thread.run(Thread.java:745)The offset of the record we just sent is:
null
So something is hanging up and then gets tied in knots when things finally shut
down.
From: Greg Zoller
To: "users@kafka.apache.org&quo
I have built 0.10.1.0-SNAPSHOT from scratch and used it with my KafkaProducer
code from 0.9.0.1.It compiled just fine but when run it hangs (times out
actually) on send(). I've created a gist below with a clip from the output in
comments at the end of the file.
Remember, this code worked flawle
GIST: https://gist.github.com/gzoller/145faef1fefc8acea212e87e06fc86e8
From: Greg Zoller
To: "users@kafka.apache.org"
Sent: Friday, April 15, 2016 5:51 PM
Subject: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)
I have built 0.10.1.0-SNAPSHOT from scratc
ok... one more attempt for a working link...
https://gist.github.com/gzoller/145faef1fefc8acea212e87e06fc86e8
(If this doesn't work please copy/paste link.)
From: Greg Zoller
To: "users@kafka.apache.org" ; Greg Zoller
Sent: Friday, April 15, 2016 5:53 PM
Subject: R
> Ismael
>
> On Fri, Apr 15, 2016 at 11:55 PM, Greg Zoller
> wrote:
>
>> ok... one more attempt for a working link...
>> https://gist.github.com/gzoller/145faef1fefc8acea212e87e06fc86e8
>> (If this doesn't work please copy/paste link.)
>>
>>
What is the broker version? Have you checked that there are no errors
> logged in the broker?
>
> Ismael
>
> On Fri, Apr 15, 2016 at 11:55 PM, Greg Zoller
> wrote:
>
>> ok... one more attempt for a working link...
>> https://gist.github.com/gzoller/145faef1fef
partition information. Not 100% sure but from the KafkaProducer code it
appears this pulls information from metadata, so if that's true I do have a
meaningful connection to my server and getting the metadata.
From: Greg Zoller
To: "users@kafka.apache.org"
Sent: Saturda
valid metadata.
Now the fun part... I'm going to try to zero in to find the build, and
therefore the change, that broke this functionality. More updates to follow...
Greg
From: Greg Zoller
To: "users@kafka.apache.org" ; Greg Zoller
Sent: Saturday, April 16, 2016
ne just before and see what
I get.
Greg
From: Ismael Juma
To: users@kafka.apache.org; Greg Zoller
Sent: Saturday, April 16, 2016 6:47 PM
Subject: Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)
That's interesting, thanks for investigating this. I had a look
if
configured. Otherwise, it will use the value # returned from
java.net.InetAddress.getCanonicalHostName().
I dunno what to say. I'll keep flipping this and have a friend confirm the
results. Is some code or script textually looking at this file (not parsing
it) for either of these 2 t
16 matches
Mail list logo
