GitHub user kyleabcha opened a pull request:
https://github.com/apache/kafka/pull/3750
KafkaConsumer was hung when bootstrap servers was not existed
Could anyone help me on this?
We have an issue if we entered an non-existed host:port for
bootstrap.servers property on KafkaConsumer. The created KafkaConsumer was hung
forever.
**the debug message:**
java.net.ConnectException: Connection timed out: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at
org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(PlaintextTransportLayer.java:50)
at
org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel.java:95)
at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:359)
at org.apache.kafka.common.network.Selector.poll(Selector.java:326)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:432)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:208)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:199)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.awaitMetadataUpdate(ConsumerNetworkClient.java:134)
at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:223)
at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:200)
at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:286)
at
org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1078)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1043)
at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:675)
at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:382)
at
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:192)
[2017-08-28 09:20:56,400] DEBUG Node -1 disconnected.
(org.apache.kafka.clients.NetworkClient)
[2017-08-28 09:20:56,400] WARN Connection to node -1 could not be
established. Broker may not be available.
(org.apache.kafka.clients.NetworkClient)
[2017-08-28 09:20:56,400] DEBUG Give up sending metadata request since no
node is available (org.apache.kafka.clients.NetworkClient)
[2017-08-28 09:20:56,450] DEBUG Initialize connection to node -1 for
sending metadata request (org.apache.kafka.clients.NetworkClient)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/kafka trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/3750.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3750
commit de982ba3fbf99664f0aaa5aa4b72af8fd1881232
Author: Randall Hauch
Date: 2017-06-21T00:48:32Z
KAFKA-5472: Eliminated duplicate group names when validating connector
results
Kafka Connect was adding duplicate group names in the response from the
REST API's validation of connector configurations. This fixes the duplicates
and maintains the order of the `ConfigDef` objects so that the `ConfigValue`
results are in the same order.
This is a blocker and should be merged to 0.11.0.
Author: Randall Hauch
Reviewers: Ewen Cheslack-Postava
Closes #3379 from rhauch/KAFKA-5472
commit 76f6e14b07bd97d17f9275968a047d68b4658704
Author: Kelvin Rutt
Date: 2017-06-21T01:00:41Z
KAFKA-5413; Log cleaner fails due to large offset in segment file
the contribution is my original work and I license the work to the project
under the project's open source license.
junrao , I had already made the code change before your last comment. I've
done pretty much what you said, except that I've not used the current segment
because I wasn't sure if it will always be available.
I'm happy to change it if you prefer.
I've run all the unit and integration tests which all passed.
Author: Kelvin Rutt
Author: Kelvin Rutt
Reviewers: Jun Rao
Closes #3357 from kelvinrutt/kafka_5413_bugfix
commit cae5977ed0d6b63f992973800273769c970b0a0a
Author: Matthias J. Sax
Date: 2017-06-21T08:32:46Z
MINOR: explain producer naming within Streams
Author: Matthias J. Sax
Reviewers: Bill Bejeck , Damian Guy
