GitHub user microwishing opened a pull request:
https://github.com/apache/kafka/pull/495
add example to send customized message by using serializer
based on 0.8.2.2. anyone can help?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/kafka trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/495.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #495
----
commit fd123965802f900fa474a8d5b1539e62d28bff73
Author: Ashish Singh <asi...@cloudera.com>
Date: 2015-09-10T20:14:24Z
KAFKA-1893: Allow regex subscriptions in the new consumer
Author: Ashish Singh <asi...@cloudera.com>
Reviewers: Jason Gustafson, Guozhang Wang, Edward Ribeiro, Ismael Juma
Closes #128 from SinghAsDev/KAFKA-1893
commit 845514d62329be8382e6d02b8041fc858718d534
Author: Jiangjie Qin <becket....@gmail.com>
Date: 2015-09-11T22:49:51Z
KAFKA-2389: remove commit type from new consumer.
A shot to remove commit type from new consumer. The coordinator constructor
takes a default offset commit callback mainly for testing purpose.
Author: Jiangjie Qin <becket....@gmail.com>
Reviewers: Ewen Cheslack-Postava, Jason Gustafson, Guohang Wang
Closes #134 from becketqin/KAFKA-2389
commit 6c1957d004f9b1a7d115543327cade274edc9cfd
Author: Dong Lin <lindon...@gmail.com>
Date: 2015-09-11T22:57:36Z
KAFKA-2278: JmxTool should support querying all objects when object name is
omitted
â¦ame is omitted
Author: Dong Lin <lindon...@gmail.com>
Reviewers: Aditya Auradkar, Manikumar Reddy, Guozhang Wang
Closes #181 from lindong28/KAFKA-2278
commit 65bf3afe86ef883136fcd6bc857724b25e750bd7
Author: Ismael Juma <ism...@juma.me.uk>
Date: 2015-09-11T23:08:00Z
KAFKA-2440; Use `NetworkClient` instead of `SimpleConsumer` to fetch data
from replica
Author: Ismael Juma <ism...@juma.me.uk>
Reviewers: Aditya Auradkar <aaurad...@linkedin.com>, Jun Rao
<jun...@gmail.com>
Closes #194 from ijuma/kafka-2440-use-network-client-in-fetcher
commit b7d4043d8da1d296519faf321e9f0f7188d7d67a
Author: Parth Brahmbhatt <brahmbhatt.pa...@gmail.com>
Date: 2015-09-13T04:58:34Z
KAFKA-2538: Fixing a compilation error in trunk.
Author: Parth Brahmbhatt <brahmbhatt.pa...@gmail.com>
Reviewers: Guozhang Wang
Closes #208 from Parth-Brahmbhatt/KAFKA-2538
commit d88b5bdfde0b6d020e687f6d59ad88d577910ae9
Author: jholoman <jeff.holo...@gmail.com>
Date: 2015-09-14T20:14:53Z
KAFKA-2504: Stop logging WARN when client disconnects
Author: jholoman <jeff.holo...@gmail.com>
Reviewers: Gwen Shapira
Closes #211 from jholoman/KAFKA-2504
commit 7199c87c32b94daec612bc022607bb86103bd8b2
Author: Geoff Anderson <ge...@confluent.io>
Date: 2015-09-14T22:00:04Z
MINOR: Added scripts to automate Vagrant setup for system tests
Updated testing README accordingly.
Author: Geoff Anderson <ge...@confluent.io>
Reviewers: Ewen Cheslack-Postava, Gwen Shapira
Closes #201 from granders/minor-vagrant-package-script
commit b658e25207174578c26ea94a75e5b0ea10f06ba5
Author: Parth Brahmbhatt <brahmbhatt.pa...@gmail.com>
Date: 2015-09-14T22:02:32Z
KAFKA-2549: Fixing checkstyle failure resulting due to unused importsâ¦
⦠in Selector.
Author: Parth Brahmbhatt <brahmbhatt.pa...@gmail.com>
Reviewers: Gwen Shapira
Closes #215 from Parth-Brahmbhatt/KAFKA-2549
commit da39931afad8008bc2b385a75a462777be051435
Author: Mayuresh Gharat <gharatmayures...@gmail.com>
Date: 2015-09-16T17:31:57Z
KAFKA-2120; Add a request timeout to NetworkClient (KIP-19); reviewed by
Jason Gustafson, Ismael Juma, Joel Koshy, Jun Rao, and Edward Ribeiro
commit 9dbeb71ab258955e04b46991c1baf880b07633f4
Author: Joel Koshy <jjko...@gmail.com>
Date: 2015-09-17T21:36:01Z
Revert "KAFKA-2120; Add a request timeout to NetworkClient (KIP-19);
reviewed by Jason Gustafson, Ismael Juma, Joel Koshy, Jun Rao, and Edward
Ribeiro"
This reverts commit da39931afad8008bc2b385a75a462777be051435.
commit 9ae98685ec7882598aee80d11af41d7c0828e1b9
Author: Flavio Junqueira <f...@apache.org>
Date: 2015-09-21T18:59:59Z
KAFKA-2300: follow-up to clear the controller state upon resignment
I have reopened this issue because the controller isn't cleaning up the
state upon an exception and the test case was legitimately failing for me every
now and then. I'm proposing a change to fix this.
Author: fpj <f...@apache.org>
Author: flavio junqueira <f...@apache.org>
Reviewers: Ismael Juma, Gwen Shapira, Guozhang Wang
Closes #212 from fpj/2300
commit e18f6860c2b297cc2ce06f9f3cb37987af3bdbae
Author: Ashish Singh <asi...@cloudera.com>
Date: 2015-09-21T19:07:56Z
KAFKA-2533: Create a member Metadata.Listener inside KafkaConsumer
Author: Ashish Singh <asi...@cloudera.com>
Reviewers: Guozhang Wang
Closes #220 from SinghAsDev/KAFKA-2533
commit 6ec88f7f8a18be7aff12fb0c73fc8abd00ef62d2
Author: Jason Gustafson <ja...@confluent.io>
Date: 2015-09-21T20:14:17Z
KAFKA-2532; Remove Consumer reference from rebalance callback
Author: Jason Gustafson <ja...@confluent.io>
Reviewers: Ewen Cheslack-Postava, Onur Karaman, Guozhang Wang
Closes #203 from hachikuji/KAFKA-2532
commit 0990b6ba6a28276f79a1a8bfaf48455c6eddfa1f
Author: Parth Brahmbhatt <brahmbhatt.pa...@gmail.com>
Date: 2015-09-22T00:47:18Z
KAFKA-2211: Adding simpleAclAuthorizer implementation and test cases.
Author: Parth Brahmbhatt <brahmbhatt.pa...@gmail.com>
Reviewers: Ismael Juma <ism...@juma.me.uk>, Jun Rao <jun...@gmail.com>
Closes #195 from Parth-Brahmbhatt/KAFKA-2211
commit 4833d8a8c34b2fb86a5cf605ea5483d0b9eadc4f
Author: Flavio Junqueira <f...@apache.org>
Date: 2015-09-22T01:25:42Z
KAFKA-2558: ServerShutdownTest is failing intermittently
See jira for a description.
Author: fpj <f...@apache.org>
Reviewers: Onur Karaman, Ismael Juma, Guozhang Wang
Closes #224 from fpj/KAFKA-2558
commit 2837fa5a34420ea1ede90901ded6e9f3c94a3e7b
Author: Onur Karaman <okara...@linkedin.com>
Date: 2015-09-22T21:32:28Z
KAFKA-2557: separate REBALANCE_IN_PROGRESS and ILLEGAL_GENERATION error
codes
Author: Onur Karaman <okara...@linkedin.com>
Reviewers: Jiangjie Qin, Jason Gustafson, Guozhang Wang
Closes #222 from onurkaraman/KAFKA-2557
commit d1dd1e902685178a990861f9948fe07f820cf4ef
Author: Jason Gustafson <ja...@confluent.io>
Date: 2015-09-23T21:10:06Z
KAFKA-2403; Add support for commit metadata in KafkaConsumer
Author: Jason Gustafson <ja...@confluent.io>
Reviewers: Ismael Juma, Guozhang Wang
Closes #119 from hachikuji/KAFKA-2403
commit b9ceac3ace353526da9c5d0f5b486265c871793a
Author: Dong Lin <lindon...@gmail.com>
Date: 2015-09-23T23:53:05Z
KAFKA-2390; OffsetOutOfRangeException should contain the Offset and
Partition info.
Author: Dong Lin <lindon...@gmail.com>
Author: Dong Lin <lind...@cis.upenn.edu>
Reviewers: Jason Gustafson, Ismael Juma, Guozhang Wang
Closes #118 from lindong28/KAFKA-2390
commit 54dd6e3ad7038ce4a32108b44153ec81caff2c68
Author: Ismael Juma <ism...@juma.me.uk>
Date: 2015-09-24T16:25:11Z
KAFKA-2576; ConsumerPerformance hangs when SSL enabled for Multi-Partition
Topic
We now write to the channel with an empty buffer when
there are pending bytes remaining and all data has been
sent.
Author: Ismael Juma <ism...@juma.me.uk>
Reviewers: Sriharsha Chintalapani <schintalap...@hortonworks.com>, Ben
Stopford <benstopf...@gmail.com>, Jun Rao <jun...@gmail.com>
Closes #236 from ijuma/kafka-2576-ssl-multi-partition-topic-hang
commit 1daf6ac510602ee27210f069bbe7415d4610fbea
Author: flavio junqueira <f...@apache.org>
Date: 2015-09-24T17:14:23Z
KAFKA-1387: Kafka getting stuck creating ephemeral node it has already
created when two zookeeper sessions are established in a very short period of
time
This is a patch to get around the problem discussed in the KAFKA-1387 jira.
The tests are not passing in my box when I run them all, but they do pass when
I run them individually, which indicates that there is something leaking from a
test to the next. I still need to work this out and also work on further
testing this. I wanted to open this PR now so that it can start getting
reviewed.
Author: flavio junqueira <f...@apache.org>
Author: fpj <f...@apache.org>
Author: Flavio Junqueira <f...@apache.org>
Reviewers: Ismael Juma <ism...@juma.me.uk>, Guozhang Wang
<wangg...@gmail.com>, Jun Rao <jun...@gmail.com>
Closes #178 from fpj/1387
commit 8943b08c9fbd31f7c50d5e06934a5fc225d56460
Author: Ismael Juma <ism...@juma.me.uk>
Date: 2015-09-24T17:35:05Z
KAFKA-2548; kafka-merge-pr tool fails to update JIRA with fix version
0.9.0.0
Simplified the logic to choose the default fix version. We just hardcode
it for `trunk` and try to compute it based on the branch name for the
rest.
Removed logic that tries to handle forked release branches as it
seems to be specific to how the Spark project handles their JIRA.
Author: Ismael Juma <ism...@juma.me.uk>
Reviewers: Guozhang Wang
Closes #238 from ijuma/kafka-2548-merge-pr-tool-4-segment-fix-version
commit ac757eb19ec50b79ab2b5336fa4d7411cd99456d
Author: Manikumar reddy O <manikumar.re...@gmail.com>
Date: 2015-09-24T19:38:27Z
KAFKA-2554: change 0.8.3 to 0.9.0 in ApiVersion and other files
Updated the version from 0.8.3 to 0.9.0. in ApiVersion. Also updated in
gradle.propeties.
Author: Manikumar reddy O <manikumar.re...@gmail.com>
Reviewers: Ismael Juma, Gwen Shapira
Closes #237 from omkreddy/KAFKA-2554
commit bcf374da9e0d9ec8d13ecdaf4a1a15691549442b
Author: Dong Lin <lindon...@gmail.com>
Date: 2015-09-24T21:40:03Z
KAFKA-2390; followup; add unit test for OffsetOutOfRange exception
Author: Dong Lin <lindon...@gmail.com>
Reviewers: Jason Gustafson, Guozhang Wang
Closes #239 from lindong28/KAFKA-2390-followup
commit 48b4d6938dfb9dc72c941e979ff0d0c4d921f743
Author: Ewen Cheslack-Postava <m...@ewencp.org>
Date: 2015-09-25T02:01:11Z
KAFKA-2373: Add Kafka-backed offset storage for Copycat.
Author: Ewen Cheslack-Postava <m...@ewencp.org>
Reviewers: Gwen Shapira, James Cheng
Closes #202 from ewencp/kafka-2373-copycat-distributed-offset
commit 18d370124b51a97eb0522c220eb0ca619e315c6a
Author: Ashish Singh <asi...@cloudera.com>
Date: 2015-09-25T02:16:28Z
KAFKA-2571; KafkaLog4jAppender dies while specifying acks config
Author: Ashish Singh <asi...@cloudera.com>
Reviewers: Ewen Cheslack-Postava, Gwen Shapira
Closes #231 from SinghAsDev/KAFKA-2571
commit fe798641a2ba5e60940fa91f5f01a14bcf98cf3e
Author: Jason Gustafson <ja...@confluent.io>
Date: 2015-09-25T02:26:07Z
KAFKA-2579; prevent unauthorized clients from joining groups
Author: Jason Gustafson <ja...@confluent.io>
Reviewers: Gwen Shapira
Closes #240 from hachikuji/KAFKA-2579
commit 7e453df3179efed92d5bbe4ce9ee1d90a07cd503
Author: Jason Gustafson <ja...@confluent.io>
Date: 2015-09-25T18:08:24Z
KAFKA-2409; have KafkaConsumer.committed return null when there is no commit
Author: Jason Gustafson <ja...@confluent.io>
Reviewers: Onur Karaman, Guozhang Wang
Closes #243 from hachikuji/KAFKA-2409
commit a07fbd0f19962037ec386b1814dc6c95749c91a3
Author: Jiangjie Qin <becket....@gmail.com>
Date: 2015-09-25T19:01:41Z
KAFKA-2555: Fix infinite recursive ensurePartitionAssignment in callback's
commitSync
hachikuji ewencp I found this problem when adding new consumer to mirror
maker which commits offset in the rebalance callback. It is not clear to me why
we are triggering rebalance for commitSync() and fetchCommittedOffset(). Can
you help review to see if I miss something?
Regarding commitSync, After each poll() the partitions will be either
assigned to a consumer or it will be already revoked. As long as user is using
internal offset map, the offset map will always be valid. i.e. the offset map
will always only contain the assigned partitions when commitSync is called.
Hence there is no need to trigger a rebalance in commitSync().
The same guarantee also apply to fetchCommittedOffset(), isn't the only
requirement is to ensure we know the coordinator?
Another related issue is that today the IllegalGenerationIdException is a
bit confusing. When we receive an IllegalGenerationIdException from heartbeat,
we need to use that same generation Id to commit offset and the coordinator
will take it. So the generation ID was not really illegal. I will file a ticket
for this issue.
Author: Jiangjie Qin <becket....@gmail.com>
Reviewers: Jason Gustafson, Guozhang Wang
Closes #221 from becketqin/KAFKA-2555
commit 10d5deac0c00a0f651be1857fbdde6c74d7e9dac
Author: Jason Gustafson <ja...@confluent.io>
Date: 2015-09-25T21:06:07Z
HOTFIX: remove unused import causing checkstyle to fail
Author: Jason Gustafson <ja...@confluent.io>
Reviewers: Guozhang Wang
Closes #244 from hachikuji/hotfix-checkstyle
commit ad120d5789306209ab8d110fcbd86d453d01641b
Author: Jason Gustafson <ja...@confluent.io>
Date: 2015-09-25T22:40:38Z
KAFKA-2582; ConsumerMetdata authorization error not returned to user
Author: Jason Gustafson <ja...@confluent.io>
Reviewers: Jun Rao <jun...@gmail.com>
Closes #245 from hachikuji/KAFKA-2582
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
