GitHub user microwishing opened a pull request:
https://github.com/apache/kafka/pull/495
add example to send customized message by using serializer
based on 0.8.2.2. anyone can help?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/kafka trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/495.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #495
----
commit fd123965802f900fa474a8d5b1539e62d28bff73
Author: Ashish Singh <[email protected]>
Date: 2015-09-10T20:14:24Z
KAFKA-1893: Allow regex subscriptions in the new consumer
Author: Ashish Singh <[email protected]>
Reviewers: Jason Gustafson, Guozhang Wang, Edward Ribeiro, Ismael Juma
Closes #128 from SinghAsDev/KAFKA-1893
commit 845514d62329be8382e6d02b8041fc858718d534
Author: Jiangjie Qin <[email protected]>
Date: 2015-09-11T22:49:51Z
KAFKA-2389: remove commit type from new consumer.
A shot to remove commit type from new consumer. The coordinator constructor
takes a default offset commit callback mainly for testing purpose.
Author: Jiangjie Qin <[email protected]>
Reviewers: Ewen Cheslack-Postava, Jason Gustafson, Guohang Wang
Closes #134 from becketqin/KAFKA-2389
commit 6c1957d004f9b1a7d115543327cade274edc9cfd
Author: Dong Lin <[email protected]>
Date: 2015-09-11T22:57:36Z
KAFKA-2278: JmxTool should support querying all objects when object name is
omitted
â¦ame is omitted
Author: Dong Lin <[email protected]>
Reviewers: Aditya Auradkar, Manikumar Reddy, Guozhang Wang
Closes #181 from lindong28/KAFKA-2278
commit 65bf3afe86ef883136fcd6bc857724b25e750bd7
Author: Ismael Juma <[email protected]>
Date: 2015-09-11T23:08:00Z
KAFKA-2440; Use `NetworkClient` instead of `SimpleConsumer` to fetch data
from replica
Author: Ismael Juma <[email protected]>
Reviewers: Aditya Auradkar <[email protected]>, Jun Rao
<[email protected]>
Closes #194 from ijuma/kafka-2440-use-network-client-in-fetcher
commit b7d4043d8da1d296519faf321e9f0f7188d7d67a
Author: Parth Brahmbhatt <[email protected]>
Date: 2015-09-13T04:58:34Z
KAFKA-2538: Fixing a compilation error in trunk.
Author: Parth Brahmbhatt <[email protected]>
Reviewers: Guozhang Wang
Closes #208 from Parth-Brahmbhatt/KAFKA-2538
commit d88b5bdfde0b6d020e687f6d59ad88d577910ae9
Author: jholoman <[email protected]>
Date: 2015-09-14T20:14:53Z
KAFKA-2504: Stop logging WARN when client disconnects
Author: jholoman <[email protected]>
Reviewers: Gwen Shapira
Closes #211 from jholoman/KAFKA-2504
commit 7199c87c32b94daec612bc022607bb86103bd8b2
Author: Geoff Anderson <[email protected]>
Date: 2015-09-14T22:00:04Z
MINOR: Added scripts to automate Vagrant setup for system tests
Updated testing README accordingly.
Author: Geoff Anderson <[email protected]>
Reviewers: Ewen Cheslack-Postava, Gwen Shapira
Closes #201 from granders/minor-vagrant-package-script
commit b658e25207174578c26ea94a75e5b0ea10f06ba5
Author: Parth Brahmbhatt <[email protected]>
Date: 2015-09-14T22:02:32Z
KAFKA-2549: Fixing checkstyle failure resulting due to unused importsâ¦
⦠in Selector.
Author: Parth Brahmbhatt <[email protected]>
Reviewers: Gwen Shapira
Closes #215 from Parth-Brahmbhatt/KAFKA-2549
commit da39931afad8008bc2b385a75a462777be051435
Author: Mayuresh Gharat <[email protected]>
Date: 2015-09-16T17:31:57Z
KAFKA-2120; Add a request timeout to NetworkClient (KIP-19); reviewed by
Jason Gustafson, Ismael Juma, Joel Koshy, Jun Rao, and Edward Ribeiro
commit 9dbeb71ab258955e04b46991c1baf880b07633f4
Author: Joel Koshy <[email protected]>
Date: 2015-09-17T21:36:01Z
Revert "KAFKA-2120; Add a request timeout to NetworkClient (KIP-19);
reviewed by Jason Gustafson, Ismael Juma, Joel Koshy, Jun Rao, and Edward
Ribeiro"
This reverts commit da39931afad8008bc2b385a75a462777be051435.
commit 9ae98685ec7882598aee80d11af41d7c0828e1b9
Author: Flavio Junqueira <[email protected]>
Date: 2015-09-21T18:59:59Z
KAFKA-2300: follow-up to clear the controller state upon resignment
I have reopened this issue because the controller isn't cleaning up the
state upon an exception and the test case was legitimately failing for me every
now and then. I'm proposing a change to fix this.
Author: fpj <[email protected]>
Author: flavio junqueira <[email protected]>
Reviewers: Ismael Juma, Gwen Shapira, Guozhang Wang
Closes #212 from fpj/2300
commit e18f6860c2b297cc2ce06f9f3cb37987af3bdbae
Author: Ashish Singh <[email protected]>
Date: 2015-09-21T19:07:56Z
KAFKA-2533: Create a member Metadata.Listener inside KafkaConsumer
Author: Ashish Singh <[email protected]>
Reviewers: Guozhang Wang
Closes #220 from SinghAsDev/KAFKA-2533
commit 6ec88f7f8a18be7aff12fb0c73fc8abd00ef62d2
Author: Jason Gustafson <[email protected]>
Date: 2015-09-21T20:14:17Z
KAFKA-2532; Remove Consumer reference from rebalance callback
Author: Jason Gustafson <[email protected]>
Reviewers: Ewen Cheslack-Postava, Onur Karaman, Guozhang Wang
Closes #203 from hachikuji/KAFKA-2532
commit 0990b6ba6a28276f79a1a8bfaf48455c6eddfa1f
Author: Parth Brahmbhatt <[email protected]>
Date: 2015-09-22T00:47:18Z
KAFKA-2211: Adding simpleAclAuthorizer implementation and test cases.
Author: Parth Brahmbhatt <[email protected]>
Reviewers: Ismael Juma <[email protected]>, Jun Rao <[email protected]>
Closes #195 from Parth-Brahmbhatt/KAFKA-2211
commit 4833d8a8c34b2fb86a5cf605ea5483d0b9eadc4f
Author: Flavio Junqueira <[email protected]>
Date: 2015-09-22T01:25:42Z
KAFKA-2558: ServerShutdownTest is failing intermittently
See jira for a description.
Author: fpj <[email protected]>
Reviewers: Onur Karaman, Ismael Juma, Guozhang Wang
Closes #224 from fpj/KAFKA-2558
commit 2837fa5a34420ea1ede90901ded6e9f3c94a3e7b
Author: Onur Karaman <[email protected]>
Date: 2015-09-22T21:32:28Z
KAFKA-2557: separate REBALANCE_IN_PROGRESS and ILLEGAL_GENERATION error
codes
Author: Onur Karaman <[email protected]>
Reviewers: Jiangjie Qin, Jason Gustafson, Guozhang Wang
Closes #222 from onurkaraman/KAFKA-2557
commit d1dd1e902685178a990861f9948fe07f820cf4ef
Author: Jason Gustafson <[email protected]>
Date: 2015-09-23T21:10:06Z
KAFKA-2403; Add support for commit metadata in KafkaConsumer
Author: Jason Gustafson <[email protected]>
Reviewers: Ismael Juma, Guozhang Wang
Closes #119 from hachikuji/KAFKA-2403
commit b9ceac3ace353526da9c5d0f5b486265c871793a
Author: Dong Lin <[email protected]>
Date: 2015-09-23T23:53:05Z
KAFKA-2390; OffsetOutOfRangeException should contain the Offset and
Partition info.
Author: Dong Lin <[email protected]>
Author: Dong Lin <[email protected]>
Reviewers: Jason Gustafson, Ismael Juma, Guozhang Wang
Closes #118 from lindong28/KAFKA-2390
commit 54dd6e3ad7038ce4a32108b44153ec81caff2c68
Author: Ismael Juma <[email protected]>
Date: 2015-09-24T16:25:11Z
KAFKA-2576; ConsumerPerformance hangs when SSL enabled for Multi-Partition
Topic
We now write to the channel with an empty buffer when
there are pending bytes remaining and all data has been
sent.
Author: Ismael Juma <[email protected]>
Reviewers: Sriharsha Chintalapani <[email protected]>, Ben
Stopford <[email protected]>, Jun Rao <[email protected]>
Closes #236 from ijuma/kafka-2576-ssl-multi-partition-topic-hang
commit 1daf6ac510602ee27210f069bbe7415d4610fbea
Author: flavio junqueira <[email protected]>
Date: 2015-09-24T17:14:23Z
KAFKA-1387: Kafka getting stuck creating ephemeral node it has already
created when two zookeeper sessions are established in a very short period of
time
This is a patch to get around the problem discussed in the KAFKA-1387 jira.
The tests are not passing in my box when I run them all, but they do pass when
I run them individually, which indicates that there is something leaking from a
test to the next. I still need to work this out and also work on further
testing this. I wanted to open this PR now so that it can start getting
reviewed.
Author: flavio junqueira <[email protected]>
Author: fpj <[email protected]>
Author: Flavio Junqueira <[email protected]>
Reviewers: Ismael Juma <[email protected]>, Guozhang Wang
<[email protected]>, Jun Rao <[email protected]>
Closes #178 from fpj/1387
commit 8943b08c9fbd31f7c50d5e06934a5fc225d56460
Author: Ismael Juma <[email protected]>
Date: 2015-09-24T17:35:05Z
KAFKA-2548; kafka-merge-pr tool fails to update JIRA with fix version
0.9.0.0
Simplified the logic to choose the default fix version. We just hardcode
it for `trunk` and try to compute it based on the branch name for the
rest.
Removed logic that tries to handle forked release branches as it
seems to be specific to how the Spark project handles their JIRA.
Author: Ismael Juma <[email protected]>
Reviewers: Guozhang Wang
Closes #238 from ijuma/kafka-2548-merge-pr-tool-4-segment-fix-version
commit ac757eb19ec50b79ab2b5336fa4d7411cd99456d
Author: Manikumar reddy O <[email protected]>
Date: 2015-09-24T19:38:27Z
KAFKA-2554: change 0.8.3 to 0.9.0 in ApiVersion and other files
Updated the version from 0.8.3 to 0.9.0. in ApiVersion. Also updated in
gradle.propeties.
Author: Manikumar reddy O <[email protected]>
Reviewers: Ismael Juma, Gwen Shapira
Closes #237 from omkreddy/KAFKA-2554
commit bcf374da9e0d9ec8d13ecdaf4a1a15691549442b
Author: Dong Lin <[email protected]>
Date: 2015-09-24T21:40:03Z
KAFKA-2390; followup; add unit test for OffsetOutOfRange exception
Author: Dong Lin <[email protected]>
Reviewers: Jason Gustafson, Guozhang Wang
Closes #239 from lindong28/KAFKA-2390-followup
commit 48b4d6938dfb9dc72c941e979ff0d0c4d921f743
Author: Ewen Cheslack-Postava <[email protected]>
Date: 2015-09-25T02:01:11Z
KAFKA-2373: Add Kafka-backed offset storage for Copycat.
Author: Ewen Cheslack-Postava <[email protected]>
Reviewers: Gwen Shapira, James Cheng
Closes #202 from ewencp/kafka-2373-copycat-distributed-offset
commit 18d370124b51a97eb0522c220eb0ca619e315c6a
Author: Ashish Singh <[email protected]>
Date: 2015-09-25T02:16:28Z
KAFKA-2571; KafkaLog4jAppender dies while specifying acks config
Author: Ashish Singh <[email protected]>
Reviewers: Ewen Cheslack-Postava, Gwen Shapira
Closes #231 from SinghAsDev/KAFKA-2571
commit fe798641a2ba5e60940fa91f5f01a14bcf98cf3e
Author: Jason Gustafson <[email protected]>
Date: 2015-09-25T02:26:07Z
KAFKA-2579; prevent unauthorized clients from joining groups
Author: Jason Gustafson <[email protected]>
Reviewers: Gwen Shapira
Closes #240 from hachikuji/KAFKA-2579
commit 7e453df3179efed92d5bbe4ce9ee1d90a07cd503
Author: Jason Gustafson <[email protected]>
Date: 2015-09-25T18:08:24Z
KAFKA-2409; have KafkaConsumer.committed return null when there is no commit
Author: Jason Gustafson <[email protected]>
Reviewers: Onur Karaman, Guozhang Wang
Closes #243 from hachikuji/KAFKA-2409
commit a07fbd0f19962037ec386b1814dc6c95749c91a3
Author: Jiangjie Qin <[email protected]>
Date: 2015-09-25T19:01:41Z
KAFKA-2555: Fix infinite recursive ensurePartitionAssignment in callback's
commitSync
hachikuji ewencp I found this problem when adding new consumer to mirror
maker which commits offset in the rebalance callback. It is not clear to me why
we are triggering rebalance for commitSync() and fetchCommittedOffset(). Can
you help review to see if I miss something?
Regarding commitSync, After each poll() the partitions will be either
assigned to a consumer or it will be already revoked. As long as user is using
internal offset map, the offset map will always be valid. i.e. the offset map
will always only contain the assigned partitions when commitSync is called.
Hence there is no need to trigger a rebalance in commitSync().
The same guarantee also apply to fetchCommittedOffset(), isn't the only
requirement is to ensure we know the coordinator?
Another related issue is that today the IllegalGenerationIdException is a
bit confusing. When we receive an IllegalGenerationIdException from heartbeat,
we need to use that same generation Id to commit offset and the coordinator
will take it. So the generation ID was not really illegal. I will file a ticket
for this issue.
Author: Jiangjie Qin <[email protected]>
Reviewers: Jason Gustafson, Guozhang Wang
Closes #221 from becketqin/KAFKA-2555
commit 10d5deac0c00a0f651be1857fbdde6c74d7e9dac
Author: Jason Gustafson <[email protected]>
Date: 2015-09-25T21:06:07Z
HOTFIX: remove unused import causing checkstyle to fail
Author: Jason Gustafson <[email protected]>
Reviewers: Guozhang Wang
Closes #244 from hachikuji/hotfix-checkstyle
commit ad120d5789306209ab8d110fcbd86d453d01641b
Author: Jason Gustafson <[email protected]>
Date: 2015-09-25T22:40:38Z
KAFKA-2582; ConsumerMetdata authorization error not returned to user
Author: Jason Gustafson <[email protected]>
Reviewers: Jun Rao <[email protected]>
Closes #245 from hachikuji/KAFKA-2582
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
