GitHub user jmlvanre opened a pull request:
https://github.com/apache/kafka/pull/15
Rack aware replication
Adding rack-aware replication option. rack-id defaults to -1. use the
max-rack-replication option when creating a topic to distribute replicas such
that no more than max-rack-replication replicas are hosted on the same rack-id.
This option is also enforced when adding new partitions. The option does not
enforce manual (re)assignment.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jmlvanre/kafka rack-aware-replication
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/15.patch
----
commit 1021ea9002dc7250c000512db7a8dec92f462404
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-01-13T19:53:32Z
KAFKA 244 Improve log4j appender to use kafka.producer.Producer; patched by
vtkstef; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1231276
13f79535-47bb-0310-9956-ffa450edef68
commit d3c58b64287b73ff9613e53e293d4a0989389cb2
Author: Jun Rao <jun...@apache.org>
Date: 2012-01-17T17:30:38Z
max.message.size and fetch.size defaults should be consistent; patched by
Pierre-Yves Ritschard; reviewed by Jun Rao; KAFKA-247
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1232500
13f79535-47bb-0310-9956-ffa450edef68
commit fe2f0557130b21aca203ced11bd6990322847b97
Author: Jun Rao <jun...@apache.org>
Date: 2012-01-19T17:53:32Z
ConsumerIterator throws a IllegalStateException after a ConsumerTimeout
occurs; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-241
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1233501
13f79535-47bb-0310-9956-ffa450edef68
commit fcc82dce6aff8fee30ce8a5ada3c6167aef1462f
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-02T17:33:46Z
Corrupted request shuts down the broker; patched by Jun Rao; reviewed by
Jay Kreps and Neha Narkhede; KAFKA-261
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239740
13f79535-47bb-0310-9956-ffa450edef68
commit afd4b0d772f35f902a7acf81039abcc47b983d1f
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-02-02T19:07:48Z
KAFKA 256 Bug in the consumer rebalancing logic leads to the consumer not
pulling data from some partitions; patched by nehanarkhede; reviewed by
joelkoshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239766
13f79535-47bb-0310-9956-ffa450edef68
commit 2552a2488f2674e2fc3abea02272e85ff13a3ee4
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-02-06T23:10:54Z
KAFKA-257 Hadoop producer should use software load balancer; patched by Sam
Shah; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241249
13f79535-47bb-0310-9956-ffa450edef68
commit 345bc7bad594af43df5fc264ad0b5904d1126257
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-02-07T17:38:15Z
KAFKA-263 Enhance single host broker failure test to have 2 topics with
uneven distribution on the source brokers; patched by John Fung; reviewed by
Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241528
13f79535-47bb-0310-9956-ffa450edef68
commit a888a9d09e4fc219ab9d8536034ac043093f17df
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-02-09T22:04:32Z
KAFKA-262 Bug in the consumer rebalancing logic causes one consumer to
release partitions that it does not own; patched by Neha Narkhede; reviewed by
Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242552
13f79535-47bb-0310-9956-ffa450edef68
commit 6a3c2f2032c5e910f634a29bfead555b63433465
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-10T06:52:37Z
trivial change to reduce default fetcher queue size
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242696
13f79535-47bb-0310-9956-ffa450edef68
commit 732c27ff3e8bc6d5a9511ee64de275df49adf73f
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-13T22:31:02Z
Add a queue of zookeeper notifications in the zookeeper consumer to reduce
the number of rebalancing attempts; patched by Jun Rao; reviewed by Neha
Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243721
13f79535-47bb-0310-9956-ffa450edef68
commit 0bd3b9c3f6df76043afbdce817d33d7531f1eecd
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-14T06:19:34Z
time-based reconnect in producer; patched by Yang Ye; reviewed by Jun Rao;
KAFKA-268
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243786
13f79535-47bb-0310-9956-ffa450edef68
commit 5c4ce616994112a68f8864520c4a2a6c7b545e30
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-15T22:04:00Z
add JMX on broker to track bytes/messages per topic; patched by Jun Rao;
reviewed by Neha Narkhede; KAFKA-272
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244755
13f79535-47bb-0310-9956-ffa450edef68
commit 3e79116e7a7c725cafae1b5248a99837641a4ca2
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-15T22:22:11Z
fix condition to use await instead of wait; patched by Jun Rao; reviewed by
Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244765
13f79535-47bb-0310-9956-ffa450edef68
commit 2ead8a49ea1c7e634c889e9425fd5eb209e7f1ff
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-15T23:51:27Z
trivial fix to add trace logging in FetcherRunnable
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244792
13f79535-47bb-0310-9956-ffa450edef68
commit 6e1b2ebe3278c99e1b3ea89a47c60497cb964d44
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-17T02:14:25Z
shutdown watch executor thread properly; patched by Jun Rao; reviewed by
Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245295
13f79535-47bb-0310-9956-ffa450edef68
commit c28b3a61cce3288d3c0b620d1ef73d936989d3c5
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-02-17T02:33:07Z
KAFKA-274 Handle corrupted messages cleanly; patched by nehanarkhede;
reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245299
13f79535-47bb-0310-9956-ffa450edef68
commit ff562472ddf834e092cc2a8124dad59e763017db
Author: Joe Stein <joest...@apache.org>
Date: 2012-02-17T04:14:47Z
test access, fixed space
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245316
13f79535-47bb-0310-9956-ffa450edef68
commit a23d396a5a2f5c8685a404ce8478540c13fac6d4
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-17T21:54:29Z
trivial fix for kafka-producer-perf-test.sh
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245779
13f79535-47bb-0310-9956-ffa450edef68
commit 95ee38728cb1d8eb9b62a73eb5ad26902142a1fd
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-20T22:24:52Z
make time-based reconnect starting at a random time; patched by Yang Ye;
reviewed by Jun Rao; KAFKA-268
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291490
13f79535-47bb-0310-9956-ffa450edef68
commit 7066d1c38b66d4de2d02fc1ef2fa8e7908990d07
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-21T00:25:55Z
A tool to GET Zookeeper partition-offset and output to files; patched by
John Fung; reviewed by Jun Rao; KAFKA-254
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291535
13f79535-47bb-0310-9956-ffa450edef68
commit 22d80462b15e24fc63960254bdfd8be74ddc14ba
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-21T00:26:42Z
A tool to UPDATE Zookeeper partition-offset with input from a file; patched
by John Fung; reviewed by Jun Rao; KAFKA-255
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291536
13f79535-47bb-0310-9956-ffa450edef68
commit 333966f50ea42ba41ff243d1ba5571a2fa8b9a60
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-23T22:57:40Z
Add a shallow iterator to the ByteBufferMessageSet; patched by Yang Ye;
reviewed by Jun Rao; KAFKA-277
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293010
13f79535-47bb-0310-9956-ffa450edef68
commit 7e91c167430afcffd5b700de58bbc54b2149be00
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-25T23:08:02Z
add jmx beans in broker to track # of failed requests; patched by Jun Rao;
reviewed by Neha Narkhede; KAFKA-283
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293720
13f79535-47bb-0310-9956-ffa450edef68
commit caf310c2283731751926ccf8bd902df01dcb04f4
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-27T19:46:36Z
consumer sometimes don't release partition ownership properly in ZK during
rebalance; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-286
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294302
13f79535-47bb-0310-9956-ffa450edef68
commit d8286aad107dbec34faae9e4e29c65bde20eb6f8
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-28T01:50:38Z
Increase maximum value of log.retention.size; patched by Elben Shira;
reviewed by Jun Rao; KAFKA-285
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294441
13f79535-47bb-0310-9956-ffa450edef68
commit 6c34cf2dcc5961703001ab484a1ca6e662eee362
Author: Jun Rao <jun...@apache.org>
Date: 2012-02-29T03:22:14Z
use propertyExists to test if both broker.list and zk.connect are present;
patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-290
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294959
13f79535-47bb-0310-9956-ffa450edef68
commit ccc464c19a80f9818145c70079e9966fed22d75c
Author: Joe Stein <joest...@apache.org>
Date: 2012-03-01T02:47:03Z
Niek Sanders - KAFKA-284 fixed compilation issue for cpp client
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1295388
13f79535-47bb-0310-9956-ffa450edef68
commit 0443e2dd737cada1fed3964dd1cb2b687944f9c6
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-06T02:21:54Z
broker deletes all file segments when cleaning up an empty log segment;
patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-292
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1297324
13f79535-47bb-0310-9956-ffa450edef68
commit 624a361e01431bf87ccda883fb9b1817d67cdbf7
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-07T17:51:21Z
trivial fix to include violated payload size in
MessageSizeTooLargeException; patched by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298030
13f79535-47bb-0310-9956-ffa450edef68
commit 74af0deef17bfed19237367cdbee7027666add08
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-08T15:18:30Z
LogManager test fails on linux; patched by Jun Rao; reviewed by Neha
Narkhede; KAFKA-220
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298426
13f79535-47bb-0310-9956-ffa450edef68
commit 66d8073156403ce1a8f91b56f27beed93196ae04
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-14T22:58:57Z
Update Go Client to new version of Go; patched by AaronR; KAFKA-296
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300777
13f79535-47bb-0310-9956-ffa450edef68
commit 5e0e0b17fb5a9549fc9860c91384121def8ae695
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-15T00:39:42Z
reverting previous commit for KAFKA-296 because patch didn't apply cleanly
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300801
13f79535-47bb-0310-9956-ffa450edef68
commit 7b39d7eed1449d993cdec6dca6babea6032dbbc3
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-21T00:25:09Z
kafka-console-producer does not take in customized values of --batch-size
or --timeout; patched by Jun Rao; reviewed by Edward Smith; KAFKA-279
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303232
13f79535-47bb-0310-9956-ffa450edef68
commit e180e68f94d1d50fb9563d273c03d255eb081998
Author: Jun Rao <jun...@apache.org>
Date: 2012-03-21T00:38:14Z
Dead code in the Log4j appender; patched by Jose Quinteiro; reviewed by Jun
Rao; KAFKA-303
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303239
13f79535-47bb-0310-9956-ffa450edef68
commit 2bcc91134316a546322bf59a422bec1934613607
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-03-22T16:03:49Z
KAFKA-310 Incomplete message set validation checks in Log's append API can
corrupt on disk log segment; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303861
13f79535-47bb-0310-9956-ffa450edef68
commit ba8fd9f1ee9fc47a1e62ee6f529f7cb272b3c7f3
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-03-22T16:59:11Z
KAFKA-309 Bug in FileMessageSet's append API can corrupt on disk log;
patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303890
13f79535-47bb-0310-9956-ffa450edef68
commit f8346239d492b22416d9c5d4639ebd5eafdbae92
Author: Jun Rao <jun...@apache.org>
Date: 2012-04-06T16:59:44Z
CallbackHandler.afterDequeuingExistingData is not called during event queue
timeout; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-326
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310482
13f79535-47bb-0310-9956-ffa450edef68
commit d9441f0066604534a8226ce1809eaf68e5a4ada2
Author: Jun Rao <jun...@apache.org>
Date: 2012-04-06T21:18:56Z
enable shallow iterator in ByteBufferMessageSet to allow mirroing data
without decompression; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-315
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310595
13f79535-47bb-0310-9956-ffa450edef68
commit c0e190cdefabc7c59b11bbe0de843baec78efe3f
Author: Jun Rao <jun...@apache.org>
Date: 2012-04-07T00:04:51Z
Separate out Kafka mirroring into a stand-alone app; patched by Joel Koshy;
reviewed by Jun Rao and Neha Narkhede; KAFKA-249
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310645
13f79535-47bb-0310-9956-ffa450edef68
commit d97c557202e7f20001d2597d09bcbf0bfc123fa9
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-04-08T02:00:19Z
KAFKA-320 testZKSendWithDeadBroker fails intermittently due to
ZKNodeExistsException; patched by nehanarkhede; reviewed by junrao and
prashanth menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310937
13f79535-47bb-0310-9956-ffa450edef68
commit d6b1de35f6b9cd5370c7812790fea8e61618f461
Author: Jun Rao <jun...@apache.org>
Date: 2012-04-25T02:24:47Z
Mirroring should use multiple producers; add producer retries to
DefaultEventHandler; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-332
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1330083
13f79535-47bb-0310-9956-ffa450edef68
commit 2a59ad76c657e4aad8ee6ca67078f49d2f6017c9
Author: Neha Narkhede <nehanarkh...@apache.org>
Date: 2012-05-18T01:22:11Z
Minor fix: Turning on TCP NODELAY in the Simple Consumer. This fix has a
significant impact on single fetch request performance from a latency standpoint
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1339944
13f79535-47bb-0310-9956-ffa450edef68
commit f8ce071f3fa0efdad555a82aba9e024e3a7f4f56
Author: Joe Stein <joest...@apache.org>
Date: 2012-06-14T17:47:20Z
KAFKA-365 change copyright in NOTICE to current year, reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1350349
13f79535-47bb-0310-9956-ffa450edef68
commit 16b600d4fd972be697af95398f22f23aa8ad2608
Author: Jun Rao <jun...@apache.org>
Date: 2012-06-19T00:27:00Z
add jmx beans in broker to track # bytes in consumer; patched by Jun Rao;
reviewed by Joel Koshy; KAFKA-336
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1351544
13f79535-47bb-0310-9956-ffa450edef68
commit 1af23bb2633c162659ab6fa99020307960f41465
Author: Joe Stein <joest...@apache.org>
Date: 2012-06-20T15:04:04Z
KAFKA-368 use the pig core jar from maven instead of distributing it patch
by Joe Stein reviewed by Jun Rao and Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1352145
13f79535-47bb-0310-9956-ffa450edef68
commit 489b09c120992d624fe95ed970b80ec8157131a9
Author: Joel Jacob Koshy <jjko...@apache.org>
Date: 2012-07-06T20:44:51Z
KAFKA-373 Fix trunk broker failure test to work with mirror maker; patched
by John Fung; reviewed by Joel Koshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1358407
13f79535-47bb-0310-9956-ffa450edef68
commit 9a84e408c1dff1f32ea030190987501701a1903f
Author: Jun Rao <jun...@apache.org>
Date: 2012-08-24T14:32:10Z
message size not checked at the server; patched by Swapnil Ghike; reviewed
by Jun Rao, Neha Narkhede; KAFKA-469
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1376943
13f79535-47bb-0310-9956-ffa450edef68
commit 21326cb9f29c3514b9533a741b69b90ef6d45038
Author: Jun Rao <jun...@apache.org>
Date: 2012-08-24T20:38:27Z
Time based log segment rollout; patched by Swapnil Ghike; reviewed by Jun
Rao, Neha Narkhede; KAFKA-475
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1377093
13f79535-47bb-0310-9956-ffa450edef68
commit 749665e33672b0e96869af787d8a4c78fa681732
Author: Jun Rao <jun...@apache.org>
Date: 2012-08-25T01:04:59Z
Expose JMX operation to set logger level dynamically; patched by Jun Rao;
reviewed by Jay Kreps; KAFKA-429
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1377172
13f79535-47bb-0310-9956-ffa450edef68
commit f2c901bcd422807f5d172a3a2f8aa18ee1b7c701
Author: Jun Rao <jun...@apache.org>
Date: 2012-08-25T05:16:27Z
Require values in Utils.getTopic* methods to be positive; patched by
Swapnil Ghike; reviewed by Jun Rao; KAFKA-481
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1377213
13f79535-47bb-0310-9956-ffa450edef68
commit 695a8d43eb2a58920f3f00ae4dbce30b10adb42c
Author: Jun Rao <jun...@apache.org>
Date: 2012-08-29T14:52:39Z
Message size not checked at the server (patch v3); patched by Swapnil
Ghike; reviewed by Jun Rao; KAFKA-469
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1378590
13f79535-47bb-0310-9956-ffa450edef68
commit 9e54dadf4bffbd0401d4b92fb82b1044c87cccc8
Author: Jun Rao <jun...@apache.org>
Date: 2012-09-07T03:48:50Z
Handle topic names with / on Kafka server; patched by Swapnil Ghike;
reviewed by Jay Kreps and Jun Rao; kafka-495
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1381853
13f79535-47bb-0310-9956-ffa450edef68
commit d37eb7fdd87ce16afb1cf94e1236301663833247
Author: Jun Rao <jun...@apache.org>
Date: 2012-09-18T05:04:00Z
TopicCount.constructTopicCount isn't thread-safe; patched by Jun Rao;
reviewed by Joel Koshy; KAFKA-379
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1386987
13f79535-47bb-0310-9956-ffa450edef68
commit e9d07d72fa3bd29d61b4995abff07ea287853f6b
Author: Joe Stein <joest...@apache.org>
Date: 2012-09-27T00:21:45Z
KAFKA-534 remove client library directory
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1390784
13f79535-47bb-0310-9956-ffa450edef68
commit 2a62bdb040352f838fd0afceb9983c35a6a9dafe
Author: Joe Stein <joest...@apache.org>
Date: 2012-09-27T00:24:56Z
KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing
client libraries from repo
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1390788
13f79535-47bb-0310-9956-ffa450edef68
commit 80d571049f60414537d385d1c688a6fb7f724740
Author: Joe Stein <joest...@apache.org>
Date: 2012-09-29T01:11:07Z
KAFKA-538 missing apache license header in sbt and util.h
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1391714
13f79535-47bb-0310-9956-ffa450edef68
commit 7294dd3333238423cd665f3103221e24182173ec
Author: Joel Jacob Koshy <jjko...@apache.org>
Date: 2012-10-08T23:18:48Z
ConsumerOffsetChecker now works with hostnames (in addition to IP) in the
brokers/ids zk path; KAFKA-549; patched by Bob Cotton; reviewed by Joel Koshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1395809
13f79535-47bb-0310-9956-ffa450edef68
commit 3819adc48631d6841032c0d8d08b74ea1912daf2
Author: Jun Rao <jun...@apache.org>
Date: 2012-10-09T15:56:52Z
The ConsumerStats MBean name should include the groupid; patched by Michael
Tamm; reviewed by Jun Rao; kafka-547
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1396085
13f79535-47bb-0310-9956-ffa450edef68
commit dd21b35120119dc35da7e800bfd50dad3dd2f44b
Author: Joel Jacob Koshy <jjko...@apache.org>
Date: 2012-10-10T00:06:28Z
Fix wildcard consumption to work with greater than one stream; KAFKA-550;
patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1396425
13f79535-47bb-0310-9956-ffa450edef68
commit 3f432cd01c4728396f277e33897f6f898c530c99
Author: Jun Rao <jun...@apache.org>
Date: 2012-11-26T17:33:03Z
copy branch 0.8 to trunk
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1413738
13f79535-47bb-0310-9956-ffa450edef68
commit 45ba1019cb007c9876b2392577a4db7a9ab5dba8
Author: Gavin McDonald <gmcdon...@apache.org>
Date: 2012-11-28T08:41:58Z
Kafka has become a TLP
git-svn-id: https://svn.apache.org/repos/asf/kafka/trunk@1414576
13f79535-47bb-0310-9956-ffa450edef68
commit 4be0b1be29e301500515b6c5e00655b06e829045
Author: Edward Jay Kreps <jkr...@apache.org>
Date: 2012-12-02T20:50:01Z
KAFKA-521 Refactor the log subsystem. Patch reviewed by Neha.
git-svn-id: https://svn.apache.org/repos/asf/kafka/trunk@1416253
13f79535-47bb-0310-9956-ffa450edef68
commit 494706999c43003f1f16ce3558bebe39421ff3eb
Author: Edward Jay Kreps <jkr...@apache.org>
Date: 2012-12-02T20:55:27Z
KAFKA-521 Missing files on last commit.
git-svn-id: https://svn.apache.org/repos/asf/kafka/trunk@1416254
13f79535-47bb-0310-9956-ffa450edef68
commit a10be4b69c904a596af198feaac4cef4c391bf4c
Author: Edward Jay Kreps <jkr...@apache.org>
Date: 2012-12-10T19:31:29Z
KAFKA-597 Refactor scheduler. Fixes a couple of bugs, and adds the ability
to mock scheduled tasks.
git-svn-id: https://svn.apache.org/repos/asf/kafka/trunk@1419692
13f79535-47bb-0310-9956-ffa450edef68
commit ac35ae1fef0294cc5a33908209598f938dc7d84c
Author: Edward Jay Kreps <jkr...@apache.org>
Date: 2012-12-11T19:47:13Z
KAFKA-636 Make log segment delete an asynchronous background action done by
the scheduler. Patch reviewed by Jun and Neha.
git-svn-id: https://svn.apache.org/repos/asf/kafka/trunk@1420361
13f79535-47bb-0310-9956-ffa450edef68
commit 739b2df6806c10b934f69e6181555fccb85cd9b8
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2012-12-16T19:28:16Z
KAFKA-374 Move off the default java crc implementation to the crc code
borrowed from Hadoop. Patch reviewed by Joe.
commit 32dae955d5e2e2dd45bddb628cb07c874241d856
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2012-12-18T17:43:41Z
Merge branch '0.8' into trunk
Conflicts:
core/src/main/scala/kafka/log/Log.scala
core/src/test/scala/unit/kafka/admin/AdminTest.scala
core/src/test/scala/unit/kafka/log/LogTest.scala
core/src/test/scala/unit/kafka/server/LogOffsetTest.scala
commit a39c34a2d138b3bdc5af70f4888982b02dea0742
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-04T21:42:27Z
Merge remote branch 'origin/0.8' into trunk
commit 222c0e46ab78a12e1f58e3fb526667a4f73d344a
Author: David Arthur <mum...@gmail.com>
Date: 2013-01-04T22:30:03Z
KAFKA-657 Add APIs for the consumer to commit and fetch offsets on the
broker.
commit 274cd02f1ad69650e8abe7022d36049124219317
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-01-04T23:56:41Z
KAFKA-657 Change property name to offset.metadata.max.bytes for consistency.
commit dc9edc462257f535ebf1acc2d6a1404904b8798e
Author: Joe Stein <joest...@apache.org>
Date: 2013-01-05T18:55:41Z
fixed incubation url
Signed-off-by: Joe Stein <joest...@apache.org>
commit ed36a7f07a45650862e115f42696b9ec70e563a5
Author: Joe Stein <joest...@apache.org>
Date: 2013-01-07T03:45:51Z
KAFKA-133 publish kafka to maven - patch by Maxime Brugidou with updates
for depen by Otis Gospodnetic, reviewed by Joe Stein
commit 9249b76d1d04f2583843cf5fe09ba8bbdf611183
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-12T02:25:56Z
merge from 0.8 and resolve conflicts
commit d7f410925e870f3f8b220fb7bdc2c2f265f06ed6
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-13T22:00:52Z
Merge remote branch 'origin/0.8' into trunk
commit b052e80de20785946dff27559ee3fd5eb45e7ce1
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-14T22:30:52Z
Merge remote branch 'origin/0.8' into trunk
commit 362eba981de40a69ae509a291649531ead6f6aee
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-15T17:46:34Z
Merge remote branch 'origin/0.8' into trunk
commit 9ee795ac563c3ce4c4f03e022c7f951e065ad1ed
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-17T18:17:30Z
merge from 0.8 and resolve conflict in Log
commit 999813821c091adcc5c50d0cb6b8c702473a0a8c
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-21T04:53:36Z
Merge remote branch 'origin/0.8' into trunk
commit 92f177b309834a9b572bbab33e8f6198316bd156
Author: Jun Rao <jun...@gmail.com>
Date: 2013-01-26T06:03:39Z
merge 0.8 to trunk and resolve conflicts
commit e7edb5e1e933f5535378d546bcf4d8b178d2e69c
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-01-29T03:31:17Z
KAFKA-631 Implement a log cleaner for Kafka. Reviewed by Neha.
commit 218e6a53c1385be897d9f8a3a39baa38b68d7992
Author: David Arthur <mum...@gmail.com>
Date: 2013-02-25T02:10:21Z
KAFKA-771 NPE in handleOffsetCommitRequest; reviewed by Neha Narkhede
commit 82b11aa0d4bc32c5a351ace3a67cd2d57c9d1e8d
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-03-01T21:54:00Z
KAFKA-759 Commit/FetchOffset APIs should not return versionId; reviewed by
Neha Narkhede
commit 4f2742d60d16f5ba468aa66d2c3ed7aa37479dce
Author: Jun Rao <jun...@gmail.com>
Date: 2013-03-04T04:20:41Z
merge from 0.8 and resolve conflicts
commit c1ed12e44ddebe41dc464683e3d7eeb4e6d39a45
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-03-08T23:07:39Z
KAFKA-554 Dynamic per-topic configuration. This patch adds a mechanism for
storing per-topic configurations in zookeeper and dynamically making config
changes across the cluster. Reviewed by Neha and Jun.
commit 9ff4e8eb10e0ddd86f257e99d55971a132426605
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-03-12T18:17:12Z
KAFKA-739 Handle null message payloads in messages and in the log cleaner.
Reviewed by Jun and Neha.
commit 731ba9007d4e2fa2f3a5e44f7b30827975fca420
Author: Jun Rao <jun...@gmail.com>
Date: 2013-04-18T04:52:04Z
kafka-823; merge 0.8 (51421fcc0111031bb77f779a6f6c00520d526a34) to trunk;
patched by Jun Rao; reviewed by Jay Kreps
commit 3b470f56b479f618b7e90577f9857b4e25b38c1a
Author: Colin B <lanzaa+...@gmail.com>
Date: 2013-05-30T04:25:34Z
kafka-891; NullPointerException in ConsoleConsumer; patched by Colin B.;
reviewed by Neha Narkhede and Jun Rao
commit c98bdd3e4f6edb7a4db97a876c26e7d37e88e12a
Author: Jun Rao <jun...@gmail.com>
Date: 2013-07-08T22:42:24Z
kafka-896; merge 0.8 (988d4d8e65a14390abd748318a64e281e4a37c19) to trunk;
patched by Jun Rao; reviewed by Jay Kreps
commit 2cda5d1fca90e93ecfd44665fe32033ddce99c52
Author: Jun Rao <jun...@gmail.com>
Date: 2013-07-08T22:49:53Z
Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/kafka into
trunk
commit db37ed0054305a3f5d824166914092076b10ac1e
Author: Jun Rao <jun...@gmail.com>
Date: 2013-07-11T06:36:51Z
kafka-965; merge c39d37e9dd97bf2462ffbd1a96c0b2cb05034bae from 0.8 to
trunk; patched by Jun Rao; reviewed by Jay Kreps
commit c27c768463a5dc6be113f2e5b3e00bf8d9d9d602
Author: David Arthur <mum...@gmail.com>
Date: 2013-07-11T22:34:57Z
KAFKA-852, remove clientId from Offset{Fetch,Commit}Response. Reviewed by
Jay.
commit d285e263bf403f3db27f5d138594c395643a2284
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-07-29T22:32:36Z
KAFKA-925 Add a partition key that overrides the message's stored key.
Patch reviewed by Joel.
commit bdb2fdc6460c48189b487e1e8a75c344e32aa222
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-08-03T16:46:50Z
KAFKA-995 Ensure that replica fetch size is > max message size on server.
commit 493a46613e9a90c0879de96d04c42696fdf95510
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-08-03T16:58:48Z
KAFKA-985 integer overflow in log time configuration values. Patch from
Frank Fejes.
commit df18fe13ad50bba3dbc7d1db0ecd8b698169ade2
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-07-17T21:45:03Z
KAFKA-615 fsync asynchronous from log roll. Patch reviewed by Jun and
Sriram.
commit ff6292904a67cd021d365ef1e07c113002b80582
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2013-08-19T16:45:39Z
KAFKA-1009 DumpLogSegments tool should return error on non-existing files;
reviewed by Neha Narkhede
commit 75d95d9b0770d187916bed1dd1ca7a3e82ef08b0
Author: Jun Rao <jun...@gmail.com>
Date: 2013-09-11T16:49:48Z
merge from 0.8 da4512174b6f7c395ffe053a86d2c6bb19d2538a and resolve
conflicts
commit 8e554c4d2acf5108805905b9f06198f20398ee3a
Author: Christopher Freeman <cfree...@linkedin.com>
Date: 2013-09-13T19:55:43Z
KAFKA-1046 Added support for Scala 2.10 builds while maintaining
compatibility with 2.8.x; reviewed by Neha and Jun
commit fed901cad2e7f8fe8dffd36b72006d912c18743a
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-09-13T20:17:17Z
KAFKA-1046 New files
commit 324936609f9e087aa4168e7f7581148e34b346a4
Author: Jun Rao <jun...@gmail.com>
Date: 2013-09-13T22:36:53Z
merge from 0.8 c12d2ea9e5b4bdcf9aeb07c89c69553a9f270c82 to trunk
commit 9feef9fd60920cf25a88e03dc5711745c0b7c0c5
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-09-15T15:18:07Z
Trivial commit: Fix whitespace in Utils.rm.
commit 8959690e96f22e6905f80c76faa355448e4d2e51
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-09-18T03:44:33Z
KAFKA-1053 Kafka patch review tool that integrates JIRA and reviewboard;
reviewed by Joel Koshy, Swapnil Ghike and Guozhang Wang
commit bfc4ba499521addf3d109c3fbe77b8908eabc644
Author: Jun Rao <jun...@gmail.com>
Date: 2013-10-07T21:29:16Z
Merge remote branch 'origin/0.8' into trunk
commit 343a1e2660aa7c3c847c459360a5fbbcb065c759
Author: Jun Rao <jun...@gmail.com>
Date: 2013-10-08T20:05:40Z
Merge remote-tracking branch 'origin/0.8' into trunk
commit 8d4dbe60f188c48a7f0d552b7b1109fb8e126521
Author: Sriram Subramanian <sri...@gmail.com>
Date: 2013-10-10T03:44:49Z
kafka-1052; integrate add-partitions command into topicCommand; patched by
Sriram Subramanian; reviewed by Jun Rao
commit ace95c48a924db69ea6c6053d4cc2943c7b8958a
Author: Jun Rao <jun...@gmail.com>
Date: 2013-10-10T14:58:10Z
trivial change to remove unused command bin/kafka-add-partitions.sh
commit b0fecacbe8232deea5ea8a71e8dd9b57c7cf0435
Author: Joe Stein <joe.st...@stealth.ly>
Date: 2013-10-11T04:59:43Z
KAFKA-1018 tidy up the pom, 0.8.0 release, build the test jars now too
commit 3e7c9c6abfed90b4e6e0e1bb3c806adf1c6bbbe9
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-10-14T16:39:10Z
KAFKA-1081 Clean up shell scripts. Removed re-run of failed command. Use
exec instead of subprocess execution.
commit 062d910e3235ef71b1e7a01472f4360658c83bea
Author: Swapnil Ghike <sgh...@linkedin.com>
Date: 2013-10-15T16:30:22Z
KAFKA-1087 Empty topic list causes consumer to fetch metadata of all
topics; reviewed by Guozhang Wang and Neha Narkhede
commit e351039b1a9ed188e3be1581f31674b876094274
Author: Francois Saint-Jacques <fsaintjacq...@gmail.com>
Date: 2013-10-15T16:47:40Z
kafka-1084; Validate properties for custom serializers; patched by Francois
Saint-Jacquese; reviewed by Jun Rao
commit a160f1023b23c7d9d79c7970a72f48ae883dfe07
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-10-15T16:58:08Z
KAFKA-1086 Improve GetOffsetShell to find metadata automatically; reviewed
by Jun Rao
commit c98b6de15db9a2ce72f44a5b2736f74de5066113
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-10-09T20:50:09Z
KAFKA-1008 Lock around unmap on windows.
commit ccdb56201e494d6025e47a48c82f233ccc9386ac
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-10-09T23:55:49Z
KAFKA-1036 Close checkpoint file before renaming it for Windows
compatibility.
commit d5dfa28596857d5564c14b598901653714717bdc
Author: Joel Koshy <jjko...@gmail.com>
Date: 2013-10-16T16:36:40Z
KAFKA-1089; Fix run-class and log4j for migration tool system test;
reviewed by Jun Rao
commit b448d4e075f0f138530e6cfc0634f4035c8d1878
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-10-16T23:36:53Z
KAFKA-1086 Improve GetOffsetShell to find metadata automatically; reviewed
by Jun Rao and Joel Koshy
commit c66e4d58687bee54bae6a31e976d4b9b63c36de1
Author: Jun Rao <jun...@gmail.com>
Date: 2013-10-17T16:37:06Z
kafka-1091; full topic list can be read from metadata cache in the broker
instead of ZK; patched by Jun Rao; reviewed by Joel Koshy, Guozhang Wang,
Swapnil Ghike, and Neha Narkhede
commit d0e948ca86730a900adbe3300fe4af01cf15922a
Author: Jun Rao <jun...@gmail.com>
Date: 2013-10-17T17:26:53Z
kafka-1090; testPipelinedRequestOrdering has transient failures; patched by
Jun Rao; reviewed by Joel Koshy, Guozhang Wang, and Neha Narkhede
commit d030778861e6d274281adf7e0311dc4d51448c84
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-10-18T18:15:39Z
KAFKA-1042 logSegments(from, to) Misses first segment.
I think this patch also fixes the continual timing problems we have had in
log tests. The root cause
was that we weren't passing through the clock instance so we were mixing
instances of MockTime and SystemTime.
This worked only because MockTime initializes to SystemTime.milliseconds so
as long as the test took less than 1 ms it worked!
commit b61d147fd0774370a41d2a6cadcbfd30c7703a34
Author: Swapnil Ghike <sgh...@linkedin.com>
Date: 2013-10-19T23:37:50Z
KAFKA-1094 Configure reviewboard url in kafka-patch-review tool; reviewed
by Neha Narkhede
commit 0198e67febfa805b7a5d7ef8a939254bbe0b0d00
Author: Joris Van Remoortere <joris.van.remoort...@gmail.com>
Date: 2013-10-21T18:14:31Z
KAFKA-1042 follow up compilation fix; reviewed by Neha Narkhede
commit 0e90c246c68954204ea524139023d97173bfde56
Author: Jay Kreps <jay.kr...@gmail.com>
Date: 2013-10-25T04:33:53Z
KAFKA-1098 Fix failing test in LogCleaner.
commit 274b12f3351e007f76e8ef64ba9baf5b0824e690
Author: Alan Vasile <alinachegal...@yahoo.com>
Date: 2013-10-25T15:12:36Z
kafka-918; Change log.retention.hours to be log.retention.mins; patched by
Alin Vasile; reviewed by Jun Rao
commit bd49e4f3e77c86a9cd93262e628143fff762d4ee
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2013-10-29T20:11:17Z
KAFKA-1001; Handle follower transition in batch; patched by Guozhang Wang;
reviewed by Jun Rao
commit bf4dbd5ee3be67a214c01aae0bf01b1492994cf5
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2013-10-30T23:21:49Z
KAFKA-1060 Break-down sendTime into responseQueueTime and the real
sendTime; reviewed by Neha Narkhede and Jun Rao
commit a55ec0620f6ce805fafe2e1d4035ec3e0ab4e0d0
Author: Roger Hoover <roger.hoo...@gmail.com>
Date: 2013-10-31T04:06:23Z
kafka-1092; Add server config parameter to separate bind address and ZK
hostname; patched by Roger Hoover; reviewed by Jun Rao
commit ec547737de730cddb29200eba62c0165f901447b
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-11-01T04:14:17Z
KAFKA-1107 Broker unnecessarily recovers all logs when upgrading from 0.8
to 0.8.1; reviewed by Jay Kreps and Guozhang Wang
commit a4fafefdb3a2701d30f14feed3be11f1c0905c31
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-11-01T04:27:38Z
KAFKA-1107 Follow up review cleanup comments
commit e602ed0582b04d7b6fd442990dd3182f1e2834a5
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-11-01T17:03:37Z
KAFKA-1113 log.cleanup.interval.mins property should be renamed; Trivial
patch, no review
commit df7f7a255bdd803cddfdf3fea2ace4f1ae366377
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-11-01T17:27:36Z
KAFKA-1097 Race condition while reassigning low throughput partition leads
to incorrect ISR information in zookeeper; reviewed by Jun Rao, Guozhang Wang
commit 7d1ac1d806ea893a1503c35dbd6087941dc5c25c
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-11-04T00:18:11Z
Minor logging improvement
commit 98616188645d1d57e98a6b92f615345fc7653d9d
Author: Swapnil Ghike <sgh...@linkedin.com>
Date: 2013-11-06T02:13:58Z
KAFKA-1121 DumpLogSegments tool should print absolute file name to report
inconsistencies; reviewed by Neha Narkhede and Guozhang Wang
commit a700c99efddb3ae83b42a2bcf5c58dd16ee7edf1
Author: Joe Stein <joe.st...@stealth.ly>
Date: 2013-11-08T01:39:43Z
KAFKA-1126 Remove the DISCLAIMER it is left over from incubation reviewed
by Neha
commit eedbea6526986783257ad0e025c451a8ee3d9095
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-11-08T01:45:39Z
KAFKA-1119 Kafka 0.8.1 overwrites previous per topic config changes;
reviewed by Joel Koshy, Guozhang Wang, Swapnil Ghike, Jay Kreps
commit 7c54e39bd48c9908c220ee68cee608a0d0cf5d9d
Author: Jun Rao <jun...@gmail.com>
Date: 2013-11-19T02:31:32Z
KAFKA-1112; broker can not start itself after kafka is killed with -9;
patched by Jay Kreps and Jun Rao; reviewed by Jay Kreps, Neha Narkhede and
Guozhang Wang
commit 58789d7cbe21f0b29f4a94a1fe75d1f1e0851d86
Author: Jun Rao <jun...@gmail.com>
Date: 2013-11-19T05:02:00Z
kafka-1127; kafka and zookeeper server should start in daemon mode and log
to correct position; patched by Raymond Liu; reviewed by Jun Rao
commit 440e45e5131131a30987b991eabfee147061c42b
Author: Jun Rao <jun...@gmail.com>
Date: 2013-11-20T17:21:56Z
kafka-1117; tool for checking the consistency among replicas; patched by
Jun Rao; reviewed by Neha Narkhede, Joel Koshy, Swapnil Ghike, Guozhang Wang
commit 9b0776d157afd9eacddb84a99f2420fa9c0d505b
Author: Swapnil Ghike <sgh...@linkedin.com>
Date: 2013-11-20T18:05:40Z
kafka-1135; Code cleanup - use Json.encode() to write json data to zk;
patched by Swapnil Ghike; reviewed by Neha Narkhede, Guozhang Wang and Jun Rao
commit c2dd071b52632c638fefcf864cc2aa1a2cac629b
Author: Joe Stein <joe.st...@stealth.ly>
Date: 2013-11-20T22:16:40Z
KAFKA-1131 copy license and notice to the release files, reviewed by David
Arthur
commit cd81d37ac872654c0cc68fab830ee457c56b7c6a
Author: Jun Rao <jun...@gmail.com>
Date: 2013-11-21T05:42:24Z
fix for scala 2.10.1 compilation issued introduced in kafka-1117
commit 99dd94c9b659775e738e12330d90ae7ebe7bdbb6
Author: drunkedcat <whiteli...@gmail.com>
Date: 2013-11-22T05:37:34Z
kafka-933; Hadoop example running DataGenerator causes
kafka.message.Message cannot be cast to [B exception; patched by drunkedcat;
reviewed by Jun Rao
commit 2477a7468e7bfe728abae793236d8aaf1c211d3b
Author: Jie Huang <ie.hu...@intel.com>
Date: 2013-11-22T16:25:05Z
kafka-1136; Add subAppend in Log4jAppender for generic usage; patched by
Jie Huang; reviewed by Joel Koshy and Jun Rao
commit 87efda7f818218e0868be7032c73c994d75931fd
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2013-11-22T17:16:39Z
kafka-1103; Consumer uses two zkclients; patched by Guozhang Wang; reviewed
by Joel Koshy and Jun Rao
commit bb2dc49bde2f77b7ceb9e47a0f710204530774a4
Author: Joe Stein <joe.st...@stealth.ly>
Date: 2013-11-25T02:33:45Z
KAFKA-1133 LICENSE and NOTICE files need to get into META-INF when jars are
built before they're signed for publishing to maven reviewed by Joel Koshy
commit 583044cd5109cd060bdfc9e516f4c85d1d4e73a0
Author: Jun Rao <jun...@gmail.com>
Date: 2013-11-25T23:34:04Z
recommit kafka-1112 since it's inadvently reverted in the commit of
kafka-1135
commit ac239da502c4de10f63b0b5d638c3d8b11711eae
Author: Joel Koshy <jjko...@gmail.com>
Date: 2013-11-26T03:46:42Z
Update description of num.partitions config in sample server properties -
issue reported by Vaibhav Puranik
commit df288b75a0c6685deeda99ce4db3e17fff39b0ad
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2013-11-28T05:56:55Z
kafka-1140; Move the decoding logic from ConsumerIterator.makeNext to next;
patched by Guozhang Wang; reviewed by Jun Rao
commit 224f192c776b4348596fbf068771c98aa9db9f3d
Author: Swapnil Ghike <sgh...@linkedin.com>
Date: 2013-11-29T17:29:56Z
kafka-1152; ReplicaManager's handling of the leaderAndIsrRequest should
gracefully handle leader == -1; patched by Swapnil Ghike; reviewed by Jun Rao
commit 7c7951426df5fe8a65b176fe49584868e7af3b4f
Author: Jun Rao <jun...@gmail.com>
Date: 2013-12-02T21:58:10Z
kafka-1154; replicas may not have consistent data after becoming follower;
patched by Jun Rao; reviewed by Guozhang Wang and Neha Narkhede
commit b638b0f34623769e2efbcb7c2c36f7b742f6b690
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2013-12-03T05:55:48Z
kafka-1157; Clean up Per-topic Configuration from Kafka properties; patched
by Guozhang Wang; reviewed by Jun Rao
commit ea3961fc84c5a45a5458b9db4080b32f28855f7b
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-04T00:25:31Z
KAFKA-1156 Improve reassignment tool to output the existing assignment to
facilitate rollbacks; reviewed by Jun Rao
commit 6c36beef873e8696e3e68b38c886893e01ce6dbb
Author: Swapnil Ghike <sgh...@linkedin.com>
Date: 2013-12-04T00:50:18Z
minor fix for KAFKA-1152; ReplicaManager's handling of the
leaderAndIsrRequest should gracefully handle leader == -1; patched by Swapnil
Ghike; reviewed by Jun Rao
commit 8a2ba3f6f2eab88db4b5ea6d880ec2feba93276c
Author: Jun Rao <jun...@gmail.com>
Date: 2013-12-04T23:47:18Z
kafka-1168; OfflinePartitionCount in JMX can be incorrect during controlled
shutdown; patched by Jun Rao; reviewed by Swapnil Ghike
commit 7dee06ee99bf2610d71df04e4e5238a10a8388a2
Author: Jun Rao <jun...@gmail.com>
Date: 2013-12-05T17:38:24Z
kafka-1169; missing synchronization in access to leaderCache in KafkaApis;
patched by Jun Rao; reviewed by Neha Narkhede
commit 876cfdb59730f0e0c0f87aed15d65fa747c19bd3
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-06T00:57:26Z
KAFKA-1167 Improve the kafka-topics tool to list the topics with overridden
configs; reviewed by Jun Rao
commit 32aae7202ce041128fb1f6d2ea43580ee7864d74
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-07T00:26:53Z
KAFKA-1170 ISR can be inconsistent during partition reassignment for low
throughput partitions; reviewed by Jun Rao and Guozhang Wang
commit 6bc290f66d738a9133afe93e2a6ac64f1344c111
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-11T19:18:24Z
KAFKA-1178 Replica fetcher thread dies while becoming follower; reviewed by
Jun Rao and Guozhang Wang
commit 169a79e687799bffd5cf1f4bb86855bf3725cb88
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-12T00:20:38Z
KAFKA-1142 Patch review tool should take diff with origin from last
divergent point; reviewed by Neha Narkhede
commit dd58d753ce3ffb41776a6fa6322cb822f2222500
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-12T00:34:34Z
KAFKA-1134 onControllerFailover function should be synchronized with other
functions; reviewed by Neha Narkhede
commit b5d16871c02a585643aec3229546af04721bb42c
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-19T20:54:10Z
KAFKA-1139 Topic data change handling callback should not call
syncedRebalance directly; reviewed by Guozhang Wang and Jun Rao
commit b23cf1968f2aa4f8dbd6629634ae813b5e14564c
Author: Sriram Subramanian <sriram....@gmail.com>
Date: 2013-12-20T22:04:23Z
KAFKA-930 leader auto rebalance feature; reviewed by Neha Narkhede, Jun Rao
and Guozhang Wang
commit 10fa20001dd22a2cfc7da065d75d7cf6c0009b42
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2013-12-20T22:39:03Z
KAFKA-1185 Improve leader elector module to have a resign API; reviewed by
Guozhang Wang and Jun Rao
commit a119f532c8b310122d85391efe11fd26027ef7f9
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2014-01-03T19:06:04Z
Rebased from trunk to resolve conflicts between KAFKA-1185 and KAFKA-930
commit 3f88be6318670864b372deccb2af705e8c84382a
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2014-01-03T19:29:53Z
KAFKA-1187 Controller should retry connecting to brokers to send state
change requests; reviewed by Jun Rao and Guozhang Wang
commit 15f3c8417e07e6bc6cbe0c5991f5641396c61b24
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2014-01-03T20:21:49Z
kafka-1198; NullPointerException in describe topic; patched by Guozhang
Wang; reviewed by Jun Rao
commit f63e3f730673f60ca179030cf0d64380689c2a40
Author: Jun Rao <jun...@gmail.com>
Date: 2014-01-08T06:36:00Z
kafka-1074; Reassign partitions should delete the old replicas from disk;
patched by Jun Rao; reviewed by Jay Kreps, Neha Narkhede and Guozhang Wang
commit d2e2c607d1490cf2121dd64f4e79f34ba64c8ed7
Author: Neha Narkhede <neha.narkh...@gmail.com>
Date: 2014-01-13T21:59:33Z
KAFKA-1199 Add a reduced access log level; reviewed by Guozhang Wang and
Jun Rao
commit d401292abb0f3660895173d4613f712058ae097f
Author: Joe Stein <joe.st...@stealth.ly>
Date: 2014-01-14T02:16:32Z
KAFKA-1200 inconsistent log levels when consumed offset is reset patch by
Dima Pekar reviewed by Joe Stein
commit 855340a2e65ffbb79520c49d0b9a231b94acd538
Author: Jun Rao <jun...@gmail.com>
Date: 2014-01-15T16:37:14Z
kafka-1202; optimize ZK access in KafkaController; also incorporating fixes
in kafka-1020; patched by Jun Rao and Guozhang Wang; reviewed by Neha Narkhede
and Joel Koshy
commit c2ed6415fcfa02d08dde031f0f799f5a0f18d8c5
Author: Guozhang Wang <guw...@linkedin.com>
Date: 2014-01-16T04:57:07Z
kafka-1208; Update system test still to use kafka-topics instead of
kafka-create-topics shell; patched by Guozhang Wang; reviewed by Jun Rao
commit e1f7bea157c828d1eefdc5f9cf0337be79d809eb
Author: Ailing Zhang <zhangal1...@gmail.com>
Date: 2014-01-17T16:29:28Z
kafka-1205; README in examples not update; patched by Ailing Zhang;
reviewed by Jun Rao
commit 088cc3b019abe6cd1ca49dd8eff1335bc37d4adf
Author: jmlvanre <joris.van.remoort...@gmail.com>
Date: 2014-02-01T00:03:41Z
Adding rack-aware replication option. rack-id defaults to -1. use the
max-rack-replication option when creating a topic to distribute replicas such
that no more than max-rack-replication replicas are hosted on the same rack-id.
This option is also enforced when adding new partitions. The option does not
enforce manual (re)assignment.
----
