The very first message triggers the creation of the topic. Once the topic
is created, the producer can know the # of partitions.
Thanks,
Jun
On Fri, Jan 11, 2013 at 5:20 PM, Jane Wang wrote:
> I am using kafka 0.7. and I write a simple customized partitioner:
>
> public static class ExpertSear
In 0.7, we don't have such an api, but you can read all topics directly
from ZK. In 0.8, there is a getMetadata Api that returns all topics.
Thanks,
Jun
On Fri, Jan 11, 2013 at 5:17 PM, Jane Wang wrote:
> I am new to kafka and would appreciate any suggestions:)=
>
> In kafka 0.7, is it possibl
[
https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551766#comment-13551766
]
Jun Rao commented on KAFKA-648:
---
Merged to trunk and resolved conflicts.
> U
I am using kafka 0.7. and I write a simple customized partitioner:
public static class ExpertSearchCollectionPartitioner
implementsPartitioner {
@Override
public synchronized int partition(Long key, int numPartitions) {
System.out.print("partition: " + key.hashCode() + ", " +
I am new to kafka and would appreciate any suggestions:)=
In kafka 0.7, is it possible for the consumer to obtain all the topics so
far written by the broker?
If not possible, is there any later version makes this possible?
thanks alot!
[
https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jun Rao updated KAFKA-648:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
Thanks for the last patch. +1. Committed to 0
[
https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551666#comment-13551666
]
Swapnil Ghike commented on KAFKA-648:
-
Will it make sense to create a Utils function to
[
https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sriram Subramanian updated KAFKA-648:
-
Attachment: configchanges-v6-rebased.patch
rebased
> Use uniform conventi
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-683:
Resolution: Fixed
Status: Resolved (was: Patch Available)
Checked in the patch after revert
Neha Narkhede created KAFKA-696:
---
Summary: Fix toString() API for all requests to make logging
easier to read
Key: KAFKA-696
URL: https://issues.apache.org/jira/browse/KAFKA-696
Project: Kafka
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-683:
Status: Patch Available (was: In Progress)
> Fix correlation ids in all requests sent to kafka
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551550#comment-13551550
]
Jun Rao commented on KAFKA-683:
---
The changes in core/src/test/resources/log4j.properties are
[
https://issues.apache.org/jira/browse/KAFKA-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swapnil Ghike updated KAFKA-515:
Affects Version/s: 0.8.1
> Log cleanup can close a file channel opnened by Log.read before the t
[
https://issues.apache.org/jira/browse/KAFKA-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swapnil Ghike updated KAFKA-515:
Fix Version/s: (was: 0.8)
0.8.1
> Log cleanup can close a file channel op
[
https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sriram Subramanian updated KAFKA-648:
-
Attachment: configchanges-v6.patch
- Updated the comments.
- Did not remove log.dir as the
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-683:
Attachment: kafka-683-v3-unit-test.patch
Fixed correlation ids in AsyncProducerTest
[
https://issues.apache.org/jira/browse/KAFKA-598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551383#comment-13551383
]
Joel Koshy commented on KAFKA-598:
--
The full scope should probably move out of 0.8 - i.e.,
[
https://issues.apache.org/jira/browse/KAFKA-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-695:
Component/s: log
> Broker shuts down due to attempt to read a closed index file
> --
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-683:
Attachment: kafka-683-v3.patch
> Fix correlation ids in all requests sent to kafka
> ---
[
https://issues.apache.org/jira/browse/KAFKA-598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551344#comment-13551344
]
Neha Narkhede commented on KAFKA-598:
-
Do we want to move this out of 0.8 ?
[
https://issues.apache.org/jira/browse/KAFKA-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551345#comment-13551345
]
Neha Narkhede commented on KAFKA-568:
-
ping
> LogTest started failing
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551340#comment-13551340
]
Jun Rao commented on KAFKA-683:
---
Got the following compilation error on the latest rebase.
[
[
https://issues.apache.org/jira/browse/KAFKA-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-649:
Affects Version/s: 0.8.1
> Cleanup log4j logging
> -
>
> Key
[
https://issues.apache.org/jira/browse/KAFKA-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede resolved KAFKA-669.
-
Resolution: Implemented
Assignee: Neha Narkhede
> Irrecoverable error on leader while ro
Neha Narkhede created KAFKA-695:
---
Summary: Broker shuts down due to attempt to read a closed index
file
Key: KAFKA-695
URL: https://issues.apache.org/jira/browse/KAFKA-695
Project: Kafka
Issue
[
https://issues.apache.org/jira/browse/KAFKA-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede closed KAFKA-692.
---
> ConsoleConsumer outputs diagnostic message to stdout instead of stderr
> ---
[
https://issues.apache.org/jira/browse/KAFKA-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-692:
Resolution: Fixed
Assignee: ben fleis
Status: Resolved (was: Patch Available)
Checked
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-694:
Fix Version/s: (was: 0.8)
Assignee: John Fung (was: ben fleis)
> ProducerPerforman
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551335#comment-13551335
]
Neha Narkhede commented on KAFKA-694:
-
oops, wrong jira
> ProducerPerf
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede closed KAFKA-694.
---
> ProducerPerformance doesn't take "compression-codec" from command line
> ---
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-694:
Resolution: Fixed
Fix Version/s: 0.8
Assignee: ben fleis
Status: Resolved
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551323#comment-13551323
]
Neha Narkhede commented on KAFKA-694:
-
I suggest we take a string compression code that
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Fung updated KAFKA-694:
Status: Patch Available (was: Open)
> ProducerPerformance doesn't take "compression-codec" from command
[
https://issues.apache.org/jira/browse/KAFKA-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Fung updated KAFKA-694:
Attachment: kafka-694-v1.patch
Uploaded kafka-694-v1.patch to remove variable compressionCodecOption which
[
https://issues.apache.org/jira/browse/KAFKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neha Narkhede updated KAFKA-683:
Attachment: kafka-683-v2-rebased-twice.patch
Rebased yet again!
> Fix correlation i
John Fung created KAFKA-694:
---
Summary: ProducerPerformance doesn't take "compression-codec" from
command line
Key: KAFKA-694
URL: https://issues.apache.org/jira/browse/KAFKA-694
Project: Kafka
Iss
[
https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13551233#comment-13551233
]
Jun Rao commented on KAFKA-648:
---
Thanks for patch v5. Some of the comments in those config fi
[
https://issues.apache.org/jira/browse/KAFKA-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ben fleis updated KAFKA-692:
Description:
At the end of its handling loop, ConsoleConsumer prints "Consumed %d messages"
to standard out
[
https://issues.apache.org/jira/browse/KAFKA-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxime Brugidou updated KAFKA-693:
--
Attachment: mirror_debug.log
mirror.log
> Consumer rebalance fails if no lea
Maxime Brugidou created KAFKA-693:
-
Summary: Consumer rebalance fails if no leader available for a
partition and stops all fetchers
Key: KAFKA-693
URL: https://issues.apache.org/jira/browse/KAFKA-693
40 matches
Mail list logo
