@Jun Rao, Kafka version: 0.8.1.1
@Guozhang Wang, I can not found the original controller log, but I can give
the controller log after execute ./bin/kafka-reassign-partitions.sh
and ./bin/kafka-preferred-replica-election.sh
Now I do not known how to recover leader for partition 25 and 31, any id
I think @chenlax has encounter the same problem with me in
us...@kafka.apache.org with titile "How recover leader when broker restart".
cc to us...@kafka.apache.org.
On Wed, Jul 9, 2014 at 3:10 PM, 鞠大升 wrote:
> @Jun Rao, Kafka version: 0.8.1.1
>
> @Guozhang Wang, I can not found the original
Michał Michalski created KAFKA-1531:
---
Summary: zookeeper.connection.timeout.ms is set to 1000 in
configuration file in Kafka tarball
Key: KAFKA-1531
URL: https://issues.apache.org/jira/browse/KAFKA-1531
[
https://issues.apache.org/jira/browse/KAFKA-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michał Michalski updated KAFKA-1531:
Description: I've noticed that Kafka tarball comes with
zookeeper.connection.timeout.ms=100
[
https://issues.apache.org/jira/browse/KAFKA-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056049#comment-14056049
]
Stanislav Gilmulin commented on KAFKA-1530:
---
Thank you,
i'd like to ask some que
[
https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Ozeritskiy updated KAFKA-1414:
-
Attachment: parallel-dir-loading-trunk-threadpool.patch
> Speedup broker startup after ha
[
https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056065#comment-14056065
]
Alexey Ozeritskiy commented on KAFKA-1414:
--
You are right. I have made new versio
[
https://issues.apache.org/jira/browse/KAFKA-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056147#comment-14056147
]
Alan Lee commented on KAFKA-1406:
-
Would it be okay if I work on this?
> Fix scaladoc/jav
Julian Morrison created KAFKA-1532:
--
Summary: Move CRC32 to AFTER the payload
Key: KAFKA-1532
URL: https://issues.apache.org/jira/browse/KAFKA-1532
Project: Kafka
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056258#comment-14056258
]
Manikumar Reddy commented on KAFKA-1325:
Created reviewboard against branch origi
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-1325:
---
Attachment: KAFKA-1325.patch
> Fix inconsistent per topic log configs
> -
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-1325:
---
Attachment: (was: KAFKA-1325.patch)
> Fix inconsistent per topic log configs
> --
It's weird that you have replication factor 1, but two of the partitions
25 and 31 have 2 assigned replicas. What's the command you used for
reassignment?
Thanks,
Jun
On Wed, Jul 9, 2014 at 12:10 AM, 鞠大升 wrote:
> @Jun Rao, Kafka version: 0.8.1.1
>
> @Guozhang Wang, I can not found the orig
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/23362/
---
Review request for kafka.
Bugs: KAFKA-1325
https://issues.apache.org/jira/b
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-1325:
---
Attachment: KAFKA-1325.patch
> Fix inconsistent per topic log configs
> -
[
https://issues.apache.org/jira/browse/KAFKA-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056299#comment-14056299
]
Jun Rao commented on KAFKA-1406:
Alan,
That would be great. Thanks for your help.
> Fix
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056300#comment-14056300
]
Manikumar Reddy commented on KAFKA-1325:
Created reviewboard https://reviews.apach
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-1325:
---
Attachment: (was: KAFKA-1325.patch)
> Fix inconsistent per topic log configs
> --
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056319#comment-14056319
]
Jun Rao commented on KAFKA-1325:
Thanks for the patch. It seems to me that ms granularity
[
https://issues.apache.org/jira/browse/KAFKA-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056323#comment-14056323
]
Jun Rao commented on KAFKA-1528:
Thanks for the patch. It doesn't apply to trunk though. A
[
https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056338#comment-14056338
]
Jun Rao commented on KAFKA-1414:
Thanks for the patch. A few comments.
1. If there are lo
[
https://issues.apache.org/jira/browse/KAFKA-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Lee updated KAFKA-1406:
Attachment: kafka-1406-v1.patch
I've attached a patch file for the fix.
There are still few (non variable t
[
https://issues.apache.org/jira/browse/KAFKA-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056339#comment-14056339
]
Guozhang Wang commented on KAFKA-1530:
--
Not sure I understand your question, what do
It seems your broker 1 is in a bad state, besides these two partitions you
also have partition 10 whose Isr/Leader is not part of the replicas list:
Topic: org.mobile_nginx Partition: 10 Leader: 2 Replicas: 1
Isr: 2
Maybe you can go to broker 1 and check its logs first.
Guozhang
On Wed
[
https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056358#comment-14056358
]
Alexey Ozeritskiy commented on KAFKA-1414:
--
1. Ok
2. If any thread fails we get E
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/23363/
---
Review request for kafka.
Bugs: KAFKA-1325
https://issues.apache.org/jira/b
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-1325:
---
Attachment: KAFKA-1325.patch
> Fix inconsistent per topic log configs
> -
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056402#comment-14056402
]
Manikumar Reddy commented on KAFKA-1325:
Created reviewboard https://reviews.apach
[
https://issues.apache.org/jira/browse/KAFKA-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056410#comment-14056410
]
Manikumar Reddy commented on KAFKA-1325:
I added log.retention.ms and log.roll.ms
[
https://issues.apache.org/jira/browse/KAFKA-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056411#comment-14056411
]
Stanislav Gilmulin commented on KAFKA-1530:
---
It means we have the risks.
You're
[
https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056417#comment-14056417
]
Jun Rao commented on KAFKA-1414:
2. Yes, that probably right. Could you verify that the or
[
https://issues.apache.org/jira/browse/KAFKA-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056422#comment-14056422
]
Oleg commented on KAFKA-1530:
-
Another situation which happened in our production:
We have rep
[
https://issues.apache.org/jira/browse/KAFKA-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056424#comment-14056424
]
Jun Rao commented on KAFKA-1507:
Thanks for the patch. I am currently working on KAFKA-146
[
https://issues.apache.org/jira/browse/KAFKA-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056422#comment-14056422
]
Oleg edited comment on KAFKA-1530 at 7/9/14 4:33 PM:
-
Another situatio
[
https://issues.apache.org/jira/browse/KAFKA-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jay Kreps resolved KAFKA-1515.
--
Resolution: Fixed
> Wake-up Sender upon blocked on fetching leader metadata
> -
[
https://issues.apache.org/jira/browse/KAFKA-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056440#comment-14056440
]
Mickael Hemri commented on KAFKA-1019:
--
Hi Jun,
We use ZK 3.4.6, can it cause this i
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056441#comment-14056441
]
Jay Kreps commented on KAFKA-1532:
--
This is a good idea, but unfortunately would break co
[
https://issues.apache.org/jira/browse/KAFKA-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056448#comment-14056448
]
Guozhang Wang commented on KAFKA-1530:
--
Hi Stanislav/Oleg,
Kafka server has a config
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056444#comment-14056444
]
Jay Kreps commented on KAFKA-1532:
--
Also since Kafka itself fully materializes messages i
[
https://issues.apache.org/jira/browse/KAFKA-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056456#comment-14056456
]
Jun Rao commented on KAFKA-1019:
I am not sure how reliable ZK 3.4.6 is. If you check the
[
https://issues.apache.org/jira/browse/KAFKA-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056521#comment-14056521
]
Evgeny Vereshchagin commented on KAFKA-1528:
[~junrao], what command do you ru
that's because the topic have replication factor 2 at first, then I want to
reassign all partitions 2 replicas to 1 replicas, so all partitions changed
success except 25 and 31.
I think before the reassign operation partitions 25 and 31 became to have
no leader, cause the reassign operation failed
thanks for your found, it is weird.
i checked my broker 1, it is working fine, no error or warn log.
I checked the data folder, and found replication 10's replicas, isr and
leader is actually on broker 2, works fine.
just now I execute a reassignment operation to move partition 10's replicas
to b
[
https://issues.apache.org/jira/browse/KAFKA-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056720#comment-14056720
]
Evgeny Vereshchagin commented on KAFKA-1528:
kafka-patch-review.py squashes tw
Dasheng,
This is indeed wired. Could you easily re-produce the problem, i.e.
starting the cluster with a topic' replication factor > 1, then change it
to 1. And see if this issue shows up again.
Guozhang
On Wed, Jul 9, 2014 at 12:09 PM, DashengJu wrote:
> thanks for your found, it is weird.
>
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056792#comment-14056792
]
Julian Morrison commented on KAFKA-1532:
Is "Kafka itself fully materializes messa
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056802#comment-14056802
]
Jay Kreps commented on KAFKA-1532:
--
It's not unavoidable, but it is pretty hard. To make
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056806#comment-14056806
]
Jay Kreps commented on KAFKA-1532:
--
Your approach where you buffer the message with a bac
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056816#comment-14056816
]
Julian Morrison commented on KAFKA-1532:
Streaming it to a scratch file (never syn
[
https://issues.apache.org/jira/browse/KAFKA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056833#comment-14056833
]
Jay Kreps commented on KAFKA-1532:
--
Yeah agreed. I think that is doable.
> Move CRC32 to
Guozhang,
I will try to re-preduce the problem in our test environment.
And the problem now exist in our production environment for 10 days, is
there any log or memory dump or zookeeper information useful for you to
analysis the problem?
and any ideas to recover from the situation? restart the cl
51 matches
Mail list logo
