[
https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-3950:
-----------------------------------
consumer.subscribe(Pattern p , ..) method is failing when authorizer is enabled.
irrespective of pattern supplied, Consumer.subscribe(Pattren p, ..) method is
always fetches metadata of all the topics(including internal topics) available
in the cluster.
Since consumer is trying to fetch all the topics available in the cluster, it
will fail for internal topics and topics which does not have describe
permission.
Even if we give permission to all the topics which are matching the pattern,
consumer.subscribe(Pattern p,..) will fail by complaining about internal topics
and other uninterested topics.
Current Consumer.subscribe(Pattern p,..) method implementation is fetching all
the topic metadata and then it is applying the
pattern matching on client side. One possible solution is, send the pattern
string to server and fetch only required topic metadata
[~ijuma] [~hachikuji]] I would like to know your views on this issue.
> kafka mirror maker tool is not respecting whitelist option
> ----------------------------------------------------------
>
> Key: KAFKA-3950
> URL: https://issues.apache.org/jira/browse/KAFKA-3950
> Project: Kafka
> Issue Type: Bug
> Reporter: Raghav Kumar Gautam
> Assignee: Manikumar Reddy
> Priority: Critical
>
> A mirror maker launched like this:
> {code}
> /usr/bin/kinit -k -t /home/kfktest/hadoopqa/keytabs/kfktest.headless.keytab
> kfkt...@example.com
> JAVA_HOME=/usr/jdk64/jdk1.8.0_77 JMX_PORT=9112
> /usr/kafka/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config
> /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/config/mirror_consumer_12.properties
> --producer.config
> /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/config/mirror_producer_12.properties
> --new.consumer --whitelist="test.*" >>
> /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/logs/mirror_maker-12/mirror_maker_12.log
> 2>&1 & echo pid:$! >
> /usr/kafka/system_test/mirror_maker_testsuite/testcase_15001/logs/mirror_maker-12/entity_12_pid
> {code}
> Lead to TopicAuthorizationException:
> {code}
> WARN Error while fetching metadata with correlation id 44 :
> {__consumer_offsets=TOPIC_AUTHORIZATION_FAILED}
> (org.apache.kafka.clients.NetworkClient)
> [2016-06-20 13:24:49,983] FATAL [mirrormaker-thread-0] Mirror maker thread
> failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
> org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to
> access topics: [__consumer_offsets]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
