Koji Kawamura created NIFI-4818:
-----------------------------------
Summary: Fix transit URL parsing at Hive2JDBC and KafkaTopic for
ReportLineageToAtlas
Key: NIFI-4818
URL: https://issues.apache.org/jira/browse/NIFI-4818
Project: Apache NiFi
Issue Type: Bug
Components: Extensions
Affects Versions: 1.5.0
Reporter: Koji Kawamura
Assignee: Koji Kawamura
ReportLineageToAtlas parses Hive JDBC connection URLs to get database names. It
works if a connection URL does not have parameters. (e.g.
jdbc:hive2://host:port/dbName) But it reports wrong database name if there are
parameters. (e.g.
jdbc:hive2://host.port/dbName;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2)
Also, if there are more than one host:port defined, it will not be able to
analyze cluster name from hostnames correctly.
Similarly for Kafka topic, the reporting task uses transit URIs to analyze
hostnames and topic names. It does handle multiple host:port definitions within
a URI, however, current logic only uses the first hostname entry even if there
are multiple ones. For example, with a transit URI,
"PLAINTEXT://0.example.com:6667,1.example.com:6667/topicA", it uses
"0.example.com" to match configured regular expressions to derive a cluster
name. If none of regex matches, then it uses the default cluster name without
looping through all hostnames. It never uses the 2nd or later hostnames to
derive a cluster name.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
