Solved this problem! Because of SpringBoot dependency in parent POM, it
depends lots of components...
在 2018/12/18 上午10:54, big data 写道:
> When I remove/comment parent dependency like
> in Module A pom.xml, it seems ok, and streaming kafka's depends on
> kafka_2.11:0.8.2.1.
>
> The Modula
When I remove/comment parent dependency likein
Module A pom.xml, it seems ok, and streaming kafka's depends on
kafka_2.11:0.8.2.1.
The Modula A's tree:
[INFO] +- org.apache.spark:spark-core_2.11:jar:2.1.0:provided
[INFO] | +- org.apache.avro:avro-mapred:jar:hadoop2:1.7.7:provided
[INFO] |
Can you please post the full output of maven dependency:tree from the
parent POM in both scenarios?
Thanks,
Liam Clarke
On Tue, 18 Dec. 2018, 3:26 pm big data Hi,
>
> No other dependency include kafka's jar.
>
> The project structure is:
>
> pom.xml
>
> |---Module A
>
>|--pom.xml
>
> |---M
Hi,
No other dependency include kafka's jar.
The project structure is:
pom.xml
|---Module A
|--pom.xml
|---Module B
|---Module C
When spark-streaming-kafka_2.11:1.6.3 in in Module A's pom.xml, from
dependency tree, we can see in depends on kafka_2.11:0.8.2.1
When we move spark-streaming
Hi,
Is it a transitive dependency of any of your other dependencies?
Cheers,
Liam Clarke
On Tue, 18 Dec. 2018, 2:57 pm big data Hi,
> our project includes this dependency by:
>
> org.apache.spark
> spark-streaming-kafka_2.11
> 1.6.3
>
> From dependency tree, we can see it depende
Hi,
our project includes this dependency by:
org.apache.spark
spark-streaming-kafka_2.11
1.6.3
From dependency tree, we can see it dependency kafka_2.11:0.8.2.1 verson.
[cid:part1.6C4724D2.B06C4F81@outlook.com]
But when we move this dependency to project's parent pom file, the de