[ 
https://issues.apache.org/jira/browse/FLINK-21143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272699#comment-17272699
 ] 

zhisheng commented on FLINK-21143:
----------------------------------

first, i config the `execution.target` in flink-conf.yaml, it is `yarn-per-job`.

 

!image-2021-01-27-16-55-06-104.png|width=645,height=433!

 

second, the test has exception in flink sql client

!image-2021-01-27-16-56-47-400.png|width=586,height=346!

following is the files in lib/ 

!image-2021-01-27-16-58-43-372.png|width=764,height=347!

following is the files in hdfs 

!image-2021-01-27-17-00-38-661.png|width=1062,height=456!

 

> Are you sure that it could work for the old version without having connector 
> jar in the client lib directory?

 

if the flink client lib directory has not any connector jar, it may has 
exception like the second picture above

 

HDFS            lib directory                  Status

new jar         old jar                job can submit and running, but with 
exception

new jar         no jar                 job can not submit

new jar         new jar              job can submit and running, works well

 

> 【runtime】flink job use the lib jars instead of the `yarn.provided.lib.dirs` 
> config jars
> ---------------------------------------------------------------------------------------
>
>                 Key: FLINK-21143
>                 URL: https://issues.apache.org/jira/browse/FLINK-21143
>             Project: Flink
>          Issue Type: Bug
>          Components: Deployment / YARN, Runtime / Configuration
>    Affects Versions: 1.12.0
>            Reporter: zhisheng
>            Priority: Major
>         Attachments: flink-deploy-sql-client-.log, 
> image-2021-01-27-16-53-11-255.png, image-2021-01-27-16-55-06-104.png, 
> image-2021-01-27-16-56-47-400.png, image-2021-01-27-16-58-43-372.png, 
> image-2021-01-27-17-00-01-553.png, image-2021-01-27-17-00-38-661.png
>
>
> Flink 1.12.0, I had use `yarn.provided.lib.dirs` config to speed up the job 
> start,so I upload all jars in HDFS,but I update the jars in HDFS(not 
> flink-1.12.0/lib/),it will still use the lib/  jars instead of use the new 
> HDFS jars when I submit new job.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to