dpengpeng commented on PR #18664: URL: https://github.com/apache/flink/pull/18664#issuecomment-2276162116
@gaborgsomogyi Hello, I am currently using Flink version 1.15.2 and have encountered an issue with the HDFS delegation token expiring after 7 days in a Kerberos scenario. I have seen your new delegation token framework (https://issues.apache.org/jira/browse/FLINK-21232) and have merged the code commits from 1 to 12 (Sub-Tasks 1-12) in the link into my Flink version 1.15.2. Now, it is possible to refresh the delegation token periodically. However, after 7 days, if the JobManager or TaskManager needs to be restarted due to an exception [example:**token (HDFS_DELEGATION_TOKEN token 31615466 for xx) can't be found in cache)**], I found that the Yarn container used to start JM/TM still uses the HDFS_DELEGATION_KIND that was generated the first time the job was submitted. That is, the token in the container environment variable HADOOP_TOKEN_FILE_LOCATION file content has not been updated. I would like to ask if your new framework supports refreshing the token corresponding to the HADOOP_TOKEN_FILE_LOCATION file. Please let me know where the code logic is, and I would be very grateful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
