pithecuse527 commented on issue #13454:
URL: https://github.com/apache/gravitino/issues/13454#issuecomment-6081796144
So I've been digging into this token delegation problem, and I'd like to
suggest a new configuration for spark.
- New GVFS config `fs.gravitino.delegationToken.filesets`.
- GVFS resolves each listed fileset(gvfs paths to hdfs) and collects a
delegation token for its Kerberized HDFS cluster.
- `spark.kerberos.access.hadoopFileSystems=gvfs://fileset` stays the trigger
- just like indicating a traditional hadoop namenode address (e.g.,
spark.kerberos.access.hadoopFileSystems=hdfs://remote-namenode-1:8020)
Details:
https://github.com/apache/gravitino/pull/13455#discussion_r4218846314
I'd like to hear some thoughts or concerns. @yuqi1129 @jerryshao
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
