jerryshao opened a new issue, #13555:
URL: https://github.com/apache/gravitino/issues/13555

   ### Describe the subtask
   
   `JobTemplateResolver.resolve(jobConf, stagingDir)` (from #13468) both 
resolves the placeholders of a job template and downloads its resources 
(executable, scripts, jars, files, archives) into the job's staging directory.
   
   Split these two steps:
   
   - `JobTemplateResolver.resolve(jobConf)` builds the runtime job template 
with the placeholders resolved, keeping the resources as their original URIs.
   - A new public helper, `JobResourceUtils.fetchResources(jobTemplate, dir)` 
in `org.apache.gravitino.connector.job`, fetches the resources of a runtime job 
template into a directory, so that job executors can reuse it.
   
   `JobManager` calls both, so the behavior stays the same: parameters are 
still validated before anything is fetched, and failed runs still clean up 
their staging directory. This prepares for letting each job executor decide how 
to handle job resources.
   
   Depends on #13468.
   
   ### Parent issue
   
   #13554
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to