[
https://issues.apache.org/jira/browse/SQOOP-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759269#comment-13759269
]
Venkat Ranganathan commented on SQOOP-1192:
-------------------------------------------
Thanks [~shuainie] for uploading the patch. Can you add tests for it. BTW,
we need to also do the same for HCatalog jars also and make sure Sqoop action
includes HCat jars given that Sqoop has Hcat integration now
And can you also please add a review board link with the revised patch
> Add option "--skip-dist-cache" to allow Sqoop not copying jars in
> %SQOOP_HOME%\lib folder when launched by Oozie and use Oozie share lib
> ----------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SQOOP-1192
> URL: https://issues.apache.org/jira/browse/SQOOP-1192
> Project: Sqoop
> Issue Type: Bug
> Reporter: Shuaishuai Nie
> Attachments: SQOOP-1192.1.patch
>
>
> Now Sqoop will copy jar files in %SQOOP_HOME%\lib folder to the job cache
> every time a Sqoop job is launched. When Oozie launch a Sqoop job, this
> behavior can be optimized by add these jars in Oozie Sqoop sharelib. In this
> case, the jar files in share lib only needed be localized to each worker node
> once and reuse by all Sqoop job launched by Oozie. This can reduce massive
> disk I/O on worker node when using Sqoop by Oozie. To enable this, Sqoop need
> to have an option which enable the job to skip adding lib jars to the job
> cache. For now, this option should only be used by Oozie started Sqoop job.
> The patch attached introduce "--skip-dist-cache" option to enable this
> feature.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
