[
https://issues.apache.org/jira/browse/SQOOP-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boglarka Egyed updated SQOOP-3368:
----------------------------------
Description:
The current implementation of Sqoop handles HDFS as a default filesystem, i.e.
it creates temporary directories on HDFS in case of incremental append or merge
imports. To make these incremental import use cases work with S3 the user needs
to set the {{--temporary-rootdir}} to an S3 location properly.
There should be fail-fast scenarios without the {{--temporary-rootdir}} option.
was:
The current implementation of Sqoop handles HDFS as a default filesystem, i.e.
it creates temporary directories on HDFS in case of incremental append or merge
imports. To make these incremental import use cases work with S3 the user needs
to set the {{--temporary-rootdir}} to an S3 location properly.
There should be fail-fast scenarios without the \{{--temporary-rootdir}} option
as well as a documentation of this.
> Add fail-fast scenarios to S3 incremental import use cases without
> --temporary-rootdir option
> ---------------------------------------------------------------------------------------------
>
> Key: SQOOP-3368
> URL: https://issues.apache.org/jira/browse/SQOOP-3368
> Project: Sqoop
> Issue Type: Sub-task
> Affects Versions: 1.4.7
> Reporter: Boglarka Egyed
> Assignee: Boglarka Egyed
> Priority: Major
> Attachments: SQOOP-3368.patch
>
>
> The current implementation of Sqoop handles HDFS as a default filesystem,
> i.e. it creates temporary directories on HDFS in case of incremental append
> or merge imports. To make these incremental import use cases work with S3 the
> user needs to set the {{--temporary-rootdir}} to an S3 location properly.
> There should be fail-fast scenarios without the {{--temporary-rootdir}}
> option.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
