Sadanand Shenoy created HDFS-16911:
--------------------------------------
Summary: Distcp with snapshot diff to support Ozone filesystem.
Key: HDFS-16911
URL: https://issues.apache.org/jira/browse/HDFS-16911
Project: Hadoop HDFS
Issue Type: Bug
Components: distcp
Reporter: Sadanand Shenoy
Currently in DistcpSync i.e the step which applies the diff b/w 2 provided
snapshots as arguments to the distcp job with -diff option, only
DistributedFilesystem and WebHDFS filesytems are supported.
{code:java}
// currently we require both the source and the target file system are
// DistributedFileSystem or (S)WebHdfsFileSystem.
if (!(srcFs instanceof DistributedFileSystem
|| srcFs instanceof WebHdfsFileSystem)) {
throw new IllegalArgumentException("Unsupported source file system: "
+ srcFs.getScheme() + "://. " +
"Supported file systems: hdfs://, webhdfs:// and swebhdfs://.");
}
if (!(tgtFs instanceof DistributedFileSystem
|| tgtFs instanceof WebHdfsFileSystem)) {
throw new IllegalArgumentException("Unsupported target file system: "
+ tgtFs.getScheme() + "://. " +
"Supported file systems: hdfs://, webhdfs:// and swebhdfs://.");
}{code}
As Ozone now supports snapshot feature after HDDS-6517, add support to use
distcp with ozone snapshots.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
