Hrishikesh Gadre created SOLR-10360:
---------------------------------------
Summary: Solr HDFS snapshot export fails due to
FileNotFoundException error
Key: SOLR-10360
URL: https://issues.apache.org/jira/browse/SOLR-10360
Project: Solr
Issue Type: Bug
Security Level: Public (Default Security Level. Issues are Public)
Affects Versions: 6.3
Environment: SOLR deployed along with a HADOOP cluster (HDFS +M/R 1).
Reporter: Hrishikesh Gadre
Priority: Minor
The Solr snapshot export command (implemented in the snapshotscli.sh) uses
Hadoop distcp tool to copy the Solr index files to the desired location. When
the cluster is configured with MR1 framework (instead of YARN), this command
fails with following error,
{noformat}
Err:With failures, global counters are inaccurate; consider running with -i
Copy failed: java.io.FileNotFoundException: File does not exist: /user/systest/
/backups/mysnap/copylistings/shard1
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:66)
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:56)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:2007)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1977)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1890)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:572)
{noformat}
During investigation I found that an extra space in the distcp command was
causing this failure. For example,
This command fails with the error mentioned above,
{noformat}
hadoop distcp -f ' /backups/mysnap/copylistings/shard1'
/backups/mysnap/snapshot.shard1
{noformat}
Removing the space from the copylisting directory path fixes this issue.
{noformat}
hadoop distcp -f '/backups/mysnap/copylistings/shard1'
/backups/mysnap/snapshot.shard1
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
