Hello,

After migrate from Solr 8.4 to 9, HDFS backup stops working with the error:


"Operation backup caused exception:“:
“org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for
scheme \“hdfs\“”


We followed the upgrade notes to change the solr.xml setting in Solr.xml


<backup>

    <repository name="hdfs"
class="org.apache.solr.hdfs.backup.repository.HdfsBackupRepository"
default="false">

    <str name="solr.hdfs.home”>hdfs://mynamenode:9000/app/hadoop</str>

    <int name="solr.hdfs.buffer.size">262144</int>

    <str name="solr.hdfs.permissions.umask-mode">0022</str>

    <str name="location">/user/solrbackup</str>

    </repository>

  </backup>


Then install the hdfs module by using -Dsolr.modules=hdfs option.


In solr.log it looks the module and hdfs lib jars are loaded:

2023-08-18 14:34:24.669 INFO (main) [] o.a.s.c.SolrResourceLoader Added 3
libs to classloader, from paths: /app/solr/modules/hdfs/lib]

2023-08-18 14:34:24.669 INFO (main) [] o.a.s.c.NodeConfig Added module
hdfs. libPath=/app/solr/modules/hdfs/lib with 3 libs 2023-08-18
14:34:24.669 DEBUG (main) [] o.a.s.c.NodeConfig Libs loaded from
/app/solr/modules/hdfs/lib:
[file:/app/solr/modules/hdfs/lib/solr-hdfs-9.0.0.jar,
file:/app/solr/modules/hdfs/lib/hadoop-client-runtime-3.3.2.jar,
file:/app/solrmodules/hdfs/lib/hadoop-client-api-3.3.2.jar]


Also we cannot find the exception in solr.log.  The error message only
appears in the REQUESTSTATUS api response.


What could be missing here?  I also tried adding the classpath to lib
directives in solrconfig.xml without effect.


Thanks,

Wei

Reply via email to