I’ve been trying to use S3 backup with a NetApp appliance here but ran into problems. Has anyone managed to do this? I’m getting 404 errors on the bucket, but it does exist:
2024-09-09 22:40:28.657 DEBUG (qtp1257299717-124-bio-gp.cels.anl.gov-4) [c:genome s: r: x: t:bio-gp.cels.anl.gov-4] o.a.h.wire http-outgoing-4 >> "HEAD /solr9-backup/genome/ HTTP/1.1[\r][\n]" 2024-09-09 22:40:28.703 DEBUG (qtp1257299717-124-bio-gp.cels.anl.gov-4) [c:genome s: r: x: t:bio-gp.cels.anl.gov-4] s.a.a.request Received failed response: 404, Request ID: 1725921628649471, Extended Request ID: 12605632 It seems like that object is there: $ s3cmd info s3://solr9-backup/genome s3://solr9-backup/genome (object): File size: 0 Last mod: Fri, 06 Sep 2024 21:02:31 GMT MIME type: inode/x-empty Storage: STANDARD MD5 sum: d41d8cd98f00b204e9800998ecf8427e SSE: none Policy: none CORS: none ACL: CELS-PATRIC: FULL_CONTROL x-amz-meta-s3cmd-attrs: atime:1725644332/ctime:1725644326/gid:20001/gname:cels/md5:d41d8cd98f00b204e9800998ecf8427e/mode:33188/mtime:1725644326/uid:10078/uname:svcbvbrc Has anyone been able to make this work with a NetApp? Thanks, Bob From: Jan Høydahl <jan....@cominvent.com> Reply-To: "users@solr.apache.org" <users@solr.apache.org> Date: Wednesday, October 16, 2024 at 1:25 PM To: "users@solr.apache.org" <users@solr.apache.org> Subject: Re: Confirmation - Object Storage Hi, I don't know much about it, but our backup S3 feature works with e. g. MinIO which is S3 compatible. And most often these are made pluggable as well. I encourage you to engage in the discussion on mailing list and/or JIRA with your input. ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I don't know much about it, but our backup S3 feature works with e.g. MinIO which is S3 compatible. And most often these are made pluggable as well. I encourage you to engage in the discussion on mailing list and/or JIRA with your input. Jan > 16. okt. 2024 kl. 19:56 skrev mtn search <search...@gmail.com>: > > Hi Jan, > > Do you know if there would be many hurdles to implement SOLR SIP-20 with > on-prem object storage rather than say S3 in the cloud? > > Matt > > On Tue, Oct 15, 2024 at 5:28 PM mtn search <search...@gmail.com> wrote: > >> Thanks Jan! >> >> On Tue, Oct 15, 2024 at 4:46 PM Jan Høydahl <jan....@cominvent.com> wrote: >> >>> Hi, >>> >>> That is correct. But plans are being made to add such support: >>> https://urldefense.us/v3/__https://cwiki.apache.org/confluence/display/SOLR/SIP-20*3A*Separation*of*Compute*and*Storage*in*SolrCloud__;JSsrKysrKys!!G_uCfscf7eWS!bjujaNyj04HKq1sBscOEw4w1bJjaHotpFbJkuZlftZs0_onKy9PQiTC39a7ntxsinHxFs8el1gSBcMMmtSk$<https://urldefense.us/v3/__https:/cwiki.apache.org/confluence/display/SOLR/SIP-20*3A*Separation*of*Compute*and*Storage*in*SolrCloud__;JSsrKysrKys!!G_uCfscf7eWS!bjujaNyj04HKq1sBscOEw4w1bJjaHotpFbJkuZlftZs0_onKy9PQiTC39a7ntxsinHxFs8el1gSBcMMmtSk$> >>> >>> Jan >>> >>>> 15. okt. 2024 kl. 20:17 skrev mtn search <search...@gmail.com>: >>>> >>>> Hello, >>>> >>>> Just want to confirm that while Solr provides a backup/restore API to >>> S3 - >>>> object storage - there is no option to run Solr on object storage. Is >>> this >>>> correct? >>>> >>>> Thanks, >>>> Matt >>> >>>