Re: [ceph-users] Design a PetaByte scale CEPH object storage

2018-08-27 Thread John Hearns
James, I would recommend that you do the following a) write out a clear set of requirements and use cases for this system. Do not mention any specific technology b) plan to install and test a small ProofOfConcept system. You can then assess if it meets the requirement in (a) On Mon, 27 Aug 2018 a

Re: [ceph-users] Design a PetaByte scale CEPH object storage

2018-08-27 Thread Marc Roos
> I am a software developer and am new to this domain. So maybe first get some senior system admin or so? You also do not want me to start doing some amateur brain surgery, do you? > each file has approx 15 TB Pfff, maybe rethink/work this to -Original Message- From: Jame

Re: [ceph-users] Design a PetaByte scale CEPH object storage

2018-08-26 Thread John Hearns
James, I echo what Christian Balzer says. DO not fixate on CEPH at this stage, we need to look at what the requirements are, There are alternatives such as Spectrum Scale and Minio. Also, depending on how often the videos are to be recalled, looking at a tape based solution. Regarding hardware, Su

Re: [ceph-users] Design a PetaByte scale CEPH object storage

2018-08-26 Thread Christian Balzer
Hello, On Sun, 26 Aug 2018 22:23:53 +0400 James Watson wrote: > Hi CEPHers, > > I need to design an HA CEPH object storage system. The first question that comes to mind is why? Why does it need to be Ceph and why object based (RGW)? >From what's stated below it seems that nobody at your en