Hi,
> “Clients run program written by them, which generates files of various sizes > - from 1 KB to 200 GB” If the clients are running custom software on Windows and if at all possible, I would consider using librados<http://docs.ceph.com/docs/hammer/rados/api/librados-intro/>. The library is available for C/C++, Java, PHP and Python. The object API is fairly simple and would lift the CephFS requirement. Using Rados your client will be able to talk directly to the cluster (OSDs). Some other options to access Ceph form Windows, but require a gateway (CephFS to NFS/Samba or RBD to NFS/Samba) which usually ends up being a bottleneck and a SPOF. Regarding the performance, you mentioned 160GB/min, so that is 2.7 GB/s. That shouldn’t be too difficult to reach with Journals on SSDs. In a previous thread you mentioned 468 OSDs. Doing a quick napkin calculation with a Journal:OSD ratio of 1:6 (usually 1:4 to 1:6), that should be 78 Journals, if you estimate 400MB/s (like the Intel S3710 serie) Journal write speed and a replica factor of 3, you have a maximum theoretical write speed of ~10GB/s. Say you get ~50% (I usually reach 50~60% of the theoretical write speed) of the theoretical write speed you are still above your target of 2.7 GB/s. Regards Maxime G. From: ceph-users <ceph-users-boun...@lists.ceph.com> on behalf of Nick Fisk <n...@fisk.me.uk> Reply-To: "n...@fisk.me.uk" <n...@fisk.me.uk> Date: Friday 12 August 2016 09:33 To: 'Александр Пивушков' <p...@mail.ru>, 'ceph-users' <ceph-users@lists.ceph.com> Subject: Re: [ceph-users] High-performance way for access Windows of users to Ceph. I’m not sure how stable that ceph dokan is, I would imagine the best way to present ceph-fs to windows users would be through samba. From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of ????????? ???????? Sent: 12 August 2016 07:53 To: ceph-users <ceph-users@lists.ceph.com> Subject: [ceph-users] High-performance way for access Windows of users to Ceph. Hello, I continue to design high-performance cluster Ceph, petascale. Scheduled to purchase a high-performance server, OS Windows 2016, for clients. Clients are in the Dockers. https://docs.docker.com/engine/installation/windows/<http://xo4t.mj.am/lnk/AEQAE45C5XYAAAAAAAAAAEtrDcsAADNJBWwAAAAAAACRXwBXrXveazcUdwd8RsikNs5poROMqgAAlBI/1/_45b8eFbyHPnSFd7VHy6hA/aHR0cHM6Ly9kb2NzLmRvY2tlci5jb20vZW5naW5lL2luc3RhbGxhdGlvbi93aW5kb3dzLw> Virtualization. It does not matter... Clients run program written by them, which generates files of various sizes - from 1 KB to 200 GB (yes, creepy single file size). Network planning to use Infiniband 40 GB/s between clients and Ceph. Clients work with Ceph always on one, and always only either for record or for reading. While I do not understand what Ceph technology is appropriate to use? Object, block, or file storage CephFS. So far, it seems to me, i need to use MDS, CephFS and ceph-dokan https://github.com/ketor/ceph-dokan<http://xo4t.mj.am/lnk/AEQAE45C5XYAAAAAAAAAAEtrDcsAADNJBWwAAAAAAACRXwBXrXveazcUdwd8RsikNs5poROMqgAAlBI/2/o7kGEdLuTQUpdOsZlusB9Q/aHR0cHM6Ly9naXRodWIuY29tL2tldG9yL2NlcGgtZG9rYW4> Please share the experience of how it is possible to provide access with minimal overhead (preferably zero :( ) Windows Ceph users to the server? Ie how to make sure that the files generated by the program on Windows very quickly proved to Ceph. -- Александр Пивушков
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
