This is slightly off topic, so I apologise in advance.
I'm investigating the option of offering private "cloud storage". I've
found many things which offer features that I want, but nothing that seems
to glue them all together into a useful whole. Thus I would like to pick
your collective brains on the matter. The reason for this mailing list is
that the obvious solution to aspects of this is to use ZFS as the
underlying filesystem, and this is the only storage mailing list I am
subscribed to. :-)
What I would like to achieve:
Large (by my standard) scale storage. Lets say petabyte scale, although
I'll start around 50-100TB.
Redundancy across machines of data. This doesn't mean that I have to have
synchronous mirroring or anything, but I don't want data stored in just
one location. I also don't require this happen at the block level. I am
quite happy for a system which has two copies of every file one two
machines done at the application level.
An Amazon S3 style interface. It doesn't have to be the same API as S3,
but something which has the same sorts of features would be good.
Scalability. My building blocks would be X4540's or similar. I want to
be able to add more of these and be able to manage the storage well. I
want the front end to hide that the data is half on machines Alpha and
Aleph and half on machines Beta and Beth.
A means of managing all this storage. I'll accept a web front end, but
I'd rather have something scriptable with an API.
Does anyone have any thoughts, pointers, or suggestions. If people have
ideas that force me away from ZFS then I'm interested, although that does
mean that this thread would drift more off topic.
Has anyone done anything like this? Whether public cloud or private
cloud? In my head the model worked really well, but research didn't
result in the solutions I thought I was going to find.
This is intended to be a service, so if it is too shonky then it won't
meet my needs.
Oh, and free isn't a requirement, but it is definitely a bonus.
Thanks in advance,
Julian
--
Julian King
Computer Officer, University of Cambridge, Unix Support
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
