Bruno, Bruno Sousa wrote:
Interesting, at least to me, the part where/ "this storage node is very small (~100TB)" /:)
Well, that's only as big as two x4540s, and we have lots of those for a slightly different project.
Anyway, how are you using your ZFS? Are you creating volumes and present them to end-nodes over iscsi/fiber , nfs, or other? Could be helpfull to use some sort of cluster filesystem to have some more control in the "balance"of writes across devices?
Yes -- right now I'm using Infiniband as our interconnect directly to each compute node, and am testing a variety of protocols for transferring data, all over IP, sadly. I seem to have run into some SDP performance issues but that's a different issue altogether. Most likely, we'll be moving toward Lustre which has RDMA support and is expected to support ZFS as a back end next year at which point we'll migrate to directly mounted storage on the nodes.
I'm just thinking out loud, but if your end-nodes access a zvol over iscsi, could you format that zvol in the end-node with LustreFS, and use the features of the LustreFS?
We'd really like to use ZFS and wait for Lustre to support it as a back end next year. At that point, I realize this particular question will probably be moot. However, I don't want to stand still while waiting for a feature to be implemented -- which is why I'm looking to mitigate performance penalties associated with poorly organized data across vdevs.
Best, Jesse _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
