Re: [zfs-discuss] Dedicated metadata devices

2012-08-28 Thread Karl Wagner
On 2012-08-24 14:39, Jim Klimov wrote: Hello all, The idea of dedicated metadata devices (likely SSDs) for ZFS has been generically discussed a number of times on this list, but I don't think I've seen a final proposal that someone would take up for implementation (as a public source code, at

Re: [zfs-discuss] Dedicated metadata devices

2012-08-25 Thread Jim Klimov
2012-08-25 15:46, Sašo Kiselkov wrote: The difference is that when you want to go fetch a block from a metaxel, you still need some way to reference it. Either you use direct references (i.e. ARC entries as above), or you use an indirect mechanism, which means that for each read you will need to

Re: [zfs-discuss] Dedicated metadata devices

2012-08-25 Thread Sašo Kiselkov
On 08/25/2012 11:53 AM, Jim Klimov wrote: >> No they're not, here's l2arc_buf_hdr_t a per-buffer structure >> held for >> buffers which were moved to l2arc: >> >> typedef struct l2arc_buf_hdr { >> l2arc_dev_t *b_dev; >> uint64_t b_daddr; >> } l2arc_buf_hdr_t; >> >> That's about 16-bytes overhead p

Re: [zfs-discuss] Dedicated metadata devices

2012-08-25 Thread Jim Klimov
> No they're not, here's l2arc_buf_hdr_t a per-buffer structure > held for > buffers which were moved to l2arc: > > typedef struct l2arc_buf_hdr { > l2arc_dev_t *b_dev; > uint64_t b_daddr; > } l2arc_buf_hdr_t; > > That's about 16-bytes overhead per block, or 3.125% if the > block's data is 512

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Sašo Kiselkov
On 08/25/2012 12:22 AM, Jim Klimov wrote: > 2012-08-25 0:42, Sašo Kiselkov wrote: >> Oh man, that's a million-billion points you made. I'll try to run >> through each quickly. > > Thanks... > I still do not have the feeling that you've fully got my > idea, or, alternately, that I correctly underst

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Jim Klimov
2012-08-25 0:42, Sašo Kiselkov wrote: Oh man, that's a million-billion points you made. I'll try to run through each quickly. Thanks... I still do not have the feeling that you've fully got my idea, or, alternately, that I correctly understand ARC :) There is also relatively large RAM pointer

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Sašo Kiselkov
Oh man, that's a million-billion points you made. I'll try to run through each quickly. On 08/24/2012 05:43 PM, Jim Klimov wrote: > First of all, thanks for reading and discussing! :) No problem at all ;) > 2012-08-24 17:50, Sašo Kiselkov wrote: >> This is something I've been looking into in the

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Jim Klimov
2012-08-24 17:39, Jim Klimov wrote: Hello all, The idea of dedicated metadata devices (likely SSDs) for ZFS has been generically discussed a number of times on this list, but I don't think I've seen a final proposal that someone would take up for implementation (as a public source code, at le

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Jim Klimov
First of all, thanks for reading and discussing! :) 2012-08-24 17:50, Sašo Kiselkov wrote: This is something I've been looking into in the code and my take on your proposed points this: 1) This requires many and deep changes across much of ZFS's architecture (especially the ability to sustain t

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Richard Elling
On Aug 24, 2012, at 6:50 AM, Sašo Kiselkov wrote: > This is something I've been looking into in the code and my take on your > proposed points this: > > 1) This requires many and deep changes across much of ZFS's architecture > (especially the ability to sustain tlvdev failures). > > 2) Most of

Re: [zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Sašo Kiselkov
This is something I've been looking into in the code and my take on your proposed points this: 1) This requires many and deep changes across much of ZFS's architecture (especially the ability to sustain tlvdev failures). 2) Most of this can be achieved (except for cache persistency) by implementi

[zfs-discuss] Dedicated metadata devices

2012-08-24 Thread Jim Klimov
Hello all, The idea of dedicated metadata devices (likely SSDs) for ZFS has been generically discussed a number of times on this list, but I don't think I've seen a final proposal that someone would take up for implementation (as a public source code, at least). I'd like to take a liberty of