Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-28 Thread Gao Xiang
On 2023/5/27 11:13, Du Rui wrote: Block drivers has nothing to do on filesystem page cache stuffs, also currently your approach has nothing to do with pmem stuffs (If you must mention "DAX" to proposal your "page cache sharing", please _here_ write down your detailed design first and explain h

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-28 Thread Gao Xiang
On 2023/5/26 03:26, Du Rui wrote: Hi Alexander, all the lvm volume changes and mounts during runtime caused weird behaviour (especially at scale) that was painful to manage (just search the docker issue tracker for devmapper backend). In the end everyone moved to a filesystem based implement

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-28 Thread Du Rui
Hi Alexander, > all the lvm volume changes and mounts during runtime caused > weird behaviour (especially at scale) that was painful to manage (just > search the docker issue tracker for devmapper backend). In the end > everyone moved to a filesystem based implementation (overlayfs based). Yes, w

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-28 Thread Du Rui
Hi Giuseppe, > The current OCI format, with some tweaks like (e)stargz or zstd:chunked, > already make its content addressable and a client can retrieve only the > subset of the files that are needed. At the same time we maintain the > simplicity of a tarball and it won't break existing clients.

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-28 Thread Du Rui
> Block drivers has nothing to do on filesystem page cache stuffs, also > currently your approach has nothing to do with pmem stuffs (If you must > mention "DAX" to proposal your "page cache sharing", please _here_ > write down your detailed design first and explain how it could work to > ours if y

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-28 Thread Du Rui
Hi Mike: > I appreciate that this work is being done with an eye toward > containerd "community" and standardization > it appears that this format of OCI image storage/use is only > used by Alibaba? > But you'd do well to explain why the userspace solution isn't > acceptable. Yes overlaybd ha

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Giuseppe Scrivano
Gao Xiang writes: > On 2023/5/24 23:43, Alexander Larsson wrote: >> On Tue, May 23, 2023 at 7:29 PM Mike Snitzer wrote: >>> >>> On Fri, May 19 2023 at 6:27P -0400, >>> Du Rui wrote: >>> OverlayBD is a novel layering block-level image format, which is design for container, secure cont

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Giuseppe Scrivano
Gao Xiang writes: > Hi Giuseppe, > > On 2023/5/24 01:11, Giuseppe Scrivano wrote: >> Gao Xiang writes: >> > > ... > >>> Agreed, I hope you guys could actually sit down and evaluate a proper >>> solution on the next OCI v2, currently I know there are: >>> >>> - Composefs >>> - (e)stargz ht

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Alexander Larsson
On Tue, May 23, 2023 at 7:29 PM Mike Snitzer wrote: > > On Fri, May 19 2023 at 6:27P -0400, > Du Rui wrote: > > > OverlayBD is a novel layering block-level image format, which is design > > for container, secure container and applicable to virtual machine, > > published in USENIX ATC '20 > > htt

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Gao Xiang
On 2023/5/24 23:43, Alexander Larsson wrote: On Tue, May 23, 2023 at 7:29 PM Mike Snitzer wrote: On Fri, May 19 2023 at 6:27P -0400, Du Rui wrote: OverlayBD is a novel layering block-level image format, which is design for container, secure container and applicable to virtual machine, pu

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Du Rui
Hi Mike, On 5/24/23 1:28 AM, Mike Snitzer wrote: On Fri, May 19 2023 at 6:27P -0400, Du Rui wrote: OverlayBD is a novel layering block-level image format, which is design for container, secure container and applicable to virtual machine, published in USENIX ATC '20 https://www.usenix.org/sys

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Gao Xiang
On 2023/5/24 03:48, Giuseppe Scrivano wrote: Gao Xiang writes: Hi Giuseppe, On 2023/5/24 01:11, Giuseppe Scrivano wrote: Gao Xiang writes: ... Agreed, I hope you guys could actually sit down and evaluate a proper solution on the next OCI v2, currently I know there are: - Compose

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-25 Thread Gao Xiang
Hi Giuseppe, On 2023/5/24 01:11, Giuseppe Scrivano wrote: Gao Xiang writes: ... Agreed, I hope you guys could actually sit down and evaluate a proper solution on the next OCI v2, currently I know there are: - Composefs - (e)stargz https://github.com/containerd/stargz-snapshotter -

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-23 Thread Gao Xiang
Hi Mike, On 2023/5/24 10:28, Mike Snitzer wrote: On Fri, May 19 2023 at 6:27P -0400, Du Rui wrote: OverlayBD is a novel layering block-level image format, which is design for container, secure container and applicable to virtual machine, published in USENIX ATC '20 https://www.usenix.org/sys

Re: [dm-devel] dm overlaybd: targets mapping OverlayBD image

2023-05-23 Thread Mike Snitzer
On Fri, May 19 2023 at 6:27P -0400, Du Rui wrote: > OverlayBD is a novel layering block-level image format, which is design > for container, secure container and applicable to virtual machine, > published in USENIX ATC '20 > https://www.usenix.org/system/files/atc20-li-huiba.pdf > > OverlayBD a