Thank you so much for your quick response. Please see my inline response. - The ASF advocates Community Over Code. In the incubator, we help projects grow and mature their communities, rather than just building a code repository. So where is your community? Are there any outside contributors besides Solidigm? Wayne: currently CSAL is from SPDK community, all SPDK developers help on it. We have one dedicated developer who works on SPDK community upstreaming, and he is SPDK big maintainer help review patches. - The ASF works for public good. If your code is already part of upstream SPDK, why do you believe donating it to the ASF will improve things? Are you considering open-sourcing your internal closed-source projects as well? Does this software work with all SSDs or just Solidigm ones? Wayne: I attend this 2024 Asia Apache SW conference, I believe there are a lot of amazing AI and streaming, big data Open-Source SW there. I would like to bring our developers be more active to build more open-source collaboration with other projects to improve from application to storage. As we can see the trend, storage industry develops new FDP protocol that is for how to tune application with storage in all in one stack. We can be that part core component. We will be considering open-source our internal closed source features to apache community for better collaboration with other projects. ๐ this SW works for all NVMe SSDs. NVMe SSD is one standard, driven by Samsung, Solidigm(previous intel SSD), WD and Koxia. We worked with WD to demo ZNS CSAL together in the SINA SDC too.
-----Original Message----- From: Xuanwo <xua...@apache.org> Sent: Wednesday, July 31, 2024 10:51 AM To: Wayne Gao <wayne.g...@solidigm.com.invalid>; general@incubator.apache.org; Wayne Gao <wayne.g...@solidigm.com> Subject: Re: need help one champion who is interested to bring Solidigm CSAL cloud storage acceleration Layer into Apache Open Source SW family [You don't often get email from xua...@apache.org. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ] Caution: External Email Hi, Wayne Gao Thanks a lot for starting this thread and also happy to see more storage related projects in the ASF. I have two questions around this idea: - The ASF advocates Community Over Code. In the incubator, we help projects grow and mature their communities, rather than just building a code repository. So where is your community? Are there any outside contributors besides Solidigm? - The ASF works for public good. If your code is already part of upstream SPDK, why do you believe donating it to the ASF will improve things? Are you considering open-sourcing your internal closed-source projects as well? Does this software work with all SSDs or just Solidigm ones? On Wed, Jul 31, 2024, at 10:23, Wayne Gao wrote: > > > Hello dear Apache mentors, > > This is Wayne Gao from Solidigm as Principal storage solution architect, > previous I worked at DellEMC objectscale and Isilon as Sr-Principal storage > engineer. Recently Solidigm 60T-120T QLC gain big success in US AI infra > building as backend storage. > > I would like to proposal our storage open-source SW to be into Apache. > CSAL is cloud storage acceleration Layer. We developed this back to 5 years > ago at Intel. Now we continue working on based on customer demands. > 1. CSAL offer both log structure cache and set associate cache, it is global > commercial release inside Alibaba EBS local disk and Cloud EBS disk. > 2. With CSAL shaping feature, you can easily build scale out S+Q storage > solution to service the user workloads and maintain density, storage industry > have VAST that using similar design too. > 3. you can export CSAL inside DPU, CIPU, NVMeOF to provide storage service, > it supports K8S CSI too. > 4. CSAL is also one user mode FTL that user can tuned and customized > well for the workload, underlying device support large density QLC, > FDP(Flexible Data Placement) > > > *We released CSAL with in Alibaba Cloud big data high density disk > service and jointly publish paper in Eurosys2024 together attached > please find. *For Alibaba it is basically same HDD cost but get NVMe > SSD performance story.** > > > *Brief introduction link from Solidigm* ====CSAL solution brief==== > https://www/. > solidigm.com%2Fproducts%2Ftechnology%2Fcloud-storage-acceleration-laye > r-write-shaping-csal.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C5 > 44c2e7de124410f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0 > %7C0%7C638579912341307665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAi > LCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=un0V > dU14zWsiRpraShUTI8SVTEGN%2BBc6Yp8NoXlXHSA%3D&reserved=0 > ===CSAL RSP JBOF design link=== > > https://www/. > solidigm.com%2Fproducts%2Ftechnology%2Fcsal-based-reference-storage-pl > atform.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C544c2e7de124410 > f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0%7C6385799 > 12341321147%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMz > IiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=7F4BeSzfI25JOCG7%2 > F8zhIz%2BiHveb2n55zx487DanRP0%3D&reserved=0 > ===CSAL RSP solution brief paper=== > https://www/. > solidigm.com%2Fcontent%2Fdam%2Fsolidigm%2Fen%2Fsite%2Fproducts%2Ftechn > ology%2Fcsal-based-reference-storage-platform%2Fdocuments%2Fcsal-based > -reference-storage-platform-p5336-solution-brief.pdf&data=05%7C02%7CWa > yne.Gao1%40solidigm.com%7C544c2e7de124410f711508dcb10bcd68%7C4bb44aac8 > 67a4be0aa3430794e8470dd%7C0%7C0%7C638579912341330953%7CUnknown%7CTWFpb > GZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0 > %3D%7C0%7C%7C%7C&sdata=Xye%2BVLxaKcgEchGl8zWvcf1iT76mkISSIPLc%2F4%2Btk > sQ%3D&reserved=0 > ===RSP step by step==== > https://www/. > solidigm.com%2Fcontent%2Fsolidigm%2Fus%2Fen%2Fsupport-page%2Fdrivers-d > ownloads%2Fka-01786.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C54 > 4c2e7de124410f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0% > 7C0%7C638579912341338812%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiL > CJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=8TVqN > h9DNEs6j7ZG%2FLGT%2FXnEtfYnrgoPefUsozrQ6no%3D&reserved=0 > > > *current open-source repo is in upstreaming SPDK, we have internal > closed source repo too.* > SPDK: Flash Translation Layer > <https://spd/ > k.io%2Fdoc%2Fftl.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C544c2 > e7de124410f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0 > %7C638579912341347328%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQ > IjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=kKr%2BBv > ZWEqhBOxdIZ7eL5q%2B5eNHhBDGuKllhRSPtqSo%3D&reserved=0> > spdk/lib/ftl at master ยท spdk/spdk (github.com) > <https://git/ > hub.com%2Fspdk%2Fspdk%2Ftree%2Fmaster%2Flib%2Fftl&data=05%7C02%7CWayne > .Gao1%40solidigm.com%7C544c2e7de124410f711508dcb10bcd68%7C4bb44aac867a > 4be0aa3430794e8470dd%7C0%7C0%7C638579912341356028%7CUnknown%7CTWFpbGZs > b3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D > %7C0%7C%7C%7C&sdata=7L5VjJwdjMefjGs45fyBFDw9M%2BngqomjkHQkDo3Rkp4%3D&r > eserved=0> > * * > > Wayne Gao > Principle Storage Solution Architect** > wechat: 13636331364 > solidigm.com > > > > CONFIDENTIALITY NOTICE: This email and any files attached may contain > confidential information and may be restricted from disclosure by corporate > confidentiality guidelines, or applicable state and federal law. It is > intended solely for the use of the person or entity to whom the email was > addressed. If you are not the intended recipient of this message, be advised > that any dissemination, distribution, or use of the contents of this message > is strictly prohibited. Please delete this email from your system if you are > not the intended recipient. > Xuanwo https://xuanwo.io/ CONFIDENTIALITY NOTICE: This email and any files attached may contain confidential information and may be restricted from disclosure by corporate confidentiality guidelines, or applicable state and federal law. It is intended solely for the use of the person or entity to whom the email was addressed. If you are not the intended recipient of this message, be advised that any dissemination, distribution, or use of the contents of this message is strictly prohibited. Please delete this email from your system if you are not the intended recipient.
