Hi, Wayne Gao Thanks a lot for the explaination.
Thank you for the explanation. I am currently focused on rewriting big data in Rust, so I'm not interested to be a champion of your project, although it does look good and interesting. I hope you find a champion else from it here. On Sat, Aug 3, 2024, at 22:47, Wayne Gao wrote: > Not get any information from you for a while. May I know if you got this? > > -----Original Message----- > From: Wayne Gao <wayne.g...@solidigm.com> > Sent: Friday, August 2, 2024 5:28 PM > To: Xuanwo <xua...@apache.org>; general@incubator.apache.org; Wayne Gao > <wayne.g...@solidigm.com> > Subject: RE: need help one champion who is interested to bring Solidigm > CSAL cloud storage acceleration Layer into Apache Open Source SW family > > Sorry Xuan, > > I reply to all, not sure why miss you. Below is my reply. ๐ > > Any question please feels free let me know. > > -----Original Message----- > From: Wayne Gao <wayne.g...@solidigm.com> > Sent: Wednesday, July 31, 2024 12:54 PM > To: general@incubator.apache.org; Wayne Gao <wayne.g...@solidigm.com> > Subject: RE: need help one champion who is interested to bring Solidigm > CSAL cloud storage acceleration Layer into Apache Open Source SW family > > Thank you so much for your quick response. Please see my inline response. > > - The ASF advocates Community Over Code. In the incubator, we help > projects grow and mature their communities, rather than just building a > code repository. So where is your community? Are there any outside > contributors besides Solidigm? > Wayne: currently CSAL is from SPDK community, all SPDK developers help > on it. We have one dedicated developer who works on SPDK community > upstreaming, and he is SPDK big maintainer help review patches. > - The ASF works for public good. If your code is already part of > upstream SPDK, why do you believe donating it to the ASF will improve > things? Are you considering open-sourcing your internal closed-source > projects as well? Does this software work with all SSDs or just > Solidigm ones? > Wayne: I attend this 2024 Asia Apache SW conference, I believe there > are a lot of amazing AI and streaming, big data Open-Source SW there. I > would like to bring our developers be more active to build more > open-source collaboration with other projects to improve from > application to storage. As we can see the trend, storage industry > develops new FDP protocol that is for how to tune application with > storage in all in one stack. We can be that part core component. We > will be considering open-source our internal closed source features to > apache community for better collaboration with other projects. ๐ this > SW works for all NVMe SSDs. NVMe SSD is one standard, driven by > Samsung, Solidigm(previous intel SSD), WD and Koxia. We worked with WD > to demo ZNS CSAL together in the SINA SDC too. > > -----Original Message----- > From: Xuanwo <xua...@apache.org> > Sent: Wednesday, July 31, 2024 10:51 AM > To: Wayne Gao <wayne.g...@solidigm.com.invalid>; > general@incubator.apache.org; Wayne Gao <wayne.g...@solidigm.com> > Subject: Re: need help one champion who is interested to bring Solidigm > CSAL cloud storage acceleration Layer into Apache Open Source SW family > > [You don't often get email from xua...@apache.org. Learn why this is > important at https://aka.ms/LearnAboutSenderIdentification ] > > Caution: External Email > > > Hi, Wayne Gao > > Thanks a lot for starting this thread and also happy to see more > storage related projects in the ASF. > > I have two questions around this idea: > > - The ASF advocates Community Over Code. In the incubator, we help > projects grow and mature their communities, rather than just building a > code repository. So where is your community? Are there any outside > contributors besides Solidigm? > - The ASF works for public good. If your code is already part of > upstream SPDK, why do you believe donating it to the ASF will improve > things? Are you considering open-sourcing your internal closed-source > projects as well? Does this software work with all SSDs or just > Solidigm ones? > > On Wed, Jul 31, 2024, at 10:23, Wayne Gao wrote: >> >> >> Hello dear Apache mentors, >> >> This is Wayne Gao from Solidigm as Principal storage solution architect, >> previous I worked at DellEMC objectscale and Isilon as Sr-Principal storage >> engineer. Recently Solidigm 60T-120T QLC gain big success in US AI infra >> building as backend storage. >> >> I would like to proposal our storage open-source SW to be into Apache. >> CSAL is cloud storage acceleration Layer. We developed this back to 5 years >> ago at Intel. Now we continue working on based on customer demands. >> 1. CSAL offer both log structure cache and set associate cache, it is >> global commercial release inside Alibaba EBS local disk and Cloud EBS disk. >> 2. With CSAL shaping feature, you can easily build scale out S+Q storage >> solution to service the user workloads and maintain density, storage >> industry have VAST that using similar design too. >> 3. you can export CSAL inside DPU, CIPU, NVMeOF to provide storage service, >> it supports K8S CSI too. >> 4. CSAL is also one user mode FTL that user can tuned and customized >> well for the workload, underlying device support large density QLC, >> FDP(Flexible Data Placement) >> >> >> *We released CSAL with in Alibaba Cloud big data high density disk >> service and jointly publish paper in Eurosys2024 together attached >> please find. *For Alibaba it is basically same HDD cost but get NVMe >> SSD performance story.** >> >> >> *Brief introduction link from Solidigm* ====CSAL solution brief==== >> https://www/. >> solidigm.com%2Fproducts%2Ftechnology%2Fcloud-storage-acceleration-laye >> r-write-shaping-csal.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C5 >> 44c2e7de124410f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0 >> %7C0%7C638579912341307665%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAi >> LCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=un0V >> dU14zWsiRpraShUTI8SVTEGN%2BBc6Yp8NoXlXHSA%3D&reserved=0 >> ===CSAL RSP JBOF design link=== >> >> https://www/. >> solidigm.com%2Fproducts%2Ftechnology%2Fcsal-based-reference-storage-pl >> atform.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C544c2e7de124410 >> f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0%7C6385799 >> 12341321147%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMz >> IiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=7F4BeSzfI25JOCG7%2 >> F8zhIz%2BiHveb2n55zx487DanRP0%3D&reserved=0 >> ===CSAL RSP solution brief paper=== >> https://www/. >> solidigm.com%2Fcontent%2Fdam%2Fsolidigm%2Fen%2Fsite%2Fproducts%2Ftechn >> ology%2Fcsal-based-reference-storage-platform%2Fdocuments%2Fcsal-based >> -reference-storage-platform-p5336-solution-brief.pdf&data=05%7C02%7CWa >> yne.Gao1%40solidigm.com%7C544c2e7de124410f711508dcb10bcd68%7C4bb44aac8 >> 67a4be0aa3430794e8470dd%7C0%7C0%7C638579912341330953%7CUnknown%7CTWFpb >> GZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0 >> %3D%7C0%7C%7C%7C&sdata=Xye%2BVLxaKcgEchGl8zWvcf1iT76mkISSIPLc%2F4%2Btk >> sQ%3D&reserved=0 >> ===RSP step by step==== >> https://www/. >> solidigm.com%2Fcontent%2Fsolidigm%2Fus%2Fen%2Fsupport-page%2Fdrivers-d >> ownloads%2Fka-01786.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C54 >> 4c2e7de124410f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0% >> 7C0%7C638579912341338812%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiL >> CJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=8TVqN >> h9DNEs6j7ZG%2FLGT%2FXnEtfYnrgoPefUsozrQ6no%3D&reserved=0 >> >> >> *current open-source repo is in upstreaming SPDK, we have internal >> closed source repo too.* >> SPDK: Flash Translation Layer >> <https://spd/ >> %2F&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C58359ae12b35403e1f2d08d >> cb2d55cf4%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0%7C638581876672450 >> 433%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTi >> I6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=dUt47Pn2C6sfV9YBAEVWTJYAAO >> JgL7fAyhhmWwdGmE8%3D&reserved=0 >> %2F&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C532e4192c39349f587a908d >> cb11cda2b%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0%7C638579984689110 >> 495%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTi >> I6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=Xc%2BkNI0btXT%2FvLxsAAIq7j >> LX8YhL4nrk1KBjvFIUd1M%3D&reserved=0 >> k.io%2Fdoc%2Fftl.html&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C544c2 >> e7de124410f711508dcb10bcd68%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0 >> %7C638579912341347328%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQ >> IjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=kKr%2BBv >> ZWEqhBOxdIZ7eL5q%2B5eNHhBDGuKllhRSPtqSo%3D&reserved=0> >> spdk/lib/ftl at master ยท spdk/spdk (github.com) >> <https://git/ >> %2F&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C58359ae12b35403e1f2d08d >> cb2d55cf4%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0%7C638581876672454 >> 443%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTi >> I6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=tSR%2FP0QvHbAoUnO4MCfcoJGt >> rWi8HrZGGqOJ0NHQZ7s%3D&reserved=0 >> %2F&data=05%7C02%7CWayne.Gao1%40solidigm.com%7C532e4192c39349f587a908d >> cb11cda2b%7C4bb44aac867a4be0aa3430794e8470dd%7C0%7C0%7C638579984689114 >> 412%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTi >> I6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=RYCnNbPDx%2F%2BeUyZ7DFVHpO >> J2fnLZXn%2B8VnmUDp9j%2BWs%3D&reserved=0 >> hub.com%2Fspdk%2Fspdk%2Ftree%2Fmaster%2Flib%2Fftl&data=05%7C02%7CWayne >> .Gao1%40solidigm.com%7C544c2e7de124410f711508dcb10bcd68%7C4bb44aac867a >> 4be0aa3430794e8470dd%7C0%7C0%7C638579912341356028%7CUnknown%7CTWFpbGZs >> b3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D >> %7C0%7C%7C%7C&sdata=7L5VjJwdjMefjGs45fyBFDw9M%2BngqomjkHQkDo3Rkp4%3D&r >> eserved=0> >> * * >> >> Wayne Gao >> Principle Storage Solution Architect** >> wechat: 13636331364 >> solidigm.com >> >> >> >> CONFIDENTIALITY NOTICE: This email and any files attached may contain >> confidential information and may be restricted from disclosure by corporate >> confidentiality guidelines, or applicable state and federal law. It is >> intended solely for the use of the person or entity to whom the email was >> addressed. If you are not the intended recipient of this message, be advised >> that any dissemination, distribution, or use of the contents of this message >> is strictly prohibited. Please delete this email from your system if you are >> not the intended recipient. >> > Xuanwo > > https://xuanwo.io/ > CONFIDENTIALITY NOTICE: This email and any files attached may contain > confidential information and may be restricted from disclosure by > corporate confidentiality guidelines, or applicable state and federal > law. It is intended solely for the use of the person or entity to whom > the email was addressed. If you are not the intended recipient of this > message, be advised that any dissemination, distribution, or use of the > contents of this message is strictly prohibited. Please delete this > email from your system if you are not the intended recipient. -- Xuanwo https://xuanwo.io/ --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org