[RESULT] [VOTE] Release Apache Pinot (incubating) 0.3.0 RC2
Thanks for everyone who participated to the vote. The voting is now closed and it has passed with three +1(binding), and no 0 or -1 votes. Binding: +1 Kishore Gopalakrishna +1 Olivier Lamy +1 Justin Mclean (binding) Voting thread: https://lists.apache.org/thread.html/r1a7d73204883fa4616da528d93c76e82af01dcd7391a80af88574b3b%40%3Cgeneral.incubator.apache.org%3E I will process to publish the release and send ANNOUNCE later. Thanks, Apache Pinot (incubating) Community
[RESULT][VOTE] Apache Hudi (incubating) 0.5.2 RC2
Hi all, The voting for releasing Apache Hudi (incubating) 0.5.2 RC2 has passed with 4 +1 binding votes and no -1 votes. +1 Vote from: - Suneel Marthi (binding) - Justin Mclean (binding) - Thomas Weise (binding) - Gosling Von (binding) Voting Thread:http://mail-archives.apache.org/mod_mbox/incubator-general/202003.mbox/%3CCAA_%3Do7Bwfb6kCMfhT6fsU5gtshcco3xN%3DFZ%3Df1O910U6WYZoEA%40mail.gmail.com%3E http://mail-archives.apache.org/mod_mbox/incubator-general/202003.mbox/%3CCAOtpBjjTZCy2-nieqMDhwXGe59KGG5%2B6CowvVA%2BFTm2S%2BuEzPg%40mail.gmail.com%3E We will soon follow with the announcement email for the release to general@incubator. Thanks, Vino
Re: [DISCUSS] Project proposal - Apache Rainbow
I'm probably leaning towards accepting. Given that the closest fit to me seems the DLAB project, I would be keen to see if anyone in that project has an interest in keeping abreast of developments in Rainbow. DLAB is itself also incubating so we wouldn't want to burden them with too many more official responsibilities, so just informal interest would be all I would hope we could encourage. Cheers, Paul. On Wed, Mar 25, 2020 at 3:31 PM Justin Mclean wrote: > Hi, > > Really up to the project on what process would fit them best. If it ends > up an Incubator project that may mean more work for the mentors. I think > as long as they are committed to the project we could accept it, but I’d > like to hear what other IPMC members think. > > Thanks, > justin > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [Proposal]New storage project: HBlock
On 3/9/20 10:45 PM, Sheng Wu wrote: Hi Personally, and basically, I am feeling the team has misunderstood the meaning of incubator and the requirements of building the community. Same as the last time discussion, I still think they will be in a big pressure as they have to deal with the basic feature development, community build and following ASF incubator requirements at the same time if they are accepted into the incubator. And at the same time, the team lacks the experiences of open source community in or out of ASF. I find this remark confusing. Surely this is what the incubator is *for* - to learn about open source community at the ASF. A strong community and "basic feature development" are not requirements for entering the Incubator. Rather, the incubator is the place for community building (among other things). I noticed there are a lot of `will`s here in the Proposal section as the project core features. Are these language issues or all these features not available today? Which parts have been implemented? There is no requirement that a project be a completed product when it comes to the ASF. Indeed, as our friend Stefano Mazzocchi observed, all those years ago, coming in with a completed product makes it a lot harder to build a strong community, because there's nothing for them to do. I readily admit that I've been away from the Incubator for some time, but surely we don't require projects to have a robust feature set and vibrant community as a requirement of entry. That would seem completely contrary to the entire point of coming here. -- Rich Bowen - rbo...@rcbowen.com http://rcbowen.com/ @rbowen - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [Proposal]New storage project: HBlock
Three things are very clear to me: 1) having an open source iSCSI implementation from a mature and experienced storage stream is a very cool thing, especially if it can be targeted to non HDFS storage relatively easily. Building such a thing requires very high levels of experience and expertise that have generally been lacking in the open source world. 2) this team is very naive about the negative impacts that Apache processes will have on their development speed and will need lots of mentoring. Given their release schedule, I think that there are symmetrical risks, first that the team will be tempted to JFDI when getting features out the door rather than communicate and share designs and second that if they build a proper community overcoming language, timezone and large internal team dynamics that the internal political costs will severe due to slower development. 3) this team is very enthusiastic about making open source work and that might be enough to allow them to succeed in spite of the difficulties. The path to success here is, in my opinion, to require strong and engaged mentorship and make it very clear before they come in that Apache may not be a good fit due to the pressures they face to delivery on a schedule. If incubation with a high risk of exit back to a non-Apache form is acceptable to the project team, then it should be fine for Apache. On Mon, Mar 9, 2020 at 7:45 PM Sheng Wu wrote: > Hi > > Personally, and basically, I am feeling the team has misunderstood > the meaning of incubator and the requirements of building the community. > Same as the last time discussion, I still think they will be in a big > pressure as they have to deal with the basic feature development, community > build and following ASF incubator requirements at the same time if they are > accepted into the incubator. And at the same time, the team lacks the > experiences of open source community in or out of ASF. > I am not sure whether this is good for the project. Seem like a little > hurry to join the incubator. > More Comments inline. > > Willing to listen to what other IPMCs think. > > 于2020年3月10日周二 上午10:21写道： > > > Hi, All, > > > > We are China Telecom Corporation Limited Cloud Computing Branch > > Corporation. > > We hope to contribute one of our projects named 'HBlock' to Apache. > > Here is the proposal of HBlock project, please feel free to let me know > > what > > the concerns and suggestions from you. Thank you so much. > > > > HBlock Proposal > > > > 1.Abstract > > The HBlock project will be an enterprise distributed block storage. > > > > 2.Proposal > > HBlock provides a distributed block storage with the following features: > > 2.1.User-space iSCSI target: HBlock will implement an iSCSI target that > is > > RFC-7143 (https://tools.ietf.org/html/rfc7143) compliant written in pure > > Java designed to run on top of any mainstream Operating System, including > > Windows and Linux, as a user-space process. > > 2.2.Enterprise level features: HBlock will implement comprehensive > > enterprise level features, such as > > Asymmetric Logical Unit Access (ALUA, Information technology -SCSI > Primary > > Commands - 4 (SPC-4), > https://www.t10.org/cgi-bin/ac.pl?t=f&f=spc4r37.pdf), > > > > Persistent Reservations (PR, Information technology -SCSI Primary > Commands > > - > > 4 (SPC-4), https://www.t10.org/cgi-bin/ac.pl?t=f&f=spc4r37.pdf), > > VMware vSphere Storage APIs - Array Integration(VAAI, > > > > > https://www.vmware.com/techpapers/2012/vmware-vsphere-storage-apis-array-int > > egration-10337.html > > < > https://www.vmware.com/techpapers/2012/vmware-vsphere-storage-apis-array-integration-10337.html > > > > ), > > Offloaded Data Transfer(ODX, > > > > > https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-se > > rver-2012-R2-and-2012/hh831628(v=ws.11) > > < > https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-server-2012-R2-and-2012/hh831628(v=ws.11) > >), > > so that it will support > > session-level fail-over, > > Oracle Real Application Cluster(Oracle RAC, > > https://www.oracle.com/database/technologies/rac.html) , > > Cluster File System (CFS), VMware cluster and Windows cluster. > > 2.3.Low latency: HBlock will implement in-memory distributed cache to > > reduce > > write latency and improve Input / Output Operations Per Second (IOPS), > and > > it will leverage storage-class memory to archive even higher durability > > without IOPS loss. > > 2.4.Smart Compaction and Garbage Collection(GC): HBlock will convert all > > the > > write operations into sequential append operations to improve the random > > write performance, and it will choose the best timing to compact and > > collect > > the garbage per Logic Unit (LU). Comparting to Solid State Drives (SSD's) > > internal Garbage Collection, such a global GC will reduce the need of > SSD's > > internal GC, which indirectly make SSD have more usable space, and have > > even > > better GC strategy due to c
Re: [Proposal]New storage project: HBlock
I have committed to champion and I think the points you make are good, Ted. Do you have the bandwidth to be a mentor? I will work with them to set expectations about the process. I have also asked for them to do some community building now, too. -- Kevin A. McGrail Member, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 On Wed, Mar 25, 2020 at 12:00 PM Ted Dunning wrote: > Three things are very clear to me: > > 1) having an open source iSCSI implementation from a mature and experienced > storage stream is a very cool thing, especially if it can be targeted to > non HDFS storage relatively easily. Building such a thing requires very > high levels of experience and expertise that have generally been lacking in > the open source world. > > 2) this team is very naive about the negative impacts that Apache processes > will have on their development speed and will need lots of mentoring. Given > their release schedule, I think that there are symmetrical risks, first > that the team will be tempted to JFDI when getting features out the door > rather than communicate and share designs and second that if they build a > proper community overcoming language, timezone and large internal team > dynamics that the internal political costs will severe due to slower > development. > > 3) this team is very enthusiastic about making open source work and that > might be enough to allow them to succeed in spite of the difficulties. > > The path to success here is, in my opinion, to require strong and engaged > mentorship and make it very clear before they come in that Apache may not > be a good fit due to the pressures they face to delivery on a schedule. If > incubation with a high risk of exit back to a non-Apache form is acceptable > to the project team, then it should be fine for Apache. > > > > On Mon, Mar 9, 2020 at 7:45 PM Sheng Wu wrote: > > > Hi > > > > Personally, and basically, I am feeling the team has misunderstood > > the meaning of incubator and the requirements of building the community. > > Same as the last time discussion, I still think they will be in a big > > pressure as they have to deal with the basic feature development, > community > > build and following ASF incubator requirements at the same time if they > are > > accepted into the incubator. And at the same time, the team lacks the > > experiences of open source community in or out of ASF. > > I am not sure whether this is good for the project. Seem like a little > > hurry to join the incubator. > > More Comments inline. > > > > Willing to listen to what other IPMCs think. > > > > 于2020年3月10日周二 上午10:21写道： > > > > > Hi, All, > > > > > > We are China Telecom Corporation Limited Cloud Computing Branch > > > Corporation. > > > We hope to contribute one of our projects named 'HBlock' to Apache. > > > Here is the proposal of HBlock project, please feel free to let me know > > > what > > > the concerns and suggestions from you. Thank you so much. > > > > > > HBlock Proposal > > > > > > 1.Abstract > > > The HBlock project will be an enterprise distributed block storage. > > > > > > 2.Proposal > > > HBlock provides a distributed block storage with the following > features: > > > 2.1.User-space iSCSI target: HBlock will implement an iSCSI target that > > is > > > RFC-7143 (https://tools.ietf.org/html/rfc7143) compliant written in > pure > > > Java designed to run on top of any mainstream Operating System, > including > > > Windows and Linux, as a user-space process. > > > 2.2.Enterprise level features: HBlock will implement comprehensive > > > enterprise level features, such as > > > Asymmetric Logical Unit Access (ALUA, Information technology -SCSI > > Primary > > > Commands - 4 (SPC-4), > > https://www.t10.org/cgi-bin/ac.pl?t=f&f=spc4r37.pdf), > > > > > > Persistent Reservations (PR, Information technology -SCSI Primary > > Commands > > > - > > > 4 (SPC-4), https://www.t10.org/cgi-bin/ac.pl?t=f&f=spc4r37.pdf), > > > VMware vSphere Storage APIs - Array Integration(VAAI, > > > > > > > > > https://www.vmware.com/techpapers/2012/vmware-vsphere-storage-apis-array-int > > > egration-10337.html > > > < > > > https://www.vmware.com/techpapers/2012/vmware-vsphere-storage-apis-array-integration-10337.html > > > > > > ), > > > Offloaded Data Transfer(ODX, > > > > > > > > > https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-se > > > rver-2012-R2-and-2012/hh831628(v=ws.11) > > > < > > > https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-server-2012-R2-and-2012/hh831628(v=ws.11) > > >), > > > so that it will support > > > session-level fail-over, > > > Oracle Real Application Cluster(Oracle RAC, > > > https://www.oracle.com/database/technologies/rac.html) , > > > Cluster File System (CFS), VMware cluster and Windows cluster. > > > 2.3.Low latency: HBlock will implement in-memory distributed cache to > > > reduce > > > write latency and improve
Re: [Proposal]New storage project: HBlock
On Wed, Mar 25, 2020 at 1:56 PM Kevin A. McGrail wrote: > I have committed to champion and I think the points you make are good, > Ted. Do you have the bandwidth to be a mentor? > I don't have the time. I am interested in the project, but just can't afford the time and effort for mentoring a project like this that will need a lot of help and education. This would be even harder because of timezones. Most of my other-timezone meetings are with Europe (therefore early in my day). Adding Asia meetings and calls (necessary for education, I think) would mean burning both ends of the candle.
[ANNOUNCE] Apache Hudi (incubating) 0.5.2 released
Hi All, The Apache Hudi(incubating) community is happy to announce that Apache Hudi(incubating) 0.5.2 has been released! This is our third apache release. Apache Hudi (incubating) (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Apache Hudi (incubating) manages storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage) and provides the ability to query them. Voting Threads: (general@incubator) : http://mail-archives.apache.org/mod_mbox/incubator-general/202003.mbox/%3cCAA_=o7Bwfb6kCMfhT6fsU5gtshcco3xN=FZ=f1o910u6wyz...@mail.gmail.com%3e (dev@hudi) : https://lists.apache.org/thread.html/r7d8b4831666446bdf19fb6365090ad8c5975b5221e66184ccb24b7e2%40%3Cdev.hudi.apache.org%3E All information about the release is available on our release web page : https://hudi.incubator.apache.org/releases.html#release-052-incubating-docs We would like to thank IPMC members and community for taking the time to review and verify, and making this release possible! Best, Vino
Re: [Proposal]New storage project: HBlock
On 3/25/2020 5:39 PM, Ted Dunning wrote: > On Wed, Mar 25, 2020 at 1:56 PM Kevin A. McGrail > wrote: > >> I have committed to champion and I think the points you make are good, >> Ted. Do you have the bandwidth to be a mentor? >> > I don't have the time. > > I am interested in the project, but just can't afford the time and effort > for mentoring a project like this that will need a lot of help and > education. This would be even harder because of timezones. Most of my > other-timezone meetings are with Europe (therefore early in my day). Adding > Asia meetings and calls (necessary for education, I think) would mean > burning both ends of the candle. I understand but can't think of a better mentor for the project. They are looking for more mentors, btw, and I think HBlock presents a very cool solution. Anyone else willing to mentor them? Regards, KAM -- Kevin A. McGrail kmcgr...@apache.org Member, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
