Hi All,
Since the last discussion, we have done the following based on suggestions.
1. Split flink-connector, spark-connector, and doris-mananger from the Doris
repo into three separate repo.
- https://github.com/apache/incubator-doris-manager
- https://github.com/apache/incubator-doris-flink-connector
- https://github.com/apache/incubator-doris-spark-connector
so that we can release these modules independently.
2. finished releasing both spark-connector and flink-connector components.
1. https://lists.apache.org/thread/gql1xorqs1smlq5o3jxfjgnzfh4woh2z
2. https://lists.apache.org/thread/gdhym3pv15265dlssc8knsn3bomnpmzj
3. Binary release of Doris core 1.0.0 is being voted on at IPMC.
https://lists.apache.org/thread/y2plp5gwl2cpk54jb4g2myfn91s6q7yt
I think we can continue the discussion about Doris graduation issues now.
If there are no other comments, I will start preparing the Resolution and start
a discussion at IPMC
--
此致!Best Regards
陈明雨 Mingyu Chen
Email:
[email protected]
在 2022-02-10 15:01:27,"Yun Tang" <[email protected]> 写道:
>Thanks for the explanations.
>+ 1 for starting the graduation process.
>
>Best
>Yun Tang
>
>On 2022/02/10 04:41:43 陈明雨 wrote:
>> >For the branding issues, I found I cannot open the thread links. Are they
>> >private threads? If this discussion thread is public, maybe we could at
>> >least give some background information.
>>
>>
>> Yes, they were discussed in private@doris list. It is about "doris" on Baidu
>> Cloud, "dorisdb" and "cdwdoris" on Tecent Cloud.
>> The first 2 has been solved, and the "cdwdoris" will be solved at the end of
>> Feb.
>>
>>
>>
>>
>> --
>>
>> 此致!Best Regards
>> 陈明雨 Mingyu Chen
>>
>> Email:
>> [email protected]
>>
>>
>>
>>
>>
>> 在 2022-02-10 11:23:33,"Yun Tang" <[email protected]> 写道:
>> >It's great to see the discussion on Apache Doris' graduation from the
>> >incubator!
>> >
>> >For the branding issues, I found I cannot open the thread links. Are they
>> >private threads? If this discussion thread is public, maybe we could at
>> >least give some background information.
>> >
>> >Best
>> >Yun Tang
>> >
>> >On 2022/02/10 01:20:25 寒江雪 wrote:
>> >> +1. I think we can get started on the graduation process.
>> >>
>> >> 陈明雨 <[email protected]> 于2022年2月9日周三 22:26写道:
>> >>
>> >> > >For the relationship of the Impala project, I think we need to get in
>> >> > >touch with the Impala team to get more feedback.Before entering the
>> >> > apache incubator, Doris was developed based on a very early version of
>> >> > Impala.
>> >> >
>> >> > In order to adapt to Doris' architecture (both metadata and planning are
>> >> > in FE), we have made many changes.
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > After entering the apache incubator, we try to give back some new
>> >> > features
>> >> > to the Impala community including Grouping set [1], left join -> inner
>> >> > join
>> >> > [2], etc.
>> >> >
>> >> > Although we raised tickets, after communicating with Impala PMC, we
>> >> > found
>> >> > that new features we wanted to give back to Impala have been
>> >> > implemented.
>> >> >
>> >> > So in the end there is no substantial code contribution.
>> >> >
>> >> >
>> >> > Both communities are iterating rapidly at their own pace, and many
>> >> > common
>> >> > SQL features do overlap in part, but only in terms of functionality,
>> >> > with
>> >> > significant differences at the code level.
>> >> >
>> >> >
>> >> >
>> >> > [1] https://issues.apache.org/jira/browse/IMPALA-9298
>> >> >
>> >> > [2] https://issues.apache.org/jira/browse/IMPALA-11074
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> >
>> >> > 此致!Best Regards
>> >> > 陈明雨 Mingyu Chen
>> >> >
>> >> > Email:
>> >> > [email protected]
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > 在 2022-02-09 14:43:10,"陈明雨" <[email protected]> 写道:
>> >> > >>I just want to mention about the recent release of Java code, it's
>> >> > >>better to add another git repo to host the java code for the maven
>> >> > >>release.
>> >> > >>It doesn't make any sense that we have different tags for the java
>> >> > >>code release. I'd like to see this issue addressed before graduation.
>> >> > >
>> >> > >Thanks for you suggestion. I will start a new thread to discuss it. I
>> >> > think creating a new repo is a good way to address this issue.
>> >> > >
>> >> > >--
>> >> > >
>> >> > >此致!Best Regards
>> >> > >陈明雨 Mingyu Chen
>> >> > >
>> >> > >Email:
>> >> > >[email protected]
>> >> > >
>> >> > >
>> >> > >
>> >> > >
>> >> > >
>> >> > >At 2022-02-08 20:44:25, "Willem Jiang" <[email protected]> wrote:
>> >> > >>It is good to see Doris did lots of work on building up the community.
>> >> > >>The brand issues were addressed last year.
>> >> > >>For the relationship of the Impala project, I think we need to get in
>> >> > >>touch with the Impala team to get more feedback.
>> >> > >>
>> >> > >>I just want to mention about the recent release of Java code, it's
>> >> > >>better to add another git repo to host the java code for the maven
>> >> > >>release.
>> >> > >>It doesn't make any sense that we have different tags for the java
>> >> > >>code release. I'd like to see this issue addressed before graduation.
>> >> > >>
>> >> > >>Willem Jiang
>> >> > >>
>> >> > >>Twitter: willemjiang
>> >> > >>Weibo: 姜宁willem
>> >> > >>
>> >> > >>On Tue, Feb 8, 2022 at 3:09 PM 陈明雨 <[email protected]> wrote:
>> >> > >>>
>> >> > >>> Hi all.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> Apache Doris (Incubating) has been in development for over 3 years
>> >> > since it entered the Apache incubator in September 2018.
>> >> > >>>
>> >> > >>> During our time in the Incubator, we have learned a lot about open
>> >> > source software governance and the Apache Foundation's philosophy on
>> >> > managing, maintaining, and developing open source community.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> I am pleased to conduct a discussion here on matters related to
>> >> > >>> Doris'
>> >> > graduation from the incubator.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> The following is a brief overview of the progress of the Doris
>> >> > >>> project
>> >> > and community since entering the incubator.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 1. Community
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> - 8 new PPMC members were added, from five different companies,
>> >> > bringing the total number of PPMC members to 21.
>> >> > >>>
>> >> > >>> - 16 new Committers were added (including the new PPMC members),
>> >> > bringing the total number of Committers to 29.
>> >> > >>>
>> >> > >>> - The number of Contributors is now 245 and growing.
>> >> > >>>
>> >> > >>> - The dev@doris mailing list currently has 289 subscribers, and
>> >> > all major project discussions are happening in the dev@doris.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 2. Project
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> - 7 releases by 6 release managers. All compliance issues have
>> >> > been resolved.
>> >> > >>>
>> >> > >>> - Doris official website[1] is compliant with Apache Foundation
>> >> > requirements[2].
>> >> > >>>
>> >> > >>> - Project maturity model is detailed in [3].
>> >> > >>>
>> >> > >>> - We have also created a pre-graduation Check List[4] following
>> >> > the Apache official website guidelines and are currently moving forward.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> Some things that I think need further discussion.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 1. Branding issue
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> Doris had some branding issues during the incubating[5][6]. I
>> >> > think these issues have been resolved and would appreciate the mentors'
>> >> > assistance in checking them out.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 2. Relationship with Apache Impala
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> Doris' current query engine is forked from Impala version v0.7
>> >> > >>> and
>> >> > has been updated with Impala in the early stages of the project
>> >> > (hands-on
>> >> > code merge).
>> >> > >>>
>> >> > >>> In the Doris Proposal [7], we expressed our desire to decouple
>> >> > >>> the
>> >> > Doris storage engine from the query engine through a layer of abstract
>> >> > API.
>> >> > So that the query layer could fully follow Impala's evolution.
>> >> > >>>
>> >> > >>> However, as the project progressed, we found it difficult to
>> >> > achieve this goal, mainly for the following reasons.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 1. Impala focus on providing query acceleration on the Hadoop
>> >> > ecosystem, while Doris focus on a standalone data warehouse or DBMS
>> >> > system.
>> >> > The difference of targets means that many features do not meet the
>> >> > needs of
>> >> > both projects.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 2. Doris has completely refactored the metadata and has its own
>> >> > storage engine. This required a deep integration of the query layer with
>> >> > the metadata and the storage engine. We also made a lot of architectural
>> >> > changes for this.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> 3. Doris has now developed a new vectorized execution engine
>> >> > >>> that
>> >> > rewrites most of the execution node in query layer, which is different
>> >> > from
>> >> > Impala.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> For these reasons, it is difficult for us to continue to follow
>> >> > the Impala community with code level iterations and integrations.
>> >> > >>>
>> >> > >>> Of course, all code references to Impala are fully compliant
>> >> > >>> with
>> >> > the Apache License, and we explicitly declare the relationship between
>> >> > Doris and Impala in the NOTICE file[8] and the README file[9] and thank
>> >> > the
>> >> > Impala community for their help.
>> >> > >>>
>> >> > >>> Since this aspect deviates from the direction in the original
>> >> > Proposal, I think it needs to be listed separately for necessary
>> >> > discussion.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> If there are any other aspects that need to be discussed before
>> >> > graduation, please discuss.
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> [1] http://doris.incubator.apache.org/
>> >> > >>>
>> >> > >>> [2] https://whimsy.apache.org/pods/project/doris
>> >> > >>>
>> >> > >>> [3]
>> >> > https://cwiki.apache.org/confluence/display/DORIS/Maturity+Assessment+for+Doris
>> >> > >>>
>> >> > >>> [4]
>> >> > https://cwiki.apache.org/confluence/display/DORIS/Graduation+Check+List
>> >> > >>>
>> >> > >>> [5] https://lists.apache.org/thread/k8klobjzffobbx161nj6plc0mfl8gc7z
>> >> > >>>
>> >> > >>> [6] https://lists.apache.org/thread/t6dwq77x0jjm63kpkzlq51sfbowd92p9
>> >> > >>>
>> >> > >>> [7]
>> >> > https://cwiki.apache.org/confluence/display/incubator/DorisProposal
>> >> > >>>
>> >> > >>> [8] https://github.com/apache/incubator-doris/blob/master/NOTICE.txt
>> >> > >>>
>> >> > >>> [9] https://github.com/apache/incubator-doris/blob/master/README.md
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> --
>> >> > >>>
>> >> > >>> 此致!Best Regards
>> >> > >>> 陈明雨 Mingyu Chen
>> >> > >>>
>> >> > >>> Email:
>> >> > >>> [email protected]
>> >> > >>
>> >> > >>---------------------------------------------------------------------
>> >> > >>To unsubscribe, e-mail: [email protected]
>> >> > >>For additional commands, e-mail: [email protected]
>> >> >
>> >>
>> >
>> >---------------------------------------------------------------------
>> >To unsubscribe, e-mail: [email protected]
>> >For additional commands, e-mail: [email protected]
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: [email protected]
>For additional commands, e-mail: [email protected]