Re: [VOTE] Release Apache Linkis (Incubating) 1.1.0-RC2

[cas...@apache.org]

+1 (non-binding)

I checked:
  1.Download links are valid.
  2.Checksums and PGP signatures are valid.
· 3.Release files have the word incubating in their name
  4.LICENSE and NOTICE files exist.
  5.DISCLAIMER-WIP file exist
  6.NOTICE year correct
  7.Build successfully on Win10

Chen Xia

peacewong  于2022年3月30日周三 17:10写道：
>
>  +1 binding, I checked,
>
> [ok] Download links are valid.
>
> [ok] Checksums and PGP signatures are valid.
>
> [ok] Source code distributions have correct names matching the current 
> release.
>
> [ok] LICENSE and NOTICE files are correct for each Linkis repo.
>
> [ok] All files have license headers if necessary.
>
> [ok] Build successfully on Windows.
>
> wangxiaogang  于2022年3月29日周二 23:35写道：
>
> > Hello Linkis Community,
> >
> > This is a call for vote to release Apache Linkis (Incubating) version
> > Release-1.1.0-RC2.
> >
> > Release notes:
> >
> > https://linkis.apache.org/docs/1.1.0/release-notes-1.1.0/
> >
> > The release candidates:
> >
> > https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.0-RC2/
> >
> > Maven artifacts are available in a staging repository at:
> >
> > https://repository.apache.org/content/repositories/orgapachelinkis-1060
> >
> > Git tag for the release:
> >
> > https://github.com/apache/incubator-linkis/releases/tag/release-1.1.0-rc2
> >
> > Keys to verify the Release Candidate:
> >
> > https://downloads.apache.org/incubator/linkis/KEYS
> >
> > GPG user ID:
> >
> > wangxiaogang
> >
> > As the DISCLAIMER-WIP shows, this release still left some license
> > problems, which will be gradually resolved during incubation.
> >
> > The vote will be open for at least 72 hours or until necessary number
> > of votes are reached.
> >
> > Please vote accordingly:
> >
> > [ ] +1 approve
> >
> > [ ] +0 no opinion
> >
> > [ ] -1 disapprove with the reason
> >
> > Checklist for reference:
> >
> > [ ] Download links are valid.
> >
> > [ ] Checksums and PGP signatures are valid.
> >
> > [ ] Source code distributions have correct names matching the current
> > release.
> >
> > [ ] LICENSE and NOTICE files are correct for each Linkis repo.
> >
> > [ ] All files have license headers if necessary.
> >
> > [ ] No compiled archives bundled in source archive.
> >
> > More detail checklist please refer:
> >
> >
> > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> >
> > Steps to validate the release，Please refer to:
> >
> > https://linkis.apache.org/community/how-to-verify
> >
> > Thanks,
> >
> > Xiaogang Wang.
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> > For additional commands, e-mail: dev-h...@linkis.apache.org
> >
> >

-
To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
For additional commands, e-mail: dev-h...@linkis.apache.org

[Notice]Author tag is not allowed in the header of the class file

[cas...@apache.org]

Hello Linkis Community,

Apache Linkis is licensed under the Apache License Version 2.0, which
does not allow using author tag in java code. All listed author info
can be gained from git commit history.
Some discussion emails can be found here [1]

类文件头部的不允许添加作者标签
Apache Linkis 是Apache License Version 2.0 的许可， 它不允许在 java 代码中使用 author
标记， 文件的所有贡献过的作者信息都可以从 git 提交历史中获得。
一些讨论电子邮件可以在这里找到[1]


[1] https://lists.apache.org/thread/kwzbdkldt55qw7fvw8tv3f5z1jn00z5d

Best Regards!
Chen Xia

-
To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
For additional commands, e-mail: dev-h...@linkis.apache.org

Re: Podling Linkis Report Reminder - May 2022

[cas...@apache.org]

Thank you for your reminder, we are sorting out and confirming the
corresponding quarterly board report content and will submit it soon.
In addition, can the Linkis board report be submitted every month, or
must it be reported  once a quarter?

Best Regards!

Chen Xia

 于2022年4月28日周四 08:47写道：

>
> Dear podling,
>
> This email was sent by an automated system on behalf of the Apache
> Incubator PMC. It is an initial reminder to give you plenty of time to
> prepare your quarterly board report.
>
> The board meeting is scheduled for Wed, 18 May 2022.
> The report for your podling will form a part of the Incubator PMC
> report. The Incubator PMC requires your report to be submitted 2 weeks
> before the board meeting, to allow sufficient time for review and
> submission (Wed, May 04).
>
> Please submit your report with sufficient time to allow the Incubator
> PMC, and subsequently board members to review and digest. Again, the
> very latest you should submit your report is 2 weeks prior to the board
> meeting.
>
> Candidate names should not be made public before people are actually
> elected, so please do not include the names of potential committers or
> PPMC members in your report.
>
> Thanks,
>
> The Apache Incubator PMC
>
> Submitting your Report
>
> --
>
> Your report should contain the following:
>
> *   Your project name
> *   A brief description of your project, which assumes no knowledge of
> the project or necessarily of its field
> *   A list of the three most important issues to address in the move
> towards graduation.
> *   Any issues that the Incubator PMC or ASF Board might wish/need to be
> aware of
> *   How has the community developed since the last report
> *   How has the project developed since the last report.
> *   How does the podling rate their own maturity.
>
> This should be appended to the Incubator Wiki page at:
>
> https://cwiki.apache.org/confluence/display/INCUBATOR/May2022
>
> Note: This is manually populated. You may need to wait a little before
> this page is created from a template.
>
> Note: The format of the report has changed to use markdown.
>
> Mentors
> ---
>
> Mentors should review reports for their project(s) and sign them off on
> the Incubator wiki page. Signing off reports shows that you are
> following the project - projects that are not signed may raise alarms
> for the Incubator PMC.
>
> Incubator PMC
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> For additional commands, e-mail: dev-h...@linkis.apache.org
>

-
To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
For additional commands, e-mail: dev-h...@linkis.apache.org

Podling Linkis Report - May 2022

[cas...@apache.org]

Hi  Apache Linkis PPMC,

The board meeting is scheduled for Wed, 18 May 2022.
Podling report will end on Tue May 10  2022.

I have updated the content of this report[1], please review and check it.
If mentors have no objection, please sign to confirm.


[1] https://cwiki.apache.org/confluence/display/INCUBATOR/May2022#linkis


Best Regards!
Chen Xia

[PROPOSAL] DataSource Manager Module Optimization

[cas...@apache.org]

The new features introduced by linkis in 1.1.0. The management of data
sources supports users to configure the relevant configuration of data
source connections, and by using these connection configurations, create
connections and query the metadata data of the corresponding library.
Metadata service positioning for data sources is a query service that only
provides metadata, and does not involve modifying metadata information.
Therefore, the metadata query service module is named:
linkis-metedata-manager-server with manager, which is easy to cause
misunderstanding and does not match the function positioning. The
optimization adjustment is manager->query, that is,
linkis-metedata-query-server.

At present, the SDK client LinkisMetaDataRemoteClient for metadata query
uses the data source id to associate to obtain the configuration. For
upstream users, the data source id attribute is the self-incrementing id of
a data table, which is too abstract and has no actual specific meaning. It
is recommended to optimize For association through the data source name
parameter.

Goals achieved
● Module naming adjustment
linkis-metedata-manager-server->linkis-metedata-query-server
● Metadata LinkisMetaDataRemoteClient is adjusted using key input
parameters from the data source id to the data source name name
General idea
● 1. When the client builds the request entity class object, the original
dataSourceId is adjusted to the name dataSourceName
● 2. Related back-end http interface The input parameter is adjusted from
the original dataSourceId to dataSourceName, and the data source
configuration is queried through dataSourceName to connect to the database

--

目前linkis在1.1.0中引入的新特性。数据源的管理，支持用户配置数据源连接的相关配置，通过使用这些连接配置，创建连接，查询对应库的元信息数据。对于数据源提供元数据服务定位，是只提供元数的查询服务，不涉及到修改元数据信息。所以对于元数据查询服务模块命名为：linkis-metedata-manager-server
带有manager，容易造成误解，与功能定位也不匹配，优化调整为manager->query
即linkis-metedata-query-server.

目前元数据查询的SDK客户端LinkisMetaDataRemoteClient
查询时通过数据源id来关联获取配置，对于上游用户来说，数据源id这个属性是一个数据表的自增id，太抽象，没实际具体含义，建议优化为通过数据源名称参数来作关联。

实现的目标
● 模块命名调整 linkis-metedata-manager-server->linkis-metedata-query-server
● 元数据LinkisMetaDataRemoteClient使用关键入参调整 由数据源id，调整为数据源名称name
实现大体思路
● 1.客户端在组建请求实体类对象时，由原来的dataSourceId，调整为名称dataSourceName
● 2. 相关的后端http接口 入参由原来的dataSourceId调整为dataSourceName，并通过dataSourceName
查询到数据源配置，进行数据库的连接


issue: https://github.com/apache/incubator-linkis/issues/2082
Best Regards!

Chen Xia

Re: The linkis-1.1.3 version recommends adding the following features

[cas...@apache.org]

I hava add an new feature:

[Feature] DataSource Manager module optimizatio
issue https://github.com/apache/incubator-linkis/issues/2082

Best Regards!

Chen Xia


peacewong  于2022年5月6日周五 11:47写道：

> Hello community developers, I have sorted out the problems that have
> collected a lot of community feedback before. The plan is planned in
> version 1.1.3, including resources such as linkismanager to record
> historical ec information, record ec information in the task record table,
> and export results in a table format. Automatically set cell formatting and
> other requirements.For details, please refer to:
> Projects:https://github.com/apache/incubator-linkis/projects/19
>

Re: [VOTE] Release Apache Linkis (Incubating) 1.1.1-RC1

[cas...@apache.org]

+1 (non-binding)
I  checked:
1. All download links are valid
2. Checksum and signature are OK
3. LICENSE and NOTICE are exist
4. DISCLAIMER are OK
5. Build success on win10 with jdk8

Best Regards!

Chen Xia


peacewong  于2022年5月7日周六 18:59写道：

> Hello Linkis Community,
>
> This is a call for vote to release Apache Linkis (Incubating) version
> Release-1.1.1-RC1
>
> Release notes:
>
> https://linkis.apache.org/docs/1.1.1/release-notes-1.1.1/
>
> The release candidates:
>
> https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.1-RC1/
>
> Maven artifacts are available in a staging repository at:
>
> https://repository.apache.org/content/repositories/orgapachelinkis-1063
>
> Git tag for the release:
>
> https://github.com/apache/incubator-linkis/releases/tag/release-1.1.1-rc1
>
> Keys to verify the Release Candidate:
>
> https://downloads.apache.org/incubator/linkis/KEYS
>
> GPG user ID:
>
> peacewong
>
> The vote will be open for at least 72 hours or until necessary number
> of votes are reached.
>
> Please vote accordingly:
>
> [ ] +1 approve
>
> [ ] +0 no opinion
>
> [ ] -1 disapprove with the reason
>
> Checklist for reference:
>
> [ ] Download links are valid.
>
> [ ] Checksums and PGP signatures are valid.
>
> [ ] Source code distributions have correct names matching the current
> release.
>
> [ ] LICENSE and NOTICE files are correct for each Linkis repo.
>
> [ ] All files have license headers if necessary.
>
> [ ] No compiled archives bundled in source archive.
>
> More detail checklist please refer:
>
>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
>
> Steps to validate the release，Please refer to:
>
> https://linkis.apache.org/community/how-to-verify
>
> Thanks,
>
> peacewong
>

Re: [VOTE] Release Apache Linkis (Incubating) 1.1.1-RC2

[cas...@apache.org]

1 (non-binding)
I  checked:
1. All download links are valid
2. Checksum and signature are OK
3. LICENSE and NOTICE are exist
4. DISCLAIMER are OK
5. Build success on win10 with jdk8

The  .mvn/wrapper/maven-wrapper.jar has been removed , py4j version is
py4j-0.10.9.5，and licenses/LICENSE-py4j-0.10.9.5-src.txt is exist


Best Regards!
Chen Xia


peacewong  于2022年5月16日周一 19:33写道：

>   Hello Linkis Community,
>
> This is a call for vote to release Apache Linkis (Incubating) version
> Release-1.1.1-RC2
>
> The RC2 version mainly optimizes the problems reported by Justin in RC1
> 1. Removed maven-wrapper.jar from source release
> 2. Upgrade py4j version to py4j-0.10.9.5
>
> Release notes:
>
> https://linkis.apache.org/docs/1.1.1/release-notes-1.1.1/
>
> The release candidates:
>
> https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.1-RC2/
>
> Maven artifacts are available in a staging repository at:
>
> https://repository.apache.org/content/repositories/orgapachelinkis-1064
>
> Git tag for the release:
>
> https://github.com/apache/incubator-linkis/releases/tag/release-1.1.1-rc2
>
> Keys to verify the Release Candidate:
>
> https://downloads.apache.org/incubator/linkis/KEYS
>
> GPG user ID:
>
> peacewong
>
> The vote will be open for at least 72 hours or until necessary number
> of votes are reached.
>
> Please vote accordingly:
>
> [ ] +1 approve
>
> [ ] +0 no opinion
>
> [ ] -1 disapprove with the reason
>
> Checklist for reference:
>
> [ ] Download links are valid.
>
> [ ] Checksums and PGP signatures are valid.
>
> [ ] Source code distributions have correct names matching the current
> release.
>
> [ ] LICENSE and NOTICE files are correct for each Linkis repo.
>
> [ ] All files have license headers if necessary.
>
> [ ] No compiled archives bundled in source archive.
>
> More detail checklist please refer:
>
>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
>
> Steps to validate the release，Please refer to:
>
> https://linkis.apache.org/community/how-to-verify
>
> Thanks,
>
> peacewong
>

Re: [DISCUSS] [Linkis1.1.x] [Datasource] Data source connection parameter configuration name normalization discussion

[cas...@apache.org]

At present, many configuration items are used in linkis. I think it is
necessary to discuss and determine the naming convention of configuration
parameter items.

Best Regards!

Chen Xia


leo jie  于2022年6月5日周日 19:20写道：

> Hi all:
>
>
> 目前，数据源服务模块，内置的几个数据源连接的配置项名称，与引擎数据库连接参数的配置项名称不一致。数据源服务中的数据源连接参数配置项名称是在数据库中配置的，没有命名标准的约束，用户或开发者定义的自由性很大，在做JDBC类型引擎多数据源功能参数的时候，遇到两处的数据源连接参数命名不一致。
> 详见：https://github.com/apache/incubator-linkis/issues/2211
>
> Currently, the data source service module, the built-in configuration item
> names of several data source connections are inconsistent with the
> configuration item names of the engine database connection parameters. The
> name of the data source connection parameter configuration item in the data
> source service is configured in the database, there is no naming standard
> constraint, and the user or developer has a lot of freedom to define. The
> data source connection parameters to the two places are named
> inconsistently.
> See: https://github.com/apache/incubator-linkis/issues/2211
>

Re: [HELP] The Linkis website failed to pass the apache podling website checks

[cas...@apache.org]

Hi Beacon

About Linkis website check rule,maybe you can find some useful information
from the historical discussion such as
https://lists.apache.org/thread/y1j7jd4sg1jq990tks7mq2dtdg6n1mk9
or in whimsy history mail list
https://lists.apache.org/list.html?d...@whimsical.apache.org
or ask for help at d...@whimsical.apache.org

Best Regards!

Chen Xia


NewBeacon <1963697...@qq.com.invalid> 于2022年6月7日周二 23:31写道：

> Hi Support Team,
>
> We can see here [https://whimsy.apache.org/pods/project/linkis] that this
> site failed the check.
> What's the problem? I would appreciate it if someone could tell me.

Re: [VOTE] Release Apache Linkis (Incubating) 1.1.2-RC2

[cas...@apache.org]

+1 approve( non-binding )

I checked:

[YES] Download links are valid
[YES] Checksums and PGP signatures are valid
[YES] LICENSE and NOTICE files are correct
[YES] All files have license headers if necessary
[YES] Build success on macOS
[YES] JS file(/src/common/util/ras.js, web/src/common/util/ras.js files)
with license issue in RC1 has been removed

Best Regards!

Chen Xia


Sherlock Homles  于2022年6月28日周二 14:46写道：

> +1 (binding)
>
> I checked:
> - incubating in name
> - signatures and hashes are correct
> - LICENSE and NOTICE are fine
> - no unexpected binary files
> - can compile from source on macbook arm
>
> Kind Regards,
> CooperYang
>
> peacewong  于2022年6月27日周一 17:58写道：
>
> > +1 (binding)
> >
> > I checked:
> > - incubating in name
> > - signatures and hashes are correct
> > - LICENSE and NOTICE are fine
> > - no unexpected binary files
> > - all ASF files have ASF headers
> > - can compile from source
> >
> > Kind Regards,
> > Peace Wong
> >
> > seayi  于2022年6月25日周六 23:02写道：
> >
> > > Hello Linkis Community,
> > > This is a call for vote to release Apache Linkis (Incubating)
> version
> > > Release-1.1.2-RC2.
> > >
> > >
> > >  The RC2 version mainly resolve the problems about some web JS file
> > license
> > > in RC1[1]
> > >
> > > Release notes:
> > > https://linkis.apache.org/docs/1.1.2/release-notes-1.1.2
> > >
> > >
> > > The release candidates:
> > >
> > https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.2-RC2/
> > >
> > > Maven artifacts are available in a staging repository at:
> > >
> > >
> https://repository.apache.org/content/repositories/orgapachelinkis-1079
> > >
> > > Git tag for the release:
> > >
> > >
> >
> https://github.com/apache/incubator-linkis/releases/tag/release-1.1.2-rc2
> > >
> > > Keys to verify the Release Candidate:
> > > https://downloads.apache.org/incubator/linkis/KEYS
> > >
> > > GPG user ID:
> > > seayi
> > > (I have tried to modify the description about "test key for apache"
> > >  for the gpg key but it didn't work)
> > >
> > > The vote will be open for at least 72 hours or until necessary
> number
> > > of votes are reached.
> > >
> > > Please vote accordingly:
> > >
> > > [ ] +1 approve
> > > [ ] +0 no opinion
> > > [ ] -1 disapprove with the reason
> > >
> > > Checklist for reference:
> > >
> > > [ ] Download links are valid.
> > > [ ] Checksums and PGP signatures are valid.
> > > [ ] Source code distributions have correct names matching the
> current
> > > release.
> > > [ ] LICENSE and NOTICE files are correct for each Linkis repo.
> > > [ ] All files have license headers if necessary.
> > > [ ] No unlicensed compiled archives bundled in source archive.
> > >
> > > More detail checklist  please refer:
> > >
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > > Steps to validate the release，Please refer to:
> > > https://linkis.apache.org/community/how-to-verify
> > >
> > > Thanks,
> > > XiaoHua Yi
> > >
> >
>

[Notice] Community Weekly Meeting (July 13, 2022)

[cas...@apache.org]

Conference theme: Apache Linkis(incubating) bi-weekly meeting
Meeting time: 2022/07/13 19:30-21:00
Tencent Conference: https://meeting.tencent.com/dm/cE6SdQIoSDEJ
Conference number: 396-220-298
Moderator: Xia Chen

Topic:
1. [Fixed topic] Apache Linkis incubation & version progress
synchronization.
https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax
2. [Fixed topic] Apache Linkis 1.1.2 has been released. -   Kelu Tao
 Published complete
3. [Fixed topic] Apache Linkis1.1.3 progress synchronization - Xia Chen
Release manager: Yang Zhiyue serves as the release manager
release-notes https://github.com/apache/incubator-linkis/issues/2287
test in progress
4. [Fixed topic] Apache Linkis1.2.0 progress synchronization. —— Wang Zhen
- Presto and Elasticsearch engine usage documentation
- Packaging and compiling documentation update
- Supplement to the new feature documentation
- test in progress
5. [Fixed topic] Apache Linkis1.2.1 progress synchronization —— Zhu Hui
   Mainly Trino engine, under development
6. [Fixed topic] Apache Linkis 1.3.0 progress synchronization. - Kelu Tao
Containerization Phase 1
github container image workflow
7. [Fixed topic] Apache Linkis community operation progress is
synchronized. —— Li Wen
8. [Fixed topic] The host of the next regular meeting, welcome to claim it.
—— Xia Chen
9. [Temporary Issue] Answers to developer questions
https://docs.qq.com/sheet/DUlJIREJKaHlVVUVU?u=444994d9ce1841d3af5bb0d65efbe4a9&tab=ggfj6i
10. [Temporary topic] Functional characteristics of basic data management
services -- Tao Zhiqiang
11. The project's recent PR/issue dynamic synchronization to be added

---

会议主题：Apache Linkis(incubating) 双周例会
会议时间：2022/07/13 19:30-21:00
腾讯会议：https://meeting.tencent.com/dm/cE6SdQIoSDEJ
会议号：396-220-298
主持人：夏晨
议题：
1. 【固定议题】Apache Linkis 孵化&版本 进展同步。
https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax
2. 【固定议题】Apache Linkis1.1.2  发布完成。 —— 陶克路
 已发布完成
3. 【固定议题】Apache Linkis1.1.3 进展同步  —— 夏晨
release manager：杨峙岳担任
release-noteshttps://github.com/apache/incubator-linkis/issues/2287
测试进行中
4. 【固定议题】Apache Linkis1.2.0 进展同步。 —— 王震
Presto 和ElasticSearch 引擎使用文档
打包编译文档更新
新特性文档的补充
测试进行中
5. 【固定议题】Apache Linkis1.2.1进展同步  —— 朱辉
  主要是 Trino引擎, 开发中
6. 【固定议题】Apache Linkis1.3.0进展同步。 —— 陶克路
容器化第一期
github 容器镜像工作流
7. 【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文
8. 【固定议题】下一场例会的主持人，欢迎认领。 —— 夏晨
9. 【临时议题】开发者问题答疑
https://docs.qq.com/sheet/DUlJIREJKaHlVVUVU?u=444994d9ce1841d3af5bb0d65efbe4a9&tab=ggfj6i
10. 【临时议题】基础数据管理服务功能特性 --陶志强
11.   项目近期PR/issue 动态同步 待补充


Best Regards!
Chen Xia

Re: [Notice] Community Weekly Meeting (July 13, 2022)

[cas...@apache.org]

ache/incubator-linkis/pull/2424

hbase引擎支持
阳光保险 后续贡献

===
主要事项的跟进：
- 1.1.3版本发布推进release manager   杨峙岳
- Presto 和ElasticSearch 引擎使用文档, Pr待提交 & 单测用例补充  王震
- jdbc多数据源使用文档补充   介龙平
- 1.1.3 编译指引文档的更新 夏晨
- github 容器镜像构建工作流   陶克路
- trino引擎&jdbc引擎支持trino进度展示特性 黄定琦
- 数据源增加对  oracle,kingbase,postgresql,sqlserver,db2,greenplum,dm数据类型支持 李孟
- hhase引擎  阳光保险
- 基础数据管理服务功能  陶志强
- 单测覆盖率专项  夏晨


Best Regards!
Chen Xia


cas...@apache.org  于2022年7月12日周二 19:12写道：

> Conference theme: Apache Linkis(incubating) bi-weekly meeting
> Meeting time: 2022/07/13 19:30-21:00
> Tencent Conference: https://meeting.tencent.com/dm/cE6SdQIoSDEJ
> Conference number: 396-220-298
> Moderator: Xia Chen
>
> Topic:
> 1. [Fixed topic] Apache Linkis incubation & version progress
> synchronization.
> https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax
> 2. [Fixed topic] Apache Linkis 1.1.2 has been released. -   Kelu Tao
>  Published complete
> 3. [Fixed topic] Apache Linkis1.1.3 progress synchronization - Xia Chen
> Release manager: Yang Zhiyue serves as the release manager
> release-notes https://github.com/apache/incubator-linkis/issues/2287
> test in progress
> 4. [Fixed topic] Apache Linkis1.2.0 progress synchronization. —— Wang Zhen
> - Presto and Elasticsearch engine usage documentation
> - Packaging and compiling documentation update
> - Supplement to the new feature documentation
> - test in progress
> 5. [Fixed topic] Apache Linkis1.2.1 progress synchronization —— Zhu Hui
>Mainly Trino engine, under development
> 6. [Fixed topic] Apache Linkis 1.3.0 progress synchronization. - Kelu Tao
> Containerization Phase 1
> github container image workflow
> 7. [Fixed topic] Apache Linkis community operation progress is
> synchronized. —— Li Wen
> 8. [Fixed topic] The host of the next regular meeting, welcome to claim
> it. —— Xia Chen
> 9. [Temporary Issue] Answers to developer questions
>
> https://docs.qq.com/sheet/DUlJIREJKaHlVVUVU?u=444994d9ce1841d3af5bb0d65efbe4a9&tab=ggfj6i
> 10. [Temporary topic] Functional characteristics of basic data management
> services -- Tao Zhiqiang
> 11. The project's recent PR/issue dynamic synchronization to be added
>
> ---
>
> 会议主题：Apache Linkis(incubating) 双周例会
> 会议时间：2022/07/13 19:30-21:00
> 腾讯会议：https://meeting.tencent.com/dm/cE6SdQIoSDEJ
> 会议号：396-220-298
> 主持人：夏晨
> 议题：
> 1. 【固定议题】Apache Linkis 孵化&版本 进展同步。
> https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax
> 2. 【固定议题】Apache Linkis1.1.2  发布完成。 —— 陶克路
>  已发布完成
> 3. 【固定议题】Apache Linkis1.1.3 进展同步  —— 夏晨
> release manager：杨峙岳担任
> release-noteshttps://github.com/apache/incubator-linkis/issues/2287
> 测试进行中
> 4. 【固定议题】Apache Linkis1.2.0 进展同步。 —— 王震
> Presto 和ElasticSearch 引擎使用文档
> 打包编译文档更新
> 新特性文档的补充
> 测试进行中
> 5. 【固定议题】Apache Linkis1.2.1进展同步  —— 朱辉
>   主要是 Trino引擎, 开发中
> 6. 【固定议题】Apache Linkis1.3.0进展同步。 —— 陶克路
> 容器化第一期
> github 容器镜像工作流
> 7. 【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文
> 8. 【固定议题】下一场例会的主持人，欢迎认领。 —— 夏晨
> 9. 【临时议题】开发者问题答疑
>
> https://docs.qq.com/sheet/DUlJIREJKaHlVVUVU?u=444994d9ce1841d3af5bb0d65efbe4a9&tab=ggfj6i
> 10. 【临时议题】基础数据管理服务功能特性 --陶志强
> 11.   项目近期PR/issue 动态同步 待补充
>
>
> Best Regards!
> Chen Xia
>

Re: [VOTE] Release Apache Linkis (Incubating) 1.1.3-RC1

[cas...@apache.org]

+1 approve(non-binding)

[YES] Download links are valid.
[YES] Checksums and PGP signatures are valid.
[YES] Source code distributions have correct names matching the current
release.
[YES] LICENSE and NOTICE files are correct for each repo.
[YES] All files have license headers if necessary.
[YES] No unlicensed compiled archives bundled in source archive.


Best Regards!
Chen Xia


Sherlock Homles  于2022年7月20日周三 20:40写道：

> Hello Linkis Community,
>
> This is a call for vote to release Apache Linkis (Incubating) version
> 1.1.3-RC1.
>
> Release notes:
> https://linkis.apache.org/docs/1.1.3/release-notes-1.1.3/
>
> The release candidates:
> https://dist.apache.org/repos/dist/dev/incubator/linkis/1.1.3-RC1/
>
> Maven artifacts are available in a staging repository at:
> https://repository.apache.org/content/repositories/orgapachelinkis-1080/
>
> Git tag for the release:
> https://github.com/apache/incubator-linkis/releases/tag/1.1.3-rc1
>
> Keys to verify the Release Candidate:
> https://downloads.apache.org/incubator/linkis/KEYS
>
> GPG user ID:
> cooperyang
>
> The vote will be open for at least 72 hours or until necessary number
> of votes are reached.
>
> Please vote accordingly:
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Checklist for reference:
>
> [ ] Download links are valid.
> [ ] Checksums and PGP signatures are valid.
> [ ] Source code distributions have correct names matching the current
> release.
> [ ] LICENSE and NOTICE files are correct for each Linkis repo.
> [ ] All files have license headers if necessary.
> [ ] No unlicensed compiled archives bundled in source archive.
>
> More detail checklist please refer:
>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> Steps to validate the release，Please refer to:
> https://linkis.apache.org/community/how-to-verify
> Thanks!
>
> cooperyang
> Best Regards.
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> For additional commands, e-mail: dev-h...@linkis.apache.org
>
>

Re: 2022-07-27 Minutes of Apache Linkis(incubating) bi-weekly meeting

[cas...@apache.org]

I added a discussion item about the
《Apache Product Name Usage Guide》
https://linkis.apache.org/community/apache-product-name-usage-guide

Best Regards!
Chen Xia


peacewong  于2022年7月26日周二 20:31写道：

> Thanks, I will participate online
>
> hong luo  于2022年7月26日周二 19:49写道：
>
> > Conference Theme：Apache Linkis(incubating) bi-weekly meeting 2022-07-27
> > Meeting Time：2022/07/27 19:30-21:00 (GMT+08:00) China Standard Time -
> > Beijing Click the link to join the meeting, or add to the meeting
> > list： https://meeting.tencent.com/dm/cE6SdQIoSDEJ #Tencent
> > Conference：396-220-298 Meeting Host：Yang Bao
> > Topics:
> > 1. 【Fixed Topic】Apache Linkis Incubation & Version Progress
> > Synchronization。 —— Yang Bao
> > https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax
> > 2. 【Fixed Topic】Apache Linkis1.1.3 progress synchronization. —— ChenXia
> >   Release manager ：Zhiyue Yang.
> >   Release notes:
> > https://github.com/apache/incubator-linkis/issues/2287
> > 3. 【Fixed Topic】Apache Linkis1.2.0 progress synchronization. —— ZhenWang
> >   Test in progress
> >Document in progress
> > 4. 【Fixed Topic】Apache Linkis1.2.1 progress synchronization. —— HuiZhu
> > Trino in progress
> > 5. 【Fixed Topic】Apache Linkis1.2.1 progress synchronization. —— KeLuTao
> > Github images in progress
> > 6. 【Fixed Topic】Apache Linkis community operation progress
> > synchronization. —— WenLi
> > 7. 【Fixed Topic】The host of the next regular meeting, welcome to claim.
> > 8.【Temporary Topic】Summer of open source,engine material project
> > development progress, function demonstration and question answering.
> > ——YunYang
> > 9.【Temporary Topic】How to manage community use problems and
> > suggestions  ——HuaJinZhang,Wenli
> > 9.【Temporary Topic】Developer issues collection.
> >
> >
> https://docs.qq.com/sheet/DUlJIREJKaHlVVUVU?u=444994d9ce1841d3af5bb0d65efbe4a9&tab=ggfj6i
> >
> >
> > 会议主题：Apache Linkis(incubating) 双周例会
> > 会议时间：2022/07/27 19:30-21:00
> > 腾讯会议：https://meeting.tencent.com/dm/cE6SdQIoSDEJ
> > 会议号：396-220-298
> > 主持人：鲍洋
> > 议题：
> > 1. 【固定议题】Apache Linkis 孵化&版本 进展同步。
> > https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax
> > 2. 【固定议题】Apache Linkis1.1.3 进展同步  —— 夏晨
> > release manager：杨峙岳担任
> > release-noteshttps://github.com/apache/incubator-linkis/issues/2287
> >  社区投票中,测试进行中
> > 3. 【固定议题】Apache Linkis1.2.0 进展同步。 —— 王震
> > Presto 和ElasticSearch 引擎使用文档, Pr待提交
> > todo 单测用例补充  王震
> > module 模块添加 王震
> > 打包编译文档更新夏晨
> > 使用文档补充  介龙平
> > 新特性文档的补充
> > 测试进行中
> > 4. 【固定议题】Apache Linkis1.2.1进展同步  —— 朱辉
> >   主要是 Trino 引擎, 开发中 pr已提交
> >   todo 合并到jdbc引擎特性
> > 5. 【固定议题】Apache Linkis1.3.0进展同步。 —— 陶克路
> > 容器化第一期
> >  github 容器镜像工作流
> > 6. 【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文
> > 7. 【固定议题】下一场例会的主持人，欢迎认领。
> > 8. 【临时议题】开源之夏引擎物料管理项目开发进展、功能演示和问题答疑。——杨云
> > 9. 【临时议题】讨论如何管理社区用户使用问题和建议。——张华金、李文
> > 10.【临时议题】开发者问题答疑
> >
> >
> https://docs.qq.com/sheet/DUlJIREJKaHlVVUVU?u=444994d9ce1841d3af5bb0d65efbe4a9&tab=ggfj6i
> >
>

Re: dss工作流提交到schedulis，spark的运行参数怎么设置

[cas...@apache.org]

https://github.com/apache/incubator-linkis/issues/2566

1. if you run by linkis-cli
such as`sh ./bin/linkis-cli -engineType spark-2.4.3 -codeType sql
-confMap wds.linkis.yarnqueue=q02 -confMap spark.executor.instances=3 -code
"select count(*) from testdb.test;"  -submitUser hadoop -proxyUser hadoop
 `
see detail
https://linkis.apache.org/zh-CN/docs/1.1.3/user_guide/linkiscli-manual/

2.  system level
add new  system level configuration  for creator  in linkis web console
![16595320571217](
https://user-images.githubusercontent.com/7869972/182617776-3a2ac180-af11-4381-a857-18e29b356957.png
)

3. set for single task  in dss (like eg 1)
![16595322452353](
https://user-images.githubusercontent.com/7869972/182618096-f22cfc9b-3686-4dec-969b-d691f2d1fce6.png
)


Best Regards!

Chen Xia


lucky059  于2022年8月3日周三 16:35写道：

>
>
> 通过管理台设置的参数，在scripts好使，但是提交到schedulis就不管用
> 比如我想设置 spark.executor.cores，spark.executor.memory
> | |
> lucky059
> |
> |
> lucky...@126.com
> |

Re: dss工作流提交到schedulis，spark的运行参数怎么设置

[cas...@apache.org]

I create a new issue in github
https://github.com/apache/incubator-linkis/issues/2566
Best Regards!

Chen Xia


cas...@apache.org  于2022年8月3日周三 21:21写道：

> https://github.com/apache/incubator-linkis/issues/2566
>
> 1. if you run by linkis-cli
> such as`sh ./bin/linkis-cli -engineType spark-2.4.3 -codeType sql
> -confMap wds.linkis.yarnqueue=q02 -confMap spark.executor.instances=3 -code
> "select count(*) from testdb.test;"  -submitUser hadoop -proxyUser hadoop
>  `
> see detail
> https://linkis.apache.org/zh-CN/docs/1.1.3/user_guide/linkiscli-manual/
>
> 2.  system level
> add new  system level configuration  for creator  in linkis web console
> ![16595320571217](
> https://user-images.githubusercontent.com/7869972/182617776-3a2ac180-af11-4381-a857-18e29b356957.png
> )
>
> 3. set for single task  in dss (like eg 1)
> ![16595322452353](
> https://user-images.githubusercontent.com/7869972/182618096-f22cfc9b-3686-4dec-969b-d691f2d1fce6.png
> )
>
>
> Best Regards!
>
> Chen Xia
>
>
> lucky059  于2022年8月3日周三 16:35写道：
>
>>
>>
>> 通过管理台设置的参数，在scripts好使，但是提交到schedulis就不管用
>> 比如我想设置 spark.executor.cores，spark.executor.memory
>> | |
>> lucky059
>> |
>> |
>> lucky...@126.com
>> |
>
>

Re: 发生错误async get EngineNode AMErrorException: errCode: 30001 ,desc: Failed to createEngine ask em ServiceInstance

[cas...@apache.org]

Can you provide linkis-cg-engineconnmanager.log full detail information log.

you can  attach  log files in this issue
https://github.com/apache/incubator-linkis/issues/2619

Best Regards!

Chen Xia


李同钱  于2022年8月8日周一 11:18写道：

>
> linkis 1.1.1 版本
> hive 3.0.0
> 执行 sh bin/linkis-cli -submitUser hadoop -engineType hive-3.0.0 -codeType
> hql -code "show tables"
>
> 发生错误:
>
> o.a.l.e.s.s.i.LinuxProcessEngineConnLaunchService (41) [info] - Try to
> launch a new EngineConn with
> CommonProcessEngineConnLaunchRequest(572e577b-9136-4b4e-94d2-60199f87f7ea,hadoop,[[key:
> userCreator, value: {"creator":"LINKISCLI","user":"hadoop"}, str:
> hadoop-LINKISCLI], [key: engineType, value:
> {"engineType":"hive","version":"3.0.0"}, str:
> hive-3.0.0]],org.apache.linkis.manager.engineplugin.common.resource.UserNodeResource@59039fd7
> ,[org.apache.linkis.manager.common.protocol.bml.BmlResource@1c011a93,
> org.apache.linkis.manager.common.protocol.bml.BmlResource@10538b78
> ],{CLASSPATH=<><><><><>/conf<>/mnt/dss/LinkisInstall/conf<><>/lib/*<>/mnt/dss/LinkisInstall/lib/linkis-commons/public-module/*<><>},[Ljava.lang.String;@2d57608a,EngineConnCreationDescImpl(dssmark_id:
> mark_9,null,{wds.linkis.rm.yarnqueue.memory.max=300G,
> wds.linkis.rm.client.core.max=10, wds.linkis.rm.instance=10,
> wds.linkis.rm.yarnqueue.instance.max=30,
> wds.linkis.rm.yarnqueue.cores.max=150, wds.linkis.rm.client.memory.max=20G,
> wds.linkis.rm.yarnqueue=ide}),[JarUDFLoadECMHook],[Ljava.lang.String;@68efafd0
> ,3).
> 747:2022-08-07 17:15:01.987 [ERROR] [qtp456228477-22  ]
> o.a.l.r.m.m.MessageExecutor (89) [executeOneMethod] - method
> org.apache.linkis.ecm.server.service.impl.LinuxProcessEngineConnLaunchService.launchEngineConn
> call failed java.lang.reflect.InvocationTargetException: null
> 748- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_201]
> 749- at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_201]
> 750- at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_201]
> 751- at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201]
> 752- at
> org.apache.linkis.rpc.message.method.MessageExecutor.executeOneMethod(MessageExecutor.java:82)
> ~[linkis-rpc-1.1.1.jar:1.1.1]
> --
> 1040-
> 1041-
> 1042-==> linkis-cg-entrance.log <==
> 1043-2022-08-07 17:15:02.096 [INFO ] [RPC-Receiver-Asyn-Thread-Thread-0  ]
> o.a.l.o.e.s.i.DefaultEngineAsyncResponseService (41) [info] - Failed to
> create engine bigdata03:9101_9, can retry false
> 1044-2022-08-07 17:15:02.371 [WARN ] [BaseTaskScheduler-Thread-39  ]
> o.a.l.o.e.ComputationEngineConnManager (50) [warn] - mark_9 Failed to
> askEngineAskRequest time taken (605)
> 1045:2022-08-07 17:15:02.371 [ERROR] [BaseTaskScheduler-Thread-39  ]
> o.a.l.o.s.a.AsyncExecTaskRunnerImpl (79) [run] - Failed to execute task
> astJob_9_codeExec_9
> org.apache.linkis.orchestrator.ecm.exception.ECMPluginErrorException:
> errCode: 12003 ,desc: bigdata03:9101_9 Failed to async get EngineNode
> AMErrorException: errCode: 30001 ,desc: Failed to createEngine ask em
> ServiceInstance(linkis-cg-engineconnmanager, bigdata03:9102) ,ip: bigdata03
> ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: bigdata03 ,port:
> 9104 ,serviceKind: linkis-cg-entrance
> 1046- at
> org.apache.linkis.orchestrator.ecm.ComputationEngineConnManager.getEngineNodeAskManager(ComputationEngineConnManager.scala:165)
> ~[linkis-orchestrator-ecm-plugin-1.1.1.jar:1.1.1]
> 1047- at
> org.apache.linkis.orchestrator.ecm.ComputationEngineConnManager.askEngineConnExecutor(ComputationEngineConnManager.scala:101)
> ~[linkis-orchestrator-ecm-plugin-1.1.1.jar:1.1.1]
> 1048- at
> org.apache.linkis.orchestrator.ecm.AbstractEngineConnManager.getAvailableEngineConnExecutor(EngineConnManager.scala:132)
> ~[linkis-orchestrator-ecm-plugin-1.1.1.jar:1.1.1]
> 1049- at
> org.apache.linkis.orchestrator.computation.execute.DefaultCodeExecTaskExecutorManager.createExecutor(DefaultCodeExecTaskExecutorManager.scala:113)
> ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
> 1050- at
> org.apache.linkis.orchestrator.computation.execute.DefaultCodeExecTaskExecutorManager.askExecutor(DefaultCodeExecTaskExecutorManager.scala:89)
> ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
>
>

Re: 如何删除qualitis的已执行的任务记录

[cas...@apache.org]

Image cannot be displayed
I guess if you want to delete, maybe you need to operate db table directory



Best Regards!

Chen Xia


刘峻男(10037443)  于2022年8月11日周四 15:06写道：

> 你好，
>
> 我想问下如何删除qualitis的任务执行记录，ui 页面没有删除的选项
>
>

Re: 如何删除qualitis的已执行的任务记录

[cas...@apache.org]

In addition, what is the reason for deleting the data?

Best Regards!

Chen Xia


Vincent <330556...@qq.com.invalid> 于2022年8月12日周五 09:50写道：

> 可以提供一下sql嘛，我这面也关注到了相关的qualitis 的mysql库，但是里面很多数据是外键关联的，涉及到很多张表，所以没有轻易删除
> -- 原始邮件 --
> 发件人:
>   "dev"
>         <
> cas...@apache.org>;
> 发送时间: 2022年8月12日(星期五) 上午9:45
> 收件人: "dev"
> 主题: Re: 如何删除qualitis的已执行的任务记录
>
>
>
> Image cannot be displayed
> I guess if you want to delete, maybe you need to operate db table directory
>
>
>
> Best Regards!
>
> Chen Xia
>
>
> 刘峻男(10037443) 
> > 你好，
> >
> > 我想问下如何删除qualitis的任务执行记录，ui 页面没有删除的选项
> >
> >

Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1

[cas...@apache.org]

+1 (non-binding)

I checked
- The checksums and signatures are validate.
- LICENSE and NOTICE file look good to me.
- There is DISCLAIMER
- No unlicensed compiled archives bundled in source archive.
- All source files have ASF headers
- Build successfully on the window&jdk8  by the command ”./mvnw clean
install -Dmaven.javadoc.skip=true -Dmaven.test.skip=true“


Best Regards!
Chen Xia


Zhen Wang  于2022年8月22日周一 13:56写道：

> Hello Linkis Community,
>
> This is a call for vote to release Apache Linkis (Incubating)
> version 1.2.0-RC1.
>
> Release notes:
> https://linkis.apache.org/download/release-notes-1.2.0
>
> The release candidates:
> https://dist.apache.org/repos/dist/dev/incubator/linkis/1.2.0-RC1/
>
> Maven artifacts are available in a staging repository at:
>
> https://repository.apache.org/content/repositories/orgapachelinkis-1082
>
> Git tag for the release:
> https://github.com/apache/incubator-linkis/releases/tag/1.2.0-rc1
>
> Keys to verify the Release Candidate:
> https://downloads.apache.org/incubator/linkis/KEYS
>
> GPG user ID:
> ZhenWang
>
> The vote will be open for at least 72 hours or until necessary
> number of votes are reached.
>
> Please vote accordingly:
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Checklist for reference:
>
> [ ] Download links are valid.
> [ ] Checksums and PGP signatures are valid.
> [ ] Source code distributions have correct names matching the
> current release.
> [ ] LICENSE and NOTICE files are correct for each Linkis repo.
> [ ] All files have license headers if necessary.
> [ ] No unlicensed compiled archives bundled in source archive.
>
> More detail checklist  please refer:
>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> Steps to validate the release，Please refer to:
> https://linkis.apache.org/community/how-to-verify
>
> Thanks,
> Zhen Wang
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> For additional commands, e-mail: dev-h...@linkis.apache.org
>
>

Re: Re: Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1

[cas...@apache.org]

Hi  kinsanities

Steps to validate the release，Please refer to:
https://linkis.apache.org/community/how-to-verify
About email voting, when replying to the vote email, you must bring the
information that you have checked by yourself. simply replying to `+1
approve`  or `Yes` is invalid.

Best Regards!
Chen Xia


 于2022年8月24日周三 10:00写道：

> Yes
> - 原始邮件 -
> 发件人：Sherlock Homles 
> 收件人：dev@linkis.apache.org
> 主题：Re: Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1
> 日期：2022年08月23日 23点49分
>
> +1 approve(binding)
> [YES] Download links are valid.
> [YES] Checksums and PGP signatures are valid.
> [YES] Source code distributions have correct names matching the current
> release.
> [YES] LICENSE and NOTICE files are correct for each repo.
> [YES] Check by apache-rat tool that all files have license header if
> necessary.
> [YES] Build successfully on macos using OpenJDK8
>  于2022年8月23日周二 20:31写道：
> >
> > yes
> > - 原始邮件 -
> > 发件人："cas...@apache.org" 
> > 收件人：dev 
> > 主题：Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1
> > 日期：2022年08月23日 17点58分
> >
> > +1 (non-binding)
> > I checked
> > - The checksums and signatures are validate.
> > - LICENSE and NOTICE file look good to me.
> > - There is DISCLAIMER
> > - No unlicensed compiled archives bundled in source archive.
> > - All source files have ASF headers
> > - Build successfully on the window&jdk8  by the command ”./mvnw clean
> > install -Dmaven.javadoc.skip=true -Dmaven.test.skip=true“
> > Best Regards!
> > Chen Xia
> > Zhen Wang  于2022年8月22日周一 13:56写道：
> > > Hello Linkis Community,
> > >
> > > This is a call for vote to release Apache Linkis (Incubating)
> > > version 1.2.0-RC1.
> > >
> > > Release notes:
> > > https://linkis.apache.org/download/release-notes-1.2.0
> > >
> > > The release candidates:
> > >
> https://dist.apache.org/repos/dist/dev/incubator/linkis/1.2.0-RC1/
> > >
> > > Maven artifacts are available in a staging repository at:
> > >
> > >
> https://repository.apache.org/content/repositories/orgapachelinkis-1082
> > >
> > > Git tag for the release:
> > >
> https://github.com/apache/incubator-linkis/releases/tag/1.2.0-rc1
> > >
> > > Keys to verify the Release Candidate:
> > > https://downloads.apache.org/incubator/linkis/KEYS
> > >
> > > GPG user ID:
> > > ZhenWang
> > >
> > > The vote will be open for at least 72 hours or until necessary
> > > number of votes are reached.
> > >
> > > Please vote accordingly:
> > >
> > > [ ] +1 approve
> > > [ ] +0 no opinion
> > > [ ] -1 disapprove with the reason
> > >
> > > Checklist for reference:
> > >
> > > [ ] Download links are valid.
> > > [ ] Checksums and PGP signatures are valid.
> > > [ ] Source code distributions have correct names matching the
> > > current release.
> > > [ ] LICENSE and NOTICE files are correct for each Linkis repo.
> > > [ ] All files have license headers if necessary.
> > > [ ] No unlicensed compiled archives bundled in source archive.
> > >
> > > More detail checklist  please refer:
> > >
> > >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > > Steps to validate the release，Please refer to:
> > > https://linkis.apache.org/community/how-to-verify
> > >
> > > Thanks,
> > > Zhen Wang
> > >
> > > -
> > > To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> > > For additional commands, e-mail: dev-h...@linkis.apache.org
> > >
> > >
> -
> To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> For additional commands, e-mail: dev-h...@linkis.apache.org
>

Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1 (Round 2)

[cas...@apache.org]

+1 (non-binding)
I checked
- The checksums and signatures are validate.
- LICENSE and NOTICE file look good to me.
- There is DISCLAIMER
- No unlicensed compiled archives bundled in source archive.
- All source files have ASF headers- Build successfully on the window&jdk8
by the command ”./mvnw clean install -Dmaven.javadoc.skip=true
-Dmaven.test.skip=true“Best Regards!


Best Regards!
Chen Xia


peacewong  于2022年8月29日周一 11:38写道：

> +1 approve(binding)
>
> [YES] Download links are valid.
> [YES] Checksums and PGP signatures are valid.
> [YES] Source code distributions have correct names matching the current
> release.
> [YES] LICENSE and NOTICE files are correct for each repo.
> [YES] Check by apache-rat tool that all files have license header if
> necessary.
> [YES] Build successfully on windows.
>
> Best Regards!
> Peace wong
>
> Zhen Wang  于2022年8月29日周一 00:10写道：
>
> > Hello Linkis Community,
> >
> > In the round 1 vote, I mistakenly sent two voting emails and I did
> > not find a suitable vote thread link, so we will now start round 2
> > vote.
> >
> > This is a call for round 2 vote to release Apache Linkis
> > (Incubating) version 1.2.0-RC1.
> >
> > Release notes:
> > https://linkis.apache.org/download/release-notes-1.2.0
> >
> > The release candidates:
> >
> https://dist.apache.org/repos/dist/dev/incubator/linkis/1.2.0-RC1/
> >
> > Maven artifacts are available in a staging repository at:
> >
> > https://repository.apache.org/content/repositories/orgapachelinkis-1082
> >
> > Git tag for the release:
> >
> https://github.com/apache/incubator-linkis/releases/tag/1.2.0-rc1
> >
> > Keys to verify the Release Candidate:
> > https://downloads.apache.org/incubator/linkis/KEYS
> >
> > GPG user ID:
> > ZhenWang
> >
> > The vote will be open for at least 72 hours or until necessary
> > number of votes are reached.
> >
> > Please vote accordingly:
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove with the reason
> >
> > Checklist for reference:
> >
> > [ ] Download links are valid.
> > [ ] Checksums and PGP signatures are valid.
> > [ ] Source code distributions have correct names matching the
> > current release.
> > [ ] LICENSE and NOTICE files are correct for each Linkis repo.
> > [ ] All files have license headers if necessary.
> > [ ] No unlicensed compiled archives bundled in source archive.
> >
> > More detail checklist  please refer:
> >
> >
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > Steps to validate the release，Please refer to:
> > https://linkis.apache.org/community/how-to-verify
> >
> > Thanks,
> > Zhen Wang
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> > For additional commands, e-mail: dev-h...@linkis.apache.org
> >
> >
>

Re: Failed to submit sparksql task

[cas...@apache.org]

 Attempt to add (hdfs://**/home/spark_conf/hive-site.xml) multiple
times to the distributed cache.

The log shows that the problem is caused by duplication of
files:spark_conf/hive-site.xml,
please confirm whether there are multiple copies of this file, and try to
delete redundant files

Best Regards!

Chen Xia


15000338...@163.com <15000338...@163.com> 于2022年9月5日周一 11:18写道：

>
> 各位大神
>
> Your environment
> Linkis version used: release-1.1.3-rc1
> Environment name and version:
> hdp-3.1.5
> hive-3.1.0.3.1.4.0-315
> hadoop-3.1.1.3.1.4.0-315
> scala-2.11.12
> jdk 1.8.0_121
> spark-2.3.2.3.1.4.0-315
> Describe your questions
> 单独安装 linkis平台和管理页面，完成之后验证基础功能，使用
> sh bin/linkis-cli -submitUser ... spark 命令验证失败
> 包括使用 hive提交的时候也会爆出相同的错误
> stdout.log:
>
>
> 1b3/tmp/blockmgr-1098b279-2df6-4fc0-8c3a-5ecb57b2f5ab
> 2022-09-03 11:57:10.746 [INFO ] [main]
> o.a.s.s.m.MemoryStore (54) [logInfo] - MemoryStore started with capacity
> 434.4 MB
> 2022-09-03 11:57:10.813 [INFO ] [main]
> o.a.s.SparkEnv (54) [logInfo] - Registering OutputCommitCoordinator
> 2022-09-03 11:57:11.142 [INFO ] [main]
> o.a.s.u.Utils (54) [logInfo] - Successfully started service 'SparkUI' on
> port 4040.
> 2022-09-03 11:57:11.333 [INFO ] [main]
> o.a.s.u.SparkUI (54) [logInfo] - Bound SparkUI to 0.0.0.0, and started at
> http://**:4040
> 2022-09-03 11:57:11.349 [INFO ] [main]
> o.a.s.SparkContext (54) [logInfo] - Added JAR
> file:/appcom/tmp/hadoop/20220903/spark/ff2cebf5-72d7-4ef2-9254-d43ca498c1b3/lib/linkis-engineplugin-spark-1.1.3.jar
> at spark://**:6476/jars/linkis-engineplugin-spark-1.1.3.jar with
> timestamp 1662177431347
> 2022-09-03 11:57:11.433 [WARN ] [main]
> o.a.s.s.FairSchedulableBuilder (66) [logWarning] - Fair Scheduler
> configuration file not found so jobs will be scheduled in FIFO order. To
> use fair scheduling, configure pools in fairscheduler.xml or set
> spark.scheduler.allocation.file to a file that contains the configuration.
> 2022-09-03 11:57:11.439 [INFO ] [main]
> o.a.s.s.FairSchedulableBuilder (54) [logInfo] - Created default pool:
> default, schedulingMode: FIFO, minShare: 0, weight: 1
> 2022-09-03 11:57:12.634 [INFO ] [main]
> o.a.h.y.c.ConfiguredRMFailoverProxyProvider (100) [performFailover] -
> Failing over to rm2
> 2022-09-03 11:57:12.673 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Requesting a new application from cluster
> with 6 NodeManagers
> 2022-09-03 11:57:12.755 [INFO ] [main]
> o.a.h.c.Configuration (2757) [getConfResourceAsInputStream] - found
> resource resource-types.xml at
> file:/etc/hadoop/3.1.4.0-315/0/resource-types.xml
> 2022-09-03 11:57:12.784 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Verifying our application has not
> requested more than the maximum memory capability of the cluster (73728 MB
> per container)
> 2022-09-03 11:57:12.786 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Will allocate AM container, with 896 MB
> memory including 384 MB overhead
> 2022-09-03 11:57:12.787 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Setting up container launch context for
> our AM
> 2022-09-03 11:57:12.795 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Setting up the launch environment for our
> AM container
> 2022-09-03 11:57:12.806 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Preparing resources for our AM container
> 2022-09-03 11:57:14.556 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Use hdfs cache file as spark.yarn.archive
> for HDP,
> hdfsCacheFile:hdfs://**/hdp/apps/3.1.4.0-315/spark2/spark2-hdp-yarn-archive.tar.gz
> 2022-09-03 11:57:14.563 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Source and destination file systems are
> the same. Not copying hdfs://**/hdp/apps/3.1.4.
> 0-315/spark2/spark2-hdp-yarn-archive.tar.gz
> 2022-09-03 11:57:14.672 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Distribute hdfs cache file as
> spark.sql.hive.metastore.jars for HDP,
> hdfsCacheFile:hdfs://**/hdp/apps/3.1.4.0-315/spark2/spark2-hdp-hive-archive.tar.gz
> 2022-09-03 11:57:14.673 [INFO ] [main]
> o.a.s.d.y.Client (54) [logInfo] - Source and destination file systems are
> the same. Not copying hdfs://**/hdp/apps/3.1.4.
> 0-315/spark2/spark2-hdp-hive-archive.tar.gz
> 2022-09-03 11:57:14.690 [INFO ] [main]
> o.a.s.d.y.Clie

Re: ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$MkdirsRequestProto cannot be cast to org.apache.hadoop.shaded.com.google.protobuf.Message

[cas...@apache.org]

If you are adapting to hadoop3 and you need to make changes, you can refer
to the practice summary blog post of community user

https://linkis.staged.apache.org/zh-CN/blog/2022/08/08/linkis111-compile-integration/#linkis

Best Regards!
Chen Xia


denghaibin  于2022年9月7日周三 22:56写道：

> Hello:
>在linkis-cli 下运行 spark-sql "show tables " 语句报错。
> 错误信息：
>  Exception while invoking call #2
> ClientNamenodeProtocolTranslatorPB.mkdirs over hadoop06/
> 172.30.203.217:8020.
>
>  Not retrying because try once and fail.
>
>  java.lang.ClassCastException:
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$MkdirsRequestProto
>  cannot be cast to org.apache.hadoop.shaded.com.google.protobuf.Message
>
> -
> 环境：
> Apache
>  hadoop 3.2.4
> spark 3.2.1
> hive 3.1.2
> linkis1.1.3
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> For additional commands, e-mail: dev-h...@linkis.apache.org

Re: hello,Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/linkis/LinkisBaseServerApp

[cas...@apache.org]

Apache mailbox is not very friendly to rich text support, I can't see your
screenshot,
If the problem is more difficult to describe, you can ask questions on the
issue and follow up.

I create an issue [Question]How to run Linkis server on window
https://github.com/apache/incubator-linkis/issues/3286，
Please follow up your question under this issue

Best Regards!

Chen Xia


海 <85315...@qq.com.invalid> 于2022年9月7日周三 22:43写道：

> hello
>
>  doStop - Stopped o.s.b.w.e.j.JettyEmbeddedWebAppContext@17f8db6
> {application,/,[file:///C:/Users/Administrator/AppData/Local/Temp/jetty-docbase.9102.287418154207632/],STOPPED}
> 2022-09-07 22:37:34.060 ERROR [main]
> org.springframework.boot.SpringApplication 834 reportFailure - Application
> run failed org.springframework.beans.factory.BeanCreationException: Error
> creating bean with name 'getBmlResourceLocalizationService' defined in
> class path resource
> [org/apache/linkis/ecm/server/spring/ECMSpringConfiguration.class]: Bean
> instantiation via factory method failed; nested exception is
> org.springframework.beans.BeanInstantiationException: Failed to instantiate
> [org.apache.linkis.ecm.server.service.ResourceLocalizationService]: Factory
> method 'getBmlResourceLocalizationService' threw exception; nested
> exception is java.io.IOException: Cannot run program "id": CreateProcess
> error=2, 系统找不到指定的文件。
>
>  我是在 win10 下，idea环境，linkis 是最新的1.2.0版本，错误截图如下：
>
>
>
>
>
>

Re: schedulis相关问题

[cas...@apache.org]

Sorry, I can't see the attached file in the email. Can you send detail log
text directly?

Best Regards!

Chen Xia


Lucy <943975...@qq.com.invalid> 于2022年9月15日周四 20:20写道：

> 问题：工作流执行，一直处于“Preparing”的状态，日志于附件查看。等待回复，谢谢。
>
> --
> Lucy
> 943975...@qq.com
>
> 
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@linkis.apache.org
> For additional commands, e-mail: dev-h...@linkis.apache.org

Re: linkis1.0.2或其他版本适配spark3.x

[cas...@apache.org]

Some users have adapted spark3, the specific adaptation documents can
refer to this
https://linkis.staged.apache.org/zh-CN/blog/2022/08/08/linkis111-compile-integration


Best Regards!
Apache Linkis(Incubating)
Chen Xia

Best Regards!
Apache Linkis(Incubating)
Chen Xia



刘峻男(10037443)  于2022年10月13日周四 17:12写道：
>
> 你好，
>
>
>
>
>
> 我们的团队集群使用的spark3.x，在编译linkis源码过程中报错，想问一下这块有详细的指导步骤吗，十分感谢。
>
>
>
> 目前使用linkis1.0.2,更改完spark版本和scala.binary版本后，打包成功但是启服务的时候linkis-mg-gateway.log文件报以下错误，也烦请帮助看一下是因为什么原因，如何解决，目前由于公司几个部门想要使用linkis开源框架，所以比较着急想适配，期待您的回复
>
>