Re: [VOTE] Release 1.13.2, release candidate #3

2021-08-01 Thread Leonard Xu 


+1 (non-binding)

- verified signatures and hashsums
- started a cluster, ran a socket window word count job, no suspicious log 
output
- tested using SQL Client to submit job and the query result is expected
- the web PR looks good

Best,
Leonard

> 在 2021年7月31日，09:08，godfrey he  写道：
> 
> +1 (non-binding)
> 
> - Checked checksums and signatures: OK
> - Built from source: OK
> - Checked the flink-web PR
>   - find one typo about the number of the fixes and improvements
> - Submit some jobs from sql-client to local cluster, checked the web-ui,
> cp, sp, log, etc: OK
> 
> Best,
> Godfrey
> 
> 
> Xingbo Huang  于2021年7月30日周五 下午2:51写道：
> 
>> +1 (non-binding)
>> 
>> - Verified checksums and signatures
>> - Verified Python wheel package contents
>> - Pip install apache-flink-libraries source package and apache-flink wheel
>> package in Mac
>> - Write and Run a Simple Python UDF job in Python REPL
>> 
>> Best,
>> Xingbo
>> 
>> Yu Li  于2021年7月30日周五 下午2:33写道：
>> 
>>> +1 (binding)
>>> 
>>> - Checked the diff between 1.13.1 and 1.13.2-rc3: OK (
>>> 
>> https://github.com/apache/flink/compare/release-1.13.1...release-1.13.2-rc3
>>> )
>>>  - commons-io version has been bumped to 2.8.0 through FLINK-22747 and
>> all
>>> NOTICE files updated correctly
>>>  - guava version has been bumped to 29.0 for kinesis connector through
>>> FLINK-23009 and all NOTICE files updated correctly
>>> - Checked release notes: OK
>>>  - minor: I've moved FLINK-23315 and FLINK-23418 out of 1.13.2 to keep
>>> accordance with RC status
>>> - Checked sums and signatures: OK
>>> - Maven clean install from source: OK
>>> - Checked the jars in the staging repo: OK
>>> - Checked the website updates: OK
>>>  - minor: left some minor comments in PR (such as RN needs update, etc.)
>>> and please remember to address them before merging
>>> 
>>> Best Regards,
>>> Yu
>>> 
>>> 
>>> On Fri, 30 Jul 2021 at 14:00, Jingsong Li 
>> wrote:
>>> 
 +1 (non-binding)
 
 - Check if checksums and GPG files match the corresponding release
>> files
 - staging repository looks fine
 - Start a local cluster (start-cluster.sh), logs fine
 - Run sql-client and run a job, looks fine
 
 I found an unexpected log in sql-client:
 "Searching for
 
 
>>> 
>> '/Users/lijingsong/Downloads/tmp/flink-1.13.2/conf/sql-client-defaults.yaml'...not
 found"
 This log should be removed. I created a JIRA for this:
 https://issues.apache.org/jira/browse/FLINK-23552
 (This should not be a blocker)
 
 Best,
 Jingsong
 
 On Thu, Jul 29, 2021 at 10:44 PM Robert Metzger 
 wrote:
 
> Thanks a lot for creating this release candidate
> 
> +1 (binding)
> 
> - staging repository looks fine
> - Diff to 1.13.1 looks fine wrt to dependency changes:
> 
 
>>> 
>> https://github.com/apache/flink/compare/release-1.13.1...release-1.13.2-rc3
> - standalone mode works locally
>   - I found this issue, which is not specific to 1.13.2:
> https://issues.apache.org/jira/browse/FLINK-23546
> - src archive signature is matched; sha512 is correct
> 
> On Thu, Jul 29, 2021 at 9:10 AM Zakelly Lan 
 wrote:
> 
>> +1 (non-binding)
>> 
>> * Built from source.
>> * Run wordcount datastream job on yarn
>> * Web UI and checkpoint seem good.
>> * Kill a container to make job failover, everything is good.
>> * Try run job from checkpoint, everything is good.
>> 
>> On Fri, Jul 23, 2021 at 10:04 PM Yun Tang 
>> wrote:
>> 
>>> Hi everyone,
>>> Please review and vote on the release candidate #3 for the
>> version
>> 1.13.2,
>>> as follows:
>>> [ ] +1, Approve the release
>>> [ ] -1, Do not approve the release (please provide specific
>>> comments)
>>> 
>>> 
>>> The complete staging area is available for your review, which
 includes:
>>> * JIRA release notes [1],
>>> * the official Apache source release and binary convenience
>>> releases
 to
>> be
>>> deployed to dist.apache.org [2], which are signed with the key
>>> with
>>> fingerprint 78A306590F1081CC6794DC7F62DAD618E07CF996 [3],
>>> * all artifacts to be deployed to the Maven Central Repository
>> [4],
>>> * source code tag "release-1.13.2-rc3" [5],
>>> * website pull request listing the new release and adding
 announcement
>>> blog post [6].
>>> 
>>> The vote will be open for at least 72 hours. It is adopted by
 majority
>>> approval, with at least 3 PMC affirmative votes.
>>> 
>>> Best,
>>> Yun Tang
>>> 
>>> [1]
>>> 
>> 
> 
 
>>> 
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218&styleName=&projectId=12315522
>>> [2]
>> https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc3/
>>> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
>>> [4]
>>> 
> 
>>> https://repository.apache.org/content/repositori

Re: [VOTE] Release 1.12.5, release candidate #3

2021-08-01 Thread Jark Wu 
+1 (binding)

- checked/verified signatures and hashes
- started cluster, ran examples, verified web ui and log output, nothing
unexpected
- started cluster and ran some e2e sql queries using sql-client, looks good:
 - read from kafka source, aggregate, write into mysql
 - read from kafka source with watermark defined in ddl, window aggregate,
write into mysql
 - read from kafka with computed column defined in ddl, temporal join with
a mysql table, write into kafka
- reviewed the release PR

Best,
Jark

On Sat, 31 Jul 2021 at 10:22, godfrey he  wrote:

> +1 (non-binding)
>
> - Checked checksums and signatures: OK
> - Built from source: OK
> - Checked the flink-web PR
>- find one typo about flink version
> - Submit some jobs from sql-client to local cluster, checked the web-ui,
> cp, sp, log, etc: OK
>
> Best,
> Godfrey
>
> Robert Metzger  于2021年7月30日周五 下午4:33写道：
>
> > Thanks a lot for providing the new staging repository. I dropped the 1440
> > and 1441 staging repositories, to avoid that other RC reviewers
> > accidentally look into it, or that we accidentally release it.
> >
> > +1 (binding)
> >
> > Checks:
> > - I didn't find any additional issues in the release announcement
> > - the pgp signatures on the source archive seem fine
> > - source archive compilation starts successfully (rat check passes etc.)
> > - standalone mode, job submission and cli cancellation works. logs look
> > fine
> > - maven staging repository looks fine
> >
> > On Fri, Jul 30, 2021 at 7:30 AM Jingsong Li 
> > wrote:
> >
> > > Hi everyone,
> > >
> > > Thanks Robert, I created a new one.
> > >
> > > all artifacts to be deployed to the Maven Central Repository [4],
> > >
> > > [4]
> > >
> https://repository.apache.org/content/repositories/orgapacheflink-1444/
> > >
> > > Best,
> > > Jingsong
> > >
> > > On Thu, Jul 29, 2021 at 9:50 PM Robert Metzger 
> > > wrote:
> > >
> > > > The difference is that the 1440 staging repository contains the Scala
> > > _2.11
> > > > files, the 1441 repo contains scala_2.12. I'm not sure if this works,
> > > > because things like "flink-core:1.11.5" will be released twice?
> > > > I would prefer to have a single staging repository containing all
> > > binaries
> > > > we intend to release to maven central, to avoid complications in the
> > > > release process.
> > > >
> > > > Since only the convenience binaries are affected by this, we don't
> need
> > > to
> > > > cancel the release. We just need to create a new staging repository.
> > > >
> > > >
> > > > On Thu, Jul 29, 2021 at 3:36 PM Robert Metzger 
> > > > wrote:
> > > >
> > > > > Thanks a lot for creating a release candidate!
> > > > >
> > > > > What is the difference between the two maven staging repos?
> > > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheflink-1440/
> > > > >  and
> > > > >
> > >
> https://repository.apache.org/content/repositories/orgapacheflink-1441/
> > > > ?
> > > > >
> > > > > On Thu, Jul 29, 2021 at 1:52 PM Xingbo Huang 
> > > wrote:
> > > > >
> > > > >> +1 (non-binding)
> > > > >>
> > > > >> - Verified checksums and signatures
> > > > >> - Built from sources
> > > > >> - Verified Python wheel package contents
> > > > >> - Pip install Python wheel package in Mac
> > > > >> - Run Python UDF job in Python REPL
> > > > >>
> > > > >> Best,
> > > > >> Xingbo
> > > > >>
> > > > >> Zakelly Lan  于2021年7月29日周四 下午5:57写道：
> > > > >>
> > > > >> > +1 (non-binding)
> > > > >> >
> > > > >> > * Built from source.
> > > > >> > * Run wordcount datastream job on yarn
> > > > >> > * Web UI and checkpoint seem good.
> > > > >> > * Kill a container to make job failover, everything is good.
> > > > >> > * Try run job from checkpoint, everything is good.
> > > > >> >
> > > > >> > On Thu, Jul 29, 2021 at 2:34 PM Yun Tang 
> > wrote:
> > > > >> >
> > > > >> > > +1 (non-binding)
> > > > >> > >
> > > > >> > > Checked the signature.
> > > > >> > >
> > > > >> > > Reviewed the PR of flink-web.
> > > > >> > >
> > > > >> > > Download the pre-built tar package and launched an application
> > > mode
> > > > >> > > standalone job successfully.
> > > > >> > >
> > > > >> > > Best
> > > > >> > > Yun Tang
> > > > >> > >
> > > > >> > >
> > > > >> > > 
> > > > >> > > From: Jingsong Li 
> > > > >> > > Sent: Tuesday, July 27, 2021 11:54
> > > > >> > > To: dev 
> > > > >> > > Subject: [VOTE] Release 1.12.5, release candidate #3
> > > > >> > >
> > > > >> > > Hi everyone,
> > > > >> > >
> > > > >> > > Please review and vote on the release candidate #3 for the
> > version
> > > > >> > 1.12.5,
> > > > >> > > as follows:
> > > > >> > > [ ] +1, Approve the release
> > > > >> > > [ ] -1, Do not approve the release (please provide specific
> > > > comments)
> > > > >> > >
> > > > >> > > The complete staging area is available for your review, which
> > > > >> includes:
> > > > >> > > * JIRA release notes [1],
> > > > >> > > * the official Apache source release and binary convenience
> > > releases
> > > > >> t

Re: [VOTE] Release 1.12.5, release candidate #3

2021-08-01 Thread Leonard Xu 
+1 (non-binding)

- verified signatures and hashsums
- checked all dependency artifacts are 1.12.5
- started a cluster, ran a wordcount job, the result is expected, no suspicious 
log output
- started SQL Client, ran some sql queries in SQL Client, the result is 
expected, no suspicious log output
- reviewed the web PR

Best,
Leonard

> 在 2021年8月1日，15:24，Jark Wu  写道：
> 
> +1 (binding)
> 
> - checked/verified signatures and hashes
> - started cluster, ran examples, verified web ui and log output, nothing
> unexpected
> - started cluster and ran some e2e sql queries using sql-client, looks good:
> - read from kafka source, aggregate, write into mysql
> - read from kafka source with watermark defined in ddl, window aggregate,
> write into mysql
> - read from kafka with computed column defined in ddl, temporal join with
> a mysql table, write into kafka
> - reviewed the release PR
> 
> Best,
> Jark
> 
> On Sat, 31 Jul 2021 at 10:22, godfrey he  wrote:
> 
>> +1 (non-binding)
>> 
>> - Checked checksums and signatures: OK
>> - Built from source: OK
>> - Checked the flink-web PR
>>   - find one typo about flink version
>> - Submit some jobs from sql-client to local cluster, checked the web-ui,
>> cp, sp, log, etc: OK
>> 
>> Best,
>> Godfrey
>> 
>> Robert Metzger  于2021年7月30日周五 下午4:33写道：
>> 
>>> Thanks a lot for providing the new staging repository. I dropped the 1440
>>> and 1441 staging repositories, to avoid that other RC reviewers
>>> accidentally look into it, or that we accidentally release it.
>>> 
>>> +1 (binding)
>>> 
>>> Checks:
>>> - I didn't find any additional issues in the release announcement
>>> - the pgp signatures on the source archive seem fine
>>> - source archive compilation starts successfully (rat check passes etc.)
>>> - standalone mode, job submission and cli cancellation works. logs look
>>> fine
>>> - maven staging repository looks fine
>>> 
>>> On Fri, Jul 30, 2021 at 7:30 AM Jingsong Li 
>>> wrote:
>>> 
 Hi everyone,
 
 Thanks Robert, I created a new one.
 
 all artifacts to be deployed to the Maven Central Repository [4],
 
 [4]
 
>> https://repository.apache.org/content/repositories/orgapacheflink-1444/
 
 Best,
 Jingsong
 
 On Thu, Jul 29, 2021 at 9:50 PM Robert Metzger 
 wrote:
 
> The difference is that the 1440 staging repository contains the Scala
 _2.11
> files, the 1441 repo contains scala_2.12. I'm not sure if this works,
> because things like "flink-core:1.11.5" will be released twice?
> I would prefer to have a single staging repository containing all
 binaries
> we intend to release to maven central, to avoid complications in the
> release process.
> 
> Since only the convenience binaries are affected by this, we don't
>> need
 to
> cancel the release. We just need to create a new staging repository.
> 
> 
> On Thu, Jul 29, 2021 at 3:36 PM Robert Metzger 
> wrote:
> 
>> Thanks a lot for creating a release candidate!
>> 
>> What is the difference between the two maven staging repos?
>> 
 
>> https://repository.apache.org/content/repositories/orgapacheflink-1440/
>> and
>> 
 
>> https://repository.apache.org/content/repositories/orgapacheflink-1441/
> ?
>> 
>> On Thu, Jul 29, 2021 at 1:52 PM Xingbo Huang 
 wrote:
>> 
>>> +1 (non-binding)
>>> 
>>> - Verified checksums and signatures
>>> - Built from sources
>>> - Verified Python wheel package contents
>>> - Pip install Python wheel package in Mac
>>> - Run Python UDF job in Python REPL
>>> 
>>> Best,
>>> Xingbo
>>> 
>>> Zakelly Lan  于2021年7月29日周四 下午5:57写道：
>>> 
 +1 (non-binding)
 
 * Built from source.
 * Run wordcount datastream job on yarn
 * Web UI and checkpoint seem good.
 * Kill a container to make job failover, everything is good.
 * Try run job from checkpoint, everything is good.
 
 On Thu, Jul 29, 2021 at 2:34 PM Yun Tang 
>>> wrote:
 
> +1 (non-binding)
> 
> Checked the signature.
> 
> Reviewed the PR of flink-web.
> 
> Download the pre-built tar package and launched an application
 mode
> standalone job successfully.
> 
> Best
> Yun Tang
> 
> 
> 
> From: Jingsong Li 
> Sent: Tuesday, July 27, 2021 11:54
> To: dev 
> Subject: [VOTE] Release 1.12.5, release candidate #3
> 
> Hi everyone,
> 
> Please review and vote on the release candidate #3 for the
>>> version
 1.12.5,
> as follows:
> [ ] +1, Approve the release
> [ ] -1, Do not approve the release (please provide specific
> comments)
> 
> The complete staging area is available for your review, which

[jira] [Created] (FLINK-23570) Some of the maven dependencies in the documentation seem to have some problems and cannot be used directly

2021-08-01 Thread erick.liu (Jira) 
erick.liu created FLINK-23570:
-

 Summary: Some of the maven dependencies in the documentation seem 
to have some problems and cannot be used directly
 Key: FLINK-23570
 URL: https://issues.apache.org/jira/browse/FLINK-23570
 Project: Flink
  Issue Type: Bug
  Components: Documentation
Affects Versions: 1.13.0
Reporter: erick.liu
 Attachments: image-2021-08-01-15-26-34-346.png, 
image-2021-08-01-15-30-39-859.png

Some of the maven dependencies in the documentation seem to have some problems 
and cannot be used directly.

Page: DataStream Connectors -> File Sink/Streaming FIle Sink

!image-2021-08-01-15-26-34-346.png!

!image-2021-08-01-15-30-39-859.png!

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] Release 1.11.4, release candidate #1

2021-08-01 Thread Leonard Xu 
+1 (non-binding)

- verified signatures and hashsums
- built from source code with scala 2.11 succeeded
- checked all dependency artifacts are 1.11.4
- started a cluster, ran a wordcount job, the result is expected, no suspicious 
log output
- started SQL Client, ran some SQL queries, the result is expected
- reviewed the web PR

Best,
Leonard

> 在 2021年7月26日，23:25，godfrey he  写道：
> 
> Hi everyone,
> Please review and vote on the release candidate #1 for the version 1.11.4,
> as follows:
> [ ] +1, Approve the release
> [ ] -1, Do not approve the release (please provide specific comments)
> 
> 
> The complete staging area is available for your review, which includes:
> * JIRA release notes [1],
> * the official Apache source release and binary convenience releases to be
> deployed to dist.apache.org [2], which are signed with the key with
> fingerprint 4A978875E56AA2100EB0CF12A244D52CF0A40279 [3],
> * all artifacts to be deployed to the Maven Central Repository [4],
> * source code tag "release-1.11.4-rc1" [5],
> * website pull request listing the new release and adding announcement blog
> post [6].
> 
> The vote will be open for at least 72 hours. It is adopted by majority
> approval, with at least 3 PMC affirmative votes.
> 
> Best,
> Godfrey
> 
> [1]
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12349404
> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.11.4-rc1/
> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> [4] https://repository.apache.org/content/repositories/orgapacheflink-1438
> [5] https://github.com/apache/flink/releases/tag/release-1.11.4-rc1
> [6] https://github.com/apache/flink-web/pull/459

[jira] [Created] (FLINK-23571) The internal query-start options missed when convert exec graph to transformation

2021-08-01 Thread Leonard Xu (Jira) 
Leonard Xu created FLINK-23571:
--

 Summary: The internal query-start options missed when convert exec 
graph to transformation
 Key: FLINK-23571
 URL: https://issues.apache.org/jira/browse/FLINK-23571
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.14.0, 1.13.3
Reporter: Leonard Xu


The internal query-start configuration options is missed when convert exec 
graph to transformation, please see:
{code:java}
// org.apache.flink.table.planner.delegation.PlannerBase

 translateToPlan(execGraph: ExecNodeGraph)

{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] FLIP-177: Extend Sink API

2021-08-01 Thread Thomas Weise 
+1 (binding)


On Fri, Jul 30, 2021 at 5:05 AM Arvid Heise  wrote:

> Hi all,
>
> I'd like to start a vote on FLIP-177: Extend Sink API [1] which provides
> small extensions to the Sink API introduced through FLIP-143.
> The vote will be open for at least 72 hours unless there is an objection or
> not enough votes.
>
> Note that the FLIP was larger initially and I cut down all
> advanced/breaking changes.
>
> Best,
>
> Arvid
>
> [1]
>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-177%3A+Extend+Sink+API
>

Re: [VOTE] Release 1.12.5, release candidate #3

2021-08-01 Thread Dian Fu 
+1 (binding)

-  checked the website PR
-  verified the signatures and checksum
-  Installed the Python wheel package of Python 3.8 on MacOS and runs some 
simple examples

Regards,
Dian

> 2021年8月1日 下午3:32，Leonard Xu  写道：
> 
> +1 (non-binding)
> 
> - verified signatures and hashsums
> - checked all dependency artifacts are 1.12.5
> - started a cluster, ran a wordcount job, the result is expected, no 
> suspicious log output
> - started SQL Client, ran some sql queries in SQL Client, the result is 
> expected, no suspicious log output
> - reviewed the web PR
> 
> Best,
> Leonard
> 
>> 在 2021年8月1日，15:24，Jark Wu  写道：
>> 
>> +1 (binding)
>> 
>> - checked/verified signatures and hashes
>> - started cluster, ran examples, verified web ui and log output, nothing
>> unexpected
>> - started cluster and ran some e2e sql queries using sql-client, looks good:
>> - read from kafka source, aggregate, write into mysql
>> - read from kafka source with watermark defined in ddl, window aggregate,
>> write into mysql
>> - read from kafka with computed column defined in ddl, temporal join with
>> a mysql table, write into kafka
>> - reviewed the release PR
>> 
>> Best,
>> Jark
>> 
>> On Sat, 31 Jul 2021 at 10:22, godfrey he  wrote:
>> 
>>> +1 (non-binding)
>>> 
>>> - Checked checksums and signatures: OK
>>> - Built from source: OK
>>> - Checked the flink-web PR
>>>  - find one typo about flink version
>>> - Submit some jobs from sql-client to local cluster, checked the web-ui,
>>> cp, sp, log, etc: OK
>>> 
>>> Best,
>>> Godfrey
>>> 
>>> Robert Metzger  于2021年7月30日周五 下午4:33写道：
>>> 
 Thanks a lot for providing the new staging repository. I dropped the 1440
 and 1441 staging repositories, to avoid that other RC reviewers
 accidentally look into it, or that we accidentally release it.
 
 +1 (binding)
 
 Checks:
 - I didn't find any additional issues in the release announcement
 - the pgp signatures on the source archive seem fine
 - source archive compilation starts successfully (rat check passes etc.)
 - standalone mode, job submission and cli cancellation works. logs look
 fine
 - maven staging repository looks fine
 
 On Fri, Jul 30, 2021 at 7:30 AM Jingsong Li 
 wrote:
 
> Hi everyone,
> 
> Thanks Robert, I created a new one.
> 
> all artifacts to be deployed to the Maven Central Repository [4],
> 
> [4]
> 
>>> https://repository.apache.org/content/repositories/orgapacheflink-1444/
> 
> Best,
> Jingsong
> 
> On Thu, Jul 29, 2021 at 9:50 PM Robert Metzger 
> wrote:
> 
>> The difference is that the 1440 staging repository contains the Scala
> _2.11
>> files, the 1441 repo contains scala_2.12. I'm not sure if this works,
>> because things like "flink-core:1.11.5" will be released twice?
>> I would prefer to have a single staging repository containing all
> binaries
>> we intend to release to maven central, to avoid complications in the
>> release process.
>> 
>> Since only the convenience binaries are affected by this, we don't
>>> need
> to
>> cancel the release. We just need to create a new staging repository.
>> 
>> 
>> On Thu, Jul 29, 2021 at 3:36 PM Robert Metzger 
>> wrote:
>> 
>>> Thanks a lot for creating a release candidate!
>>> 
>>> What is the difference between the two maven staging repos?
>>> 
> 
>>> https://repository.apache.org/content/repositories/orgapacheflink-1440/
>>> and
>>> 
> 
>>> https://repository.apache.org/content/repositories/orgapacheflink-1441/
>> ?
>>> 
>>> On Thu, Jul 29, 2021 at 1:52 PM Xingbo Huang 
> wrote:
>>> 
 +1 (non-binding)
 
 - Verified checksums and signatures
 - Built from sources
 - Verified Python wheel package contents
 - Pip install Python wheel package in Mac
 - Run Python UDF job in Python REPL
 
 Best,
 Xingbo
 
 Zakelly Lan  于2021年7月29日周四 下午5:57写道：
 
> +1 (non-binding)
> 
> * Built from source.
> * Run wordcount datastream job on yarn
> * Web UI and checkpoint seem good.
> * Kill a container to make job failover, everything is good.
> * Try run job from checkpoint, everything is good.
> 
> On Thu, Jul 29, 2021 at 2:34 PM Yun Tang 
 wrote:
> 
>> +1 (non-binding)
>> 
>> Checked the signature.
>> 
>> Reviewed the PR of flink-web.
>> 
>> Download the pre-built tar package and launched an application
> mode
>> standalone job successfully.
>> 
>> Best
>> Yun Tang
>> 
>> 
>> 
>> From: Jingsong Li 
>> Sent: Tuesday, July 27, 2021 11:54
>> To: dev 
>> Subject: [VOTE] Release 1.12.5

Re: [VOTE] Release 1.13.2, release candidate #3

2021-08-01 Thread Dian Fu 
+1 (binding)

-  reviewed the website PR and have left a minor comment
-  verified the signatures and checksum
-  installed the Python wheel package of Python 3.8 on MacOS and runs some 
simple examples

Regards,
Dian

> 2021年8月1日 下午3:10，Leonard Xu  写道：
> 
> 
> +1 (non-binding)
> 
> - verified signatures and hashsums
> - started a cluster, ran a socket window word count job, no suspicious log 
> output
> - tested using SQL Client to submit job and the query result is expected
> - the web PR looks good
> 
> Best,
> Leonard
> 
>> 在 2021年7月31日，09:08，godfrey he  写道：
>> 
>> +1 (non-binding)
>> 
>> - Checked checksums and signatures: OK
>> - Built from source: OK
>> - Checked the flink-web PR
>>  - find one typo about the number of the fixes and improvements
>> - Submit some jobs from sql-client to local cluster, checked the web-ui,
>> cp, sp, log, etc: OK
>> 
>> Best,
>> Godfrey
>> 
>> 
>> Xingbo Huang  于2021年7月30日周五 下午2:51写道：
>> 
>>> +1 (non-binding)
>>> 
>>> - Verified checksums and signatures
>>> - Verified Python wheel package contents
>>> - Pip install apache-flink-libraries source package and apache-flink wheel
>>> package in Mac
>>> - Write and Run a Simple Python UDF job in Python REPL
>>> 
>>> Best,
>>> Xingbo
>>> 
>>> Yu Li  于2021年7月30日周五 下午2:33写道：
>>> 
 +1 (binding)
 
 - Checked the diff between 1.13.1 and 1.13.2-rc3: OK (
 
>>> https://github.com/apache/flink/compare/release-1.13.1...release-1.13.2-rc3
 )
 - commons-io version has been bumped to 2.8.0 through FLINK-22747 and
>>> all
 NOTICE files updated correctly
 - guava version has been bumped to 29.0 for kinesis connector through
 FLINK-23009 and all NOTICE files updated correctly
 - Checked release notes: OK
 - minor: I've moved FLINK-23315 and FLINK-23418 out of 1.13.2 to keep
 accordance with RC status
 - Checked sums and signatures: OK
 - Maven clean install from source: OK
 - Checked the jars in the staging repo: OK
 - Checked the website updates: OK
 - minor: left some minor comments in PR (such as RN needs update, etc.)
 and please remember to address them before merging
 
 Best Regards,
 Yu
 
 
 On Fri, 30 Jul 2021 at 14:00, Jingsong Li 
>>> wrote:
 
> +1 (non-binding)
> 
> - Check if checksums and GPG files match the corresponding release
>>> files
> - staging repository looks fine
> - Start a local cluster (start-cluster.sh), logs fine
> - Run sql-client and run a job, looks fine
> 
> I found an unexpected log in sql-client:
> "Searching for
> 
> 
 
>>> '/Users/lijingsong/Downloads/tmp/flink-1.13.2/conf/sql-client-defaults.yaml'...not
> found"
> This log should be removed. I created a JIRA for this:
> https://issues.apache.org/jira/browse/FLINK-23552
> (This should not be a blocker)
> 
> Best,
> Jingsong
> 
> On Thu, Jul 29, 2021 at 10:44 PM Robert Metzger 
> wrote:
> 
>> Thanks a lot for creating this release candidate
>> 
>> +1 (binding)
>> 
>> - staging repository looks fine
>> - Diff to 1.13.1 looks fine wrt to dependency changes:
>> 
> 
 
>>> https://github.com/apache/flink/compare/release-1.13.1...release-1.13.2-rc3
>> - standalone mode works locally
>>  - I found this issue, which is not specific to 1.13.2:
>> https://issues.apache.org/jira/browse/FLINK-23546
>> - src archive signature is matched; sha512 is correct
>> 
>> On Thu, Jul 29, 2021 at 9:10 AM Zakelly Lan 
> wrote:
>> 
>>> +1 (non-binding)
>>> 
>>> * Built from source.
>>> * Run wordcount datastream job on yarn
>>> * Web UI and checkpoint seem good.
>>> * Kill a container to make job failover, everything is good.
>>> * Try run job from checkpoint, everything is good.
>>> 
>>> On Fri, Jul 23, 2021 at 10:04 PM Yun Tang 
>>> wrote:
>>> 
 Hi everyone,
 Please review and vote on the release candidate #3 for the
>>> version
>>> 1.13.2,
 as follows:
 [ ] +1, Approve the release
 [ ] -1, Do not approve the release (please provide specific
 comments)
 
 
 The complete staging area is available for your review, which
> includes:
 * JIRA release notes [1],
 * the official Apache source release and binary convenience
 releases
> to
>>> be
 deployed to dist.apache.org [2], which are signed with the key
 with
 fingerprint 78A306590F1081CC6794DC7F62DAD618E07CF996 [3],
 * all artifacts to be deployed to the Maven Central Repository
>>> [4],
 * source code tag "release-1.13.2-rc3" [5],
 * website pull request listing the new release and adding
> announcement
 blog post [6].
 
 The vote will be open for at least 72 hours. It is adopted by
> majority
 approval, with at least 3 PMC affirmative votes.

Re: [VOTE] Release 1.11.4, release candidate #1

2021-08-01 Thread Dian Fu 
+1 (binding)

-  checked the website PR
-  verified the signatures and checksum
-  installed the Python wheel package of Python 3.7 on MacOS and runs the word 
count example

Regards,
Dian

> 2021年8月1日 下午4:17，Leonard Xu  写道：
> 
> +1 (non-binding)
> 
> - verified signatures and hashsums
> - built from source code with scala 2.11 succeeded
> - checked all dependency artifacts are 1.11.4
> - started a cluster, ran a wordcount job, the result is expected, no 
> suspicious log output
> - started SQL Client, ran some SQL queries, the result is expected
> - reviewed the web PR
> 
> Best,
> Leonard
> 
>> 在 2021年7月26日，23:25，godfrey he  写道：
>> 
>> Hi everyone,
>> Please review and vote on the release candidate #1 for the version 1.11.4,
>> as follows:
>> [ ] +1, Approve the release
>> [ ] -1, Do not approve the release (please provide specific comments)
>> 
>> 
>> The complete staging area is available for your review, which includes:
>> * JIRA release notes [1],
>> * the official Apache source release and binary convenience releases to be
>> deployed to dist.apache.org [2], which are signed with the key with
>> fingerprint 4A978875E56AA2100EB0CF12A244D52CF0A40279 [3],
>> * all artifacts to be deployed to the Maven Central Repository [4],
>> * source code tag "release-1.11.4-rc1" [5],
>> * website pull request listing the new release and adding announcement blog
>> post [6].
>> 
>> The vote will be open for at least 72 hours. It is adopted by majority
>> approval, with at least 3 PMC affirmative votes.
>> 
>> Best,
>> Godfrey
>> 
>> [1]
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12349404
>> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.11.4-rc1/
>> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
>> [4] https://repository.apache.org/content/repositories/orgapacheflink-1438
>> [5] https://github.com/apache/flink/releases/tag/release-1.11.4-rc1
>> [6] https://github.com/apache/flink-web/pull/459
>

[RESULT] [VOTE] Release 1.13.2, release candidate #3

2021-08-01 Thread Yun Tang 
Dear all,

I'm happy to announce that we have unanimously approved the release of 1.13.2.

There are 8 approving votes, 3 of which are binding:

  *   Zakelly Lan
  *   Robert Metzger (binding)
  *   Jingsong Li
  *   Yu Li  (binding)
  *   Xingbo Huang
  *   Godfrey He
  *   Leonard Xu
  *   Dian Fu (binding)

There are no disapproving votes.

Thanks everyone!

Best,

Yun Tang

Re: Looking for Maintainers for Flink on YARN

2021-08-01 Thread Xintong Song 
Thanks Konstantin for bringing this up, and thanks Marton and your team for
volunteering.

@Marton,
Our team at Alibaba will keep helping with the Flink on YARN maintenance.
However, as Konstaintin said, the time our team dedicated to this will
probably be less than it used to be. Your offer of help is significant and
greatly appreciated. Please feel free to reach out to us if you need any
help on this.

Thank you~

Xintong Song



On Thu, Jul 29, 2021 at 5:04 PM Márton Balassi 
wrote:

> Hi Konstantin,
>
> Thank you for raising this topic, our development team at Cloudera would be
> happy to step up to address this responsibility.
>
> Best,
> Marton
>
> On Thu, Jul 29, 2021 at 10:15 AM Konstantin Knauf 
> wrote:
>
> > Dear community,
> >
> > We are looking for community members, who would like to maintain Flink's
> > YARN support going forward. So far, this has been handled by teams at
> > Ververica & Alibaba. The focus of these teams has shifted over the past
> > months so that we only have little time left for this topic. Still, we
> > think, it is important to maintain high quality support for Flink on
> YARN.
> >
> > What does "Maintaining Flink on YARN" mean? There are no known bigger
> > efforts outstanding. We are mainly talking about addressing
> > "test-stability" issues, bugs, version upgrades, community contributions
> &
> > smaller feature requests. The prioritization of these would be up to the
> > future maintainers, except "test-stability" issues which are important to
> > address for overall productivity.
> >
> > If a group of community members forms itself, we are happy to give an
> > introduction to relevant pieces of the code base, principles,
> assumptions,
> > ... and hand over open threads.
> >
> > If you would like to take on this responsibility or can join this effort
> in
> > a supporting role, please reach out!
> >
> > Cheers,
> >
> > Konstantin
> > for the Deployment & Coordination Team at Ververica
> >
> > --
> >
> > Konstantin Knauf
> >
> > https://twitter.com/snntrable
> >
> > https://github.com/knaufk
> >
>

[jira] [Created] (FLINK-23572) KubernetesSharedInformerITCase JVM crash on azure

2021-08-01 Thread Xintong Song (Jira) 
Xintong Song created FLINK-23572:


 Summary: KubernetesSharedInformerITCase JVM crash on azure
 Key: FLINK-23572
 URL: https://issues.apache.org/jira/browse/FLINK-23572
 Project: Flink
  Issue Type: Bug
  Components: Deployment / Kubernetes
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21228&view=logs&j=91bf6583-3fb2-592f-e4d4-d79d79c3230a&t=cc5499f8-bdde-5157-0d76-b6528ecd808e&l=3139

{code}
Jul 30 20:59:45 [ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.22.1:test (default-test) on 
project flink-kubernetes_2.11: There are test failures.
Jul 30 20:59:45 [ERROR] 
Jul 30 20:59:45 [ERROR] Please refer to 
/home/vsts/work/1/s/flink-kubernetes/target/surefire-reports for the individual 
test results.
Jul 30 20:59:45 [ERROR] Please refer to dump files (if any exist) [date].dump, 
[date]-jvmRun[N].dump and [date].dumpstream.
Jul 30 20:59:45 [ERROR] The forked VM terminated without properly saying 
goodbye. VM crash or System.exit called?
Jul 30 20:59:45 [ERROR] Command was /bin/sh -c cd 
/home/vsts/work/1/s/flink-kubernetes && 
/usr/lib/jvm/adoptopenjdk-8-hotspot-amd64/jre/bin/java -Xms256m -Xmx2048m 
-Dmvn.forkNumber=1 -XX:+UseG1GC -jar 
/home/vsts/work/1/s/flink-kubernetes/target/surefire/surefirebooter8791022745489033085.jar
 /home/vsts/work/1/s/flink-kubernetes/target/surefire 
2021-07-30T20-59-32_680-jvmRun1 surefire4734143520512335815tmp 
surefire_05027311838510350290tmp
Jul 30 20:59:45 [ERROR] Error occurred in starting fork, check output in log
Jul 30 20:59:45 [ERROR] Process Exit Code: 239
Jul 30 20:59:45 [ERROR] Crashed tests:
Jul 30 20:59:45 [ERROR] 
org.apache.flink.kubernetes.kubeclient.resources.KubernetesSharedInformerITCase
Jul 30 20:59:45 [ERROR] 
org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM 
terminated without properly saying goodbye. VM crash or System.exit called?
Jul 30 20:59:45 [ERROR] Command was /bin/sh -c cd 
/home/vsts/work/1/s/flink-kubernetes && 
/usr/lib/jvm/adoptopenjdk-8-hotspot-amd64/jre/bin/java -Xms256m -Xmx2048m 
-Dmvn.forkNumber=1 -XX:+UseG1GC -jar 
/home/vsts/work/1/s/flink-kubernetes/target/surefire/surefirebooter8791022745489033085.jar
 /home/vsts/work/1/s/flink-kubernetes/target/surefire 
2021-07-30T20-59-32_680-jvmRun1 surefire4734143520512335815tmp 
surefire_05027311838510350290tmp
Jul 30 20:59:45 [ERROR] Error occurred in starting fork, check output in log
Jul 30 20:59:45 [ERROR] Process Exit Code: 239
Jul 30 20:59:45 [ERROR] Crashed tests:
Jul 30 20:59:45 [ERROR] 
org.apache.flink.kubernetes.kubeclient.resources.KubernetesSharedInformerITCase
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:669)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:282)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:245)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
Jul 30 20:59:45 [ERROR] at 
org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
Jul 30 20:59:45 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
Jul 30 20:59:45 [ERROR] at sun.reflect.

[jira] [Created] (FLINK-23573) Tests fail with AdaptiveScheduler due to exceptions in logs trying to offer slots after JobMaster shutdown

2021-08-01 Thread Xintong Song (Jira) 
Xintong Song created FLINK-23573:


 Summary: Tests fail with AdaptiveScheduler due to exceptions in 
logs trying to offer slots after JobMaster shutdown
 Key: FLINK-23573
 URL: https://issues.apache.org/jira/browse/FLINK-23573
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=20267&view=logs&j=4dd4dbdd-1802-5eb7-a518-6acd9d24d0fc&t=8d6b4dd3-4ca1-5611-1743-57a7d76b395a&l=412

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=20396&view=logs&j=4dd4dbdd-1802-5eb7-a518-6acd9d24d0fc&t=8d6b4dd3-4ca1-5611-1743-57a7d76b395a&l=2390

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=20454&view=logs&j=4dd4dbdd-1802-5eb7-a518-6acd9d24d0fc&t=8d6b4dd3-4ca1-5611-1743-57a7d76b395a&l=371

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21228&view=logs&j=4dd4dbdd-1802-5eb7-a518-6acd9d24d0fc&t=7c4a8fb8--5a77-f518-4176bfae300b&l=2437

The test failed due to exceptions in logs. I executed the following command 
from flink-end-to-end-tests/test-scripts/common.sh on the logs, and it points 
to the RecipientUnreachableException in TM logs. The problem is that, TM 
received extra slot requests from RM after the tasks are finished and slots are 
freed, while the JobMaster it tried to offer slots to had already shutdown.

{code}
$ grep -rv "GroupCoordinatorNotAvailableException" . \
   | grep -v "RetriableCommitFailedException" \
   | grep -v "NoAvailableBrokersException" \
   | grep -v "Async Kafka commit failed" \
   | grep -v "DisconnectException" \
   | grep -v "Cannot connect to ResourceManager right now" \
   | grep -v "AskTimeoutException" \
   | grep -v "WARN  akka.remote.transport.netty.NettyTransport" \
   | grep -v  "WARN  
org.apache.flink.shaded.akka.org.jboss.netty.channel.DefaultChannelPipeline" \
   | grep -v 'INFO.*AWSErrorCode' \
   | grep -v "RejectedExecutionException" \
   | grep -v "CancellationException" \
   | grep -v "An exception was thrown by an exception handler" \
   | grep -v "Caused by: java.lang.ClassNotFoundException: 
org.apache.hadoop.yarn.exceptions.YarnException" \
   | grep -v "Caused by: java.lang.ClassNotFoundException: 
org.apache.hadoop.conf.Configuration" \
   | grep -v "java.lang.NoClassDefFoundError: 
org/apache/hadoop/yarn/exceptions/YarnException" \
   | grep -v "java.lang.NoClassDefFoundError: 
org/apache/hadoop/conf/Configuration" \
   | grep -v "java.lang.Exception: Execution was suspended" \
   | grep -v "java.io.InvalidClassException: 
org.apache.flink.formats.avro.typeutils.AvroSerializer" \
   | grep -v "Caused by: java.lang.Exception: JobManager is shutting down" \
   | grep -v "java.lang.Exception: Artificial failure" \
   | grep -v "org.apache.flink.runtime.checkpoint.CheckpointException" \
   | grep -v "org.elasticsearch.ElasticsearchException" \
   | grep -v "Elasticsearch exception" \
   | grep -v "org.apache.flink.runtime.JobException: Recovery is suppressed" \
   | grep -v "WARN  akka.remote.ReliableDeliverySupervisor" \
   | grep -i "exception"
./flink-vsts-taskexecutor-0-fv-az217-107.log:org.apache.flink.runtime.rpc.exceptions.RecipientUnreachableException:
 Could not send message [RemoteFencedMessage(, 
RemoteRpcInvocation(null.offerSlots(ResourceID, Collection, Time)))] from 
sender [Actor[akka.tcp://flink@10.1.0.175:38955/temp/$0b]] to recipient 
[Actor[akka://flink/user/rpc/jobmanager_2#1483449133]], because the recipient 
is unreachable. This can either mean that the recipient has been terminated or 
that the remote RpcService is currently not reachable.
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] Release 1.12.5, release candidate #3

2021-08-01 Thread JING ZHANG 
+1 (non-binding)

1. built from source code flink-1.12.5-bin-scala_2.11.tgz

succeeded
2. Started a local Flink cluster, ran the WordCount example, WebUI looks
good,  no suspicious output/log
3. started cluster and run some e2e sql queries using SQL Client, query
result is expected. (Find a minor bug  FLINK-23554
 which would happen in
some corner cases, so it is not a blocker)
4. Repeat Step 2 and 3 with flink-1.12.5-src.tgz


Best,
JING ZHANG

Dian Fu  于2021年8月2日周一 上午9:59写道：

> +1 (binding)
>
> -  checked the website PR
> -  verified the signatures and checksum
> -  Installed the Python wheel package of Python 3.8 on MacOS and runs some
> simple examples
>
> Regards,
> Dian
>
> > 2021年8月1日 下午3:32，Leonard Xu  写道：
> >
> > +1 (non-binding)
> >
> > - verified signatures and hashsums
> > - checked all dependency artifacts are 1.12.5
> > - started a cluster, ran a wordcount job, the result is expected, no
> suspicious log output
> > - started SQL Client, ran some sql queries in SQL Client, the result is
> expected, no suspicious log output
> > - reviewed the web PR
> >
> > Best,
> > Leonard
> >
> >> 在 2021年8月1日，15:24，Jark Wu  写道：
> >>
> >> +1 (binding)
> >>
> >> - checked/verified signatures and hashes
> >> - started cluster, ran examples, verified web ui and log output, nothing
> >> unexpected
> >> - started cluster and ran some e2e sql queries using sql-client, looks
> good:
> >> - read from kafka source, aggregate, write into mysql
> >> - read from kafka source with watermark defined in ddl, window
> aggregate,
> >> write into mysql
> >> - read from kafka with computed column defined in ddl, temporal join
> with
> >> a mysql table, write into kafka
> >> - reviewed the release PR
> >>
> >> Best,
> >> Jark
> >>
> >> On Sat, 31 Jul 2021 at 10:22, godfrey he  wrote:
> >>
> >>> +1 (non-binding)
> >>>
> >>> - Checked checksums and signatures: OK
> >>> - Built from source: OK
> >>> - Checked the flink-web PR
> >>>  - find one typo about flink version
> >>> - Submit some jobs from sql-client to local cluster, checked the
> web-ui,
> >>> cp, sp, log, etc: OK
> >>>
> >>> Best,
> >>> Godfrey
> >>>
> >>> Robert Metzger  于2021年7月30日周五 下午4:33写道：
> >>>
>  Thanks a lot for providing the new staging repository. I dropped the
> 1440
>  and 1441 staging repositories, to avoid that other RC reviewers
>  accidentally look into it, or that we accidentally release it.
> 
>  +1 (binding)
> 
>  Checks:
>  - I didn't find any additional issues in the release announcement
>  - the pgp signatures on the source archive seem fine
>  - source archive compilation starts successfully (rat check passes
> etc.)
>  - standalone mode, job submission and cli cancellation works. logs
> look
>  fine
>  - maven staging repository looks fine
> 
>  On Fri, Jul 30, 2021 at 7:30 AM Jingsong Li 
>  wrote:
> 
> > Hi everyone,
> >
> > Thanks Robert, I created a new one.
> >
> > all artifacts to be deployed to the Maven Central Repository [4],
> >
> > [4]
> >
> >>>
> https://repository.apache.org/content/repositories/orgapacheflink-1444/
> >
> > Best,
> > Jingsong
> >
> > On Thu, Jul 29, 2021 at 9:50 PM Robert Metzger 
> > wrote:
> >
> >> The difference is that the 1440 staging repository contains the
> Scala
> > _2.11
> >> files, the 1441 repo contains scala_2.12. I'm not sure if this
> works,
> >> because things like "flink-core:1.11.5" will be released twice?
> >> I would prefer to have a single staging repository containing all
> > binaries
> >> we intend to release to maven central, to avoid complications in the
> >> release process.
> >>
> >> Since only the convenience binaries are affected by this, we don't
> >>> need
> > to
> >> cancel the release. We just need to create a new staging repository.
> >>
> >>
> >> On Thu, Jul 29, 2021 at 3:36 PM Robert Metzger  >
> >> wrote:
> >>
> >>> Thanks a lot for creating a release candidate!
> >>>
> >>> What is the difference between the two maven staging repos?
> >>>
> >
> >>>
> https://repository.apache.org/content/repositories/orgapacheflink-1440/
> >>> and
> >>>
> >
> >>>
> https://repository.apache.org/content/repositories/orgapacheflink-1441/
> >> ?
> >>>
> >>> On Thu, Jul 29, 2021 at 1:52 PM Xingbo Huang 
> > wrote:
> >>>
>  +1 (non-binding)
> 
>  - Verified checksums and signatures
>  - Built from sources
>  - Verified Python wheel package contents
>  - Pip install Python wheel package in Mac
>  - Run Python UDF job in Python REPL
> 
>  Best,
>  Xingbo
>

[jira] [Created] (FLINK-23574) test_pandas_udaf hangs on azure

2021-08-01 Thread Xintong Song (Jira) 
Xintong Song created FLINK-23574:


 Summary: test_pandas_udaf hangs on azure
 Key: FLINK-23574
 URL: https://issues.apache.org/jira/browse/FLINK-23574
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.12.4
Reporter: Xintong Song
 Fix For: 1.12.5


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21229&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=4fad9527-b9a5-5015-1b70-8356e5c91490&l=21404



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (FLINK-23575) UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails with AsynchronousException

2021-08-01 Thread Xintong Song (Jira) 
Xintong Song created FLINK-23575:


 Summary: 
UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails with 
AsynchronousException
 Key: FLINK-23575
 URL: https://issues.apache.org/jira/browse/FLINK-23575
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Task
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21246&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=4938

{code}
Jul 31 21:32:59 [ERROR] Tests run: 72, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 655.588 s <<< FAILURE! - in 
org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase
Jul 31 21:32:59 [ERROR] shouldRescaleUnalignedCheckpoint[upscale pipeline from 
20 to 21, buffersPerChannel = 
1](org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase)  Time 
elapsed: 21.288 s  <<< ERROR!
Jul 31 21:32:59 org.apache.flink.runtime.client.JobExecutionException: Job 
execution failed.
Jul 31 21:32:59 at 
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
Jul 31 21:32:59 at 
org.apache.flink.test.checkpointing.UnalignedCheckpointTestBase.execute(UnalignedCheckpointTestBase.java:159)
Jul 31 21:32:59 at 
org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint(UnalignedCheckpointRescaleITCase.java:543)
Jul 31 21:32:59 at 
sun.reflect.GeneratedMethodAccessor128.invoke(Unknown Source)
Jul 31 21:32:59 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Jul 31 21:32:59 at java.lang.reflect.Method.invoke(Method.java:498)
Jul 31 21:32:59 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Jul 31 21:32:59 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Jul 31 21:32:59 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Jul 31 21:32:59 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Jul 31 21:32:59 at org.junit.rules.Verifier$1.evaluate(Verifier.java:35)
Jul 31 21:32:59 at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
Jul 31 21:32:59 at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Jul 31 21:32:59 at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Jul 31 21:32:59 at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Jul 31 21:32:59 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Jul 31 21:32:59 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Jul 31 21:32:59 at org.junit.runners.Suite.runChild(Suite.java:128)
Jul 31 21:32:59 at org.junit.runners.Suite.runChild(Suite.java:27)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Jul 31 21:32:59 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Jul 31 21:32:59 at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
Jul 31 21:32:59 at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
Jul 31 21:32:59 at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
Jul 31 21:32:59 at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
Jul 3

[jira] [Created] (FLINK-23576) JoinITCase.testFullJoinWithEqualPkNonEqui fails due to Artificial Failure

2021-08-01 Thread Xintong Song (Jira) 
Xintong Song created FLINK-23576:


 Summary: JoinITCase.testFullJoinWithEqualPkNonEqui fails due to 
Artificial Failure
 Key: FLINK-23576
 URL: https://issues.apache.org/jira/browse/FLINK-23576
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21246&view=logs&j=f2c100be-250b-5e85-7bbe-176f68fcddc5&t=05efd11e-5400-54a4-0d27-a4663be008a9&l=9949

{code}
Jul 31 21:43:27 [ERROR] Tests run: 104, Failures: 0, Errors: 1, Skipped: 0, 
Time elapsed: 93.597 s <<< FAILURE! - in 
org.apache.flink.table.planner.runtime.stream.sql.JoinITCase
Jul 31 21:43:27 [ERROR] 
testFullJoinWithEqualPkNonEqui[StateBackend=ROCKSDB](org.apache.flink.table.planner.runtime.stream.sql.JoinITCase)
  Time elapsed: 20.238 s  <<< ERROR!
Jul 31 21:43:27 org.apache.flink.runtime.client.JobExecutionException: Job 
execution failed.
Jul 31 21:43:27 at 
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
Jul 31 21:43:27 at 
org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:137)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
Jul 31 21:43:27 at 
org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:250)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
Jul 31 21:43:27 at 
org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
Jul 31 21:43:27 at 
org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
Jul 31 21:43:27 at 
org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
Jul 31 21:43:27 at 
org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
Jul 31 21:43:27 at 
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
Jul 31 21:43:27 at 
org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
Jul 31 21:43:27 at akka.dispatch.OnComplete.internal(Future.scala:300)
Jul 31 21:43:27 at akka.dispatch.OnComplete.internal(Future.scala:297)
Jul 31 21:43:27 at 
akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
Jul 31 21:43:27 at 
akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
Jul 31 21:43:27 at 
scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
Jul 31 21:43:27 at 
org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
Jul 31 21:43:27 at 
scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
Jul 31 21:43:27 at 
scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
Jul 31 21:43:27 at 
scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
Jul 31 21:43:27 at 
scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
Jul 31 21:43:27 at 
akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
Jul 31 21:43:27 at 
akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
Jul 31 21:43:27 at 
akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
Jul 31 21:43:27 at 
scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
Jul 31 21:43:27 at 
scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
Jul 31 21:43:27

[jira] [Created] (FLINK-23577) CoordinatedSourceRescaleITCase.testUpscaling fails with NoSuchFileException

2021-08-01 Thread Xintong Song (Jira) 
Xintong Song created FLINK-23577:


 Summary: CoordinatedSourceRescaleITCase.testUpscaling fails with 
NoSuchFileException
 Key: FLINK-23577
 URL: https://issues.apache.org/jira/browse/FLINK-23577
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream
Affects Versions: 1.12.4
Reporter: Xintong Song
 Fix For: 1.12.5


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21256&view=logs&j=298e20ef-7951-5965-0e79-ea664ddc435e&t=b4cd3436-dbe8-556d-3bca-42f92c3cbf2f&l=21306

{code}
[ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 6.874 s 
<<< FAILURE! - in 
org.apache.flink.connector.base.source.reader.CoordinatedSourceRescaleITCase
[ERROR] 
testUpscaling(org.apache.flink.connector.base.source.reader.CoordinatedSourceRescaleITCase)
  Time elapsed: 5.32 s  <<< ERROR!
java.io.UncheckedIOException: java.nio.file.NoSuchFileException: 
/tmp/junit5156435599891303309/junit3268016245125781188/79604f102e69d25f3258a72a648dfdef/chk-8
at 
java.base/java.nio.file.FileTreeIterator.fetchNextIfNeeded(FileTreeIterator.java:87)
at 
java.base/java.nio.file.FileTreeIterator.hasNext(FileTreeIterator.java:103)
at java.base/java.util.Iterator.forEachRemaining(Iterator.java:132)
at 
java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at 
java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
at 
java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
at 
java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
at 
java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at 
java.base/java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:558)
at 
java.base/java.util.stream.ReferencePipeline.max(ReferencePipeline.java:594)
at 
org.apache.flink.connector.base.source.reader.CoordinatedSourceRescaleITCase.generateCheckpoint(CoordinatedSourceRescaleITCase.java:83)
at 
org.apache.flink.connector.base.source.reader.CoordinatedSourceRescaleITCase.testUpscaling(CoordinatedSourceRescaleITCase.java:70)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at 
org

[jira] [Created] (FLINK-23578) Remove Python operators PythonFlatMapOperator/PythonMapOperator/PythonPartitionCustomOperator and use PythonProcessOperator instead

2021-08-01 Thread Dian Fu (Jira) 
Dian Fu created FLINK-23578:
---

 Summary: Remove Python operators 
PythonFlatMapOperator/PythonMapOperator/PythonPartitionCustomOperator and use 
PythonProcessOperator instead
 Key: FLINK-23578
 URL: https://issues.apache.org/jira/browse/FLINK-23578
 Project: Flink
  Issue Type: Sub-task
  Components: API / Python
Reporter: Dian Fu
Assignee: Dian Fu
 Fix For: 1.14.0






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (FLINK-23579) SELECT SHA2(NULL, CAST(NULL AS INT)) AS ref0 can't compile

2021-08-01 Thread xiaojin.wy (Jira) 
xiaojin.wy created FLINK-23579:
--

 Summary: SELECT SHA2(NULL, CAST(NULL AS INT)) AS ref0 can't compile
 Key: FLINK-23579
 URL: https://issues.apache.org/jira/browse/FLINK-23579
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.14.0
Reporter: xiaojin.wy
 Fix For: 1.14.0


Running the sql of SELECT SHA2(NULL, CAST(NULL AS INT)) AS ref0 will get the 
error below:
java.lang.RuntimeException: Could not instantiate generated class 
'ExpressionReducer$5'

at 
org.apache.flink.table.runtime.generated.GeneratedClass.newInstance(GeneratedClass.java:75)
at 
org.apache.flink.table.planner.codegen.ExpressionReducer.reduce(ExpressionReducer.scala:108)
at 
org.apache.calcite.rel.rules.ReduceExpressionsRule.reduceExpressionsInternal(ReduceExpressionsRule.java:759)
at 
org.apache.calcite.rel.rules.ReduceExpressionsRule.reduceExpressions(ReduceExpressionsRule.java:699)
at 
org.apache.calcite.rel.rules.ReduceExpressionsRule$ProjectReduceExpressionsRule.onMatch(ReduceExpressionsRule.java:306)
at 
org.apache.calcite.plan.AbstractRelOptPlanner.fireRule(AbstractRelOptPlanner.java:333)
at org.apache.calcite.plan.hep.HepPlanner.applyRule(HepPlanner.java:542)
at 
org.apache.calcite.plan.hep.HepPlanner.applyRules(HepPlanner.java:407)
at 
org.apache.calcite.plan.hep.HepPlanner.executeInstruction(HepPlanner.java:243)
at 
org.apache.calcite.plan.hep.HepInstruction$RuleInstance.execute(HepInstruction.java:127)
at 
org.apache.calcite.plan.hep.HepPlanner.executeProgram(HepPlanner.java:202)
at 
org.apache.calcite.plan.hep.HepPlanner.findBestExp(HepPlanner.java:189)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkHepProgram.optimize(FlinkHepProgram.scala:69)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkHepRuleSetProgram.optimize(FlinkHepRuleSetProgram.scala:87)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
at 
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at 
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at 
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
at 
org.apache.flink.table.planner.plan.optimize.BatchCommonSubGraphBasedOptimizer.optimizeTree(BatchCommonSubGraphBasedOptimizer.scala:87)
at 
org.apache.flink.table.planner.plan.optimize.BatchCommonSubGraphBasedOptimizer.org$apache$flink$table$planner$plan$optimize$BatchCommonSubGraphBasedOptimizer$$optimizeBlock(BatchCommonSubGraphBasedOptimizer.scala:58)
at 
org.apache.flink.table.planner.plan.optimize.BatchCommonSubGraphBasedOptimizer$$anonfun$doOptimize$1.apply(BatchCommonSubGraphBasedOptimizer.scala:46)
at 
org.apache.flink.table.planner.plan.optimize.BatchCommonSubGraphBasedOptimizer$$anonfun$doOptimize$1.apply(BatchCommonSubGraphBasedOptimizer.scala:46)
at 
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at 
org.apache.flink.table.planner.plan.optimize.BatchCommonSubGraphBasedOptimizer.doOptimize(BatchCommonSubGraphBasedOptimizer.scala:46)
at 
org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:93)
at 
org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:307)
at 
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:169)
at 
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1718)
at 
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:803)
at 
org.apache.flink.table.api.internal.StatementSetImpl.execute(StatementSetImpl.java:125)
at 
org.apache.flink.table.planner.runtime.batch.sql.TableSourceITCase.testTableXiaojin(TableSourceITCase.scala:487)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native

Re: [VOTE] Release 1.11.4, release candidate #1

2021-08-01 Thread Yu Li 
+1 (binding)

- Checked the diff between 1.11.3 and 1.11.4-rc1: OK (
https://github.com/apache/flink/compare/release-1.11.3...release-1.11.4-rc1)
  - jackson version has been bumped to 2.10.5.1 through FLINK-21020 and all
NOTICE files updated correctly
  - beanutils version has been bumped to 1.9.4 through FLINK-21123 and all
NOTICE files updated correctly
  - snappy-java version has been bumped to 1.1.8.3 through FLINK-22208 and
all NOTICE files updated correctly
  - aws sdk version has been bumped to 1.12.7 for kinesis connector through
FLINK-18182 and all NOTICE files updated correctly
  - guava version has been bumped to 29.0 for kinesis connector through
FLINK-18182 and all NOTICE files updated correctly
- Checked release notes: OK
- Checked sums and signatures: OK
- Maven clean install from source: OK
- Checked the jars in the staging repo: OK
- Checked the website updates: Changes Required
  - Note: necessary changes needed before merging, but this is not a
blocker for RC

Best Regards,
Yu


On Mon, 2 Aug 2021 at 10:22, Dian Fu  wrote:

> +1 (binding)
>
> -  checked the website PR
> -  verified the signatures and checksum
> -  installed the Python wheel package of Python 3.7 on MacOS and runs the
> word count example
>
> Regards,
> Dian
>
> > 2021年8月1日 下午4:17，Leonard Xu  写道：
> >
> > +1 (non-binding)
> >
> > - verified signatures and hashsums
> > - built from source code with scala 2.11 succeeded
> > - checked all dependency artifacts are 1.11.4
> > - started a cluster, ran a wordcount job, the result is expected, no
> suspicious log output
> > - started SQL Client, ran some SQL queries, the result is expected
> > - reviewed the web PR
> >
> > Best,
> > Leonard
> >
> >> 在 2021年7月26日，23:25，godfrey he  写道：
> >>
> >> Hi everyone,
> >> Please review and vote on the release candidate #1 for the version
> 1.11.4,
> >> as follows:
> >> [ ] +1, Approve the release
> >> [ ] -1, Do not approve the release (please provide specific comments)
> >>
> >>
> >> The complete staging area is available for your review, which includes:
> >> * JIRA release notes [1],
> >> * the official Apache source release and binary convenience releases to
> be
> >> deployed to dist.apache.org [2], which are signed with the key with
> >> fingerprint 4A978875E56AA2100EB0CF12A244D52CF0A40279 [3],
> >> * all artifacts to be deployed to the Maven Central Repository [4],
> >> * source code tag "release-1.11.4-rc1" [5],
> >> * website pull request listing the new release and adding announcement
> blog
> >> post [6].
> >>
> >> The vote will be open for at least 72 hours. It is adopted by majority
> >> approval, with at least 3 PMC affirmative votes.
> >>
> >> Best,
> >> Godfrey
> >>
> >> [1]
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12349404
> >> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.11.4-rc1/
> >> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> >> [4]
> https://repository.apache.org/content/repositories/orgapacheflink-1438
> >> [5] https://github.com/apache/flink/releases/tag/release-1.11.4-rc1
> >> [6] https://github.com/apache/flink-web/pull/459
> >
>
>

[FLINK-23555] needs your attention

2021-08-01 Thread 卫博文 
Hi, PMC & commiters


I have come up with an issue about common subexpression elimination
https://issues.apache.org/jira/browse/FLINK-23555
I hacked on the flink-table-planner module to improve common subexpression 
elimination by using localRef
And the result tells that my hacked codes make a big difference.
The issue has been proposed several days but got little attention.
Now I don't know how to show you my code hence don't know if it's suitable.
I need help and long for your attention.


Yours sincerely