Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-24 Thread Chesnay Schepler
This is pretty simple to explain. "I want to know the environment the job ran in." -> /jobs/:jobid/environment "I want to know the environment the JM ran in." -> /jobmanager/environment It's less about the JobID being a parameter, and more of a way for them to better model the resource they are

Re: [VOTE] FLIP-221: Abstraction for lookup source and metric

2022-06-24 Thread Jing Ge
+1 (non-binding) Best regards, Jing On Fri, Jun 24, 2022 at 7:27 AM Lincoln Lee wrote: > +1 (non-binding) > > > Best, > Lincoln Lee > > > Alexander Smirnov 于2022年6月24日周五 09:54写道: > > > +1 (non-binding) > > > > Best, > > Alexander > > > > чт, 23 июн. 2022 г., 11:49 Qingsheng Ren : > > > > > Hi

Re: [DISCUSS] FLIP-242: Introduce configurable CongestionControlStrategy for Async Sink

2022-06-24 Thread Teoh, Hong
Hi Piotr, Thanks for your feedback! > As I understand it, this effort is about replacing hardcoded `AIMDRateLimitingStrategy` with something more flexible? Yes __ > I have one main question about the design. Why are you trying to split it into three different interfaces? Can not

[jira] [Created] (FLINK-28239) Table-Planner-Loader lacks access to commons-math3

2022-06-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-28239: Summary: Table-Planner-Loader lacks access to commons-math3 Key: FLINK-28239 URL: https://issues.apache.org/jira/browse/FLINK-28239 Project: Flink Is

[jira] [Created] (FLINK-28240) NettyShuffleMetricFactory#RequestedMemoryUsageMetric#getValue may throw ArithmeticException when the total segments of NetworkBufferPool is 0

2022-06-24 Thread Gen Luo (Jira)
Gen Luo created FLINK-28240: --- Summary: NettyShuffleMetricFactory#RequestedMemoryUsageMetric#getValue may throw ArithmeticException when the total segments of NetworkBufferPool is 0 Key: FLINK-28240 URL: https://issues.

[jira] [Created] (FLINK-28241) Massive regression on 20.06.2021

2022-06-24 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-28241: - Summary: Massive regression on 20.06.2021 Key: FLINK-28241 URL: https://issues.apache.org/jira/browse/FLINK-28241 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28242) CDC source with meta columns may cause error result on downstream stateful operators

2022-06-24 Thread lincoln lee (Jira)
lincoln lee created FLINK-28242: --- Summary: CDC source with meta columns may cause error result on downstream stateful operators Key: FLINK-28242 URL: https://issues.apache.org/jira/browse/FLINK-28242 Pr

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-24 Thread Xintong Song
I see. So you are suggesting the jobmanager to support both /foo/bar and /jobs/:jobid/foo/bar, while the history server only supports the latter. I was initially thinking having two APIs in jobmanager serving the exact same purpose is a bit tricky. Now I think it's a good point that these two APIs

[jira] [Created] (FLINK-28243) Considering only time of targeted operation for calculation benchmarks performance

2022-06-24 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-28243: - Summary: Considering only time of targeted operation for calculation benchmarks performance Key: FLINK-28243 URL: https://issues.apache.org/jira/browse/FLINK-28243

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-24 Thread Yangze Guo
Having two separate APIs sounds good to me. I'll update the FLIP accordingly. Best, Yangze Guo On Fri, Jun 24, 2022 at 4:27 PM Xintong Song wrote: > > I see. So you are suggesting the jobmanager to support both /foo/bar and > /jobs/:jobid/foo/bar, while the history server only supports the latte

[jira] [Created] (FLINK-28244) Introduce changelog file for DataFile

2022-06-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28244: Summary: Introduce changelog file for DataFile Key: FLINK-28244 URL: https://issues.apache.org/jira/browse/FLINK-28244 Project: Flink Issue Type: New Feature

Re: Re: Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-24 Thread godfrey he
Hi all, Sorry for the late reply. >table.cor-table-as-select.atomicity-enabled Regarding `cor`, this abbreviation is not commonly used. >Create Table As Select(CTAS) feature depends on the serializability of the >catalog. To quickly see if the catalog supports CTAS, we need to try to >seriali

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-24 Thread junhan yang
Distinguish the APIs through the naming of URLs can be a way to prevent confusion. I think we should reconsider our API design based on the insight earlier and come up with a thorough explanation or perhaps a better plan about this. Best regards, Junhan Xintong Song 于2022年6月24日周五 16:27写道: > I s

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.1, release candidate #1

2022-06-24 Thread Gyula Fóra
+1 (binding) - Verified hashes/signatures, license headers for the release artifacts - Verified Helm chart, helm install - Ran a few example jobs - Verified release notes Gyul On Thu, Jun 23, 2022 at 8:34 AM Gyula Fóra wrote: > Hi Devs, > > Please review and vote on the release candidate

[DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-06-24 Thread Jing Zhang
Hi all, One major problem of Flink batch jobs is slow tasks running on hot/bad nodes, resulting in very long execution time. In order to solve this problem, FLIP-168: Speculative Execution for Batch Job[1] is introduced and approved recently. Here, Zhu Zhu and I propose to support speculative exe

Re: Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-24 Thread godfrey he
Congrats, Shengkai and Qingsheng! Best, Godfrey Yu Li 于2022年6月22日周三 23:55写道: > > Congrats and welcome, Qingsheng and Shengkai! > > Best Regards, > Yu > > > On Wed, 22 Jun 2022 at 17:43, Jiangang Liu > wrote: > > > Congratulations! > > > > Best, > > Jiangang Liu > > > > Mason Chen 于2022年6月22日周三

退订

2022-06-24 Thread 越张
退订

[jira] [Created] (FLINK-28245) Refactor DependencyParser#parseDependencyTreeOutput to return a Tree

2022-06-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-28245: Summary: Refactor DependencyParser#parseDependencyTreeOutput to return a Tree Key: FLINK-28245 URL: https://issues.apache.org/jira/browse/FLINK-28245 Project:

[jira] [Created] (FLINK-28246) Store classifier in dependency

2022-06-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-28246: Summary: Store classifier in dependency Key: FLINK-28246 URL: https://issues.apache.org/jira/browse/FLINK-28246 Project: Flink Issue Type: Sub-task

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.1, release candidate #1

2022-06-24 Thread Őrhidi Mátyás
+1 - Verified hashes/signatures - Verified Helm chart, helm install - Ran a few example jobs Matyas On Fri, Jun 24, 2022 at 11:30 AM Gyula Fóra wrote: > +1 (binding) > > - Verified hashes/signatures, license headers for the release artifacts > - Verified Helm chart, helm install > - Ran a f

Re: Re: Re: Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-24 Thread ron
Thanks for godfrey further feedback, your suggestions are very good to me, the FLIP has updated according to your feedback. It will be very good if you look at it again。 Also looking forward to further feedback from others. > -原始邮件- > 发件人: "godfrey he" > 发送时间: 2022-06-24 17:00:51 (星期五

[jira] [Created] (FLINK-28247) Exception will be thrown when over window contains grouping in Hive Dialect

2022-06-24 Thread luoyuxia (Jira)
luoyuxia created FLINK-28247: Summary: Exception will be thrown when over window contains grouping in Hive Dialect Key: FLINK-28247 URL: https://issues.apache.org/jira/browse/FLINK-28247 Project: Flink

[jira] [Created] (FLINK-28248) Metaspace memory is leaking when repeatedly submitting Beam pipelines via the REST API

2022-06-24 Thread Arkadiusz Gasinski (Jira)
Arkadiusz Gasinski created FLINK-28248: -- Summary: Metaspace memory is leaking when repeatedly submitting Beam pipelines via the REST API Key: FLINK-28248 URL: https://issues.apache.org/jira/browse/FLINK-28248

Re: 退订

2022-06-24 Thread Lincoln Lee
Hi, 退订请发任意邮件至: user-zh-unsubscr...@flink.apache.org Best, Lincoln Lee 越张 于2022年6月24日周五 18:11写道: > 退订 >

Re: [VOTE] Release 1.15.1, release candidate #1

2022-06-24 Thread Chesnay Schepler
+1 (binding) - signatures OK - all required artifacts appear to be present - tag exists with the correct version adjustments - binary shows correct commit and version - examples run fine - website PR looks good On 22/06/2022 14:20, David Anderson wrote: Hi everyone, Please review and vote on r

Re:Re: Re: Re: Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-24 Thread Mang Zhang
Hi godfrey and ron, Thank you very much for your replies and suggestions. Special thanks to ron for helping to review and improve the FLIP. Looking forward to further feedback from others. -- Best regards, Mang Zhang At 2022-06-24 19:52:58, "ron" wrote: >Thanks for godfrey further feedba

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.1, release candidate #1

2022-06-24 Thread Chenya Zhang
+1 (non-binding) - Verified maven and helm chart versions for built from source - Verified helm chart points to correct docker image and deploys it by default - Verified helm installation and basic checkpointing, stateful examples with upgrades and manual savepoints - Verified online documents inc

Azure CI build failure question

2022-06-24 Thread Gabor Somogyi
Hi All, I've seen the following issue before and now it came up again in PR Azure CI build jobs: "E: Unsupported file ./libssl1.0.0_1.0.2n-1ubuntu5.9_amd64.deb given on commandline" Example job link: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37165&view=logs&j=bea5277

Re:Re:Re: Re: Re: Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-24 Thread Mang Zhang
Hi all, Thank you to all those who participated in the discussion and made suggestions! After several rounds of online and offline discussions, the solution in FLIP has been updated. Looking forward to more feedback from everyone. -- Best regards, Mang Zhang At 2022-06-24 21:58:01, "M

[VOTE] FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-06-24 Thread godfrey he
Hi everyone, Thanks for all the feedback so far. Based on the discussion[1] we seem to have consensus, so I would like to start a vote on FLIP-240 for which the FLIP has now also been updated[2]. The vote will last for at least 72 hours (Jun 29th 14:00 GMT, excluding weekend days) unless there is

Re: Azure CI build failure question

2022-06-24 Thread Gabor Somogyi
Ah, now I see a minor version bump happened in the ubuntu repo: libssl1.0.0_1.0.2n-1ubuntu5.10_amd64.deb Presume some job related code needs to be adapted. On Fri, Jun 24, 2022 at 4:38 PM Gabor Somogyi wrote: > Hi All, > > I've seen the following issue before and now it came up again in PR Azur

Re: [DISCUSS] FLIP-242: Introduce configurable CongestionControlStrategy for Async Sink

2022-06-24 Thread Piotr Nowojski
Hi Hong, Thanks for your clarifications. > We can change it such that AsyncSinkWriter passes a constructed batch of messages to the RateLimitingStrategy.shouldBlock(), and that returns a boolean, so the RateLimitingStrategy can decide the evaluation logic internally. Do we need to pass the const

Re: Azure CI build failure question

2022-06-24 Thread Martijn Visser
Hi Gabor, I believe that was already fixed a couple of days ago, maybe you need to rebase? See https://github.com/apache/flink/commit/b79625de622713be56ffd0417f3d0deedba5ed4e Best regards, Martijn Op vr 24 jun. 2022 om 17:11 schreef Gabor Somogyi : > Ah, now I see a minor version bump happened

Re: Azure CI build failure question

2022-06-24 Thread Gabor Somogyi
Hi Martijn, Thanks for the hint, giving a try... BR, G On Fri, 24 Jun 2022, 19:56 Martijn Visser, wrote: > Hi Gabor, > > I believe that was already fixed a couple of days ago, maybe you need to > rebase? See > > https://github.com/apache/flink/commit/b79625de622713be56ffd0417f3d0deedba5ed4e >

[jira] [Created] (FLINK-28249) Flink can not delete older checkpoint folders from google storage bucket

2022-06-24 Thread Jie Zhang (Jira)
Jie Zhang created FLINK-28249: - Summary: Flink can not delete older checkpoint folders from google storage bucket Key: FLINK-28249 URL: https://issues.apache.org/jira/browse/FLINK-28249 Project: Flink

Re: [DISCUSS] Releasing Flink ML 2.1.0

2022-06-24 Thread Jing Ge
+1 Looking forward to the new release! Thanks! Best regards, Jing On Fri, Jun 24, 2022 at 4:56 AM Becket Qin wrote: > +1. > > It looks like we have some decent progress on Flink ML :) > > Thanks, > > Jiangjie (Becket) Qin > > On Fri, Jun 24, 2022 at 8:29 AM Dong Lin wrote: > > > Hi Zhipeng a

Re:Re: Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-24 Thread Lihe Ma
Hi, Yuan Mei, Thanks for your feedback. The configuration state.backend.incremental should work for all state backends, which I think is reasonable. If we introduce more configurations(such as state.backend.hashmap.incremental, state.backend.rocksdb.incremental), it does not bring enough bene