[jira] [Created] (FLINK-22129) OrcFileSystemITCase hangs on azure

2021-04-06 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-22129: Summary: OrcFileSystemITCase hangs on azure Key: FLINK-22129 URL: https://issues.apache.org/jira/browse/FLINK-22129 Project: Flink Issue Type: Bug

Re: Automatic backpressure detection

2021-04-06 Thread Piotr Nowojski
Hi, Yes, you can use `isBackPressured` to monitor a task's back-pressure. However keep in mind: a) You are going to miss some nice way to visualize this information, which is present in 1.13's WebUI. b) `isBackPressured` is a sampling based metric. If your job has varying load, for example all win

Re: [DISCUSS] Feature freeze date for 1.13

2021-04-06 Thread Kurt Young
Hi Yuval, I think you are good to go, since there is no objection from PMC. Best, Kurt On Wed, Apr 7, 2021 at 12:48 AM Yuval Itzchakov wrote: > Hi Guowei, > > Who should I speak to regarding this? I am at the final stages of the PR I > believe (Shengkai is kindly helping me make things work)

[jira] [Created] (FLINK-22128) Window aggregation should have unique keys

2021-04-06 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-22128: Summary: Window aggregation should have unique keys Key: FLINK-22128 URL: https://issues.apache.org/jira/browse/FLINK-22128 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22127) Enrich error message of read buffer request timeout exception

2021-04-06 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-22127: --- Summary: Enrich error message of read buffer request timeout exception Key: FLINK-22127 URL: https://issues.apache.org/jira/browse/FLINK-22127 Project: Flink

[jira] [Created] (FLINK-22126) when i set ssl ,the jobmanager got certificate_unknown exception

2021-04-06 Thread tonychan (Jira)
tonychan created FLINK-22126: Summary: when i set ssl ,the jobmanager got certificate_unknown exception Key: FLINK-22126 URL: https://issues.apache.org/jira/browse/FLINK-22126 Project: Flink Iss

Re: Automatic backpressure detection

2021-04-06 Thread Lu Niu
Hi, Piotr Thanks for replying! We don't have a plan to upgrade to 1.13 in short term. We are using flink 1.11 and I notice there is a metric called isBackpressured. Is that enough to solve 1? If not, would backporting patches regarding backPressuredTimeMsPerSecond, busyTimeMsPerSecond and idleTim

Re: Flink job cannot find recover path after using entropy injection for s3 file systems

2021-04-06 Thread chenqin
Friendly ping, the fix for entropy marker is ready. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

[jira] [Created] (FLINK-22125) Revisit the return value of MapState.get when the key doesn't exists

2021-04-06 Thread Dian Fu (Jira)
Dian Fu created FLINK-22125: --- Summary: Revisit the return value of MapState.get when the key doesn't exists Key: FLINK-22125 URL: https://issues.apache.org/jira/browse/FLINK-22125 Project: Flink I

[jira] [Created] (FLINK-22124) The job finished without any exception if error was thrown during state access

2021-04-06 Thread Dian Fu (Jira)
Dian Fu created FLINK-22124: --- Summary: The job finished without any exception if error was thrown during state access Key: FLINK-22124 URL: https://issues.apache.org/jira/browse/FLINK-22124 Project: Flink

[jira] [Created] (FLINK-22123) Test state access in Python DataStream API

2021-04-06 Thread Dian Fu (Jira)
Dian Fu created FLINK-22123: --- Summary: Test state access in Python DataStream API Key: FLINK-22123 URL: https://issues.apache.org/jira/browse/FLINK-22123 Project: Flink Issue Type: Test C

[jira] [Created] (FLINK-22122) StreamingKafkaITCase Fail due to TestTimedOutException

2021-04-06 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22122: - Summary: StreamingKafkaITCase Fail due to TestTimedOutException Key: FLINK-22122 URL: https://issues.apache.org/jira/browse/FLINK-22122 Project: Flink Issue Type:

[jira] [Created] (FLINK-22121) FlinkLogicalRankRuleBase should check if name of rankNumberType already exists in the input

2021-04-06 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-22121: --- Summary: FlinkLogicalRankRuleBase should check if name of rankNumberType already exists in the input Key: FLINK-22121 URL: https://issues.apache.org/jira/browse/FLINK-22121

[jira] [Created] (FLINK-22120) Bug when generate code for map get

2021-04-06 Thread Zou (Jira)
Zou created FLINK-22120: --- Summary: Bug when generate code for map get Key: FLINK-22120 URL: https://issues.apache.org/jira/browse/FLINK-22120 Project: Flink Issue Type: Improvement Components

[jira] [Created] (FLINK-22119) Update document for hive dialect

2021-04-06 Thread Rui Li (Jira)
Rui Li created FLINK-22119: -- Summary: Update document for hive dialect Key: FLINK-22119 URL: https://issues.apache.org/jira/browse/FLINK-22119 Project: Flink Issue Type: Sub-task Component

[jira] [Created] (FLINK-22118) Always apply projection push down in blink planner

2021-04-06 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-22118: - Summary: Always apply projection push down in blink planner Key: FLINK-22118 URL: https://issues.apache.org/jira/browse/FLINK-22118 Project: Flink Issue Ty

[jira] [Created] (FLINK-22117) Not print stack trace for checkpoint trigger failure if not all tasks are started.

2021-04-06 Thread Yun Gao (Jira)
Yun Gao created FLINK-22117: --- Summary: Not print stack trace for checkpoint trigger failure if not all tasks are started. Key: FLINK-22117 URL: https://issues.apache.org/jira/browse/FLINK-22117 Project: Fli

[jira] [Created] (FLINK-22116) Setup .asf.yaml in flink-web

2021-04-06 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22116: Summary: Setup .asf.yaml in flink-web Key: FLINK-22116 URL: https://issues.apache.org/jira/browse/FLINK-22116 Project: Flink Issue Type: Task

[RESULT] [VOTE] Release flink-shaded 13.0, release candidate #1

2021-04-06 Thread Chesnay Schepler
The vote has passed with 3 binding votes. Votes: Dawid (+1) Robert (+1) Gordon (+1) On 3/31/2021 2:07 PM, Chesnay Schepler wrote: Hi everyone, Please review and vote on the release candidate #1 for the version 13.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (p

[jira] [Created] (FLINK-22115) JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released

2021-04-06 Thread wym_maozi (Jira)
wym_maozi created FLINK-22115: - Summary: JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released Key: FLINK-22115 URL: https://issues.apache.org/jira/browse/FLINK-22

[jira] [Created] (FLINK-22114) Streaming File Sink s3 end-to-end test fail because the test did not finish after 900 seconds.

2021-04-06 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22114: - Summary: Streaming File Sink s3 end-to-end test fail because the test did not finish after 900 seconds. Key: FLINK-22114 URL: https://issues.apache.org/jira/browse/FLINK-22114

[jira] [Created] (FLINK-22113) UniqueKey constraint is lost with multiple sources join in SQL

2021-04-06 Thread Fu Kai (Jira)
Fu Kai created FLINK-22113: -- Summary: UniqueKey constraint is lost with multiple sources join in SQL Key: FLINK-22113 URL: https://issues.apache.org/jira/browse/FLINK-22113 Project: Flink Issue Typ

[jira] [Created] (FLINK-22112) EmulatedPubSubSinkTest fail due to pull docker image failure

2021-04-06 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22112: - Summary: EmulatedPubSubSinkTest fail due to pull docker image failure Key: FLINK-22112 URL: https://issues.apache.org/jira/browse/FLINK-22112 Project: Flink Issue

Re: Zigzag shape in TM JVM used memory

2021-04-06 Thread Piotr Nowojski
Hi, this should be posted on the user mailing list not the dev. Apart from that, this looks like normal/standard behaviour of JVM, and has very little to do with Flink. Garbage Collector (GC) is kicking in when memory usage is approaching some threshold: https://www.google.com/search?q=jvm+heap+m

Re: Automatic backpressure detection

2021-04-06 Thread Piotr Nowojski
Hi, Lately we overhauled the backpressure detection [1] and a screenshot preview of those efforts is attached here [2]. I encourage you to check the 1.13 RC0 build and how the current mechanism works for you [3]. To support those WebUI changes we have added a couple of new metrics: backPressuredTi