[jira] [Created] (FLINK-22252) Backquotes are not rendered correctly in config option descriptions

2021-04-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-22252: -- Summary: Backquotes are not rendered correctly in config option descriptions Key: FLINK-22252 URL: https://issues.apache.org/jira/browse/FLINK-22252 Project: Flin

Re: Automatic backpressure detection

2021-04-12 Thread Piotr Nowojski
Hi, Yes. Back-pressure from AsyncOperator should be correctly reported via isBackPressured, backPressuredMsPerSecond metrics and by extension in the WebUI from 1.13. Piotre pon., 12 kwi 2021 o 23:17 Lu Niu napisał(a): > Hi, Piotr > > Thanks for your detailed reply! It is mentioned here we cann

Re: handle SUSPENDED in ZooKeeperLeaderRetrievalService

2021-04-12 Thread Yang Wang
This might be related with FLINK-10052[1]. Unfortunately, we do not have any progress on this ticket. cc @Till Rohrmann Best, Yang chenqin 于2021年4月13日周二 上午7:31写道: > Hi there, > > We observed several 1.11 job running in 1.11 restart due to job leader > lost. > Dig deeper, the issue seems relat

[jira] [Created] (FLINK-22251) PrometheusReporterEndToEndITCase.testReporter fail because Dispatcher REST endpoint did not start in time.

2021-04-12 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22251: - Summary: PrometheusReporterEndToEndITCase.testReporter fail because Dispatcher REST endpoint did not start in time. Key: FLINK-22251 URL: https://issues.apache.org/jira/browse/FLINK-222

[jira] [Created] (FLINK-22250) flink-sql-parser model Class ParserResource lack ParserResource.properties

2021-04-12 Thread WeiNan Zhao (Jira)
WeiNan Zhao created FLINK-22250: --- Summary: flink-sql-parser model Class ParserResource lack ParserResource.properties Key: FLINK-22250 URL: https://issues.apache.org/jira/browse/FLINK-22250 Project: Fli

[jira] [Created] (FLINK-22249) JobMasterStopWithSavepointITCase failed due to status is FAILING

2021-04-12 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22249: - Summary: JobMasterStopWithSavepointITCase failed due to status is FAILING Key: FLINK-22249 URL: https://issues.apache.org/jira/browse/FLINK-22249 Project: Flink I

[jira] [Created] (FLINK-22248) JobMasterStopWithSavepointITCase.suspendWithSavepointWithoutComplicationsShouldSucceedAndLeadJobToFinished fail because of TestTimedOutException

2021-04-12 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22248: - Summary: JobMasterStopWithSavepointITCase.suspendWithSavepointWithoutComplicationsShouldSucceedAndLeadJobToFinished fail because of TestTimedOutException Key: FLINK-22248 URL: https://

[jira] [Created] (FLINK-22247) can not pass AddressList when connecting to rabbitmq

2021-04-12 Thread Spongebob (Jira)
Spongebob created FLINK-22247: - Summary: can not pass AddressList when connecting to rabbitmq Key: FLINK-22247 URL: https://issues.apache.org/jira/browse/FLINK-22247 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-22246) when use HiveCatalog create table , can't set Table owner property correctly

2021-04-12 Thread xiangtao (Jira)
xiangtao created FLINK-22246: Summary: when use HiveCatalog create table , can't set Table owner property correctly Key: FLINK-22246 URL: https://issues.apache.org/jira/browse/FLINK-22246 Project: Flink

[jira] [Created] (FLINK-22245) Reuse PrintUtils.MAX_COLUMN_WIDTH in CliChangelogResultView and CliTableResultView

2021-04-12 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-22245: - Summary: Reuse PrintUtils.MAX_COLUMN_WIDTH in CliChangelogResultView and CliTableResultView Key: FLINK-22245 URL: https://issues.apache.org/jira/browse/FLINK-22245

handle SUSPENDED in ZooKeeperLeaderRetrievalService

2021-04-12 Thread chenqin
Hi there, We observed several 1.11 job running in 1.11 restart due to job leader lost. Dig deeper, the issue seems related to SUSPENDED state handler in ZooKeeperLeaderRetrievalService. ASFAIK, suspended state is expected when zk is not certain if leader is still alive. It can follow up with RECO

Re: Automatic backpressure detection

2021-04-12 Thread Lu Niu
Hi, Piotr Thanks for your detailed reply! It is mentioned here we cannot observe backpressure generated from AsyncOperator in Flink UI in 1.9.1. Is it fixed in the latest version? Thank you! http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Async-Function-Not-Generating-Backpres

Re: [jira] [Created] (FLINK-22228) Random log exception when tasks finish after a checkpoint was started

2021-04-12 Thread lian
退订 On 04/12/2021 17:10, Chesnay Schepler (Jira) wrote: Chesnay Schepler created FLINK-8: Summary: Random log exception when tasks finish after a checkpoint was started Key: FLINK-8 URL: https://issues.a

(无主题)

2021-04-12 Thread lian
退订

[jira] [Created] (FLINK-22244) Clarify Reactive Mode documentation wrt to timeouts

2021-04-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-22244: -- Summary: Clarify Reactive Mode documentation wrt to timeouts Key: FLINK-22244 URL: https://issues.apache.org/jira/browse/FLINK-22244 Project: Flink Issue

[jira] [Created] (FLINK-22243) Reactive Mode parallelism changes are not shown in the job graph visualization in the UI

2021-04-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-22243: -- Summary: Reactive Mode parallelism changes are not shown in the job graph visualization in the UI Key: FLINK-22243 URL: https://issues.apache.org/jira/browse/FLINK-22243

[jira] [Created] (FLINK-22242) Improve missing attribute error on GeneratedAddressedScopedStorage

2021-04-12 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-22242: Summary: Improve missing attribute error on GeneratedAddressedScopedStorage Key: FLINK-22242 URL: https://issues.apache.org/jira/browse/FLINK-22242 Project: Flink

Re: [DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-12 Thread Chesnay Schepler
a) yes. b) maven by default adds a timestamp to snapshot artifacts that we can use. The apache repository retains the last 2 snapshots, so we do need to keep things in sync a fair bit, but there are rarely commits made in flink-shaded that I don't think this will be a problem. c) a-SNAPSHOT-un

Re: [DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-12 Thread Robert Metzger
Thanks a lot for your proposal, I'm generally open to the idea I have a few questions: a) Does this mean that we are changing flink-shaded to deploy snapshot artifacts to Apache's snapshot maven repository, and change Flink's parent pom to point to this snapshot repo? b) How do you plan to generat

[jira] [Created] (FLINK-22241) Record AllocationID instead of JobID when marking slot active failed

2021-04-12 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-22241: Summary: Record AllocationID instead of JobID when marking slot active failed Key: FLINK-22241 URL: https://issues.apache.org/jira/browse/FLINK-22241 Project: Flink

[jira] [Created] (FLINK-22240) Sanity/phrasing pass for ExternalResourceUtils

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22240: Summary: Sanity/phrasing pass for ExternalResourceUtils Key: FLINK-22240 URL: https://issues.apache.org/jira/browse/FLINK-22240 Project: Flink Issue

Re: [DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-12 Thread Konstantin Knauf
Sounds good. +1 On Mon, Apr 12, 2021 at 1:23 PM Chesnay Schepler wrote: > Hello all, > > I would like to propose a change in how the Flink master interacts with > Flink-shaded. > > TL;DR: Release snapshot artifacts for flink-shaded, and have the Flink > master rely on specific snapshot versions

[jira] [Created] (FLINK-22239) Improve support for JdbcXaSinkFunction

2021-04-12 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-22239: Summary: Improve support for JdbcXaSinkFunction Key: FLINK-22239 URL: https://issues.apache.org/jira/browse/FLINK-22239 Project: Flink Issue Type: Task R

[DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-12 Thread Chesnay Schepler
Hello all, I would like to propose a change in how the Flink master interacts with Flink-shaded. TL;DR: Release snapshot artifacts for flink-shaded, and have the Flink master rely on specific snapshot versions for earlier dependency bumps. Aa a project we have come to the general conclusio

[jira] [Created] (FLINK-22238) Investigate angular native flamegraph library

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22238: Summary: Investigate angular native flamegraph library Key: FLINK-22238 URL: https://issues.apache.org/jira/browse/FLINK-22238 Project: Flink Issue T

[jira] [Created] (FLINK-22237) Cleanup flamegraph html component

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22237: Summary: Cleanup flamegraph html component Key: FLINK-22237 URL: https://issues.apache.org/jira/browse/FLINK-22237 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-22236) Document opt-in behavior of flamegraph

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22236: Summary: Document opt-in behavior of flamegraph Key: FLINK-22236 URL: https://issues.apache.org/jira/browse/FLINK-22236 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-22235) Document stability concerns of flamegraphs for heavier jobs

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22235: Summary: Document stability concerns of flamegraphs for heavier jobs Key: FLINK-22235 URL: https://issues.apache.org/jira/browse/FLINK-22235 Project: Flink

[jira] [Created] (FLINK-22234) Read savepoint before creating ExecutionGraph

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22234: Summary: Read savepoint before creating ExecutionGraph Key: FLINK-22234 URL: https://issues.apache.org/jira/browse/FLINK-22234 Project: Flink Issue T

[jira] [Created] (FLINK-22233) 源码中单词"constaint"拼写错误

2021-04-12 Thread Jira
王高超 created FLINK-22233: --- Summary: 源码中单词"constaint"拼写错误 Key: FLINK-22233 URL: https://issues.apache.org/jira/browse/FLINK-22233 Project: Flink Issue Type: Improvement Components: Table SQL /

[jira] [Created] (FLINK-22232) Improve test coverage for network stack

2021-04-12 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-22232: - Summary: Improve test coverage for network stack Key: FLINK-22232 URL: https://issues.apache.org/jira/browse/FLINK-22232 Project: Flink Issue Type:

[jira] [Created] (FLINK-22231) Add Rule to deprioritize Critical/Blocker Non-Bugs

2021-04-12 Thread Konstantin Knauf (Jira)
Konstantin Knauf created FLINK-22231: Summary: Add Rule to deprioritize Critical/Blocker Non-Bugs Key: FLINK-22231 URL: https://issues.apache.org/jira/browse/FLINK-22231 Project: Flink Is

[jira] [Created] (FLINK-22230) Misleading TaskExecutorResourceUtils log messages

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22230: Summary: Misleading TaskExecutorResourceUtils log messages Key: FLINK-22230 URL: https://issues.apache.org/jira/browse/FLINK-22230 Project: Flink Iss

[jira] [Created] (FLINK-22229) Noise stacktraces if checkpoints fails because sources are not ready

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-9: Summary: Noise stacktraces if checkpoints fails because sources are not ready Key: FLINK-9 URL: https://issues.apache.org/jira/browse/FLINK-9 Project:

[jira] [Created] (FLINK-22228) Random log exception when tasks finish after a checkpoint was started

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-8: Summary: Random log exception when tasks finish after a checkpoint was started Key: FLINK-8 URL: https://issues.apache.org/jira/browse/FLINK-8 Project

[jira] [Created] (FLINK-22218) Skip logging of final null input split

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22218: Summary: Skip logging of final null input split Key: FLINK-22218 URL: https://issues.apache.org/jira/browse/FLINK-22218 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-22227) Job name, Job ID and receiving Dispatcher should be logged by the client

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-7: Summary: Job name, Job ID and receiving Dispatcher should be logged by the client Key: FLINK-7 URL: https://issues.apache.org/jira/browse/FLINK-7 Proj

[jira] [Created] (FLINK-22226) Insufficient slots when submitting jobs results in massive stacktrace

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-6: Summary: Insufficient slots when submitting jobs results in massive stacktrace Key: FLINK-6 URL: https://issues.apache.org/jira/browse/FLINK-6 Project

[jira] [Created] (FLINK-22225) Improve time formatting in LeaderRetrievalUtils

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-5: Summary: Improve time formatting in LeaderRetrievalUtils Key: FLINK-5 URL: https://issues.apache.org/jira/browse/FLINK-5 Project: Flink Issue

[jira] [Created] (FLINK-22224) Nettys NativeLibraryLoader is quite noisy

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-4: Summary: Nettys NativeLibraryLoader is quite noisy Key: FLINK-4 URL: https://issues.apache.org/jira/browse/FLINK-4 Project: Flink Issue Type:

[jira] [Created] (FLINK-22223) Explicitly configure rest.address in distribution config

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-3: Summary: Explicitly configure rest.address in distribution config Key: FLINK-3 URL: https://issues.apache.org/jira/browse/FLINK-3 Project: Flink

[jira] [Created] (FLINK-22222) Global config is logged twice by the client for batch jobs

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-2: Summary: Global config is logged twice by the client for batch jobs Key: FLINK-2 URL: https://issues.apache.org/jira/browse/FLINK-2 Project: Flink

[jira] [Created] (FLINK-22221) Unclear purpose of spill directories

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-1: Summary: Unclear purpose of spill directories Key: FLINK-1 URL: https://issues.apache.org/jira/browse/FLINK-1 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-22220) Log task registration at network on debug

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-0: Summary: Log task registration at network on debug Key: FLINK-0 URL: https://issues.apache.org/jira/browse/FLINK-0 Project: Flink Issue Type:

[jira] [Created] (FLINK-22219) Deduplicate enabling of external resources

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22219: Summary: Deduplicate enabling of external resources Key: FLINK-22219 URL: https://issues.apache.org/jira/browse/FLINK-22219 Project: Flink Issue Type

[jira] [Created] (FLINK-22217) Add quotes around job names

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22217: Summary: Add quotes around job names Key: FLINK-22217 URL: https://issues.apache.org/jira/browse/FLINK-22217 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-22216) Log start of RM on info, instead of DeclarativeSlotManager

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22216: Summary: Log start of RM on info, instead of DeclarativeSlotManager Key: FLINK-22216 URL: https://issues.apache.org/jira/browse/FLINK-22216 Project: Flink

[jira] [Created] (FLINK-22214) Add quotes around checkpoint storage types

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22214: Summary: Add quotes around checkpoint storage types Key: FLINK-22214 URL: https://issues.apache.org/jira/browse/FLINK-22214 Project: Flink Issue Type

[jira] [Created] (FLINK-22215) Rename RECOVERING state to RESTORING

2021-04-12 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-22215: - Summary: Rename RECOVERING state to RESTORING Key: FLINK-22215 URL: https://issues.apache.org/jira/browse/FLINK-22215 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-22213) Do not log hashcode of filesystem factory

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22213: Summary: Do not log hashcode of filesystem factory Key: FLINK-22213 URL: https://issues.apache.org/jira/browse/FLINK-22213 Project: Flink Issue Type:

[jira] [Created] (FLINK-22212) Clean up RM resource requirement logging

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22212: Summary: Clean up RM resource requirement logging Key: FLINK-22212 URL: https://issues.apache.org/jira/browse/FLINK-22212 Project: Flink Issue Type:

[jira] [Created] (FLINK-22211) DataStream.collect() logs warnings if job is not initialized yet

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22211: Summary: DataStream.collect() logs warnings if job is not initialized yet Key: FLINK-22211 URL: https://issues.apache.org/jira/browse/FLINK-22211 Project: Fli

[jira] [Created] (FLINK-22210) Log conversion of input channels on debug

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22210: Summary: Log conversion of input channels on debug Key: FLINK-22210 URL: https://issues.apache.org/jira/browse/FLINK-22210 Project: Flink Issue Type:

[jira] [Created] (FLINK-22209) Make StreamTask#triggerCheckpointAsync return void

2021-04-12 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-22209: Summary: Make StreamTask#triggerCheckpointAsync return void Key: FLINK-22209 URL: https://issues.apache.org/jira/browse/FLINK-22209 Project: Flink Is

Re: Using FileSystem SQL Connector to Commit Hive Partition Exception

2021-04-12 Thread Till Rohrmann
Hi Chenzuoli, the exception says that Flink could not allocate enough slots. Could you share the DEBUG logs of the run with us. They should contain the reason why the allocation of further resources failed. Cheers, Till On Sun, Apr 11, 2021 at 5:59 AM chenzuoli wrote: > > https://ci.apache.org

[jira] [Created] (FLINK-22208) Bump snappy-java to 1.1.5+

2021-04-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-22208: Summary: Bump snappy-java to 1.1.5+ Key: FLINK-22208 URL: https://issues.apache.org/jira/browse/FLINK-22208 Project: Flink Issue Type: Improvement