[jira] [Created] (FLINK-22271) FlinkSQL Read Hive(parquet file) field does not exist

2021-04-13 Thread moran (Jira)
moran created FLINK-22271: - Summary: FlinkSQL Read Hive(parquet file) field does not exist Key: FLINK-22271 URL: https://issues.apache.org/jira/browse/FLINK-22271 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22270) Python test pipeline no output for 900 seconds

2021-04-13 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22270: - Summary: Python test pipeline no output for 900 seconds Key: FLINK-22270 URL: https://issues.apache.org/jira/browse/FLINK-22270 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22269) JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsShouldSimplyRestartInSuspend failed.

2021-04-13 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22269: - Summary: JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsShouldSimplyRestartInSuspend failed. Key: FLINK-22269 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-22268) JobMasterStopWithSavepointITCase.testRestartCheckpointCoordinatorIfStopWithSavepointFails fail because of "Not all required tasks are currently running."

2021-04-13 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22268: - Summary: JobMasterStopWithSavepointITCase.testRestartCheckpointCoordinatorIfStopWithSavepointFails fail because of "Not all required tasks are currently running." Key: FLINK-22268 URL:

[jira] [Created] (FLINK-22267) Savepoint an application for source of upsert-kafka, then restart the application from the savepoint, state not be recovered.

2021-04-13 Thread Carl (Jira)
Carl created FLINK-22267: Summary: Savepoint an application for source of upsert-kafka, then restart the application from the savepoint, state not be recovered. Key: FLINK-22267 URL: https://issues.apache.org/jira/brows

[jira] [Created] (FLINK-22266) JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithoutRestartsHelper fail

2021-04-13 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22266: - Summary: JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithoutRestartsHelper fail Key: FLINK-22266 URL: https://issues.apache.org/jira/browse/FLINK-22266 Pro

[jira] [Created] (FLINK-22265) Abnormal document display

2021-04-13 Thread BoYi Zhang (Jira)
BoYi Zhang created FLINK-22265: -- Summary: Abnormal document display Key: FLINK-22265 URL: https://issues.apache.org/jira/browse/FLINK-22265 Project: Flink Issue Type: Improvement Compo

subscribed

2021-04-13 Thread boyi
您好！ 有什么问题随时与我联系和沟通，期待您的回信，祝好！ 2021-04-14

[jira] [Created] (FLINK-22264) Fix misleading statement about per-job mode support for Kubernetes in Concept/Flink Architecture page

2021-04-13 Thread Fuyao Li (Jira)
Fuyao Li created FLINK-22264: Summary: Fix misleading statement about per-job mode support for Kubernetes in Concept/Flink Architecture page Key: FLINK-22264 URL: https://issues.apache.org/jira/browse/FLINK-22264

Add jobId and JobName variable to JobManager metrics in per-job deployment mode

2021-04-13 Thread Lu Niu
Hi, Flink dev Could you share your thoughts about https://issues.apache.org/jira/browse/FLINK-22164 ? context: We expose all flink metrics to an external system for monitoring and alerting. However, JobManager metrics only have one variable , which is not enough to target to one job when job is d

Re: [DISCUSS]FLIP-150: Introduce Hybrid Source

2021-04-13 Thread Stephan Ewen
Thanks all for this discussion. Looks like there are lots of ideas and folks that are eager to do things, so let's see how we can get this moving. My take on this is the following: There will probably not be one Hybrid source, but possibly multiple ones, because of different strategies/requiremen

Re: [DISCUSS] Backport FLIP-27 Kafka source connector fixes with API change to release-1.12.

2021-04-13 Thread Stephan Ewen
Hi all! Generally, avoiding API changes in Bug fix versions is the right thing, in my opinion. But this case is a bit special, because we are changing something that never worked properly in the first place. So we are not breaking a "running thing" here, but making it usable. So +1 from my side

Re: Automatic backpressure detection

2021-04-13 Thread Lu Niu
Cool. Thanks! Best Lu On Mon, Apr 12, 2021 at 11:27 PM Piotr Nowojski wrote: > Hi, > > Yes. Back-pressure from AsyncOperator should be correctly reported via > isBackPressured, backPressuredMsPerSecond metrics and by extension in the > WebUI from 1.13. > > Piotre > > pon., 12 kwi 2021 o 23:17 L

[jira] [Created] (FLINK-22263) Using TIMESTAMPADD function with partition value has some problem when push partition into TableSource

2021-04-13 Thread hehuiyuan (Jira)
hehuiyuan created FLINK-22263: - Summary: Using TIMESTAMPADD function with partition value has some problem when push partition into TableSource Key: FLINK-22263 URL: https://issues.apache.org/jira/browse/FLINK-22263

[jira] [Created] (FLINK-22262) Flink on Kubernetes ConfigMaps are created without OwnerReference

2021-04-13 Thread Andrea Peruffo (Jira)
Andrea Peruffo created FLINK-22262: -- Summary: Flink on Kubernetes ConfigMaps are created without OwnerReference Key: FLINK-22262 URL: https://issues.apache.org/jira/browse/FLINK-22262 Project: Flink

[jira] [Created] (FLINK-22261) Python StreamingModeDataStreamTests is failed on Azure

2021-04-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-22261: --- Summary: Python StreamingModeDataStreamTests is failed on Azure Key: FLINK-22261 URL: https://issues.apache.org/jira/browse/FLINK-22261 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22260) Source schema in CREATE TABLE LIKE statements is not inferred correctly

2021-04-13 Thread Jira
Ingo Bürk created FLINK-22260: - Summary: Source schema in CREATE TABLE LIKE statements is not inferred correctly Key: FLINK-22260 URL: https://issues.apache.org/jira/browse/FLINK-22260 Project: Flink

[jira] [Created] (FLINK-22259) UnalignedCheckpointITCase fails with "Value too large for header, this indicates that the test is running too long"

2021-04-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-22259: Summary: UnalignedCheckpointITCase fails with "Value too large for header, this indicates that the test is running too long" Key: FLINK-22259 URL: https://issues.apache.or

Re: [DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-13 Thread Chesnay Schepler
@Robert We can workaround the snapshot limit issue fairly easily; this limit is imposed per version, so if we modify the version to include the commit hash this limit does not apply. This should also make it easier to work with from the Flink side because a commit hash is easier to copy&paste t

[jira] [Created] (FLINK-22258) Adaptive Scheduler: Show history of rescales in the Web UI

2021-04-13 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-22258: -- Summary: Adaptive Scheduler: Show history of rescales in the Web UI Key: FLINK-22258 URL: https://issues.apache.org/jira/browse/FLINK-22258 Project: Flink

[jira] [Created] (FLINK-22257) Clarify Flink ConfigOptions Usage

2021-04-13 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-22257: --- Summary: Clarify Flink ConfigOptions Usage Key: FLINK-22257 URL: https://issues.apache.org/jira/browse/FLINK-22257 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22256) Persist checkpoint type information

2021-04-13 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-22256: --- Summary: Persist checkpoint type information Key: FLINK-22256 URL: https://issues.apache.org/jira/browse/FLINK-22256 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22255) AdaptiveScheduler improvements

2021-04-13 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-22255: - Summary: AdaptiveScheduler improvements Key: FLINK-22255 URL: https://issues.apache.org/jira/browse/FLINK-22255 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22254) Only trigger scale up if the resources have stabilized

2021-04-13 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-22254: - Summary: Only trigger scale up if the resources have stabilized Key: FLINK-22254 URL: https://issues.apache.org/jira/browse/FLINK-22254 Project: Flink Issu

Re: [DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-13 Thread Till Rohrmann
Thanks for creating this proposal Chesnay. I do understand the problem you want to fix. What I am wondering is why we don't release flink-shaded more often. Does the release process cause too much overhead? If this is the case, then we could look into what is causing the overhead and whether we ca

Re: handle SUSPENDED in ZooKeeperLeaderRetrievalService

2021-04-13 Thread Till Rohrmann
Hi Chenqin, The current rationale behind assuming a leadership loss when seeing a SUSPENDED connection is to assume the worst and to be on the safe side. Yang Wang is correct. FLINK-10052 [1] has the goal to make the behaviour configurable. Unfortunately, the community did not have enough time to

[jira] [Created] (FLINK-22253) Update backpressure monitoring documentation

2021-04-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-22253: Summary: Update backpressure monitoring documentation Key: FLINK-22253 URL: https://issues.apache.org/jira/browse/FLINK-22253 Project: Flink Issue Ty

Re: [DISCUSS] Flink should rely on flink-shaded SNAPSHOT artifacts

2021-04-13 Thread Robert Metzger
Thanks a lot for your responses. I didn't know that you can explicitly refer to the timestamped snapshots of the artifacts. The limitation to the last 2 snapshots means that a push to flink-shaded can break our main CI? This sounds very fragile to me, given that the setup itself is probably a bit