Re: flink1.10.0 set execution.attached

2020-08-16 Thread 魏烽
Hi Yang Wang: I meet the question “flink job failed because Am connection is timeout but application still running via yarn-per-job mode” the same as https://issues.apache.org/jira/browse/FLINK-18891 I try to set execution.attached to false,Will this cause other problems?I worry

Re: flink1.10.0 set execution.attached

2020-08-16 Thread Yang Wang
Hi weifeng, The reason why your settings in flink-conf.yaml do not take effect is that we override the "execution.attached" in "FlinkYarnSessionCli#applyDescriptorOptionToConfig" based on the cli option. If the "-d" is specified, "execution.attached" will be set to false. Otherwise, it is true.

Re: k8s job cluster using StatefulSet

2020-08-16 Thread Yang Wang
Hi Jan, Thanks for you valuable response. Actually, both standalone and native K8s integration, we could have two ways to achieve the HA. * StatefulSet + FilesystemHAService(with leader election/retrieval removed)[1] * Deployment + NativeK8sHaService(native K8s leader election and config map to st

Re: [DISCUSS] FLIP-134: DataStream Semantics for Bounded Input

2020-08-16 Thread Kurt Young
Hi Kostas, Thanks for starting this discussion. The first part of this FLIP: "Batch vs Streaming Scheduling" looks reasonable to me. However, there is another dimension I think we should also take into consideration, which is whether checkpointing is enabled. This option is orthogonal (but not fu

Re: How do i get processingTime in keyedPrcessFounction

2020-08-16 Thread Mike Mintz
Hi Jiazhi, Try ctx.timerService().currentProcessingTime() Best, Mike On Sun, Aug 16, 2020 at 4:48 AM ゞ野蠻遊戲χ wrote: > Hi all > > When I get the processingTime in the processElement method of the > KeyedProcessFunction, > like ctx.timestamp(), which returns null, how do I get the > p

How do i get processingTime in keyedPrcessFounction

2020-08-16 Thread ?g???U?[????
Hi all       When I get the processingTime in the processElement method of the KeyedProcessFunction,        like ctx.timestamp(), which returns null, how do I get the processingTime in processElement methoed? Thanks, Jiazhi

Re:回复:How to get the evaluation result of a time-based window aggregation in time after a new event falling into the window?

2020-08-16 Thread forideal
Hi Chengcheng Zhang, You are welcome. I also got the material from the community to answer your question. There is also a hidden method here, as if the community has not been placed publicly in the document. table.exec.emit.early-fire.enabled = true table.exec.emit.early-