Unknown call expression: avg(amount) when use distinct() in Flink Thanks~!

I posted this question here. http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Unknown-call-expression-avg-amount-when-use-distinct-in-Flink-Thanks-td40905.html but my later replies to it is NOT delivered,it's strange. Flink1.12 scala2.12 Could anyone help me? Thanks~!

Unknown call expression: avg(amount) when use distinct() in Flink Thanks~!

I posted this question here. http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Unknown-call-expression-avg-amount-when-use-distinct-in-Flink-Thanks-td40905.html but my replies to it is now delivered,it's strange. Flink1.12 scala2.12 Could anyone help me? Thanks~!

Re: Flink 1.11 job hit error "Job leader lost leadership" or "ResourceManager leader changed to new address null"

Thank you~ Xintong Song On Sat, Jan 30, 2021 at 8:27 AM Xintong Song wrote: > There's indeed a ZK version upgrading during 1.9 and 1.11, but I'm not > aware of any similar issue reported since the upgrading. > I would suggest the following: > - Turn on the DEBUG log see if there's any valuabl

Re: Deduplicating record amplification

Great, thank you for the confirmation! On Thu, Jan 28, 2021 at 11:25 PM Arvid Heise wrote: > Hi Rex, > > there cannot be any late event in processing time by definition (maybe on > a quantum computer?), so you should be fine. The timestamp of records in > processing time is monotonously increasi

LEAD/LAG functions

Another (hopefully newbie) question. Trying to use LEAD/LAG over window functions. I get the following error. The exact same query works properly using FIRST_VALUE instead of LEAD. Thanks in advance... - Patrick Flink SQL> describe l1_min ; +---++--+-+--

Re: Flink SQL OVER window

Thanks, Seth. That did the trick! On Fri, Jan 29, 2021 at 10:51 AM Seth Wiesman wrote: > You need to use TUMBLE_ROWTIME to extract a time attribute from a window, > TUMBLE_END is just a timestamp. > > > https://ci.apache.org/projects/flink/flink-docs-master/dev/table/sql/queries.html#selecting-g

Re: Flink SQL OVER window

You need to use TUMBLE_ROWTIME to extract a time attribute from a window, TUMBLE_END is just a timestamp. https://ci.apache.org/projects/flink/flink-docs-master/dev/table/sql/queries.html#selecting-group-window-start-and-end-timestamps Seth On Fri, Jan 29, 2021 at 9:14 AM Patrick Angeles wrote:

Re: Flink SQL OVER window

Forgot to mention, I am using Flink 1.12. On Fri, Jan 29, 2021 at 10:11 AM Patrick Angeles wrote: > Fairly new to Flink here so this might be a newbie mistake, but here's the > problem. I created the following table and view: > > >> CREATE TABLE test ( >> >> event_time TIMESTAMP(3), >> >

Flink SQL OVER window

Fairly new to Flink here so this might be a newbie mistake, but here's the problem. I created the following table and view: > CREATE TABLE test ( > > event_time TIMESTAMP(3), > > symbol STRING, > > price DOUBLE, > > WATERMARK FOR event_time AS event_time - INT

Re: flink checkpoints adjustment strategy

Do you have advice on how to determine why a checkpoint failed? 1. Timeout (that's easy to discover as the UI logs them). 2. Other errors are not so easy to find. How can I find other errors? Are they in the UI, or good old-fashioned logging? On Fri, Jan 29, 2021 at 3:11 AM Congxian Qiu wrote:

Re: Resource changed on src filesystem after upgrade

Hi Xintong Song, > - Does this error happen for every of your dataset jobs? For a problematic > job, does it happen for every container? > - What is the `jobs.jar`? Is it under `lib/`, `opt` of your client side > filesystem, or specified as `yarn.ship-files`, `yarn.ship-archives` or > `yarn.pro

Re: flink checkpoints adjustment strategy

Hi Marco You need to figure out why the checkpoint timed out(you can see the consumed time of each period for one checkpoint in UI), if it indeed needs such long time to complete the checkpoint, then you need to configure a longer timeout. If there are some checkpoint errors, we need firs

Re: [ANNOUNCE] Apache Flink 1.10.3 released

Thanks Xintong for driving this release! Regards, Dian > 在 2021年1月29日，下午5:24，Till Rohrmann 写道： > > Thanks Xintong for being our release manager. Well done! > > Cheers, > Till > > On Fri, Jan 29, 2021 at 9:50 AM Yang Wang > wrote: > Thanks Xintong for driving thi

Re: Flink on Kubernetes, Task/Job Manager Recycles

I think you need to enable the HA(high availability) for your Flink cluster[1]. Currently, we have the ZooKeeperHAService and KubernetesHAService. In the HA mode, all the meta data(e.g. job graph path, checkpoint counter, checkpoint path) will be stored on ZooKeeper or Kubernetes ConfigMap. And the

Re: [ANNOUNCE] Apache Flink 1.10.3 released

Thanks Xintong for being our release manager. Well done! Cheers, Till On Fri, Jan 29, 2021 at 9:50 AM Yang Wang wrote: > Thanks Xintong for driving this release. > > Best, > Yang > > Yu Li 于2021年1月29日周五 下午3:52写道： > >> Thanks Xintong for being our release manager and everyone else who made >> t

Re: Configuring ephemeral storage limits when using Native Kubernetes

Hi Emilien, Thanks for trying the native Flink integration. Unfortunately, we still do not have the ability to set the ephemeral storage limit. I think it could be supported via pod template[1]. I am still working on this ticket and already have a draft PR[2]. I believe it could be supported in r

Re: Timers not firing until stream end

1) Outside of small-scale tests the periodic emission of watermarks should ensure that the latency is not unbounded. Your test just runs so quickly that this never triggers. As for the triggering element being emitted first: The reason this happen is because watermarks are not really attached to

Re: [ANNOUNCE] Apache Flink 1.10.3 released

Thanks Xintong for driving this release. Best, Yang Yu Li 于2021年1月29日周五 下午3:52写道： > Thanks Xintong for being our release manager and everyone else who made > the release possible! > > Best Regards, > Yu > > > On Fri, 29 Jan 2021 at 15:05, Xintong Song wrote: > >> The Apache Flink community is