[ANNOUNCE] Apache Flink 1.9.3 released

Hi everyone, The Apache Flink community is very happy to announce the release of Apache Flink 1.9.3, which is the third bugfix release for the Apache Flink 1.9 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data

Re: [ANNOUNCE] Apache Flink 1.9.3 released

@Dian, thanks a lot for the release and for being the release manager. Also thanks to everyone who made this release possible! Best, Hequn On Sat, Apr 25, 2020 at 7:57 PM Dian Fu wrote: > Hi everyone, > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.9.3,

Re: define WATERMARKS in queries/views?

Hi Lec, You can only define `assignTimestampAndWatermark` on DataStream, so you have to convert `Table` into DataStream first. If the DataStream already has been assigned watermark, then the new `assignTimestampAndWatermark` will override the previous watermark. Best, Jark On Thu, 23 Apr 2020 at

Re: Flink table modules

Hi Flavio, Here is the documentation about "Module": https://ci.apache.org/projects/flink/flink-docs-master/dev/table/modules.html It is a plugin mechanism for users to register a set of UDF functions, e.g. ML function, Geo functions. Best, Jark On Thu, 23 Apr 2020 at 23:12, Flavio Pompermaier

Re: JDBC table api questions

Hi, I think views in a JDBC database is not the same thing of views in Flink Catalog, but something like a read-only table as Flavio said. Maybe we can provide a way to register a table only as a source even the connector factory supports both source and sink. cc @Bowen Li , do you have some tho

Re: JDBC error on numeric conversion (because of DecimalType MIN_PRECISION)

Thanks for creating the issue and preparing the PR. On Sat, 25 Apr 2020 at 03:44, Flavio Pompermaier wrote: > I think I hit the same problem of SPARK-26538 ( > https://github.com/apache/spark/pull/23456). > I've handled the case in the same manner in my PR for FLINK-17356 ( > https://github.com

Re: Debug Slowness in Async Checkpointing

Just echo what Lu mentioned, is there documentation we can find more info on * when barriers were instrumented at source from checkpoint coordinator * when each down stream task observe first barrier of a chk * when list of barriers of a chk arrives to a task * when snapshot start/complete *

Re: Streaming Job eventually begins failing during checkpointing

Hi All, I think the Beam Community fixed this issue: https://github.com/apache/beam/pull/11478 Thanks! Eleanore On Thu, Apr 23, 2020 at 4:24 AM Stephan Ewen wrote: > If something requires Beam to register a new state each time, then this is > tricky, because currently you cannot unregister sta

Re: define WATERMARKS in queries/views?

I mean re-assigning watermark and timestamp in sql queries. Jark Wu 于2020年4月25日周六 下午9:10写道： > Hi Lec, > > You can only define `assignTimestampAndWatermark` on DataStream, so you > have to convert `Table` into DataStream first. > If the DataStream already has been assigned watermark, then the ne

Re: [ANNOUNCE] Apache Flink 1.9.3 released

Thanks for your great job, Dian! Best, Jincheng Hequn Cheng 于2020年4月25日周六 下午8:30写道： > @Dian, thanks a lot for the release and for being the release manager. > Also thanks to everyone who made this release possible! > > Best, > Hequn > > On Sat, Apr 25, 2020 at 7:57 PM Dian Fu wrote: > >> Hi e

Re: K8s native - checkpointing to S3 with RockDBStateBackend

Hi Averell, I think David's answer is right. The user uber jar will be loaded lazily by user classloader. So it cannot be recognized by Flink system class. You need to put it directly /opt/flink/lib directory or loaded via plugin mechanism. Best, Yang David Magalhães 于2020年4月25日周六 上午12:05写道： >

Re: define WATERMARKS in queries/views?

Hi Lec, It's supported in SQL queries. Best, Jark On Sun, 26 Apr 2020 at 09:10, lec ssmi wrote: > I mean re-assigning watermark and timestamp in sql queries. > > Jark Wu 于2020年4月25日周六 下午9:10写道： > >> Hi Lec, >> >> You can only define `assignTimestampAndWatermark` on DataStream, so you >> have

Flink 1.10.0 failover

Hi, Recently, I find a problem when job failed in 1.10.0, flink didn’t release resource first. You can see I used flink on yarn, and it doesn’t allocate task manager, beacause no more memory left. If i cancel the job, the cluster has more memory. In 1.8.2, the job will restart normally

Re: Flink 1.10.0 failover

Sorry I did not quite understand the problem. Do you mean a failed job does not release resources to yarn? - if so, is the job in restarting process? A job in recovery will reuse the slots so they will not be release. Or a failed job cannot acquire slots when it is restarted in auto-recovery? - if