Version "Unknown" - Flink 1.7.0

Though not a major issue. I see that Flink UI and REST api gives flink version as "UNKNOWN" I am using flink 1.7.0, with and running the cluster in JOB mode. REST endpoint /overview output {"taskmanagers":1,"slots-total":4,"slots-available":3,"jobs-running":1,"jobs-finished":0,"jobs-cancelled":0,

Reverse of KeyBy

I am new to Flink. I am trying to figure out if there is an operator that provides reverse functionality of KeyBy. Using KeyBy you can split a stream into disjoint partitions. Is there a way to bring those partitions back into a single stream? Let me explain using my use case below. My In

Re: Videos and slides on Flink Forward Beijing

Hi Congxian & Yun, Thanks a lot for the pointers! Best, Paul Lam > 在 2019年2月1日，23:07，Yun Tang 写道： > > Hi Paul > > You could find slides here > https://github.com/flink-china/flink-forward-china-2018 > , many talks are > given in Chin

Re: Videos and slides on Flink Forward Beijing

Hi Paul You could find slides here https://github.com/flink-china/flink-forward-china-2018, many talks are given in Chinese but most of slides are presented both in Chinese and English. Best Yun Tang From: Congxian Qiu Sent: Friday, February 1, 2019 21:55 To: P

Add header to a file produced using the writeAsFormattedText method

Hi all, I am trying to produce a file from a dataset using the writeAsFormattedText method (e.g., data.writeAsFormattedText(filename, writeMode, formatter)). Is there any easy way to add a header to the file produced? Thanks in advance, Konstantinos

Re: Table API zipWithIndex

Yes, I'm looking for a unique identifiers for rows (incremental unfotunately..) Thanks Timo! On Fri, Feb 1, 2019 at 3:50 PM Timo Walther wrote: > Hi Flavio, > > I guess you are looking for a unique identifier for rows, right? > Currently, this is not possible in Table API. There, we only support

Re: Table API zipWithIndex

Hi Flavio, I guess you are looking for a unique identifier for rows, right? Currently, this is not possible in Table API. There, we only support UUID(). Once the Table API has been enhanced to be more interactive, we might support such features. Regards, Timo Am 01.02.19 um 11:16 schrieb Fl

Re: Videos and slides on Flink Forward Beijing

Hi Paul The video is available here [1]. [1] https://m.bilibili.com/space/33807709 Paul Lam 于2019年2月1日 周五15:18写道： > Hi, > > It’s been a while since Flink Forward Beijing, would the videos and slides > be available on the website? Thanks! > > Best, > Paul Lam > > -- Best, Congxian

Re: Writing a custom Rocksdb statistics collector

DBOptions created by the OptionsFactory would be used to open RocksDB, however, if you just call 'RocksDBStateBackend#getDBOptions()' would not return the exactly wanted DBOptions but a newly created one. The private 'dbOptions' within `RocksDBKeyedStateBackend` is the one you wanted. Best Yun

Submit a job to a remote cluster : RemoteEnvironnement or ClientLevel ?

Hello all, I would like to know what is the best way to sumit a job to a remote cluster (from a java app) ? Between : - Using the remoteEnvironnement & calling env.execute() ( https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/cluster_execution.html#remote-environment ) - Using the cl

Table API zipWithIndex

Hi to all, is there any plan to support the equivalent of DataSetUtils.zipWithIndex as a select expression in the Table API? is it possible to implement it as an UDF right now? Best, Flavio