Flink rest api cancel job

2020-07-19 Thread snack white
Hi, When I using rest api to cancel my job , the rest 9 TM has been canceled quickly , but the other one TM is always cancelling status , someone can show me how can I solve the question . Thanks, White

Re: [Table API] how to configure a nested timestamp field

2020-07-19 Thread Dongwon Kim
Hi Leonard, Can I have a YAML definition corresponding to the DDL you suggested? I tried below (Flink 1.11.0) but got some error: > tables: > - name: test > type: source-table > update-mode: append > connector: > property-version: 1 > type: kafka > version: univer

Re: How to debug window states

2020-07-19 Thread Congxian Qiu
Hi There is an issue[1] wants to provide an easy way to read/bootstrap window state using the state processor API, but the PR was closed currently. [1] https://issues.apache.org/jira/browse/FLINK-13095 Best, Congxian Paul Lam 于2020年7月15日周三 下午4:21写道: > It turns out to be a bug of StateTTL [1]

Re: DashBoard Name

2020-07-19 Thread Akshay Aggarwal
Hi Dinesh, I think it comes from the flink-runtime-web module, you can refer to this file/line [1]. The value is hard coded today, you can probably make it configurable for supporting your use case.

DashBoard Name

2020-07-19 Thread C DINESH
Hi All, In flink UI the name of the dashboard is Apache Flink dash Board. we have different environments. If I want to change the name of the dash board. Where do i need to change it? Thanks & Regards, Dinesh.

Re: deployin a flink app on a server;

2020-07-19 Thread Yang Wang
Hi Aissa, We have multiple choices to deploy Flink to different environments(e.g. bare machines, docker environment, Yarn cluster, K8s cluster, etc.). If you want to have a quick taste, the simplest way is using docker to start a Flink application. You just need to run two "docker run" commands[1

Re: UnsupportedOperatorException with TensorFlow on checkpointing

2020-07-19 Thread Yun Tang
Hi Sung Gon, Have you ever registered protobuf classes with kryo[1]? [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/custom_serializers.html Best, Yun Tang From: Sung Gon Yi Sent: Thursday, July 16, 2020 23:00 To: user@flink.apache.org Subject:

Re: Are files in savepoint still needed after restoring if turning on incremental checkpointing

2020-07-19 Thread Yun Tang
Hi Lu Once a new checkpoint is completed when restoring from a savepoint, the previous savepoint would be useless if you decide to restore from new checkpoint. In other words, new incremental checkpoint has no relationship with older savepoint from which restored. Best Yun Tang ___

Re: Flink FsStatebackend is giving better performance than RocksDB

2020-07-19 Thread Yun Tang
Hi Vijay, I think David has provided enough background knowledge for the difference of these two state backends. When talking about the OOM problem of RocksDB, from Flink-1.10, rocksDB would be bounded to managed memory. However, RocksDB would use the managed memory as much as possible and the

RE: Pravega connector cannot recover from the checkpoint due to "Failure to finalize checkpoint"

2020-07-19 Thread B.Zhou
Anyone can help us on this issue? Best Regards, Brian From: Zhou, Brian Sent: Wednesday, July 15, 2020 18:26 To: 'user@flink.apache.org' Subject: Pravega connector cannot recover from the checkpoint due to "Failure to finalize checkpoint" Hi community, To give some background, https://github.co

Custom metrics output

2020-07-19 Thread Joris Geer
Hi, We want to collect metrics for stream processing, typically counts aggregated over 1-minute buckets. However, we want these 1-minute boundaries determined by timestamps within the data records. Flink metrics do not handle this so we want to roll our own. How to proceed ? Some of our team me