Queryable State

Hi All, I was playing with queryable state. As queryable stream can not be modified how do I use the output of say my reduce function for further processing. Below is 1 example. I am sure I have done it wrong :). I am using reduce function twice or do I need to use rich reduce function and use th

Failed to trigger savepoint

Hi, I’m using Flink 1.5.3 and failed to trigger savepoint for a Flink on YARN job. The stack traces shows that an exception occurred while triggering the checkpoint, but the normal checkpoints of the job are running well. What could possibly be the problem? Thanks a lot! The stack traces are

Re: Failed to trigger savepoint

You will have to take a look at the JobManager/TaskManager logs. On 04.09.2018 12:02, Paul Lam wrote: Hi, I’m using Flink 1.5.3 and failed to trigger savepoint for a Flink on YARN job. The stack traces shows that an exception occurred while triggering the checkpoint, but the normal checkpoint

Cancel flink job occur exception.

Hi all, I submit a flink job through yarn-cluster mode and cancel job with savepoint option immediately after job status change to deployed. Sometimes i met this error: org.apache.flink.util.FlinkException: Could not cancel job . at org.apache.flink.client.cli.CliFrontend.lamb

Cancel flink job occur exception

Hi all, I submit a flink job through yarn-cluster mode and cancel job with savepoint option immediately after job status change to deployed. Sometimes i met this error: org.apache.flink.util.FlinkException: Could not cancel job . at org.apache.flink.client.cli.CliFrontend.lamb

Re: Why FlinkKafkaConsumer doesn't subscribe to topics?

Hi Renjie, 1. For what I could grasp from Kafka docs, you can subscribe and still use poll() to capture a specific offset. But I just read the starting point of it and didn't go deep into it. 2. Currently, Flink 1.4.2, Kafka 0.10.1 and the FlinkKafkaConsumer010. On Tue, Sep 4, 2018 at 12:47 AM,

Ask about running multiple jars for different stream jobs

Hi All, Kindly, could I ask about running multiple jars for different stream jobs in a cluster? Since I have two jars, each one joins different data streams. I submitted the first one and it works fine, when I tried to submit the second one, it failed. When I go to running tab i.e. http://myclus

Ask about running multiple jars for different stream jobs

Hi All, Kindly, could I ask about running multiple jars for different stream jobs in a cluster? Since I have two jars, each one joins different data streams. I submitted the first one and it works fine, when I tried to submit the second one, it failed. When I go to running tab i.e. http://myclus

org.apache.flink.util.FlinkException: Could not cancel job

Dear All, I had the following issue when trying to cancel a job from CLI. I am wondering am I in the proper way of canceling a job? Or, there is more elegant way to do this, both in code or in CLI? Many Thanks! BTW, I am have streaming coming from Kafka and producing to another Kafka topic. ./bi

Flink1.6.0 submit job and got "No content to map due to end-of-input" Error

Hi all, I use below way to submit jar to Flink : StreamExecutionEnvironment env = StreamExecutionEnvironment.createRemoteEnvironment(config.clusterIp, config.clusterPort,

Ask about running multiple jars for different stream jobs

Hi All, Kindly, could I ask about running multiple jars for different stream jobs in a cluster? Since I have two jars, 1- jar 1 joins stream1⋈ stream2 2- jar 2 joins stream1⋈ stream3 I submitted the first one and it works fine, when I tried to submit the second one, it failed. When I go to Flink

Re: Why FlinkKafkaConsumer doesn't subscribe to topics?

Hi Julio, As Renjie had already mentioned, to achieve exactly-once semantics with the Kafka consumer, Flink needs to have control over the Kafka partition to source subtask assignment. To add a bit more detail here, this is due to the fact that each subtask writes to Flink managed state the cu

Re: org.apache.flink.util.FlinkException: Could not cancel job

Please check that the job ID is correct. On 04.09.2018 15:48, Chang Liu wrote: Dear All, I had the following issue when trying to cancel a job from CLI. I am wondering am I in the proper way of canceling a job? Or, there is more elegant way to do this, both in code or in CLI? Many Thanks! B

Re: akka.ask.timeout setting not honored

Hi Gary, Turns out, the configuration warning you mentioned was the key. The akka.ask.timeout requires a duration unit, but the web.timeout setting is looking for a long. So the change I made earlier would not have applied since it couldn't read `300s`. Since making that change (`web.timeout: 3

flink list and flink run commands timeout

I have upgraded from Flink 1.4.0 to Flink 1.5.3 with a three node cluster configured with HA. Now I am encountering an issue where the flink command line operations timeout. The exception generated is very poor because it only indicates a timeout and not the reason or what it was trying to do: >

Re: Flink1.6.0 submit job and got "No content to map due to end-of-input" Error

Hi Pangongsen, Do you upgrade the Flink-related dependencies you use at the same time? In other words, is the dependency consistent with the flink version? Thanks, vino. ? ?? 于2018年9月4日周二 下午10:07写道： > Hi all, > I use below way to submit jar to Flink : > > StreamExecutionEnvironment env =

Re: Ask about running multiple jars for different stream jobs

Hi Rad, Which mode is your Flink cluster? If it is Standalone or something like YARN session, then of course you can run multiple jobs in a cluster. In addition, can you post the exception that the second job failed? Thanks, vino. Rad Rad 于2018年9月4日周二 下午10:07写道： > Hi All, > > Kindly, could I a

Re: Taskmanager process memory increasing always

I have met similar issue. Yarn kills the TaskManagers, as their memory usage grows to the limit. I think it might be rocksdb causing the problem. Is there any way to debug the memory usage of rocksdb backend? Best Yan From: YennieChen88 Sent: Wednesday, Augus

答复: Flink1.6.0 submit job and got "No content to map due to end-of-input" Error

Hi Vino， Below are dependencies I used，please have a look. I floud it also inclued flink-connector-kafka-0.10_2.11-1.6.0.jar and flink-connector-kafka-0.9_2.11-1.6.0.jar, and I don’t know if it has any effect? yours, Gongsen [cid:image001.png@01D4451B.3D5B1580] 发送自 Windows 10 版邮件