Does Flink 1.14 support comsume Kafka 0.9?

Flink  1.14 Document  display Flink 1.14 kafka connector only  backwards compatible with broker versions 0.10.0 or later. Unfortunately, I have to use Flink 1.14 comsume Kafka 0.9 version? How can I do it ??thx.  

Failed to stop with savepoint

enter restarting . It is successful to use savepoint command alone. Error log: 13:33:42.857 [Kafka Fetcher for Source: nlp-kafka-source -> nlp-clean (1/1)#0] DEBUG org.apache.kafka.clients.consumer.KafkaConsumer - [Consumer clientId=consumer-hjw-3, groupId=hjw] Kafka consumer has been closed

Failing to maven compile install Flink 1.15

I try to maven clean install Flink 1.15 parent,but fail. A Error happened in compiling flink-clients. Error Log: Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.4:single (create-test-dependency) on project flink-clients: Error reading assemblies: Error locating assembly d

Error when run test case in Windows

When I run mvn clean install ,It will run Flink test case . However , I get Error?? [ERROR] Failures: [ERROR]   KubernetesClusterDescriptorTest.testDeployApplicationClusterWithNonLocalSchema:155 Previous method call should have failed but it returned: org.apache.flink.kubernetes.KubernetesCluste

flink ci build run longer than the maximum time of 310 minutes.

I commit a pr to Flink Github . A error happened in building ci. [error]The job running on agent Azure Pipelines 6 ran longer than the maximum time of 310 minutes. For more information, see https://go.microsoft.com/fwlink/?linkid=2077134 How to solve this problem? How to triigle the ci building

?????? flink ci build run longer than the maximum time of 310 minutes.

epo. My fork repo status :This branch is 4 commits ahead, 11 commits behind apache:release-1.15. When I rebase the branch from upstream and push to my fork repo, the 11 commits behind apache:release-1.15 also appear in my pr change files. How can I handle this

?????? flink ci build run longer than the maximum time of 310 minutes.

Hi,Matthias I have solved this problem as you say.The link to the PR [1] .thank you. [1]https://github.com/apache/flink/pull/20671 Best, Hjw

Where will the state be stored in the taskmanager when using rocksdbstatebend??

should  take some measures to deal with it.(mount a volume for local data directories store RocksDB database etc...) thx. Best, Hjw

?????? Where will the state be stored in the taskmanager when using rocksdbstatebend??

Hi,Alexander When Flink job deployed on Native k8s, taskmanager is a Pod.The data directory size of a single container is limited in our company.Are there any idea to deal with this ? Best, Hjw

?????? Where will the state be stored in the taskmanager when using rocksdbstatebend??

thanks for everyone. I will  increase the parallelism to solve the problem.Besides, I am  looking forward to support remote state. Best, Hjw

A classloading question about submitting Flink jobs on Yarn-Perjob Mode

version: flink 1.14.0 Best, Hjw  

Re: A classloading question about submitting Flink jobs on Yarn-Perjob Mode

Hi, The yarn.classpath.include-user-jar parameter is shown as yarn.per-job-cluster.include-user-jar parameter in Flink 1.14.  I have tried DISABLED??FIRST??LAST??ORDER .But the error still happened. Best, Hjw   -- Original -- From

What is the recommended cpu.memory configuration of the Flink kubernetes operator in the production environment ?

or in the production environment ? -- Best， Hjw

来自hjw的邮件

-- Best， Hjw

来自hjw的邮件

-- Best， Hjw

How to use the local repositories Jar instead of pulling remote snapshots when building modules？

http://maven.aliyun.com/nexus/content/groups/public/ false false never -- Best， Hjw

How to set disableChaining like streaming multiple INSERT statements in a StatementSet ?

: Flink version:1.14.4 -- Best， Hjw

How to get failed streaming Flink job log in Flink Native K8s mode?

Mode: Flink kubernetes Operator 1.2.0(Application Mode) -- Best， Hjw

Application upgrade rollbacks failed in Flink Kubernetes Operator

- name: TZ value: Asia/Shanghai jobManager: resource: memory: "2048m" cpu: 1 taskManager: resource: memory: "2048m" cpu: 1 job: jarURI: local:///opt/flink/examples/streaming/StateMachineExample.jar parallelism: 2 upgradeMode: stateless -- Best， Hjw

Re:Re: Application upgrade rollbacks failed in Flink Kubernetes Operator

: - name: TZ value: Asia/Shanghai jobManager: resource: memory: "2048m" cpu: 1 taskManager: resource: memory: "2048m" cpu: 1 job: jarURI: local:///opt/flink/examples/streaming/StateMachineExample.jar parallelis

How to set reblance in Flink Sql like Streaming api?

, so only one subtask in the Lookup join operator can receive data.I want to set the relationship between the kafka Source and the Lookup join operator is reblance so that all subtask in Lookup join operator can recevie data. Env: Flink version:1.15.1 -- Best， Hjw

Re:Re: How to set reblance in Flink Sql like Streaming api?

CURRENTROW FROM product -- Best， Hjw At 2023-04-04 12:23:26, "Shammon FY" wrote: Hi hjw To rescale data for dim join, I think you can use `partition by` in sql before `dim join` which will redistribute data by specific column. In addition, you can add cache for `d

[Flink Kubernetes Operator] How to check FlinkDeployment and FlinkSessionJob are in a healthy state？

Can we make a judgment based on the fields in the status？ -- Best， Hjw