Re: Unsubscribe

2022-04-28 Thread huweihua
To unsubscribe you need to send a mail to user-unsubscr...@flink.apache.org . > 2022年4月27日 下午12:03,Amit Bhatia 写道: > > Unsubscribe > > Regards, > Amit Bhatia

Re: Unsubscribe

2022-04-28 Thread huweihua
To unsubscribe you need to send a mail to user-unsubscr...@flink.apache.org . > 2022年4月28日 下午6:45,bhawana gupta 写道: > > Unsubscribe > > Regards, > Bhawana

Re: OOM errors cause by the new KafkaSink API

2022-04-25 Thread huweihua
Hi, You can try to increase the memory of TaskManager. If there is persistent OOM, you can dump the memory and check which part is taking up memory. > 2022年4月25日 上午11:44,Hua Wei Chen 写道: > > Hi all, > > Due to FlinkKafkaConsumer and FlinkKafkaProducer will be depreciated at Flink > 1.15[1]

Re: Huge number of GAX-Threads in Flink

2022-04-21 Thread huweihua
Hi, Which connector are you using? Is the increase in the number of threads gradual or is it related to task failover? It would be helpful if you could provide a thread dump. > 2022年4月22日 上午2:12,SHREEKANT ANKALA 写道: > > Hi, Can somebody please help with this issue? This is really blocking us

Re: Problems with PrometheusReporter

2022-04-20 Thread huweihua
Hi, Peter I have not been able to reproduce this problem. From your description, it is possible that the specified port has been listened by other processes, and PrometheusReporter failed to start. You can confirm it from taskmanager.log, or check if port of the host is being listene

Re: flink-stop command fails with ` Operation not found under key`

2022-04-20 Thread huweihua
Stop-with-savepoint is an async operation, it will trigger savepoint at first, and trigger this operation in a cache. These error logs indicate that the operation is in the cache which can no longer be found. Could you provide more jobmanager.log to find when this operation is evicted from cac

Re: /status endpoint of flink jobmanager not working

2022-04-20 Thread huweihua
Hi, peter, job status endpoint is introduced in FLINK-26641[1], and it will works in Flink 1.16 [1]https://issues.apache.org/jira/browse/FLINK-26641 > 2022年4月19日 下午9:18,Peter Schrott 写道: > > Hi Flink Users, > > Does anyone know what happened to the /status endpoint of a job? > > Calling /job

Re: how to initialize few things at task managers

2022-04-20 Thread huweihua
yarn.ship-files only works in yarn environment. Maybe you could use a custom Docker entry point[1] like Austin said. [1]https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/resource-providers/standalone/docker/#further-customization > 2022年4月20日 上午1:19,Great Info 写道: > > I a

Re: New JM pod tries to connect to failed JM pod

2022-04-19 Thread huweihua
Hi, After the previous JobManager fails, K8S start the new JobManager, but the Leader saved in HA is still the old JobManager address. After the Dispatcher gets the old JobManager leader, it will try to connect to it. This error can be ignored, and it will return to normal after waiting for a p

Re: How to debug Metaspace exception?

2022-04-19 Thread huweihua
e job and restart it from the > UI multiple times, I won't see the issue because because the classes are > unloaded correctly? > > > On Thu, Mar 31, 2022 at 9:20 AM huweihua <mailto:huweihua@gmail.com>> wrote: > > The difference is that manually canceli

Re: how to initialize few things at task managers

2022-04-18 Thread huweihua
Hi, Init stuff when task manager comes up is not an option. But if the Keystore file is not changeable and you are using yarn mode, maybe you can use ‘yarn.ship-files’[1] to localize it. [1]https://nightlies.apache.org/flink/flink-docs-master/zh/docs/deployment/config/#yarn-ship-files > 2022年4月1

Re: Wrong format when passing arguments with space

2022-04-06 Thread huweihua
HI, Kevin I have not reproduced this problem. What is the impact of this problem? Can't get this parameter correctly in user main method? Could you provide a screenshot of the JobManager configuration on the UI > 2022年4月2日 上午10:23,Kevin Lee 写道: > > It's a typo > > I run this demo on yarn cl

Re: How to debug Metaspace exception?

2022-03-31 Thread huweihua
The difference is that manually canceling the job stops the JobMaster, but automatic failover keeps the JobMaster running. But looking on TaskManager, it doesn't make much difference > 2022年3月31日 上午4:01,John Smith 写道: > > Also if I manually cancel and restart the same job over and over is it

Re: flink docker image (1.14.4) unable to access other pods from flink program (job and task manager access is fine)

2022-03-29 Thread huweihua
Hi, Jin Can you provide more information about Flink cluster deployment modes? Is it running in Kubernetes/YARN or standalone mode? Maybe you can use application mode to keeps the environment (network accessibility) always keep same. Application mode will run the user-main method in the JobManager

Re: UI stability at high parallelism

2020-02-12 Thread HuWeihua
Hi, Richard This is most likely that the Rest Api has timed out, you can try to find some evidence in the jobmanager log. You can provide the full log to help us find the root cause. Best Weihua Hu > 2020年2月13日 09:40,Richard Moorhead 写道: > > When I submit a job to flink session with paralle

Re: [DISCUSS] decentralized scheduling strategy is needed

2020-01-15 Thread HuWeihua
will keep watching this ticket. Thanks again. Best Weihua Hu > 2020年1月15日 17:53,Andrey Zagrebin 写道: > > HI HuWeihua, > > I think your issue should resolve with 1.9.2 and 1.10 (not released but in > progress). > You can check the related Jira ticket [1]. > > Be