回复: Elasticsearch sink connector timeout

2021-06-06 Thread Jacky Yin 殷传旺
requests is too much? 2) if the bulk size is too big? 3) if too many indexes are included in one bulk request? BR, Jacky 发件人: Yangze Guo 发送时间: 2021年6月7日 11:41 收件人: Kai Fu 抄送: user 主题: Re: Elasticsearch sink connector timeout Hi, Kai, I think the exception should be

Re: Elasticsearch sink connector timeout

2021-06-06 Thread Yangze Guo
Hi, Kai, I think the exception should be thrown from RetryRejectedExecutionFailureHandler as you configure the 'failure-handler' to 'retry-rejected'. It will retry the action that failed with EsRejectedExecutionException and throw all other failures. AFAIK, there is no way to configure the connec

Re: Elasticsearch sink connector timeout

2021-06-04 Thread Kai Fu
With some investigation in the task manager's log, the exception was raised from RetryRejectedExecutionFailureHandler path, the related logs are showing below, not sure why it's that. * 5978 2021-06-05 05:31:31,529 INFO org.apache.flink.elasticsearch7.shade

Elasticsearch sink connector timeout

2021-06-04 Thread Kai Fu
Hi team, We encountered an issue about ES sink connector timeout quite frequently. As checked the ES cluster is far from being loaded(~40% CPU utilization, no query, index rate is also low). We're using ES-7 connector, with 12 data nodes and parallelism of 32. The error log is as below, we want t