Re: Urgent: Mitigating Slow Consumer Impact and Seeking Open-SourceSolutions in Apache Kafka Consumers

Hi All We are also seeking for a custom partitioning strategy, it will be helpful for us too. Thanks and regards, Gowtham S On Mon, 18 Sept 2023 at 12:13, Karthick wrote: > Thanks Liu Ron for the suggestion. > > Can you please give any pointers/Reference for the custom partitioning > strateg

Re: Possible bug when converting table to upsert changelog stream

Hi, Charles It is not a bug, this is because the primary keys provided by sink are not exactly match input changeLogUpsertKeys, so fallback to before and after mode, you can see [1] for more detail. [1] https://github.com/apache/flink/blob/d8630cb5db0608a630de95df0dd1d0c9f0b56aa2/flink-table/flin

Re: Maven plugin to detect issues in Flink projects

Ok, you mean this plugin is used by app developer in their app? Best, Ron Kartoglu, Emre 于2023年9月18日周一 16:23写道： > Hi Ron, > > > > Thanks for the feedback. > > > > For instance, Kinesis connector versions 1.15.3 and below (for Flink 1.15) > have a known bug that can lead to a deadlock. The plugi

flink design pazzule

Could any one tell me what the purpose and Philosophy of designing flink checkpoint master hook? Thanks.

Re: FlinkML 'DenseVector' object has no attribute 'get_fields_by_names'

Hi Evgeniy, Yes, the reason of the exception is that you are returning an incorrect data type. Flink ML doesn’t have a data type for `DenseVector` but it provides a function called `pyflink.ml.functions.array_to_vector` which returns an `Expression`. So maybe you can modify your UDF to union mu

Re: Flink 1.15 KubernetesHaServicesFactory

Thank you for information Alexey From: Chen Zhanghao Sent: Friday, September 15, 2023 9:16:00 PM To: Alexey Trenikhun ; Flink User Mail List Subject: Re: Flink 1.15 KubernetesHaServicesFactory Hi Alexey, This is expected as Flink 1.15 introduced a new multiple c

Upgrading Flink to 1.17, facing org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator

Hi team, I am upgrading our flink version from 1.16 to 1.17.1, and currently facing this issue, can I get some help? What shall I do for this? Thanks! org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: Customer Product Summary Selected' (operator

Possible bug when converting table to upsert changelog stream

Hi everyone, I noticed some unexpected behavior with Upsert changelogs in Flink 1.17.1 and I wanted to post here to see if anyone has encountered a similar issue. I’m running a Flink application which performs SQL queries using the Flink SQL and Table APIs, then I convert the resulting table to a

Re:Custom Metrics not showing in prometheus

Hi Regards 1. You can confirm whether other metrics can be seen in prometheus and whether the metrics reporter is worked; 2. Confirm whether the metrics filter logic is configured[1]. If there is filter logic, the reported metrics will also be affected; 3. You can check the TaskManager log to s

Custom Metrics not showing in prometheus

Hi, I have created a counter of records in my RichSinkFunction myCounter.inc() I can see the value exists in the job manager web ui > running jobs > sink function > task > metrics. However, I am not available to see it in my prometheus web ui. I am running docker flink in my local as well as pr

Re: Maven plugin to detect issues in Flink projects

Hi Ron, Thanks for the feedback. For instance, Kinesis connector versions 1.15.3 and below (for Flink 1.15) have a known bug that can lead to a deadlock. The plugin will warn the user (or fail the build) if app developers are using Kinesis connector 1.15.3 or below (and Flink 1.15). Another e

FlinkML 'DenseVector' object has no attribute 'get_fields_by_names'

Hello community! I'm trying to use FlinkML to train a model on data from a PostgreSQL table and I get an error when I try to view the output table after model AttributeError: 'DenseVector' object has no attribute 'get_fields_by_names' My code: # Create train source table t_env.execute_sql( "