Re: "Native Kubernetes" sample in Flink documentation fails. JobManager Web Interface is wrongly generated. [Flink 1.14.4]

By default, the idle TaskManager will be released after 30s(configured via "resourcemanager.taskmanager-timeout"). If it could not be removed, you need to check the JobManager logs for the root cause. Maybe it does not have enough permission or sth else. Best, Yang Burcu Gul POLAT EGRI 于2022年3月2

Need Help

Team, Is it possible for two independent flink-statefun applications can communicate via Http Rest API ? In other words does flink-statefun support HTTP REST as Ingress ? We are using python sdk for statefun application. Regards, Himanshu

flink docker image (1.14.4) unable to access other pods from flink program (job and task manager access is fine)

i have a flink job that uses redis as a sink. i optionally do some wiping and metadata writing from the job submitting flink program before it actually executes/submits the job to the job manager. when i don't do this redis preparation, the redis sink works completely fine. that is, the redis co

Re: SQL Client Kafka (UPSERT?) Sink for confluent-avro

Hi Georg, which Flink version are you using? The missing property is for the avro-confluent format, and if I recall correctly, how these are passed has changed in recent versions, so it'd be good to double check you are using the documentation for the version you are running on. Best Ingo

Re: Flink SQL AVG with mandatory type casting

Hi Georg, the Flink implementations seem to be based off of SQL Server[1], which has similar (though better documented) behavior for integer-like data types. [1] https://docs.microsoft.com/en-us/sql/t-sql/functions/avg-transact-sql?view=sql-server-ver15 Best Ingo On 24.03.22 16:08, Georg

Re: Where is the "Partitioned All Cache" doc?

This is interesting. Thanks for the clarification! On Mon, Mar 28, 2022 at 4:09 PM Qingsheng Ren wrote: > > Hi, > > The optimization you mentioned is only applicable for the product provided by > Alibaba Cloud. In open-source Apache Flink there isn’t a unique caching > abstraction for all looku

Re: Query regarding ClassCastException

Hi Mahima, have you checked whether the problematic dependency (seems to be avro) is contained in Flink's /lib folder in your case? I would suggest to check on JobManagers and TaskManagers, since you say it's in the business logic. Have you tried the suggestions mentioned in the docs? Those would

Re: Where is the "Partitioned All Cache" doc?

Hi, The optimization you mentioned is only applicable for the product provided by Alibaba Cloud. In open-source Apache Flink there isn’t a unique caching abstraction for all lookup tables, and each connector has there own cache implementation. For example JDBC uses Guava cache and FileSystem u

Re: Datetime format

Hi, File system table sink doesn’t provide APIs for changing the prefix or suffix of the generated filename. Maybe you can consider trying DataStream connector and set OutputFileConfig manually to specify prefix and suffix of generating filenames. Best, Qingsheng > On Mar 28, 2022, at 13:10

Re: flink cluster startup time

Hi Frank, I'm not really familiar with the internal workings of the Spotify's operator, but here are few general notes: - You only need the JM process for the REST API to become available (TMs can join in asynchronously). I'd personally aim for < 1m for this step, if it takes longer it could sign