Would Java 11 cause Getting OutOfMemoryError: Direct buffer memory?

2024-05-15 Thread John Smith
I deployed a new cluster, same version as my old cluster(1.14.4 ), only difference using Java 11 and it seems after a week of usage the below exception happens. The task manager is... 32GB total And i have the ONLY following memory settings taskmanager.memory.flink.size: 16384m taskmanager.memo

Confirmation on Lambda Support for UDFs in FlinkSQL / Table API

2024-05-15 Thread Tucker Harvey via user
Hi Flink Community, I’m writing to confirm whether lambda expressions are supported with User Defined Functions (UDFs) in FlinkSQL and the Table API. My current understanding is that they are not supported. Can anyone verify this, or let me know if there have been any recent changes regarding t

Re:Unable to log any data captured from kafka

2024-05-15 Thread Xuyang
Hi, Nida. I'd like to confirm whether there would be any log output if it's executed directly in the IDE. If there are logs in the IDE but not when running by submission, you could check if the log configuration files in the TM logs are normal. If there are no logs in the IDE either, I

Unable to log any data captured from kafka

2024-05-15 Thread Fidea Lidea
Hi Team, I've written a flink job & enabled *slf4j* logging mechanism for it. Flow of* Flink Job :* Kafka source => process datastream elements(Transformations) => kafka sink. It stops logging while processing datastream. I want to log all data captured from kafka either in a log file or on the