Re: WELCOME to user@flink.apache.org

2023-06-05 Thread Shammon FY
Hi, Thanks Li Shao, I got it. You can analyze the specific memory usage of metaspace. In fact, we have also encountered the same problem of running batch jobs in the session cluster, which resulted in metaspace growth due to the classloader. I have created a PR [1] for FLIP-32265 [2] for this and

Re: WELCOME to user@flink.apache.org

2023-06-05 Thread Shammon FY
Hi Li Shao, Currently Flink will create a user classloader in JobManager for each job which can only be released by FullGC, I think this is why JVM metaspace is increasing, you can check it. Are you using session mode? I have a small question: Is your job SQL only without UDF or DataStream? Thanks

Re: WELCOME to user@flink.apache.org

2023-06-05 Thread Li Shao
Hi, Recently I noticed my job manager JVM metaspace is keeping increasing for running batch flink jobs. I found similar stackoverflow post: https://stackoverflow.com/questions/73184042/apache-flink-job-manager-node-runs-out-of-jvm-metaspace-quickly, but there is no solution on this. I am wondering

Re: WELCOME to user@flink.apache.org

2023-03-15 Thread Martijn Visser
Hi Penny, When you complete step 1 and step 2, it means that you have subscribed to the User mailing list so you can post the email that you want to send to the User mailing list by performing step 3. I can see why the email can be confusing though. Best regards, Martijn On Sat, Mar 11, 2023 at

Re: WELCOME to user@flink.apache.org

2022-08-02 Thread Tamir Sagi
ser-h...@flink.apache.org ; user@flink.apache.org Cc: Mohan S G (mosg) Subject: Re: WELCOME to user@flink.apache.org EXTERNAL EMAIL Hi Team, We have deployed our Flink Cluster on AWS EKS using Flink Operator. We have created required service accounts with IAM OIDC integration, however fl

Re: WELCOME to user@flink.apache.org

2022-08-02 Thread Karthikeyan Muthusamy (karmuthu)
Hi Team, We have deployed our Flink Cluster on AWS EKS using Flink Operator. We have created required service accounts with IAM OIDC integration, however flink-main container seems to bypass this service account role and directly tries to create and delete objects in s3 using Node role. As the

Re: WELCOME to user@flink.apache.org

2021-07-06 Thread Nicolaus Weidner
Hi Wanghui, unfortunately, this is not supported to my knowledge. See also this similar question on Stackoverflow: https://stackoverflow.com/questions/60950594/flink-encryption-parameters-in-flink-conf-yaml Best regards, Nico On Mon, Jul 5, 2021 at 3:45 PM Wanghui (HiCampus) wrote: > Hello, I

Re: WELCOME to user@flink.apache.org

2015-06-04 Thread Chiwan Park
Hi. We’re already received your questions some hours ago. Here are our answers. [1] Regards, Chiwan Park [1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Re-Apache-Flink-transactions-tc1457.html > On Jun 5, 2015, at 2:49 AM, Hawin Jiang wrote: > > Cool > > Here is my

Re: WELCOME to user@flink.apache.org

2015-06-04 Thread Hawin Jiang
Cool Here is my question: Do we have insert, update and remove operations on Apache Flink? For example: I have 10 million records in my test file. I want to add one record, update one record and remove one record from this test file. How to implement it by Flink? Thanks. On Thu, Jun 4, 2015

Re: WELCOME to user@flink.apache.org

2015-06-04 Thread Robert Metzger
Yes, I've got this message. On Thu, Jun 4, 2015 at 7:42 PM, Hawin Jiang wrote: > Hi Admin > > Please let me know if you are received my email or not. > Thanks. > > > > Best regards > Hawin Jiang > > On Thu, Jun 4, 2015 at 10:26 AM, wrote: > >> Hi! This is the ezmlm program. I'm managing the >>

Re: WELCOME to user@flink.apache.org

2015-06-04 Thread Hawin Jiang
Hi Admin Please let me know if you are received my email or not. Thanks. Best regards Hawin Jiang On Thu, Jun 4, 2015 at 10:26 AM, wrote: > Hi! This is the ezmlm program. I'm managing the > user@flink.apache.org mailing list. > > Acknowledgment: I have added the address > >hawin.ji...@gm