Re: Frequent Flink JM restarts due to Kube API server errors.

he mentioned Flink > > > version 1.14 is not officially supported by the community anymore and a > > fix > > > seems to have been provided with a newer version. > > > > > > Matthias > > > > > > [1] https://issues.apache.org/jira/browse/

Re: Frequent Flink JM restarts due to Kube API server errors.

ues.apache.org/jira/browse/FLINK-33998 > > On Mon, Feb 5, 2024 at 6:18 AM Lavkesh Lahngir wrote: > > > Hii, Few more details: > > We are running GKE version 1.27.7-gke.1121002. > > and using flink version 1.14.3. > > > > Thanks! > > > > On Mon, 5

Re: Frequent Flink JM restarts due to Kube API server errors.

Hii, Few more details: We are running GKE version 1.27.7-gke.1121002. and using flink version 1.14.3. Thanks! On Mon, 5 Feb 2024 at 12:05, Lavkesh Lahngir wrote: > Hii All, > > We run a Flink operator on GKE, deploying one Flink job per job manager. >

Frequent Flink JM restarts due to Kube API server errors.

Hii All, We run a Flink operator on GKE, deploying one Flink job per job manager. We utilize org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory for high availability. The JobManager employs config maps for checkpointing and leader election. If, at any point, the Kube API serv

Re: SplitEnumerator for Bigquery Source.

sounds more reasonable. > > > > option1 sounds a llitte of complex and may time-counsuming during > > generateing splits . > > option2 seems isnot flexible and is too coarse-grained. > > option4 need extrac efforts to wrting the data again. > > > > Best r

Bigquery source/connector on Flink

Hi, We are trying to implement Bigquery source on Flink. I see that there is an existing JIRA but there is no progress on it. I see there is a PoC by Mat. We are also thinking of using the DynamicTable interface to implement. We can use this maili

SplitEnumerator for Bigquery Source.

Hii Everybody, we are trying to implement a google bigquery source on flink. We were thinking of taking time partition and column information as config. I was thinking of how to parallelize the source and how to generate splits. I read the code of Hive source, where we could generate hadoop file sp

Re: [Feature]Returning RuntimeException to REST client while job submission

Hello, I created a Jira. Can somebody review it, please? Or suggest if this is useful? https://issues.apache.org/jira/browse/FLINK-11423 Thank you. ~Lavkesh On Thu, Jan 24, 2019 at 11:40 AM Lavkesh Lahngir wrote: > Hi, > It's not fixed in the master. I compiled and ran it yesterday.

[jira] [Created] (FLINK-11423) Propagate the error message from Main method to JarRunHandler

Lavkesh Lahngir created FLINK-11423: --- Summary: Propagate the error message from Main method to JarRunHandler Key: FLINK-11423 URL: https://issues.apache.org/jira/browse/FLINK-11423 Project: Flink

Re: [Feature]Returning RuntimeException to REST client while job submission

Hi, It's not fixed in the master. I compiled and ran it yesterday. I am not if that is an issue or design choice. On Thu, Jan 24, 2019 at 11:38 AM Lavkesh Lahngir wrote: > Hello, > I mentioned in the first email. > > Version: 1.6.2, Commit ID: 3456ad0 > > On Thu, J

Re: [Feature]Returning RuntimeException to REST client while job submission

t; master or a recent bugfix release. > > On 23.01.2019 17:16, Lavkesh Lahngir wrote: > > Actually, I realized my mistake that JarRunHandler is being used in the > > jar/run API call. > > And the changes are done in RestClusterClient. > > The problem I was facing

Re: [Feature]Returning RuntimeException to REST client while job submission

} catch (Throwable t) { What will you suggest? On Wed, Jan 23, 2019 at 7:01 PM Chesnay Schepler wrote: > Which version are you using? > > On 23.01.2019 08:00, Lavkesh Lahngir wrote: > > Or maybe I am missing something? It looks like the JIRA is trying to >

Applying for Flink contributor permission

Please provide me controbution permission. email: lavkes...@gmail.com apache-username: lavkesh Thank you

[Feature]Returning RuntimeException to REST client while job submission

Hello, The change in FLINK-10312 makes REST response of the API not very informative. It strips the stack trace and returns a generic message. People

Re: [Feature]Returning RuntimeException to REST client while job submission

Or maybe I am missing something? It looks like the JIRA is trying to solve the same issues I stated 🤔 In the main method, I just threw a simple new Exception("Some message") and I got the response I mentioned from the rest API. Thanks. On Wed, Jan 23, 2019 at 2:50 PM Lavkesh Lahn