Re: Migration to application mode

Hi there, Currently, YARN Application mode only supports running a jar job. And as Lijie said, the main method is executed on JM, so if I understand correctly, your previous way of running execute() method on client side to submit a job to YARN cluster may not work. A quick workaround is to create

Re: Migration to application mode

Hi, I think the difference between ApplicationMode and PerJob is just where the main method is executed (ApplicationMode executes on JM, PerJob executes on client side). So I think your original job code should work well under ApplicationMode. Did you encounter any problems? You can get more detail

Re: Why this example does not save anything to file?

No, I do not have it     Sent: Monday, August 01, 2022 at 4:43 PM From: "Martijn Visser" To: pod...@gmx.com Cc: user@flink.apache.org Subject: Re: Why this example does not save anything to file? That's Flink fault-tolerance mechanism, see https://nightlies.apache.org/flink/flink-docs-stable/d

Re: Issues with Flink scheduler?

We are using 1.14 version currently. The final manifestation of the issue shows up as the trace I pasted above, and then the job keeps on restarting. When we track back, we see various exceptions depending on the job, for example for one of the jobs, some tasks were failing due to out-of-memory exc

Re: Why this example does not save anything to file?

That's Flink fault-tolerance mechanism, see https://nightlies.apache.org/flink/flink-docs-stable/docs/dev/datastream/fault-tolerance/checkpointing/ Op ma 1 aug. 2022 om 16:37 schreef : > What's that? > > > *Sent:* Monday, August 01, 2022 at 2:49 PM > *From:* "Martijn Visser" > *To:* pod...@gmx.c

Re: Why this example does not save anything to file?

What's that?     Sent: Monday, August 01, 2022 at 2:49 PM From: "Martijn Visser" To: pod...@gmx.com Cc: user@flink.apache.org Subject: Re: Why this example does not save anything to file? Do you have checkpointing enabled?    Op za 30 jul. 2022 om 17:31 schreef : Thanks

Re: Java 17 Support?

Yes, Java 11 has been supported since Flink 1.10 [1] Best regards, Martijn [1] https://nightlies.apache.org/flink/flink-docs-release-1.10/release-notes/flink-1.10.html#java-11-support-flink-10725 Op ma 1 aug. 2022 om 15:37 schreef laxmi narayan : > Do we have support for the jdk 11 ? > > On Mon

Re: Java 17 Support?

Do we have support for the jdk 11 ? On Mon, 1 Aug 2022 at 6:22 PM, Martijn Visser wrote: > Hi Clayton, > > Yes, there are plans to support Java 17. This is dependent on us dropping > support for Java 8. You can find more in the discussion thread on > deprecating Java 8 support [1]. > > Best rega

Re: Avro 1.11 with Flink 1.14

Hi Chirag, If you're willing to make the necessary changes to a forked version of Flink 1.14, you could make it work. You can have a look at https://github.com/apache/flink/pull/18133 as inspiration. It's not merged since we're waiting for Avro 1.11.1, see the comments in the PR. Best regards, M

Re: Java 17 Support?

Hi Clayton, Yes, there are plans to support Java 17. This is dependent on us dropping support for Java 8. You can find more in the discussion thread on deprecating Java 8 support [1]. Best regards, Martijn [1] https://lists.apache.org/thread/0fwo7nwzy51gck4vxhyfnbnttd4jycpx Op vr 29 jul. 2022

Re: Why this example does not save anything to file?

Do you have checkpointing enabled? Op za 30 jul. 2022 om 17:31 schreef : > Thanks David but there's no problem with that (probably ";" is default > separator). > I can read the file and insert into "Table1" (I said that in my mail). > Problem is to save to CSV. > > > *Sent:* Saturday, July 30, 20

Migration to application mode

Hi Experts, We are planning to migrate our flink jobs from per-job mode to application mode in our platform. Our jobs are basically SQL scripts so we have some custom Java code to leverage Flink's SQL and Table API to build the execution environment and execute the jobs on Yarn. We would like to k