Re: FlinkJobNotFoundException

I didn't receive any email. But we rather not do individual support. Please share the logs on the mailing list. This way, anyone is able to participate in the discussion. Best, Matthias On Wed, Sep 29, 2021 at 8:12 PM Gusick, Doug S wrote: > Hi Matthias, > > > > Thank you for getting back. We h

Re: [ANNOUNCE] Apache Flink 1.14.0 released

Big Thanks to David, Joe, Xintong and everyone who contributed to the release! Well done! Cheers, Konstantin On Thu, Sep 30, 2021 at 3:12 AM Yangze Guo wrote: > Thanks, Xintong, Joe, Dawid for the great work, thanks to everyone > involved! > > Best, > Yangze Guo > > On Thu, Sep 30, 2021 at 12:

Re: [ANNOUNCE] Apache Flink 1.14.0 released

Thanks, Xintong, Joe, Dawid for the great work, thanks to everyone involved! Best, Yangze Guo On Thu, Sep 30, 2021 at 12:02 AM Rion Williams wrote: > > Great news all! Looking forward to it! > > > On Sep 29, 2021, at 10:43 AM, Theo Diefenthal > > wrote: > > > >  > > Awesome, thanks for the re

Flink application mode with no ui , how to start job using k8s ?

Hi ,    My requirement is to create Flink cluster application Mode on k8s and do not want to expose UI, my requirement is to start the long-running  job which can be instantiated at boot time of flink and keep running use these resource files from jobmanager-application-ha.yaml and  taskmanager-j

Re: Flink run different jars

Thanks a lot Yangze. That is very helpful! On Tue, Sep 28, 2021 at 11:11 PM Yangze Guo wrote: > You need to edit the conf/workers. Example of the config[1] and the > process[2]. > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/standalone/overvie

Start Flink cluster, k8s pod behavior

Hi, I deployed flink in session mode. I didn't run any jobs. I saw below logs. That is normal, same as Flink menual shows. + /opt/flink/bin/run-job-manager.sh Starting HA cluster with 1 masters. Starting standalonesession daemon on host job-manager-776dcf6dd-xzs8g. Starting taskexecutor daemon on

RE: FlinkJobNotFoundException

Hi Matthias, Thank you for getting back. We have been looking into upgrading to a newer version, but have not completed full testing just yet. I was unable to find a previous error in the JM logs. You should have received an email with details to a “lockbox”. I have uploaded the job manager log

Re: Unable to connect to Mesos on mesos-appmaster.sh start

...and if possible, it would be helpful to provide debug logs as well. On Wed, Sep 29, 2021 at 6:33 PM Matthias Pohl wrote: > May you provide the entire JobManager logs so that we can see what's going > on? > > On Wed, Sep 29, 2021 at 12:42 PM Javier Vegas wrote: > >> Thanks again, Matthias! >>

Re: Unable to connect to Mesos on mesos-appmaster.sh start

May you provide the entire JobManager logs so that we can see what's going on? On Wed, Sep 29, 2021 at 12:42 PM Javier Vegas wrote: > Thanks again, Matthias! > > Putting -Djobmanager.rpc.address=$HOST and -Djobmanager.rpc.port=$PORT0 > as params for appmaster.sh > I see in tog they seem to tra

Re: [ANNOUNCE] Apache Flink 1.14.0 released

Great news all! Looking forward to it! > On Sep 29, 2021, at 10:43 AM, Theo Diefenthal > wrote: > >  > Awesome, thanks for the release. > > - Ursprüngliche Mail - > Von: "Dawid Wysakowicz" > An: "dev" , "user" , > annou...@apache.org > Gesendet: Mittwoch, 29. September 2021 15:59:47

Re: FlinkJobNotFoundException

Hi Doug, thanks for reaching out to the community. First of all, 1.9.2 is quite an old Flink version. You might want to consider upgrading to a newer version. The community only offers support for the two most-recent Flink versions. Newer version might include fixes for your issue. But back to you

Re: [ANNOUNCE] Apache Flink 1.14.0 released

Awesome, thanks for the release. - Ursprüngliche Mail - Von: "Dawid Wysakowicz" An: "dev" , "user" , annou...@apache.org Gesendet: Mittwoch, 29. September 2021 15:59:47 Betreff: [ANNOUNCE] Apache Flink 1.14.0 released The Apache Flink community is very happy to announce the release of

[ANNOUNCE] Apache Flink 1.14.0 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.14.0.   Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications.   The release is available for download at: https://fl

FlinkJobNotFoundException

Hello, We are facing an issue with some of our applications that are submitting a high volume of jobs to Flink (we are using v1.9.2). We are observing that numerous jobs (in this case 44 out of 350+) fail with the same FlinkJobNotFoundException within a 45 second timeframe. >From our client lo

RE: Event is taking a lot of time between the operators

Thank you @Piotr Nowojski for helping me. From: Piotr Nowojski Sent: Wednesday, September 29, 2021 12:53 PM To: Sanket Agrawal Cc: Ragini Manjaiah ; user@flink.apache.org Subject: Re: Event is taking a lot of time between the operators [**EXTERNAL EMAIL**] Hi Sanke

Re: Unable to connect to Mesos on mesos-appmaster.sh start

Thanks again, Matthias! Putting -Djobmanager.rpc.address=$HOST and -Djobmanager.rpc.port=$PORT0 as params for appmaster.sh I see in tog they seem to transform in the correct values -Djobmanager.rpc.address=10.0.23.35 -Djobmanager.rpc.port=31009 but a bit later the appmaster dies with this new

Re: flink rest endpoint creation failure

Hi Curt, could you elaborate a bit more on your setup? Maybe, provide commands you used to deploy the jobs and the Flink/YARN logs. What's puzzling me is your statement about "two JobManagers spinning up" and "everything's working fine if two TaskManagers are running on different instances". - When

Re: Unable to connect to Mesos on mesos-appmaster.sh start

The port has its separate configuration parameter jobmanager.rpc.port [1] [1] https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/config/#jobmanager-rpc-port-1 On Wed, Sep 29, 2021 at 10:11 AM Javier Vegas wrote: > Matthias, thanks for the suggestion! I changed my jobmanager.

Re: Unable to connect to Mesos on mesos-appmaster.sh start

Matthias, thanks for the suggestion! I changed my jobmanager.rpc.address param from $HOSTNAME to $HOST:$PORT0 which in the log I see resolves properly to the host IP and port mapped to 8081 2021-09-29 07:58:05.452 [main] INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Djobmanager.r

Re: Event is taking a lot of time between the operators

Hi Sanket, As I mentioned in the previous email, it's most likely still an issue of backpressure and you can check it as I described in that message. Either your records are stuck in the network buffers between (I) to async operations (if there is a network exchange), and/or inside the `AsyncWaitO

Re: Unable to connect to Mesos on mesos-appmaster.sh start

One thing that was puzzling me yesterday when reading your post: Have you tried $HOST instead of $HOSTNAME in the Marathon configuration? When I played around with Mesos, I remember using HOST to resolve the host's IP address instead of the host's name. It could be that the hostname itself cannot b