Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-16 Thread Robert Metzger
I guess you are seeing a different error now, because you are submitting the job, and stopping it right away. Can you produce new logs, where you wait until at least one Checkpoint successfully completed before you stop? >From the exception it seems that the job has not successfully been initializ

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-16 Thread Folani
Hi, I attached the log files for Jobmanager and Taskmanager: jobmanager_log.asc 6122-f8b99d_log.6122-f8b99d_log

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-16 Thread Robert Metzger
Hi, the logs from the client are not helpful for debugging this particular issue. With kubectl get pods, you can get the TaskManger pod names, with kubectl logs you can get the logs. The JobManager log would also be nice to have. On Mon, Dec 14, 2020 at 3:29 PM Folani wrote: > Hi Piotrek, > >

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-14 Thread Folani
Hi Piotrek, Sorry for late response. I have another problem with setting logs. I think the logging issue comes from using Flink on my host machine and running a job on a jobmanager in K8s. I'm managing the issue. But, this is what I got in /log folder of my host machine: 2020-12-14 15:04:51,329

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-11 Thread Piotr Nowojski
Hi, It's hard for me to guess what could be the problem. There was the same error reported a couple of months ago [1], but there is frankly no extra information there. Can we start from looking at the full TaskManager and JobManager logs? Could you share them with us? Best, Piotrek [1] http://

Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-11 Thread Folani
I'm deploying a standalone Flink cluster on top of Kubernetes and using MinIO as a S3 backend. I mainly follow the instructions in flink's website. I use the following command to run my job in Flink: $flink run -d -m : -j job.jar I also have added to flink-configmap.yaml the followings: s

Re: getting an exception

2019-08-06 Thread Avi Levi
.8), >> please check your flink-dist version. >> >> >> >> Regards, >> >> Victor >> >> >> >> *From: *Avi Levi >> *Date: *Monday, August 5, 2019 at 9:11 PM >> *To: *user >> *Subject: *getting an exception >> &

Re: getting an exception

2019-08-05 Thread Gaƫl Renoux
> > > Regards, > > Victor > > > > *From: *Avi Levi > *Date: *Monday, August 5, 2019 at 9:11 PM > *To: *user > *Subject: *getting an exception > > > > Hi, > > I'm using Flink 1.8.1. our code is mostly using Scala. > > When I try to

Re: getting an exception

2019-08-05 Thread Wong Victor
Hi Avi: It seems you are submitting your job with an older Flink version (< 1.8), please check your flink-dist version. Regards, Victor From: Avi Levi Date: Monday, August 5, 2019 at 9:11 PM To: user Subject: getting an exception Hi, I'm using Flink 1.8.1. our code is mostly usi

getting an exception

2019-08-05 Thread Avi Levi
Hi, I'm using Flink 1.8.1. our code is mostly using Scala. When I try to submit my job (on my local machine ) it crashes with the error below (BTW on the IDE it runs perfectly). Any assistance would be appreciated. Thanks Avi 2019-08-05 12:58:03.783 [Flink-DispatcherRestEndpoint-thread-3] ERROR or