Apache Airflow - Question about checkpointing and re-run a job

2019-11-16 Thread M Singh
Hi: I have a Flink job and sometimes I need to cancel and re run it.  From what I understand the checkpoints for a job are saved under the job id directory at the checkpoint location. If I run the same job again, it will get a new job id and the checkpoint saved from the previous run job (which

Re: Re:Apache Flink - Operator name and uuid best practices

2019-11-16 Thread M Singh
Thanks Jiayi for your response. I am thinking on the same lines.   Regarding using the same name and uuid, I believe the checkpoint state for an operator will be easy to identify if the uuid is the same as name.  But I am not sure if having a very long name and uuid or a character like parenthes

Re:Apache Flink - Operator name and uuid best practices

2019-11-16 Thread Jiayi Liao
Hi Mans! Firstly let’s see how operator’s name and uid is used. AFAIK, operator’s name is used in WebUI and metrics reporting, and uid is used to mark the uniqueness of operator which is useful when you’re using state[1]. > Are there any restrictions on the length of the name and uuid att

unsubscribe

2019-11-16 Thread Ceyhan Kasap

Apache Flink - Operator name and uuid best practices

2019-11-16 Thread M Singh
Hi: I am working on a project and wanted to find out what are the best practices for setting name and uuid for operators: 1. Are there any restrictions on the length of the name and uuid attributes ?2. Are there any restrictions on the characters used for name and uuid (blank spaces, etc) ?3. Ca

Re: how to setup a ha flink cluster on k8s?

2019-11-16 Thread vino yang
Hi Rock, I searched by Google and found a blog[1] talk about how to config JM HA for Flink on k8s. Do not know whether it suitable for you or not. Please feel free to refer to it. Best, Vino [1]: http://shzhangji.com/blog/2019/08/24/deploy-flink-job-cluster-on-kubernetes/ Rock 于2019年11月16日周六 上