Re: Job cannot be deployed when use detached mode

2020-01-17 Thread Biao Liu
Ah, thanks Yang for the fixup. I misunderstood the original answer. Thanks, Biao /'bɪ.aʊ/ On Fri, 17 Jan 2020 at 16:39, Yang Wang wrote: > Hi sysuke, > > >> Why the Yarn per-job attach mode could work, but detach mode could not? > It is just becausein 1.9 and previous versions, the per-job ha

Re: Job cannot be deployed when use detached mode

2020-01-17 Thread Yang Wang
Hi sysuke, >> Why the Yarn per-job attach mode could work, but detach mode could not? It is just becausein 1.9 and previous versions, the per-job have very different code path for attach and detach mode. For attach mode, Flink client will start a session cluster, and then submit a job to the exist

Re: Job cannot be deployed when use detached mode

2020-01-17 Thread Biao Liu
Hi Sysuke, Could you check the JM log (YARN AM container log) first? You might find the direct failure message there. Thanks, Biao /'bɪ.aʊ/ On Fri, 17 Jan 2020 at 12:02, sysuke Lee wrote: > Hi all, > We've got a jar with hadoop configuration files in it. > > Previously we use blocking mode

Job cannot be deployed when use detached mode

2020-01-16 Thread sysuke Lee
Hi all, We've got a jar with hadoop configuration files in it. Previously we use blocking mode to deploy jars on YARN, they run well. Recently we find the client process occupies more and more memory , so we try to use detached mode, but the job failed to deploy with following error information: