questions about yarn container(taskmanager)memory allocation

2019-05-20 Thread XiangWei Huang
Hi all, Currently i am running my flink application in yarn session mode and using below commnad : *bin/yarn-session.sh -d -s 3 -jm 1024 -tm 4096* when taskmanager complete to started,i found the container launching command is : * bin/java -Xms2765m -Xmx2765m -XX:MaxDirectMemorySize=1331m .

How to Join a dimension table in flink sql

2018-01-15 Thread XiangWei Huang
Hi all, Is it possible to join records read from a kafka stream with one(or more) dimension tables which are saved as mysql table using flink streaming sql.

Re: got Warn message - "the expected leader session ID did not equal the received leader session ID " when using LocalFlinkMiniCluster to interpret scala code

2017-09-27 Thread XiangWei Huang
; > Cheers, > Till > > On Wed, Sep 20, 2017 at 5:46 AM, XiangWei Huang <mailto:xw.huang...@gmail.com>> wrote: > Hi Till, > > Thanks for your answer,it worked when i use StandaloneMiniCluster,but > another problem is that i can’t find a way to cancel >

Re: got Warn message - "the expected leader session ID did not equal the received leader session ID " when using LocalFlinkMiniCluster to interpret scala code

2017-09-19 Thread XiangWei Huang
n, I recommend starting a local > standalone cluster and let the code run there. > > Cheers, > Till > > > On Wed, Sep 13, 2017 at 6:21 AM, XiangWei Huang <mailto:xw.huang...@gmail.com>> wrote: > dear all, > > Below is the code i execute: > > im

got Warn message - "the expected leader session ID did not equal the received leader session ID " when using LocalFlinkMiniCluster to interpret scala code

2017-09-12 Thread XiangWei Huang
dear all, Below is the code i execute: import java.io._ import java.net.{URL, URLClassLoader} import java.nio.charset.Charset import java.util.Collections import java.util.concurrent.atomic.AtomicBoolean import com.netease.atom.common.util.logging.Logging import com.netease.atom.interpreter.Code