Hi, It seems you run it in Windows. In that case, only start-cluster.bat could be used. However, this script could only start one TM[1] no matter how you configure the slaves/workers.
[1] https://github.com/apache/flink/blob/release-1.9/flink-dist/src/main/flink-bin/bin/start-cluster.bat Best, Yangze Guo On Thu, Sep 17, 2020 at 4:53 PM saksham sapra <sapra.saksh...@gmail.com> wrote: > > HI Yangze, > > I tried to run start-cluster.sh and i can see in host , when flink tries to > run second task manager or executor, pop up or host gets closed. > Please find attached logs for two command : start-cluster.sh and > start-cluster.bat. > > Thanks & Regards, > Saksham > > On Thu, Sep 17, 2020 at 2:00 PM Yangze Guo <karma...@gmail.com> wrote: >> >> Hi, >> >> > I wasnt having "workers" file in conf/workers so i created one, but i have >> > "slaves" file in conf/workers, so i edited both two localhost like >> > screenshot given below : >> Yes, for 1.9.3, you need to edit the 'slaves' file. >> >> I think we need more information to figure out what happened. >> - What is the output when you execute ./bin/start-cluster.sh, could >> you see two "Starting taskexecutor daemon on host" lines? >> - Could you see two flink-xxx-taskexecutor-xxx.log in $FLINK_DIST/log? >> If so, could you share these two log files? >> >> Best, >> Yangze Guo >> >> Best, >> Yangze Guo >> >> >> On Thu, Sep 17, 2020 at 4:06 PM saksham sapra <sapra.saksh...@gmail.com> >> wrote: >> > >> > Hi Yangze, >> > >> > Thanks for replying, but i still have some questions. >> > I wasnt having "workers" file in conf/workers so i created one, but i have >> > "slaves" file in conf/workers, so i edited both two localhost like >> > screenshot given below : >> > >> > >> > >> > >> > >> > >> > and then again started flink , but i can see only one task manager >> > >> > >> > Please find my config.yaml file attached. >> > >> > >> > Thanks for helping. >> > >> > Thanks & Regards, >> > Saksham Sapra >> > >> > On Thu, Sep 17, 2020 at 12:57 PM Yangze Guo <karma...@gmail.com> wrote: >> >> >> >> Hi, >> >> >> >> From my understanding, you want to set up a standalone cluster in your >> >> local machine. If that is the case, you could simply edit the >> >> $FLINK_DIST/conf/workers, in which each line represents a TM host. By >> >> default, there is only one TM in localhost. In your case, you could >> >> add a line 'localhost' to it. Then, execute the >> >> $FLINK_DIST/bin/start-cluster.sh, you could see a standalone cluster >> >> with two TM in your local machine. >> >> >> >> [1] >> >> https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/cluster_setup.html#configuring-flink >> >> >> >> Best, >> >> Yangze Guo >> >> >> >> On Thu, Sep 17, 2020 at 3:16 PM saksham sapra <sapra.saksh...@gmail.com> >> >> wrote: >> >> > >> >> > Hi , >> >> > >> >> > I am unable to set two task managers in my local machine and neither >> >> > any documentation provided for the same. >> >> > >> >> > I want to run a parallel job in two task managers using flink. >> >> > kindly help me with the same, how can i set up in my local without >> >> > using any zookeeper or something. >> >> > >> >> > >> >> > Thanks & Regards, >> >> > Saksham Sapra >> >> > >> >> >
