The Spark installation I am trying to do is on an Ubuntu image on Docker. So there is no text editor installed on the Ubuntu image I have installed. I have installed gedit but had some graphic issues and couldn't lunch it. When I tried to lunch gedit, I had the following error message:
root@33z261w1a18:/home# gedit Unable to init server: Could not connect: Connection refused (gedit:13922): Gtk-WARNING **: 11:52:24.510: cannot open display: 0:0vi is not installed nor vim. About the question "Where is SPARK?" below is what I did to find what I believe is the path. I don't know if the answer is enough: root@33z261w1a18:/opt/spark# cd $SPARK_HOME root@33z261w1a18:/opt/spark# pwd /opt/spark root@33z261w1a18:/opt/spark# ls LICENSE R RELEASE conf examples kubernetes python yarn NOTICE README.md bin data jars licenses sbin Can we talk on Skype? Thank. -- «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète et qui se vendent, mais d'hommes profondément loyaux et intègres, des hommes qui ne craignent pas d'appeler le péché par son nom, des hommes dont la conscience soit aussi fidèle à son devoir que la boussole l'est au pôle, des hommes qui défendraient la justice et la vérité même si l'univers s'écroulait.» Ellen Gould WHITE, education, P. 55 Le Mardi, Mars 30, 2021 09:00 GMT, Mich Talebzadeh <mich.talebza...@gmail.com> a écrit: OK on your path where is SPARK? Try to edit your .profile with simple editor of your choice (vi, vim etc if you are on Linux) export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/bin:/sbin:$PATHexport SPARK_HOME=/opt/spark## Add it to the PATH!!!!export PATH=$SPARK_HOME/bin:$SPARK_HOME/sbin:$PATH Once you have done it do . ./.profile send the output of echo $PATH HTH view my Linkedin profile Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Tue, 30 Mar 2021 at 09:23, GUINKO Ferdinand <tonguimferdin...@guinko.net> wrote:Good day Talebzadeh, here are the outputs: cat ~/.profile root@33z261w1a18:/home# cat ~/.profile # ~/.profile: executed by Bourne-compatible login shells. if [ "$BASH" ]; then if [ -f ~/.bashrc ]; then . ~/.bashrc fi fi mesg n 2> /dev/null || true export SPARK_HOME=/opt/spark export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/bin:/sbin export PYSPARK_PYTHON=/usr/bin/python3 echo $PATH /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/bin:/sbinThank you. -- «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète et qui se vendent, mais d'hommes profondément loyaux et intègres, des hommes qui ne craignent pas d'appeler le péché par son nom, des hommes dont la conscience soit aussi fidèle à son devoir que la boussole l'est au pôle, des hommes qui défendraient la justice et la vérité même si l'univers s'écroulait.» Ellen Gould WHITE, education, P. 55 Le Lundi, Mars 29, 2021 22:24 GMT, Mich Talebzadeh <mich.talebza...@gmail.com> a écrit: OK just do cat ~/.profile and send the content please also do echo $PATH and send the output as well. HTH view my Linkedin profile Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Mon, 29 Mar 2021 at 22:06, GUINKO Ferdinand <tonguimferdin...@guinko.net> wrote:Hi Talebzadeh, thank you for your answer. I am sorry, but I don't undertand what I need to do. It seems that I already put SPARK_HOME/sbin in my path as I have this line among the 3 lines I have sent in my initial email: echo "export PATH=$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin" >> ~/.profile Isn't it? Also should I remove the "echo" as it seems you don't have them in your commands. I am following this tutorial: https://phoenixnap.com/kb/install-spark-on-ubuntu but installing Spark 3.1.1 with Hadoop 2.7. Thank you for any help. Ferdinand -- «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète et qui se vendent, mais d'hommes profondément loyaux et intègres, des hommes qui ne craignent pas d'appeler le péché par son nom, des hommes dont la conscience soit aussi fidèle à son devoir que la boussole l'est au pôle, des hommes qui défendraient la justice et la vérité même si l'univers s'écroulait.» Ellen Gould WHITE, education, P. 55 Le Lundi, Mars 29, 2021 18:57 GMT, Mich Talebzadeh <mich.talebza...@gmail.com> a écrit: In my case export SPARK_HOME=/d4T/hduser/spark-3.1.1-bin-hadoop3.2export PATH=$SPARK_HOME/bin:$SPARK_HOME/sbin:$PATH which start-master.sh/d4T/hduser/spark-3.1.1-bin-hadoop3.2/sbin/start-master.sh You need to add $SPARK_HOME/sbin to your path as well HTH view my Linkedin profile Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Mon, 29 Mar 2021 at 19:19, GUINKO Ferdinand <tonguimferdin...@guinko.net> wrote:Hi, I have installed Docker, Spark 3.1.1 and Hadoop 2.7 on Ubuntu 18.04. After I have executed the following 3 lines echo "export SPARK_HOME=/opt/spark" >> ~/.profile echo "export PATH=$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin" >> ~/.profile echo "export PYSPARK_PYTHON=/usr/bin/python3" >> ~/.profile I tried to start the master server by typing start-master.sh and got the following error message bash: start-master.sh: command not found Thank you for any help.Ferdinand -- «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète et qui se vendent, mais d'hommes profondément loyaux et intègres, des hommes qui ne craignent pas d'appeler le péché par son nom, des hommes dont la conscience soit aussi fidèle à son devoir que la boussole l'est au pôle, des hommes qui défendraient la justice et la vérité même si l'univers s'écroulait.» Ellen Gould WHITE, education, P. 55
