Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-31 Thread JB Data31
find the *start-master.sh* file with command excuted as root *find / -name "start-master.sh" -print.* Check that the directory found is well put in the $PATH. As a first step go to the directory where the *start-master.sh* is with *cd* command and execute with command *./start-master.sh*. @*JB*Δ

Re: How can I add extra mounted disk to HDFS

2020-04-28 Thread JB Data31
Use Hadoop NFSv3 gateway to mount FS. @*JB*Δ Le mar. 28 avr. 2020 à 23:18, Chetan Khatri a écrit : > Hi Spark Users, > > My spark job gave me an error No Space left on the device >

Re: [spark on yarn] spark on yarn without DFS

2019-05-20 Thread JB Data31
There is a kind of check in the *yarn-site.xml* *yarn.nodemanager.remote-app-log-dir /var/yarn/logs* ** Using *hdfs://:9000* as* fs.defaultFS* in *core-site.xml* you have to *hdfs dfs -mkdir /var/yarn/logs* Using *S3://* as * fs.defaultFS*... Take care of *.dir* properties in* hdfs-site

Re: Masking username in Spark with regexp_replace and reverse functions

2019-03-17 Thread JB Data31
Hi, Why don't add a random regexp in regexp substitution, i.e. https://onlinerandomtools.com/generate-random-data-from-regexp @*JB*Δ Le sam. 16 mars 2019 à 18:39, Mich Talebzadeh a écrit : > Hi, > > I am looking at Description column of a bank stateme