RE: PySpark Write File Container exited with a non-zero exit code 143

2021-05-20 Thread Clay McDonald
Still get the same error with “pyspark --conf queue=default --conf executor-memory=24G” From: ayan guha Sent: Thursday, May 20, 2021 12:23 AM To: Clay McDonald Cc: Mich Talebzadeh ; user@spark.apache.org Subject: Re: PySpark Write File Container exited with a non-zero exit code 143

Re: PySpark Write File Container exited with a non-zero exit code 143

2021-05-19 Thread ayan guha
nesday, May 19, 2021 5:45 PM > *To:* Clay McDonald > *Cc:* user@spark.apache.org > *Subject:* Re: PySpark Write File Container exited with a non-zero exit > code 143 > > > > * *** EXTERNAL EMAIL *** * > > > > > > Hi Clay, > > > > Those parame

RE: PySpark Write File Container exited with a non-zero exit code 143

2021-05-19 Thread Clay McDonald
How so? From: Mich Talebzadeh Sent: Wednesday, May 19, 2021 5:45 PM To: Clay McDonald Cc: user@spark.apache.org Subject: Re: PySpark Write File Container exited with a non-zero exit code 143 *** EXTERNAL EMAIL *** Hi Clay, Those parameters you are passing are not valid pyspark --conf

Re: PySpark Write File Container exited with a non-zero exit code 143

2021-05-19 Thread Mich Talebzadeh
Hi Clay, Those parameters you are passing are not valid pyspark --conf queue=default --conf executory-memory=24G Python 3.7.3 (default, Apr 3 2021, 20:42:31) [GCC 4.8.5 20150623 (Red Hat 4.8.5-39)] on linux Type "help", "copyright", "credits" or "license" for more information. Warning: Ignoring