Unsubscribe

Unsubscribe

Re: Spark on Yarn, is it possible to manually blacklist nodes before running spark job?

Not as far as I recall... From: Serega Sheypak Sent: Friday, January 18, 2019 3:21 PM To: user Subject: Spark on Yarn, is it possible to manually blacklist nodes before running spark job? Hi, is there any possibility to tell Scheduler to blacklist specific node

Spark on Yarn, is it possible to manually blacklist nodes before running spark job?

Hi, is there any possibility to tell Scheduler to blacklist specific nodes in advance?

Rdd pipe Subprocess exit code

When using rdd pipe(script), i get the following error : "java.lang.IllegalStateException: Subprocess exited with status 132. Command ran: "./script -h" I'm getting this while trying to run my external script with a simple "-h" argument to test that its running smoothly through my Spark code. Whe

Re: Question about RDD pipe

Thanks a lot for the answer! It solved my problem. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: dataset best practice question

Thanks! I wanted to avoid repeating f1, f2, f3 in class B. I wonder whether the encoders/decoders work if I use mixins On Tue, Jan 15, 2019 at 7:57 PM wrote: > Hi Mohit, > > > > I’m not sure that there is a “correct” answer here, but I tend to use > classes whenever the input or output data repr

[SPARK ON K8]: How do you configure executors to use the keytab inside their image on Kubernetes?

Hi, I’m attempting to use Spark on Kubernetes to connect to a Kerberized Hadoop cluster. While I’m able to successfully connect to the company’s Hive tables and run queries on them, I’ve only managed to do this on a single driver pod (with no executors). If I use any executor pods, the process f