Re: How to run spark shell using YARN

2018-03-14 Thread Anthony, Olufemi
After you updated your yarn-site.xml file, did you restart the YARN resource manager ? https://aws.amazon.com/premiumsupport/knowledge-center/restart-service-emr/ Femi From: kant kodali Date: Wednesday, March 14, 2018 at 6:16 AM To: Femi Anthony Cc: vermanurag , "user @spark" Subject: Re:

Re: how to use lit() in spark-java

2018-03-23 Thread Anthony, Olufemi
You can us import static to import it directly: import static org.apache.spark.sql.functions.lit; Femi From: 崔苗 Date: Friday, March 23, 2018 at 8:34 AM To: "user@spark.apache.org" Subject: how to use lit() in spark-java Hi Guys, I want to add a constant column to dataset by lit function in ja