Re: DataFrame defined within conditional IF ELSE statement

Oh, sorry it was supposed to be sys.error, not sys.err From: Mich Talebzadeh Date: Sunday, September 18, 2016 at 5:23 PM To: Silvio Fiorito Cc: "user @spark" Subject: Re: DataFrame defined within conditional IF ELSE statement Thanks Silvio. This is what I ended up with val d

Re: DataFrame defined within conditional IF ELSE statement

ot;test.marketData").select('TIMECREATED,' > SECURITY,'PRICE) > > case 3 => spark.table("test.marketDataParquet").select(' > TIMECREATED,'SECURITY,'PRICE) > > case _ => sys.err(“no valid option provided”) > > } > > &

Re: DataFrame defined within conditional IF ELSE statement

#x27;SECURITY,'PRICE) case _ => sys.err(“no valid option provided”) } df.printSchema() Thanks, Silvio From: Mich Talebzadeh Date: Saturday, September 17, 2016 at 4:18 PM To: "user @spark" Subject: DataFrame defined within conditional IF ELSE statement In Spark 2 this gives me

Re: DataFrame defined within conditional IF ELSE statement

any opinion on this please? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your o

DataFrame defined within conditional IF ELSE statement

In Spark 2 this gives me an error in a conditional IF ELSE statement I recall seeing the same in standard SQL I am doing a test for different sources (text file, ORC or Parquet) to be read in dependent on value of var option I wrote this import org.apache.spark.sql.functions._ import java.util