I am noticing disparities in behavior between the REPL and in my standalone
program in terms of implicit conversion of an RDD to SchemaRDD.
In the REPL the following sequence works:
import sqlContext._
val mySchemaRDD = myNormalRDD.where("1=1")
However when attempting similar in a standalone program it does not compile
-with message:
"value where is not a member of org.apache.spark.rdd.RDD[MyRecord]'
What is the required recipe for proper implict conversion - given I have
done the import sqlContext._ in the standalone program as well but it is
not sufficient there. Note: intellij IDE *does *seem to think that "import
sqlContext._" were enough - it understands the implicit use of "where".
But even in IJ it does not actually compile. Rather strange.