I am noticing disparities in behavior between the REPL and in my standalone
program in terms of implicit conversion of an RDD to SchemaRDD.

In the REPL the following sequence works:


import sqlContext._

val mySchemaRDD = myNormalRDD.where("1=1")


However when attempting similar in a standalone program it does not compile
-with message:

  "value where is not a member of org.apache.spark.rdd.RDD[MyRecord]'


What is the required recipe for proper implict conversion  - given I have
done the import sqlContext._ in the standalone program as well but it is
not sufficient there.  Note: intellij IDE *does *seem to think that "import
sqlContext._" were  enough - it understands the implicit use of "where".
But even in IJ it does not actually compile. Rather strange.

Reply via email to