Re: DataFrame column name restriction

2015-04-11 Thread Michael Armbrust
That is a good question. Names with `.` in them are in particular broken by SPARK-5632 , which I'd like to fix. There is a more general question of whether strings that are passed to DataFrames should be treated as quoted identifiers (i.e. `as tho

DataFrame column name restriction

2015-04-10 Thread Justin Yip
Hello, Are there any restriction in the column name? I tried to use ".", but sqlContext.sql cannot find the column. I would guess that "." is tricky as this affects accessing StructType, but are there any more restriction on column name? scala> case class A(a: Int) defined class A scala> sqlCont