Re: SQLcontext changing String field to Long

2015-10-12 Thread shobhit gupta
; logger.info("troubling thing is ::" + >>>> sqlContext.sql(fileSelectQuery).schema().toString()); >>>> DataFrame df= sqlContext.sql(fileSelectQuery); >>>> JavaRDD rdd2 = df.toJavaRDD(); >>>> >>>> First Line in the code (Logger)

Re: SQLcontext changing String field to Long

2015-10-11 Thread Yana Kadiyska
>> But the moment after it the execption comes up. >>> >>> Any idea why it is treating the filed as Long? (yeah one unique thing >>> about >>> column is it is always a number e.g. Time-stamp). >>> >>> Any help is appreciated. >>> >

Re: SQLcontext changing String field to Long

2015-10-10 Thread shobhit gupta
StringType,true)) >> >> But the moment after it the execption comes up. >> >> Any idea why it is treating the filed as Long? (yeah one unique thing >> about >> column is it is always a number e.g. Time-stamp). >> >> Any help is appreciated. >>

Re: SQLcontext changing String field to Long

2015-10-10 Thread Yana Kadiyska
r e.g. Time-stamp). > > Any help is appreciated. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/SQLcontext-changing-String-field-to-Long-tp25005.html > Sent from the Apache Spark User List mailing list archive at Na

SQLcontext changing String field to Long

2015-10-09 Thread Abhisheks
ache-spark-user-list.1001560.n3.nabble.com/SQLcontext-changing-String-field-to-Long-tp25005.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apac