Hi,
One of solutions to use `spark-csv` (See:
https://github.com/databricks/spark-csv#features).
To load NULL, you can use `nullValue` there.
// maropu
On Mon, Jul 11, 2016 at 1:14 AM, Radha krishna wrote:
> I want to apply null comparison to a column in sqlcontext.sql, is there
> any way to
I want to apply null comparison to a column in sqlcontext.sql, is there any
way to achieve this?
On Jul 10, 2016 8:55 PM, "Radha krishna" wrote:
> Ok thank you, how to achieve the requirement.
>
> On Sun, Jul 10, 2016 at 8:44 PM, Sean Owen wrote:
>
>> It doesn't look like you have a NULL field,
Ok thank you, how to achieve the requirement.
On Sun, Jul 10, 2016 at 8:44 PM, Sean Owen wrote:
> It doesn't look like you have a NULL field, You have a string-value
> field with an empty string.
>
> On Sun, Jul 10, 2016 at 3:19 PM, Radha krishna wrote:
> > Hi All,IS NOT NULL is not working in
It doesn't look like you have a NULL field, You have a string-value
field with an empty string.
On Sun, Jul 10, 2016 at 3:19 PM, Radha krishna wrote:
> Hi All,IS NOT NULL is not working in programmatic sql. check below for input
> output and code.
>
> Input
>
> 10,IN
> 11,PK
> 12,US
> 13,UK
ssage in context:
http://apache-spark-user-list.1001560.n3.nabble.com/IS-NOT-NULL-is-not-working-in-programmatic-SQL-in-spark-tp27317.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Hi All,IS NOT NULL is not working in programmatic sql. check below for
input output and code.
Input
10,IN
11,PK
12,US
13,UK
14,US
15,IN
16,
17,AS
18,AS
19,IR
20,As
val cntdat = sc.textFile("/user/poc_hortonworks/radha/gsd/sample.txt");
case class CNT (id:Int , code : String)
val cntdf = cntd
