That looks like a bug to me. Open a JIRA?
On Mon, Mar 7, 2016 at 11:30 AM, Franklyn D'souza <
franklyn.dso...@shopify.com> wrote:
> Just wanted to confirm that this is the expected behaviour.
>
> Basically I'm putting nulls into a non-nullable LongType column and doing
> a transformation operati
Just wanted to confirm that this is the expected behaviour.
Basically I'm putting nulls into a non-nullable LongType column and doing a
transformation operation on that column, the result is a column with nulls
converted to 0.
Heres an example
from pyspark.sql import types
from pyspark.sql impor
