Re: Delete NA in a dataframe

Thank you Peter I try this Le Mardi 4 août 2015 15h02, Peter Rudenko a écrit : Hi Clark, the problem is that in this dataset null values represented as NA marker. Spark-csv doesn't have configurable null values marker (i've made a PR with it some time ago: https://github.com/da

Re: Delete NA in a dataframe

Hi Clark, the problem is that in this dataset null values represented as NA marker. Spark-csv doesn't have configurable null values marker (i've made a PR with it some time ago: https://github.com/databricks/spark-csv/pull/76). So one option for you is to do post filtering, something like thi

Delete NA in a dataframe

Hello, I try to magage NA in this dataset. I import my dataset with the com.databricks.spark.csv package When I do this: allyears2k.na.drop() I have no result. Can you help me please ? Regards, ---   The dataset - dataset:  https://s3.amazonaws.com/h2o-