Re: Drop a column from the DataFrame.

2015-05-03 Thread Olivier Girardot
great thx Le sam. 2 mai 2015 à 23:58, Ted Yu a écrit : > This is coming in 1.4.0 > https://issues.apache.org/jira/browse/SPARK-7280 > > > > On May 2, 2015, at 2:27 PM, Olivier Girardot wrote: > > Sounds like a patch for a "drop" method... > > Le sam. 2 mai 2015 à 21:03, dsgriffin a écrit : > >

Re: Drop a column from the DataFrame.

2015-05-02 Thread Ted Yu
This is coming in 1.4.0 https://issues.apache.org/jira/browse/SPARK-7280 > On May 2, 2015, at 2:27 PM, Olivier Girardot wrote: > > Sounds like a patch for a "drop" method... > >> Le sam. 2 mai 2015 à 21:03, dsgriffin a écrit : >> Just use select() to create a new DataFrame with only the colu

Re: Drop a column from the DataFrame.

2015-05-02 Thread Olivier Girardot
Sounds like a patch for a "drop" method... Le sam. 2 mai 2015 à 21:03, dsgriffin a écrit : > Just use select() to create a new DataFrame with only the columns you want. > Sort of the opposite of what you want -- but you can select all but the > columns you want minus the one you don. You could e

Re: Drop a column from the DataFrame.

2015-05-02 Thread dsgriffin
Just use select() to create a new DataFrame with only the columns you want. Sort of the opposite of what you want -- but you can select all but the columns you want minus the one you don. You could even use a filter to remove just the one column you want on the fly: myDF.select(myDF.columns.filter