Re: PySpark: slicing issue with dataframes

2015-05-17 Thread Davies Liu
Yes, it's a bug, please file a JIRA. On Sun, May 3, 2015 at 10:36 AM, Ali Bajwa wrote: > Friendly reminder on this one. Just wanted to get a confirmation that this > is not by design before I logged a JIRA > > Thanks! > Ali > > > On Tue, Apr 28, 2015 at 9:53 AM, Ali Bajwa wrote: >> >> Hi experts

Re: PySpark: slicing issue with dataframes

2015-05-03 Thread Ali Bajwa
Friendly reminder on this one. Just wanted to get a confirmation that this is not by design before I logged a JIRA Thanks! Ali On Tue, Apr 28, 2015 at 9:53 AM, Ali Bajwa wrote: > Hi experts, > > Trying to use the "slicing" functionality in strings as part of a Spark > program (PySpark) I get t

PySpark: slicing issue with dataframes

2015-04-28 Thread Ali Bajwa
Hi experts, Trying to use the "slicing" functionality in strings as part of a Spark program (PySpark) I get this error: Code import pandas as pd from pyspark.sql import SQLContext hc = SQLContext(sc) A = pd.DataFrame({'Firstname': ['James', 'Ali', 'Daniel'], 'Lastname': ['Jones', 'Bajw