Re: Extracting key word from a textual column

2016-08-03 Thread Mich Talebzadeh
d grouping much easier. >>>>> >>>>> I believe Spark can do it, though I am generally interested on >>>>> alternative ideas. >>>>> >>>>> >>>>> >>>>> >>>>> >>>>&g

Re: Extracting key word from a textual column

2016-08-02 Thread Jörn Franke
t;>>>> it in a table and math the company name to transactiondesciption column. >>>>>>> >>>>>>> That catalog should have sectors in it. For example company XYZ is >>>>>>> under Grocers etc which will make search and grouping much easier. >

Re: Extracting key word from a textual column

2016-08-02 Thread Jörn Franke
rally interested on >>>>>> alternative ideas. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Dr Mich Talebzadeh >>>>>> >>>>>> LinkedIn

Re: Extracting key word from a textual column

2016-08-02 Thread ayan guha
w.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>>> >>>> >>>> >>>> http://talebzadehmich.wordpress.com >>>> >>>> >>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for >>>> any

Re: Extracting key word from a textual column

2016-08-02 Thread Mich Talebzadeh
; disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> On 2 August 2016 at 16:26, Yong Zhang wrote: >>> >>>> Well, if you still want to use

Re: Extracting key word from a textual column

2016-08-02 Thread Ted Yu
ll in no case be liable for any monetary damages arising from >>>> such loss, damage or destruction. >>>> >>>> >>>>> On 2 August 2016 at 16:26, Yong Zhang wrote: >>>>> Well, if you still want to use windows function for your

Re: Extracting key word from a textual column

2016-08-02 Thread Jörn Franke
>>> On 2 August 2016 at 16:26, Yong Zhang wrote: >>>> Well, if you still want to use windows function for your logic, then you >>>> need to derive a new column out, like "catalog", and use it as part of >>>> grouping logic. >>>> &

Re: Extracting key word from a textual column

2016-08-02 Thread Mich Talebzadeh
like "catalog", and use it as part of >>> grouping logic. >>> >>> >>> Maybe you can use regex for deriving out this new column. The >>> implementation needs to depend on your data in "transactiondescription", >>> and regex

Re: Extracting key word from a textual column

2016-08-02 Thread Sonal Goyal
to you process your logic >> based on the data given. >> >> >> Yong >> >> >> -- >> *From:* Mich Talebzadeh >> *Sent:* Tuesday, August 2, 2016 10:00 AM >> *To:* user @spark >> *Subject:* Extract

Re: Extracting key word from a textual column

2016-08-02 Thread Mich Talebzadeh
to you process your logic > based on the data given. > > > Yong > > > -- > *From:* Mich Talebzadeh > *Sent:* Tuesday, August 2, 2016 10:00 AM > *To:* user @spark > *Subject:* Extracting key word from a textual column > > Hi, > > Need some

Re: Extracting key word from a textual column

2016-08-02 Thread Yong Zhang
user @spark Subject: Extracting key word from a textual column Hi, Need some ideas. Summary: I am working on a tool to slice and dice the amount of money I have spent so far (meaning the whole data sample) on a given retailer so I have a better idea of where I am wasting the money Approach

Extracting key word from a textual column

2016-08-02 Thread Mich Talebzadeh
Hi, Need some ideas. *Summary:* I am working on a tool to slice and dice the amount of money I have spent so far (meaning the whole data sample) on a given retailer so I have a better idea of where I am wasting the money *Approach* Downloaded my bank statements from a given account in csv form