[
https://issues.apache.org/jira/browse/SPARK-19848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15899250#comment-15899250
]
Nick Pentreath commented on SPARK-19848:
----------------------------------------
Perhaps the ML pipeline components mentioned
[here|https://lucidworks.com/2016/04/13/spark-solr-lucenetextanalyzer/] may be
of use?
> Regex Support in StopWordsRemover
> ---------------------------------
>
> Key: SPARK-19848
> URL: https://issues.apache.org/jira/browse/SPARK-19848
> Project: Spark
> Issue Type: Improvement
> Components: ML
> Affects Versions: 2.1.0
> Reporter: Mohd Suaib Danish
> Priority: Minor
>
> Can we have regex feature in StopWordsRemover in addition to the provided
> list of stop words?
> Use cases can be following:
> 1. Remove all single or double letter words- [a-zA-Z]{1,2}
> 2. Remove anything starting with abc - ^abc
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
