Re: How to drop all tokens that a snowball dictionary cannot stem?

2019-11-23 Thread Christoph Gößmann
list that could be used to filter after stemming? Thanks, Christoph > On 23. Nov 2019, at 16:27, Jeff Janes wrote: > > On Fri, Nov 22, 2019 at 8:02 AM Christoph Gößmann <mailto:m...@goessmann.io>> wrote: > Hi everybody, > > I am trying to get all the lexemes for a

How to drop all tokens that a snowball dictionary cannot stem?

2019-11-22 Thread Christoph Gößmann
Hi everybody, I am trying to get all the lexemes for a text using to_tsvector(). But I want only words that english_stem -- the integrated snowball dictionary -- is able to handle to show up in the final tsvector. Since snowball dictionaries only remove stop words, but keep the words that they