This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1850-2b-term
in repository https://gitbox.apache.org/repos/asf/opennlp.git
omit 57e2b5833 OPENNLP-1850 Layered Term model: Term, TermAnalyzer (2b)
omit a450069ef OPENNLP-1850 UAX #29 word tokenizer: WordSegmenter,
WordTokenizer, WordType (2a)
omit 08de0d35c OPENNLP-1850 Offset/alignment layer: Alignment, AlignedText,
buildAligned, *Aligned (1b)
add 1a6b27387 OPENNLP-1850 Fail loud on a structurally-malformed
confusables line (engine)
add 9af6d92bd OPENNLP-1850 Offset/alignment layer: Alignment, AlignedText,
buildAligned, *Aligned (1b)
add e51758922 OPENNLP-1850 UAX #29 word tokenizer: WordSegmenter,
WordTokenizer, WordType (2a)
add dc02b9e85 OPENNLP-1850 Fail loud on a Word_Break line missing its ';'
(tokenizer)
add 82cb041e8 OPENNLP-1850 Layered Term model: Term, TermAnalyzer (2b)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (57e2b5833)
\
N -- N -- N refs/heads/OPENNLP-1850-2b-term (82cb041e8)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../tools/tokenize/uax29/WordBreakProperty.java | 9 +-
.../opennlp/tools/util/normalizer/Confusables.java | 98 ++++++++++++----------
.../tokenize/uax29/WordBreakPropertyTest.java | 16 ++++
.../tools/util/normalizer/ConfusablesLoadTest.java | 53 ++++++++++++
4 files changed, 130 insertions(+), 46 deletions(-)
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/ConfusablesLoadTest.java
