This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1850-3-dl
in repository https://gitbox.apache.org/repos/asf/opennlp.git
omit be98bd611 OPENNLP-1850 Reject non-finite logits in softmax, not just
NaN (dl)
omit 10d43cf7b OPENNLP-1850 Fully-qualify TokenNameFinder javadoc links in
NameFinderDL
omit 4dc78ffad OPENNLP-1850 Fail loud on corrupt document-classification
model output
omit fd9479f18 OPENNLP-1850 Fail fast on null finder input; fix the GPU
eval test options
omit 264b20ac8 OPENNLP-1850 Harden fail-loud paths in the DL components
omit 46cac9839 OPENNLP-1850 Add real-model chunk-boundary eval tests; drop
dead label constants
omit 8c206cadc OPENNLP-1850 Resolve overlapping chunk spans and compose the
input alignment
omit 85d45f13f OPENNLP-1850 Add OffsetMappingNameFinder capability
interface and a findInOriginal end-to-end test
omit 3c6acd4e1 OPENNLP-1850 Offset-safe, Unicode-aware input normalization
in the DL components
omit a345f48b2 OPENNLP-1850 Resolve Norwegian nb/nn to the Norwegian
profile (profiles)
omit be8d26e31 OPENNLP-1850 Per-language NormalizationProfile registry (2c)
omit 82cb041e8 OPENNLP-1850 Layered Term model: Term, TermAnalyzer (2b)
omit dc02b9e85 OPENNLP-1850 Fail loud on a Word_Break line missing its ';'
(tokenizer)
omit e51758922 OPENNLP-1850 UAX #29 word tokenizer: WordSegmenter,
WordTokenizer, WordType (2a)
omit 9af6d92bd OPENNLP-1850 Offset/alignment layer: Alignment, AlignedText,
buildAligned, *Aligned (1b)
add 69f513616 OPENNLP-1850 Dedup expanding folds via CharClass.substitute;
share a Lazy holder (engine)
add 9dc7d5106 OPENNLP-1850 Offset/alignment layer: Alignment, AlignedText,
buildAligned, *Aligned (1b)
add aa3522eb9 OPENNLP-1850 UAX #29 word tokenizer: WordSegmenter,
WordTokenizer, WordType (2a)
add a46b2f3bb OPENNLP-1850 Fail loud on a Word_Break line missing its ';'
(tokenizer)
add dd1906d0e OPENNLP-1850 Route WordBreakProperty/ExtendedPictographic
through the shared Lazy holder
add e35e8591d OPENNLP-1850 Layered Term model: Term, TermAnalyzer (2b)
add 9cac6484e OPENNLP-1850 Per-language NormalizationProfile registry (2c)
add 93618ce40 OPENNLP-1850 Resolve Norwegian nb/nn to the Norwegian
profile (profiles)
add 349399083 OPENNLP-1850 Offset-safe, Unicode-aware input normalization
in the DL components
add 6c9a8f192 OPENNLP-1850 Add OffsetMappingNameFinder capability
interface and a findInOriginal end-to-end test
add 004073926 OPENNLP-1850 Resolve overlapping chunk spans and compose the
input alignment
add 61e0100a2 OPENNLP-1850 Add real-model chunk-boundary eval tests; drop
dead label constants
add ba6c5dbc1 OPENNLP-1850 Harden fail-loud paths in the DL components
add 330325910 OPENNLP-1850 Fail fast on null finder input; fix the GPU
eval test options
add f7f26d376 OPENNLP-1850 Fail loud on corrupt document-classification
model output
add e10be7d9b OPENNLP-1850 Fully-qualify TokenNameFinder javadoc links in
NameFinderDL
add d4fec508f OPENNLP-1850 Reject non-finite logits in softmax, not just
NaN (dl)
add 5a1114c0d OPENNLP-1850 Make mergeOverlappingSpans O(n log n) (dl)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (be98bd611)
\
N -- N -- N refs/heads/OPENNLP-1850-3-dl (5a1114c0d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../opennlp/tools/util/normalizer/CharClass.java | 61 ++++++++++++++++++++
.../java/opennlp/dl/namefinder/NameFinderDL.java | 26 +++++----
.../tools/tokenize/uax29/ExtendedPictographic.java | 28 +++-------
.../tools/tokenize/uax29/WordBreakProperty.java | 30 +++-------
.../src/main/java/opennlp/tools/util/Lazy.java | 65 ++++++++++++++++++++++
.../opennlp/tools/util/normalizer/Confusables.java | 31 +++--------
.../normalizer/DigitCharSequenceNormalizer.java | 41 +++-----------
.../normalizer/EllipsisCharSequenceNormalizer.java | 34 +----------
.../GermanUmlautCharSequenceNormalizer.java | 37 +++---------
9 files changed, 181 insertions(+), 172 deletions(-)
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/Lazy.java
