Bug#1145427: tokenizers: diff for NMU version 0.23.1+dfsg-2.1

[Adrian Bunk]

Control: tags 1145427 + pending

Dear maintainer,

I've prepared an NMU for tokenizers (versioned as 0.23.1+dfsg-2.1) and 
uploaded it to DELAYED/2. Please feel free to tell me if I should cancel it.

cu
Adrian

diffstat for tokenizers-0.23.1+dfsg tokenizers-0.23.1+dfsg

 changelog                 |    9 +++++++++
 patches/set_version.patch |    8 ++++++--
 2 files changed, 15 insertions(+), 2 deletions(-)

diff -Nru tokenizers-0.23.1+dfsg/debian/changelog tokenizers-0.23.1+dfsg/debian/changelog
--- tokenizers-0.23.1+dfsg/debian/changelog	2026-08-11 05:46:56.000000000 +0300
+++ tokenizers-0.23.1+dfsg/debian/changelog	2026-08-31 15:59:50.000000000 +0300
@@ -1,3 +1,12 @@
+tokenizers (0.23.1+dfsg-2.1) unstable; urgency=medium
+
+  * Non-maintainer upload.
+
+  [ Simon Quigley ]
+  * Allow compact_str 0.10. (Closes: #1145427)
+
+ -- Adrian Bunk <b...@debian.org>  Mon, 31 Aug 2026 15:59:50 +0300
+
 tokenizers (0.23.1+dfsg-2) unstable; urgency=medium
 
   * Mask a test case for armhf and i386 to unblock migration.
diff -Nru tokenizers-0.23.1+dfsg/debian/patches/set_version.patch tokenizers-0.23.1+dfsg/debian/patches/set_version.patch
--- tokenizers-0.23.1+dfsg/debian/patches/set_version.patch	2026-07-10 04:49:26.000000000 +0300
+++ tokenizers-0.23.1+dfsg/debian/patches/set_version.patch	2026-08-31 15:59:50.000000000 +0300
@@ -13,7 +13,7 @@
  regex = "1.10"
  regex-syntax = "0.8"
  rayon = "1.10"
-@@ -78,20 +78,20 @@ serde_json = "1.0"
+@@ -78,23 +78,23 @@ serde_json = "1.0"
  unicode-normalization-alignments = "0.1"
  unicode_categories = "0.1"
  unicode-segmentation = "1.11"
@@ -38,7 +38,11 @@
 +monostate = "1.0"
  ahash = { version = "0.8.11", features = ["serde"] }
  dary_heap = { version = "0.3.6", features = ["serde"] }
- compact_str = { version = "0.9", features = ["serde"] }
+-compact_str = { version = "0.9", features = ["serde"] }
++compact_str = { version = ">= 0.9, < 0.11", features = ["serde"] }
+ 
+ [features]
+ default = ["progressbar", "onig", "esaxx_fast"]
 Index: tokenizers/tokenizers/src/models/bpe/word.rs
 ===================================================================
 --- tokenizers.orig/tokenizers/src/models/bpe/word.rs