Skip to content

Pull requests: guillaume-be/rust-tokenizers

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Sort

Pull requests list

Add lock files to .gitignore
#101 by guillaume-be was merged Oct 1, 2023 Loading…
Bump webpki from 0.22.0 to 0.22.2 in /main dependencies Pull requests that update a dependency file
#100 by dependabot bot was closed Oct 1, 2023 Loading…
Bump openssl from 0.10.48 to 0.10.57 in /main dependencies Pull requests that update a dependency file
#99 by dependabot bot was merged Oct 1, 2023 Loading…
Fix RoBERTa segment ids
#98 by guillaume-be was merged Oct 1, 2023 Loading…
Upgrade readme to reflect new tokenizers API
#97 by ToluClassics was merged Oct 1, 2023 Loading…
change target branch for CI
#95 by guillaume-be was merged Jul 27, 2023 Loading…
[perf] Avoid unnecessary collect.
#94 by ttsugriy was closed Jul 29, 2023 Loading…
[perf] Remove unnecessary vec extend.
#93 by ttsugriy was merged Jul 28, 2023 Loading…
Reexport TLS options from cached-path
#92 by mweber15 was merged Oct 1, 2023 Loading…
Bump openssl from 0.10.48 to 0.10.55 in /main dependencies Pull requests that update a dependency file
#91 by dependabot bot was closed Sep 30, 2023 Loading…
Allow addition of tokens in vocab/tokenizer
#88 by guillaume-be was merged Apr 15, 2023 Loading…
Bump h2 from 0.3.15 to 0.3.17 in /main dependencies Pull requests that update a dependency file
#87 by dependabot bot was merged Apr 13, 2023 Loading…
Fix Clippy warnings
#86 by guillaume-be was merged Mar 25, 2023 Loading…
Bump openssl from 0.10.45 to 0.10.48 in /main dependencies Pull requests that update a dependency file
#85 by dependabot bot was merged Mar 25, 2023 Loading…
8.0.0 release
#84 by guillaume-be was merged Jan 29, 2023 Loading…
CI Fix
#83 by guillaume-be was merged Jan 28, 2023 Loading…
Bump bumpalo from 3.3.0 to 3.12.0 in /main dependencies Pull requests that update a dependency file
#82 by dependabot bot was closed Jan 28, 2023 Loading…
NLLB Tokenizer support.
#81 by npatsakula was merged Jan 29, 2023 Loading…
3 tasks done
Use AsRef<Path> instead of &str.
#80 by npatsakula was merged Oct 19, 2022 Loading…
2 tasks done
Special token map extension
#78 by guillaume-be was merged Sep 24, 2022 Loading…
4 of 5 tasks
Respect special_tokens_map.json.
#77 by yk-goblin was closed Oct 15, 2022 Loading…
DRAFT: NLLB tokenizer support.
#76 by npatsakula was closed Oct 19, 2022 Loading…
2 of 4 tasks
Bump smallvec from 1.4.0 to 1.8.0 in /main dependencies Pull requests that update a dependency file
#75 by dependabot bot was merged Jun 19, 2022 Loading…
Bump smallvec from 1.4.2 to 1.8.0 in /python-bindings dependencies Pull requests that update a dependency file
#74 by dependabot bot was merged Jun 19, 2022 Loading…
Bump futures-task from 0.3.5 to 0.3.21 in /main dependencies Pull requests that update a dependency file
#73 by dependabot bot was merged Jun 17, 2022 Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.