| Index | index by Group | index by Distribution | index by Vendor | index by creation date | index by Name | Mirrors | Help | Search |
| Name: python3-pytorch-tokenizers | Distribution: Fedora Project |
| Version: 1.4.1 | Vendor: Fedora Project |
| Release: 4.fc45 | Build date: Sun Oct 25 12:46:58 2026 |
| Group: Unspecified | Build host: buildvm-a64-45.rdu3.fedoraproject.org |
| Size: 1185292 | Source RPM: python-pytorch-tokenizers-1.4.1-4.fc45.src.rpm |
| Packager: Fedora Project | |
| Url: https://github.com/meta-pytorch/tokenizers | |
| Summary: C++ implementations for various tokenizers | |
C++ implementations for various tokenizers (sentencepiece, tiktoken etc). Useful for other PyTorch repos such as torchchat, ExecuTorch to build LLM runners using ExecuTorch stack or AOT Inductor stack.
BSD-3-Clause AND Apache-2.0 AND MIT
* Fri Oct 23 2026 Peter Robinson <pbrobinson@fedoraproject.org> - 1.4.1-4 - Updates and fixes for review * Fri Oct 09 2026 Peter Robinson <pbrobinson@fedoraproject.org> - 1.4.1-3 - Enable import checks, minor updates * Wed Sep 23 2026 Peter Robinson <pbrobinson@fedoraproject.org> - 1.4.1-2 - Run a full cmake build to get all binaries - Add various devel deps - Update for json deps * Wed Sep 23 2026 Peter Robinson <pbrobinson@fedoraproject.org> - 1.4.1-1 - Initial package
/usr/lib/.build-id /usr/lib/.build-id/81 /usr/lib/.build-id/81/acfc36872868feb6a67cfabb5bfc96cdd74893 /usr/lib64/python3.15/site-packages/pytorch_tokenizers /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info/INSTALLER /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info/METADATA /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info/WHEEL /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info/licenses /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info/licenses/LICENSE /usr/lib64/python3.15/site-packages/pytorch_tokenizers-1.4.1.dist-info/top_level.txt /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__init__.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__ /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/__init__.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/__init__.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/constants.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/constants.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/hf_tokenizer.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/hf_tokenizer.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/llama2c.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/llama2c.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/tiktoken.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/__pycache__/tiktoken.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/constants.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/hf_tokenizer.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/llama2c.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/pytorch_tokenizers_cpp.cpython-315-aarch64-linux-gnu.so /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tiktoken.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/__init__.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/__pycache__ /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/__pycache__/__init__.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/__pycache__/__init__.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/__init__.py /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/__pycache__ /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/__pycache__/__init__.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/__pycache__/__init__.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/__pycache__/convert.cpython-315.opt-1.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/__pycache__/convert.cpython-315.pyc /usr/lib64/python3.15/site-packages/pytorch_tokenizers/tools/llama2c/convert.py /usr/share/doc/python3-pytorch-tokenizers /usr/share/doc/python3-pytorch-tokenizers/README.md /usr/share/licenses/python3-pytorch-tokenizers /usr/share/licenses/python3-pytorch-tokenizers/LICENSE
Generated by rpm2html 1.8.1
Fabrice Bellet, Wed Oct 28 00:31:54 2026