explosion / spaCy

💫 Industrial-strength Natural Language Processing (NLP) in Python

stanfordnlp / stanza

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

liangpan99 / TokenHSI

[CVPR 2025 Oral] TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization

ziplab / ZipTok3D

ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes

michaelc-yu / cs336-llm-systems

Large language model systems implementation and optimization: Transformers, BPE tokenization, FlashAttention, Triton, distributed training, GPU profiling, and GRPO reasoning RL