tinygrad/tinygrad/apps
George Hotz b9eb5b5d49
clean up the LLM tokenizer (#12653)
* clean up the LLM tokenizer

* simple tokenizer is actually simple

* ugh write good code
2025-10-14 14:22:01 +08:00
..
llm.py clean up the LLM tokenizer (#12653) 2025-10-14 14:22:01 +08:00