tinygrad/test/external/mlperf_bert/preprocessing
Elias Wahl 4a114756f6
New BERT dataloader (#5881)
* One file == One topic

* update test

* new dataloader

* update train script

* get index is faster
2024-08-02 15:12:23 -04:00
..
create_pretraining_data.py
external_test_preprocessing_part.py New BERT dataloader (#5881) 2024-08-02 15:12:23 -04:00
pick_eval_samples.py
tokenization.py