tinygrad/examples/mlperf
2025-09-15 00:31:45 -04:00
..
scripts download data and ckpts for sd train/eval (#12170) 2025-09-15 00:31:45 -04:00
training_submission_v4.0/tinycorp copy mlperf 4.0 to mlperf 4.1 (#5614) 2024-07-20 16:12:00 -04:00
training_submission_v4.1/tinycorp update mlperf systems and copy 4.1 to 5.0 (#7004) 2024-10-11 16:20:34 -04:00
training_submission_v5.0/tinycorp mlperf system updates (#10550) 2025-05-28 16:15:46 -04:00
training_submission_v5.1/tinycorp remove FUSE_ARANGE_UINT (#11567) 2025-08-07 16:49:06 -04:00
dataloader.py feat: small llama3 training (#11829) 2025-08-31 13:41:47 -07:00
helpers.py ruff check whole examples/mlperf/ (#10979) 2025-06-25 12:57:48 -04:00
initializers.py ruff check whole examples/mlperf/ (#10979) 2025-06-25 12:57:48 -04:00
losses.py cleanups on losses and dataset tests (#9538) 2025-03-21 17:03:18 -04:00
lr_schedulers.py CosineAnnealingLRWithWarmup (#10981) 2025-06-25 17:45:21 -04:00
metrics.py log_perplexity metrics (#10912) 2025-06-21 10:44:47 -04:00
model_eval.py feat: small llama3 training (#11829) 2025-08-31 13:41:47 -07:00
model_spec.py remove Tensor.no_grad, it's meaningless now [pr] (#10556) 2025-05-28 22:20:02 -07:00
model_train.py assert benchmark times (#12042) 2025-09-09 23:40:02 +02:00
README start on mlperf models 2023-05-10 16:30:49 -07:00

Each model should be a clean single file.
They are imported from the top level `models` directory

It should be capable of loading weights from the reference imp.

We will focus on these 5 models:

# Resnet50-v1.5 (classic) -- 8.2 GOPS/input
# Retinanet
# 3D UNET (upconvs)
# RNNT
# BERT-large (transformer)

They are used in both the training and inference benchmark:
https://mlcommons.org/en/training-normal-21/
https://mlcommons.org/en/inference-edge-30/
And we will submit to both.

NOTE: we are Edge since we don't have ECC RAM