tinygrad/examples/mlperf
2025-06-21 10:44:47 -04:00
..
scripts UNet3D MLPerf (#3470) 2024-09-10 04:37:28 -04:00
training_submission_v4.0/tinycorp copy mlperf 4.0 to mlperf 4.1 (#5614) 2024-07-20 16:12:00 -04:00
training_submission_v4.1/tinycorp update mlperf systems and copy 4.1 to 5.0 (#7004) 2024-10-11 16:20:34 -04:00
training_submission_v5.0/tinycorp mlperf system updates (#10550) 2025-05-28 16:15:46 -04:00
training_submission_v5.1/tinycorp remove DEBUG=2 in mi300x bert setup (#10886) 2025-06-19 13:28:53 -04:00
dataloader.py rename lazydata to uop (#10698) 2025-06-08 08:42:22 -07:00
helpers.py move BoxCoder to mlperf helpers (#9773) 2025-04-07 20:27:06 -04:00
initializers.py RetinaNet MLPerf (#8385) 2025-04-12 22:11:51 -04:00
losses.py cleanups on losses and dataset tests (#9538) 2025-03-21 17:03:18 -04:00
lr_schedulers.py fp16 resnet (without expand backwards sum in float, doesn't work) (#3816) 2024-03-28 01:25:37 -04:00
metrics.py log_perplexity metrics (#10912) 2025-06-21 10:44:47 -04:00
model_eval.py remove Tensor.no_grad, it's meaningless now [pr] (#10556) 2025-05-28 22:20:02 -07:00
model_spec.py remove Tensor.no_grad, it's meaningless now [pr] (#10556) 2025-05-28 22:20:02 -07:00
model_train.py bert grad accumulation (#10863) 2025-06-18 12:17:07 -04:00
README start on mlperf models 2023-05-10 16:30:49 -07:00

Each model should be a clean single file.
They are imported from the top level `models` directory

It should be capable of loading weights from the reference imp.

We will focus on these 5 models:

# Resnet50-v1.5 (classic) -- 8.2 GOPS/input
# Retinanet
# 3D UNET (upconvs)
# RNNT
# BERT-large (transformer)

They are used in both the training and inference benchmark:
https://mlcommons.org/en/training-normal-21/
https://mlcommons.org/en/inference-edge-30/
And we will submit to both.

NOTE: we are Edge since we don't have ECC RAM