tinygrad/examples/mlperf
chenyu fcaed1e1dd
don't use empty in bert fake data (#13661)
somehow jit does not count empty as input
2025-12-12 15:59:50 -05:00
..
scripts download data and ckpts for sd train/eval (#12170) 2025-09-15 00:31:45 -04:00
training_submission_v4.0/tinycorp copy mlperf 4.0 to mlperf 4.1 (#5614) 2024-07-20 16:12:00 -04:00
training_submission_v4.1/tinycorp update mlperf systems and copy 4.1 to 5.0 (#7004) 2024-10-11 16:20:34 -04:00
training_submission_v5.0/tinycorp Stable Diffusion mlperf training (#11304) 2025-10-05 07:56:05 -04:00
training_submission_v5.1/tinycorp remove FUSE_ARANGE_UINT (#11567) 2025-08-07 16:49:06 -04:00
training_submission_v6.0/tinycorp more bert updates (#13597) 2025-12-06 08:32:43 -05:00
dataloader.py Training loop for Stable Diffusion mlperf (#12315) 2025-10-03 02:45:38 -04:00
helpers.py don't use empty in bert fake data (#13661) 2025-12-12 15:59:50 -05:00
initializers.py remove contiguous and use where in EmbeddingBert (#13632) 2025-12-09 15:49:21 -05:00
losses.py cleanups on losses and dataset tests (#9538) 2025-03-21 17:03:18 -04:00
lr_schedulers.py LR scheduler for Stable Diffusion mlperf training (#12201) 2025-09-30 21:21:08 -04:00
metrics.py log_perplexity metrics (#10912) 2025-06-21 10:44:47 -04:00
model_eval.py Eval for Stable Diffusion mlperf (#12316) 2025-10-02 02:35:38 -04:00
model_spec.py remove Tensor.no_grad, it's meaningless now [pr] (#10556) 2025-05-28 22:20:02 -07:00
model_train.py clean up bert next_data (#13650) 2025-12-11 22:56:28 -05:00
README start on mlperf models 2023-05-10 16:30:49 -07:00

Each model should be a clean single file.
They are imported from the top level `models` directory

It should be capable of loading weights from the reference imp.

We will focus on these 5 models:

# Resnet50-v1.5 (classic) -- 8.2 GOPS/input
# Retinanet
# 3D UNET (upconvs)
# RNNT
# BERT-large (transformer)

They are used in both the training and inference benchmark:
https://mlcommons.org/en/training-normal-21/
https://mlcommons.org/en/inference-edge-30/
And we will submit to both.

NOTE: we are Edge since we don't have ECC RAM