tinygrad/examples/mlperf
qazal 5bffa17f82
llama train: better NULL=1 EMULATE=AMD_CDNA4 dev experience (#14395)
* beam opens devices

* switch to hip renderer

* amd: true?

* llvm true is for test_autogen
2026-01-28 17:31:22 +09:00
..
scripts download data and ckpts for sd train/eval (#12170) 2025-09-15 00:31:45 -04:00
training_submission_v4.0/tinycorp copy mlperf 4.0 to mlperf 4.1 (#5614) 2024-07-20 16:12:00 -04:00
training_submission_v4.1/tinycorp update mlperf systems and copy 4.1 to 5.0 (#7004) 2024-10-11 16:20:34 -04:00
training_submission_v5.0/tinycorp Stable Diffusion mlperf training (#11304) 2025-10-05 07:56:05 -04:00
training_submission_v5.1/tinycorp remove FUSE_ARANGE_UINT (#11567) 2025-08-07 16:49:06 -04:00
training_submission_v6.0/tinycorp llama train: better NULL=1 EMULATE=AMD_CDNA4 dev experience (#14395) 2026-01-28 17:31:22 +09:00
dataloader.py add seed in bert data shuffle (#14054) 2026-01-07 10:02:05 -05:00
helpers.py train bert with fp8 (#13874) 2026-01-09 09:21:59 -05:00
initializers.py remove contiguous and use where in EmbeddingBert (#13632) 2025-12-09 15:49:21 -05:00
losses.py cleanups on losses and dataset tests (#9538) 2025-03-21 17:03:18 -04:00
lr_schedulers.py LR scheduler for Stable Diffusion mlperf training (#12201) 2025-09-30 21:21:08 -04:00
metrics.py log_perplexity metrics (#10912) 2025-06-21 10:44:47 -04:00
model_eval.py update llama dataloader (#13825) 2025-12-24 17:42:08 -05:00
model_spec.py remove Tensor.no_grad, it's meaningless now [pr] (#10556) 2025-05-28 22:20:02 -07:00
model_train.py llama3 gradacc (#14291) 2026-01-27 19:48:10 -08:00
README start on mlperf models 2023-05-10 16:30:49 -07:00

Each model should be a clean single file.
They are imported from the top level `models` directory

It should be capable of loading weights from the reference imp.

We will focus on these 5 models:

# Resnet50-v1.5 (classic) -- 8.2 GOPS/input
# Retinanet
# 3D UNET (upconvs)
# RNNT
# BERT-large (transformer)

They are used in both the training and inference benchmark:
https://mlcommons.org/en/training-normal-21/
https://mlcommons.org/en/inference-edge-30/
And we will submit to both.

NOTE: we are Edge since we don't have ECC RAM