tinygrad/examples/mlperf
chenyu d8d7ac1bb1
fix bert free_intermediates (#9633)
fix when only run eval `TRAIN=0 BERT_SIZE=tiny examples/mlperf/training_submission_v5.0/tinycorp/benchmarks/bert/implementations/tinybox_green/dev_beam.sh`
2025-03-30 22:42:52 -04:00
..
scripts UNet3D MLPerf (#3470) 2024-09-10 04:37:28 -04:00
training_submission_v4.0/tinycorp copy mlperf 4.0 to mlperf 4.1 (#5614) 2024-07-20 16:12:00 -04:00
training_submission_v4.1/tinycorp update mlperf systems and copy 4.1 to 5.0 (#7004) 2024-10-11 16:20:34 -04:00
training_submission_v5.0/tinycorp bert BEAM_UOPS_MAX 3000->4000 (#9603) 2025-03-27 11:58:47 -04:00
dataloader.py RetinaNet dataloader (#9442) 2025-03-21 13:36:41 -04:00
helpers.py RetinaNet dataloader (#9442) 2025-03-21 13:36:41 -04:00
initializers.py acc_dtype -> dtype (#9402) 2025-03-10 16:05:30 -04:00
losses.py cleanups on losses and dataset tests (#9538) 2025-03-21 17:03:18 -04:00
lr_schedulers.py fp16 resnet (without expand backwards sum in float, doesn't work) (#3816) 2024-03-28 01:25:37 -04:00
metrics.py [MLPerf][UNet3D] Add DICE loss + metrics (#4204) 2024-04-17 20:09:33 -04:00
model_eval.py [MLPerf] Prepare openimages dataset script (#6747) 2024-09-27 11:13:56 -04:00
model_spec.py move globalcounters to ops (#2960) 2024-01-01 14:21:02 -08:00
model_train.py fix bert free_intermediates (#9633) 2025-03-30 22:42:52 -04:00
README start on mlperf models 2023-05-10 16:30:49 -07:00

Each model should be a clean single file.
They are imported from the top level `models` directory

It should be capable of loading weights from the reference imp.

We will focus on these 5 models:

# Resnet50-v1.5 (classic) -- 8.2 GOPS/input
# Retinanet
# 3D UNET (upconvs)
# RNNT
# BERT-large (transformer)

They are used in both the training and inference benchmark:
https://mlcommons.org/en/training-normal-21/
https://mlcommons.org/en/inference-edge-30/
And we will submit to both.

NOTE: we are Edge since we don't have ECC RAM