27 commits

Author	SHA1	Message	Date
George Hotz	857d440ea7	fail means fail (#2391) ... * flip order * cleanup and comment out failing test	2023-11-24 08:27:39 -08:00
George Hotz	1f4231a8f9	global pipefail	2023-11-24 08:03:49 -08:00
George Hotz	095e2ced61	add name support to fetch (#2407) ... * add name support * use fetch in gpt2 * remove requests from main lib, networkx also optional * umm, keep that assert * updates to fetch * i love the walrus so much * stop bundling mnist with tinygrad * err, https * download cache names * add DOWNLOAD_CACHE_VERSION * need env. * ugh, wrong path * replace get_child	2023-11-23 14:16:17 -08:00
George Hotz	c60c3b467a	clean up symlinking in benchmark (#2219) ... * clean up symlinking * make torch deterministic	2023-11-05 16:46:05 -08:00
George Hotz	12dd165d38	add WINO/HALF/HIP to AMD benchmark	2023-10-25 13:22:45 -04:00
George Hotz	0e3e2bac13	amd wino: upload results	2023-09-09 13:57:14 -07:00
George Hotz	6f95c5f284	winograd speed test for AMD (#1826)	2023-09-09 13:56:33 -07:00
George Hotz	0f2bd10d00	add winograd CIFAR to mac tests (#1825) ... * add winograd CIFAR to mac tests * symlink already done	2023-09-09 13:45:24 -07:00
George Hotz	fb1cc6bf4b	llama jit is default, print tok/sec (#1774) ... * llama jit is default, print tok/sec * jit not default in CI	2023-09-05 10:12:16 -07:00
George Hotz	89cd380bfc	add nvidia CI (#1737) ... * add nvidia * speed(nvidia)	2023-09-01 22:02:30 -07:00
George Hotz	fdd7f282cb	Reenable tensor cores for self-hosted Mac CI (#1717) ... * debug 5 matmul * allow tensor cores in CI * tensor cores on arm64 * put debug back	2023-08-30 07:53:04 -07:00
wozeparrot	2f768e386d	stable diffusion benchmark artifact (#1714)	2023-08-29 21:08:40 -04:00
George Hotz	0ea22bf249	remove DEBUG=1 from stable diffusion AMD since jit cache is fixed	2023-08-29 12:46:12 -07:00
George Hotz	ab9b9ff3e2	pipefail benchmark (#1709) (#1710) ... * feat: specify shell * feat: specify shell for mac Co-authored-by: wozeparrot <wozeparrot@gmail.com>	2023-08-29 08:15:02 -07:00
George Hotz	aa7c98722b	sd timing (#1706)	2023-08-28 20:22:57 -07:00
George Hotz	ad7d26c393	fix __launch_bounds__ and benchmark TC MATMUL (#1575) ... * fix * benchmark matmul	2023-08-19 10:54:39 -07:00
George Hotz	e3c6c0c6db	add GPT2 example (#1511) (#1514) ... * add gpt2 to examples * some cleanup * fixes * argparse + scaled_dot_product_attention * add timing * add to benchmark Co-authored-by: YassineYousfi <yassine.y10@gmail.com>	2023-08-10 09:09:47 -07:00
wozeparrot	351684395c	dont run on fork (#1510)	2023-08-09 13:06:45 -04:00
wozeparrot	88e2e0c8a3	Revert "don't try to run benchmark on forks" (#1508)	2023-08-09 12:59:49 -04:00
wozeparrot	65b65b760b	don't try to run benchmark on forks (#1507)	2023-08-09 12:59:19 -04:00
George Hotz	5fdd248617	don't download cifar (#1472)	2023-08-06 21:38:59 -07:00
George Hotz	d78fb8f4ed	add stable diffusion and llama (#1471) ... * add stable diffusion and llama * pretty in CI * was CI not true * that * CI=true, wtf * pythonpath * debug=1 * oops, wrong place * uops test broken for wgpu * wgpu tests flaky	2023-08-06 21:31:51 -07:00
George Hotz	486a9dbfd9	speed v torch (#1464) ... * speed v torch * always print * change print * torch speed tee * all exposed	2023-08-06 09:32:33 -07:00
George Hotz	2ab282bfec	run on update_benchmark too (#1460) ... * run on update_benchmark too * amd inference test * name it better * add 10 CIFAR training steps	2023-08-06 08:58:37 -07:00
George Hotz	943b227cb1	only on push to master	2023-08-06 00:10:07 -07:00
George Hotz	2274e3e757	Fix benchmark (#1454) ... * do benchmarking * system * artifact * go * name artifact * only on push	2023-08-05 23:44:36 -07:00
George Hotz	bf21aec81f	do benchmarking (#1451) ... * do benchmarking * system * artifact * go * name artifact	2023-08-05 23:35:01 -07:00