14 commits

Author	SHA1	Message	Date
Sieds Lykles	cfa65bea05	Subtract 1 from Variable upper bound (#10715)	2025-06-09 09:25:53 -07:00
wozeparrot	1ed04f993b	move benchmark stat tracking to influxdb (#10185)	2025-05-15 16:14:56 -07:00
chenyu	e356807696	tinytqdm.set_description and tinytrange (#5101)	2024-06-22 14:45:06 -04:00
chenyu	dccefab23f	remove mixtral weight to clang first (#3792) ... seems fine without it now	2024-03-17 23:33:17 -04:00
George Hotz	3527c5a9d2	add Tensor.replace (#3738) ... * add Tensor.replace * fix dtypes in that test * should be replace * and mixtral	2024-03-14 13:34:14 -07:00
George Hotz	3415b0ee54	hotfix: mixtral copies norms together for 2% speed	2024-03-11 01:28:03 +00:00
chenyu	bad6adaf8c	add mixtral and 6 gpus cifar to tinybox ci (#3676) ... * add mixtral and 6 gpus cifar to tinybox ci * print total ram used at the end of loading	2024-03-10 18:25:31 -04:00
chenyu	c3c35f9142	flag to profile mixtral - 1.7 tok/s now (#3104)	2024-01-12 18:54:27 -05:00
George Hotz	f432ec9c33	Bitcast hip fix + fix mixtral (#3022) ... * fix bitcast in hip * wrong dtype for precast, double COPY	2024-01-05 14:51:25 -08:00
chenyu	f88506e630	move gpt2/llama sampling inside the model call (#3013) ... * move gpt2/llama sampling inside the model call * argmax uses one more kernel	2024-01-04 17:01:50 -05:00
Ivan Vnučec	8d206f6bfd	fix help message (#2705) ... llama -> mixtral	2023-12-10 22:04:35 -08:00
George Hotz	59ab3675a3	faster mixtral + green for new kernels (#2701) ... * green for new kernels * track ram	2023-12-10 19:04:58 -08:00
George Hotz	b01e3907a1	mixtral touch up: two lines	2023-12-10 17:21:49 -08:00
George Hotz	b3982187d1	Mixtral Example (#2691) ... * mixtral * simpler * global counters * simpler * weights arg	2023-12-10 17:18:31 -08:00