11,106 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Kirill	26a3888ab8	Fix llama 13B RAM usage (#710)	2023-03-18 13:50:09 -07:00
Kirill	0fe5014b1f	Use pathlib (#711) ... * Use pathlib in llama * Use pathlib in stablediffusion	2023-03-18 13:49:21 -07:00
Connor Henderson	5e8fdfa956	Update path for test_mnist in README (#706)	2023-03-15 18:42:17 -07:00
George Hotz	3a8af99adb	i understand ClassVar now	2023-03-15 09:00:25 -07:00
Kirill	0532025b04	Fix llama 13B weights loading (#700) ... * Fix llama 13B weights loading * refactor more * add test * test storage offset * fix spacing * fix strides * llama 13B working? * yolo? * better test for seeks	2023-03-15 08:59:52 -07:00
Pasan Perera	df48753692	fixed the import error for latest changes in master (#705)	2023-03-15 08:59:42 -07:00
Ayushman Kumar	e28bd11ff1	Cast Tensor data to float32 (#703) ... * Cast Tensor data to float32 * astype('float32') --> Tensor.randn()	2023-03-14 23:09:41 -07:00
Jacky Lee	5e820818e9	Cast image to float32 (#702)	2023-03-14 08:13:19 -07:00
George Hotz	54f499b623	Move rawbuffer (#697) ... * move GlobalCounters to helpers * that's not part of the public api * move InterpretedBuffer * remove fromCPU from devicebuffer	2023-03-13 22:30:36 -07:00
George Hotz	cbc5a7222a	symbolic is now a 6/10 due to the infinite loop. do better.	2023-03-13 00:07:59 -07:00
George Hotz	aca244194f	bufs not none	2023-03-12 23:57:41 -07:00
George Hotz	c594a0a835	fix flip bug, add new unit tests	2023-03-12 23:55:31 -07:00
George Hotz	a4abcf0969	improve test_example	2023-03-12 22:59:40 -07:00
George Hotz	5577634cf3	tests in pre commit	2023-03-12 22:42:26 -07:00
George Hotz	ce1564b05e	fix shapetracker test	2023-03-12 22:33:25 -07:00
George Hotz	153cce0f7e	tutorial	2023-03-12 22:31:46 -07:00
George Hotz	8d16ebaea7	we have docs:	2023-03-12 19:05:44 -07:00
George Hotz	b512edc9ff	no decorators for image methods. move out RawMallocBuffer. -7 lines	2023-03-12 16:28:45 -07:00
George Hotz	ed9ab6ff03	move image to nn/image.py	2023-03-12 16:21:42 -07:00
George Hotz	fe0e8a306f	jittable llama	2023-03-12 14:15:04 -07:00
George Hotz	dcac618515	stop wasting time with the compiler. tinygrad needs to just jit	2023-03-12 12:08:46 -07:00
George Hotz	46b49d50bd	llvm was using wrong shapetracker	2023-03-12 11:49:03 -07:00
George Hotz	fdde87afda	Revert "Revert "late simplify on st"" ... This reverts commit c8508e359d.	2023-03-12 11:47:44 -07:00
George Hotz	c8508e359d	Revert "late simplify on st" ... This reverts commit 606550474c.	2023-03-12 11:46:10 -07:00
George Hotz	606550474c	late simplify on st	2023-03-12 11:38:56 -07:00
George Hotz	de6f1695a3	only allow exact buffer name	2023-03-12 11:13:36 -07:00
George Hotz	15e0b56e39	compile works (#688) ... * compile works * runtimes * line count * fix custom, to tg dtype * meh, that's fine with lazy import	2023-03-12 11:01:25 -07:00
Kirill	af7745073f	Add comments to SD (#686) ... * Add explanation for empty lambdas * Fix my_unpickle if pytorch_lightning is installed * oops	2023-03-12 10:56:49 -07:00
George Hotz	58d3824cbe	better get_state_dict	2023-03-12 00:10:48 -08:00
George Hotz	046b3952c3	get_state_dict	2023-03-11 23:46:53 -08:00
George Hotz	6c3675c01c	_mmap loads to gpu fast	2023-03-11 23:00:13 -08:00
George Hotz	dc9a6b4bb7	fix float16 in CLANG on linux	2023-03-11 21:51:22 -08:00
George Hotz	803b0aef28	track memory for numpy/torch	2023-03-11 20:39:10 -08:00
George Hotz	37cf6fc4c0	err, external_test_opt.py broke...fusing will have to wait. correctness over speed	2023-03-11 17:54:47 -08:00
George Hotz	305b9f2d21	multistep optim tests passing	2023-03-11 17:49:53 -08:00
George Hotz	61071f881a	fix bug, and add unit test to catch failure	2023-03-11 16:57:25 -08:00
George Hotz	3ec457248c	failing llama test	2023-03-11 16:28:10 -08:00
George Hotz	8aa63847c7	llama: up max tokens to 1000	2023-03-11 13:39:33 -08:00
George Hotz	d30005b645	shapetracker touchups	2023-03-11 12:07:52 -08:00
George Hotz	d41ac5f5f1	touchups	2023-03-11 11:41:34 -08:00
Cyril Roumégous	3f08613a2a	apply flake8 E203 rule (#684)	2023-03-11 11:35:16 -08:00
Diogo	784afc6c6f	Eq magic function support (#683) ... * add eq magic func * changed from eq to __eq__ * ignore type for linter * mypy doenst like descriptions :(	2023-03-11 10:31:46 -08:00
George Hotz	5ea44cefcc	llama: add lexie personality	2023-03-11 10:23:33 -08:00
George Hotz	c908f911a7	llama defaults to metal on osx	2023-03-11 09:30:13 -08:00
George Hotz	fd65edf595	fix mem_estimate for dtype.itemsize	2023-03-11 09:20:05 -08:00
George Hotz	fe8c05b96f	allow disabling method cache	2023-03-11 08:57:49 -08:00
George Hotz	5e1380df6a	profiling llama + cache is_contiguous	2023-03-11 08:23:21 -08:00
George Hotz	01f39b19dc	move to shapetracker.py	2023-03-11 07:50:07 -08:00
George Hotz	f3ac52aee8	Mypyc (#680) ... * building shapetracker * default ENABLE_METHOD_CACHE * symbolic compiles * improve types * tensor compiles * oops, that's a bug * best of both worlds * find legit typing bugs * pad2d can take list or tuple * sub 200ms when compiled	2023-03-11 07:33:30 -08:00
George Hotz	22905dd657	speedups from llama branch	2023-03-10 22:01:32 -08:00