10 commits

Author	SHA1	Message	Date
imaolo	0d0c74bac9	Assert for memory allocation failures (#2337) ... * assert adequate memory has been freed * cleaned up runtime error message * improved metal buffer alloc error catching and reporting * decreased lines and altered messages * removed unnecessary _get_cur_free_space() call * improved assert message * added allocate massive buffer test * added test_lru_allocator_metal_max_buffer_length * split into two asserts and removed walrus assignment from assert expression * update assert message and use byte data type for clarity	2023-11-16 20:14:16 -08:00
vish-pr	6051f0ce82	For cuda get current free space from device, and retry alloc failures (#2197) ... * For cuda get current free space from device, and rery alloc failures * type ignore for mypy * add init to get free mem in cuda * Move retry logic in common lib. Fix typo in override _get_cur_free_space * linter error fix in test file * Not catch all, as it will catch KeyboardInterrupt * fix unintened line changes	2023-11-09 15:53:50 -08:00
George Hotz	2f7aab3d13	move optimize_local_size (#2221) ... * move optimize_local_size * interpret_ast	2023-11-05 21:00:52 -08:00
George Hotz	8ba7ced7f9	extract const if it's const (#2193) ... * extract const if it's const * fix if statement * fast math issue * fix graphing and casting * disable flaky copyout test	2023-10-31 18:52:35 -07:00
nimlgen	8c07c73a9b	Fix cl map buffer (#2190) ... * fix gpu enqueue_map_buffer out of space * add test	2023-10-31 12:02:46 -07:00
nimlgen	9450e41f70	no import when Python is shutting down (#1875)	2023-09-20 12:47:02 -04:00
Pavol Rusnak	52a92bf95d	use class Foo: instead of class Foo(): (#1797) ... * use class Foo: instead of class Foo(): * add ruff linter, copy settings from .flake8 to ruff.toml	2023-09-06 12:20:25 -07:00
nimlgen	355b02dc3f	allow zerosized tensors (#1659) ... * allow zerosized tensors * works with numpy	2023-08-30 10:39:24 -07:00
George Hotz	a6d842af7a	move device to ops (#1646) ... * move device to ops * mlops types * 2 lines	2023-08-23 08:30:17 -07:00
nimlgen	bd111411bf	init allocator for compiled backends (#1467) ... * init allocator for compiled backends * Update ops_webgpu.py --------- Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2023-08-17 10:33:32 -07:00