167 commits

Author	SHA1	Message	Date
George Hotz	2da02f1ae1	add loads at the end (#12988) ... * add loads at the end * simpler * late load * tests passing * fix matvec * spec test passes * fix where on load * fix abs2 * fix more tests	2025-10-30 10:42:19 +08:00
George Hotz	6b35467f53	stores don't end ranges (#12902) ... * early endrange * bugfixes	2025-10-24 23:05:03 +08:00
George Hotz	583553f467	split ranges (#12411) ... * split ranges * simpler * split ranges * range str * fix test * oops * faster * no group 2 * tests * dont_sub_ranges_for_image * revert that	2025-10-02 12:57:22 +08:00
George Hotz	b4eb876d5a	kernel.py no longer permutes reduce axis [pr] (#10968) ... * kernel.py no longer permutes reduce axis [pr] * delete tests that handcode uops * regen of sops is broken... * put import back * just remove that * disable those tests	2025-06-26 17:44:58 -07:00
George Hotz	cf60ccac6a	support new const lowering (#10967) ... * support new const lowering * delete invalid linearizer failure tests	2025-06-24 15:21:41 -07:00
Sieds Lykles	772cd02ad2	Perform index validation on load/store, not on the index (#10849) ... * move index validation to load/stores * add name * add linearizer_failure * add validate_store with implicit gates * linearizer_failure_58 is fixed! * add test_uop_graph test * rename cond to gate * test gated load/stores * use or_casted()	2025-06-23 16:25:05 -07:00
George Hotz	92678e59ee	move kernel to opt (#10899)	2025-06-20 15:22:28 -07:00
chenyu	b7198fdcfd	linearizer failure from wino fuse arange cifar (#10739)	2025-06-09 23:10:19 -04:00
George Hotz	81b9c04574	move high level stuff to unit tests [pr] (#10708) ... * move high level stuff to unit tests [pr] * process replay on unit tests * fix pr, less compute * set omp num threads * set 200MB buffer size limit * delete junk * fix tests * faster * move test_indexing to unit * faster	2025-06-08 14:05:56 -07:00
qazal	5b59728c75	refactor LOAD(DEFINE_GLOBAL, VIEW) in kernels to LOAD(VIEW(DEFINE_GLOBAL)) (#10541) ... * changes to core tinygrad * fixups pt1 TC=3 docs/abstractions2.py IMAGE=2 test_quantize_dsp test_schedule * more tests * green now * images stay images	2025-05-30 14:27:58 +03:00
qazal	7051bf3fd5	fixup hardcoded asts ptr dtype and constants [pr] (#10570) ... * fixup hardcoded asts ptr dtype and constants [pr] * use kernelize for test_kernel_count	2025-05-30 09:38:32 +03:00
George Hotz	e140f8f0d8	linearizer test_failure_61 (#10552) ... * enumerate cases of Tensors in the JIT * optional fused optimizers * add fused optimizer test * move that there * ugh * work on beautiful_cifar * speed close to hlb_cifar * test_failure_61 * just the failure	2025-05-28 21:30:50 -07:00
George Hotz	411392dfb7	move files into uop dir (#10399) ... * move files into uop dir [pr] * tinygrad.uop is a thing * fix uop docs, no pr * fix viz	2025-05-18 11:38:28 -07:00
Ignacio Sica	bda116d773	fix use_tensor_cores propagation (#10048) ... * propagate use_tensor_cores * add use_tensor_core to arg in test and search * bugfix * get TC val from ContextVar in search * revert minor space change * add tc emulation test to ci and benchmark * revert * revert whitespace change * remove test for ptx * add comment and remove llvm test run	2025-04-28 19:30:50 -03:00
George Hotz	ecff82a698	fixing single kernel softmax: resolve (#10086) ... * fixing single kernel softmax: resolve * add failing lin test	2025-04-28 13:46:20 -04:00
George Hotz	129bddde74	lin failure from SINGLE_KERNEL_SOFTMAX (#10073) ... * lin failure from SINGLE_KERNEL_SOFTMAX * fix lin issue * more pure diff	2025-04-27 13:02:10 -04:00
Sieds Lykles	e75be6eafc	[bounty] [pr] index validation with z3 (#9981) ... * index validation with z3 * Change comment * toposort -> toposort() --------- Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-04-24 08:06:08 -04:00
George Hotz	2ed3acd767	toposort is a function [pr] (#10004)	2025-04-23 16:25:03 +01:00
chenyu	f5256e0020	Kernel.apply_opts [pr] (#9917) ... * Kernel.apply_opts [pr] updated all `for opt in`. also updated a few test_liinearizer tests to not implcitly depend on hand_coded_optimization * not you yet	2025-04-17 08:00:56 -04:00
chenyu	fe998798fb	linearizer failure test for OUT OF BOUNDS ACCESS (#9738)	2025-04-04 03:48:43 -04:00
chenyu	2e7c2780a9	CLANG -> CPU (#9189)	2025-02-20 18:03:09 -05:00
chenyu	f53b819648	UOps. -> Ops. [pr] (#9044) ... updated the comments and doc except extra	2025-02-12 12:53:23 -05:00
George Hotz	e618efce22	COMMUTATIVE flipping is only for ints (#8996) ... * COMMUTATIVE flipping is only for ints [pr] * no pr * comm fixes this	2025-02-10 12:01:28 +08:00
Ignacio Sica	260df1a17f	tc_select noop (#8801) ... * tc_select noop * revert changes in test	2025-01-29 13:53:23 -05:00
qazal	ba17786068	do not construct unmasked VALID (#8759) ... * new lines that exist in codegen/ops * update tests * update sops.gz (13071 -> 13070 asts) * fix viz too * remove that TODO * diff pruning * mask assert + device * work * diff pruning * re: fix viz too --------- Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-28 20:51:21 +02:00
Ignacio Sica	b240f12593	[TIP-9] rename Opt's amt to arg 2 (#8770) ... * rename Opt amt to arg * ignore_beam_cache for test_tiny * move ignore_beam_cache to test_tiny * move to separate pr * revert space change --------- Co-authored-by: chenyu <chenyu@fastmail.com>	2025-01-27 14:19:04 -05:00
George Hotz	3ed146a5ff	Revert "rename Opt amt to arg (#8767)" (#8769) ... This reverts commit bf041659a5.	2025-01-27 23:46:37 +09:00
Ignacio Sica	bf041659a5	rename Opt amt to arg (#8767)	2025-01-27 23:36:47 +09:00
George Hotz	b4bf6a7dea	switch backward to use gradient [pr] (#8235) ... * switch backward to use gradient [pr] * set device correctly, dedup * why does that fail? * add noop cast * simple backward * fix beautiful_mnist * touchups * set in compute_gradient * uop_count * uop_count was wrong * collections * no note * skip that test * update sched kernel counts * train mnist is 65 * fix metadata and gc * fixes * materialize_grads * no pathlib stuff * add contiguous_backward, fix bugs * add some realize * fix multi	2025-01-26 09:12:16 +09:00
George Hotz	f17af70d17	replace all sparents with toposort (#7983)	2024-12-02 15:00:30 +08:00
ignaciosica	597a239e28	Remove UnaryOps, BinaryOps, TernaryOps, MetaOps [pr] (#7725) ... * remove unaryops * remove ternaryops * remove metaops * hotfix * remove binaryops * hotfix: test_pattern_matcher --------- Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>	2024-11-16 20:56:56 +08:00
qazal	0914c2fec9	add TestLinearizerFailures test_failure_56 and test_failure_57 (#7682) ... * add test_failure_56 and test_failure_57 * so it's only METAL=1	2024-11-14 12:00:33 +08:00
George Hotz	bbc64bf305	x|(x&y) -> x (#7629) ... * x|(x&y) -> x * fix tests	2024-11-11 10:00:18 +08:00
George Hotz	205befa788	move is_dtype_supported to device [pr] (#7575)	2024-11-07 20:38:03 +08:00
Carl Basho	630a7f37cf	update tests (#7554) ... Co-authored-by: John Doe <null@mail.com> Co-authored-by: chenyu <chenyu@fastmail.com>	2024-11-05 11:35:15 -05:00
George Hotz	c8bf09b7d4	s/UOps/Ops (#7500) ... * s/UOps/Ops [pr] * fix	2024-11-03 11:26:10 +08:00
George Hotz	4e2895f8d2	safe changes from new dtype branch [pr] (#7397) ... * safe changes from new dtype branch [pr] * only image test on GPU	2024-10-30 17:18:48 +08:00
George Hotz	2fdfcffe4c	improve ci speed [pr] (#7357)	2024-10-29 17:00:35 +08:00
chenyu	0a4d01f6d4	disable simplify_valid (#7312) ... fixed test_failure_55. will reenable it later after fixing the bug	2024-10-26 12:42:48 -04:00
nimlgen	3c62315aa8	add resnet pf (#7310) ... * add resnet pf * all platforms	2024-10-26 13:20:32 +03:00
chenyu	f511ad9103	No pyint again (#7156) ... * Revert "bring back pyint (#7150)" This reverts commit 37e83ca6fc. * remove truncate in const folding * truncate_output=False	2024-10-19 13:48:59 -04:00
nimlgen	54c6a317f8	test_failure_54 (#7155) ... * test_failure_54 * metal	2024-10-18 23:31:18 +03:00
chenyu	37e83ca6fc	bring back pyint (#7150) ... fixed test_failure_52 and resnet. need to understand this better	2024-10-18 14:54:37 -04:00
chenyu	12ff52b88b	test_failure_52 fails on real METAL (#7138)	2024-10-17 15:37:28 -04:00
chenyu	84e98900e8	test linearizer failure 53 (#7137) ... variable scope issue caused compile error	2024-10-17 15:23:43 -04:00
George Hotz	ded1b38b84	minor dtype cleanup [pr] (#7124) ... * minor dtype cleanup [pr] * use ptr() function	2024-10-17 17:41:23 +08:00
nimlgen	9f00eacde5	nv tagged memory + resnet failed kernel (#7061) ... * nv tagged memory * linter * metal fix?	2024-10-15 18:19:58 +03:00
chenyu	1a27417262	remove arbitrary multiplication case (#7033) ... adds the wrongly simplified kernel in test_linearizer_failures #7019	2024-10-13 15:06:05 -04:00
qazal	20d3c2d113	unify UOps.SHAPETRACKER and UOps.SWIZZLE with UOps.VIEW (#6955) ... * add UOps.VIEW * update hardcoded asts * update sops.gz	2024-10-09 02:00:17 +08:00
George Hotz	14ad47b515	rewrite to use uops if (#6764) ... * rewrite to use uops if * does this pass * careful penalty * fix tests * remove unused stuff * that's a cstyle rewrite * Update test_linearizer_dumb.py	2024-09-26 18:09:09 +08:00