581 commits

Author	SHA1	Message	Date
qazal	498a2bf738	add err handling tests to viz + cleanups (#9825) ... * cleanup * add err handling tests to viz + cleanups * lint	2025-04-10 14:05:05 +08:00
qazal	3bd992dc95	multi stage graph_rewrite_map (#9803) ... * multistage graph_rewrite_map * s/merge_map/input_map * build up kernel_map from the tensor_map	2025-04-09 15:59:45 +08:00
Eitan Turok	bb7922b95f	Vectorize Transcendental Regression Tests (#9753) ... * init test * cleanup	2025-04-08 01:27:39 +08:00
chenyu	407ca54382	symbolic fold double where (#9436) ... * symbolic fold double where a.where(b.where(c, d), d) -> (a & b).where(c, d). a pattern in optimizer * test case	2025-04-05 05:12:17 -04:00
Sieds Lykles	9c2fc695b5	cond.logical_not().where(a,b) -> cond.where(b,a) (#9741) ... * Add rule for negation in where, simplifies arange patterns * 0 becomes 0.0 again * Only if cond is bool * ne is never None * Add a test --------- Co-authored-by: chenyu <chenyu@fastmail.com>	2025-04-04 19:13:32 -04:00
George Hotz	8b5a523743	fix minimum length in pattern matcher (#9736)	2025-04-04 14:57:01 +08:00
George Hotz	cac8bcf8b5	use Ops.REDUCE (#9721) ... * decrease bert python time [pr] * order copies * Revert "order copies" This reverts commit 3f62c8693b. * rewrite count * Ops.REDUCE * acc first in the add chain * Fix tensor core acc * arange patterns look good * fix multireduce gate * reduce rewrite rule * bump that to 15 minutes * multiwmma isn't fusing * gep through wmma is gep pushing * bump that timeout too, it's all env setup * add failing test	2025-04-04 10:14:34 +08:00
chenyu	c20f112e9f	example test use z3 to verify valid simplification (#9684)	2025-04-02 01:05:52 -04:00
chenyu	c672716b38	improve vmin/vmax for IDIV (#9678)	2025-04-01 23:16:01 -04:00
chenyu	8dd88ad476	don't div_and_mod_folding for negative numerator with remainder (#9674) ... can be wrong in C div since it truncates towards zero	2025-04-01 16:26:23 -04:00
chenyu	0e34f9082e	helper functions for cstyle div mod [pr] (#9673)	2025-04-01 08:06:56 -04:00
chenyu	5358b0904b	update uop_given_valid if a node becomes const (#9604) ... * update uop_given_valid if a node becomes const * cleanup	2025-03-27 14:57:46 -04:00
qazal	bf94924d5a	fix viz with nested graph_rewrite (#9595)	2025-03-27 13:14:28 +08:00
qazal	e5ff7b23d7	refactor to @track_matches + add failing test_nested_rewrite (#9592) ... * test_nested_rewrite * refactor to track_matches * positional arg	2025-03-27 11:11:56 +08:00
George Hotz	3c5161b4cb	add validation of the bounds of Ops.INDEX (#9503) ... * add validation of the bounds of Ops.INDEX * do mask properly * more validation * correct * fix gated * add CAST support to vmin/vmax * fix ptx and image * ptx no diff * upat.index also stays --------- Co-authored-by: qazal <qazal.software@gmail.com>	2025-03-20 12:15:55 +08:00
qazal	0b20f91ce7	remove move_mask from the devectorizer (#9511) ... * remove move_mask from the devectorizer * add (wrong) ptx * reason * enable index addition in PTX, we won't have the INDEX anyways * space	2025-03-20 11:53:12 +08:00
chenyu	189f62d44f	add rounding to tqdm unit scale (#9507) ... fixed `AssertionError: ' 1.00/10.0 1000it/s]' != ' 1.00/10.0 1.00kit/s]'`	2025-03-19 12:08:46 -04:00
hooved	136cf7b8b1	hotfix: load >2 GiB from disk on macOS (#9361) ... * enable loading >2 GiB buffer from disk on macOS * handle None case raised by mypy * add test * revert fix to repro bug in CI * tell CI to run a unit test for macOS * reapply fix	2025-03-07 14:51:58 +08:00
George Hotz	2cc4cb74f0	reorder binops (#9328) ... * reorder binops * test improvements + fix string tests * ugh, okay this	2025-03-03 14:58:18 +08:00
qazal	e162aa862d	is_realized only if buffer is allocated (#9253) ... * is_realized only if the buffer is allocated * fix the image check too * assert test_lil_model after ExecItems run	2025-02-26 08:58:08 +01:00
Sieds Lykles	9c4d9d9f10	Acc first (#9232) ... * put acc in front of the add chain * handle the other case * Make loop collapse more generic * Remove mulacc_unrolled * Actually remove it --------- Co-authored-by: George Hotz <geohot@gmail.com> Co-authored-by: chenyu <chenyu@fastmail.com>	2025-02-25 22:10:15 -05:00
chenyu	90c3ed17c5	move cast to before softmax in attention (#9213) ... * move cast to before softmax in attention saved some memory because exp (which is used for backward) are done in half. training bert seems fine and can fit BS=78 now (from 66) * test	2025-02-24 17:24:59 -05:00
qazal	14aa2395d0	allow VIEW(BUFFER) in Tensor UOps [pr] (#9210) ... * allow VIEW(BUFFER) in Tensor UOps [pr] * still reshapes * update becomes_map tests * bring copy folder to the scheduler * lint * only sgd left * optimizer assign * 13 kernels * rename to test_reorder_expand + assert VIEW	2025-02-24 13:06:15 +01:00
qazal	d12efc95d4	support custom name function in viz [pr] (#9219) ... * support custom name function in viz [pr] * title case * assert name count in test_track_rewrites_name_fxn	2025-02-24 03:03:25 +02:00
chenyu	2e7c2780a9	CLANG -> CPU (#9189)	2025-02-20 18:03:09 -05:00
chenyu	3e22747799	run unit test on windows ci (#9187) ... * factor out testing_minimal in setup.py [pr] * testing_unit + windows	2025-02-20 14:40:41 -05:00
chenyu	287de4ecc6	use torch in test_gradient (#9186) ... used torch.autograd.grad, but not sure if it can be a template like jax	2025-02-20 12:26:11 -05:00
George Hotz	df3b320f46	rewriter -> devectorizer [pr] (#9147)	2025-02-18 12:42:08 +08:00
Ali Ladjevardi	35e9c4657b	Use proper units when printing beam time (#9103) ... * use proper units when printing beam time * refactor DEBUG=2	2025-02-17 23:41:38 +08:00
George Hotz	4dd10d03b7	move is_increasing to ops [pr] (#9134)	2025-02-17 19:27:48 +08:00
George Hotz	1bf66d62cf	symbolic gets its own file [pr] (#9132)	2025-02-17 18:55:21 +08:00
quortus	638d925e4e	Prevent const folding in test_payne_hanek_reduction (#9088) ... * Prevent const folding in test_payne_hanek_reduction * Do not use list as a default parameter	2025-02-17 17:31:10 +08:00
qazal	2d04a75a40	start tracking bottom_up_rewrite in viz [pr] (#9071) ... * start tracking bottom_up_rewrite in viz [pr] * use the tracking matcher in test_viz	2025-02-14 00:28:10 +01:00
gg	19ae829bd1	test float uop in sym_infer (#7456) ... * float uop in sym_infer * break line :( * rerun mypy * update GlobalCounters types * revert type change and cast assignments to mem and ops * cast inferred value to UOp in reshape * cast hcq, update view reshape to handle inferred float * rm extra space * update error * no type updates	2025-02-13 12:55:28 +08:00
qazal	fd9f9ec772	realized base tensors become RESHAPE(BUFFER) [pr] (#8994)	2025-02-10 10:17:54 +01:00
qazal	7eba5fb413	Tensor.empty is RESHAPE(BUFFER) (#8987) ... * empty is RESHAPE(BUFFER) * eh * add test_empty_buf * can we unsupport this * linter * Revert "can we unsupport this" This reverts commit 0f71e1aadb.	2025-02-09 18:42:51 +01:00
uuuvn	09ec33a578	Better errors when relocating against undefined symbol (#8902)	2025-02-06 10:13:44 +08:00
George Hotz	af2c2837f6	hotfix: skip broken test, add KERNEL Op	2025-02-03 14:02:55 +08:00
chenyu	5b1fc4dcb2	push cast to branches in UOp where (#8850)	2025-02-01 13:55:24 -05:00
Ahmed Harmouche	07d3676019	weights_only=False (#8839)	2025-01-31 17:16:47 -05:00
qazal	af4f9d1aa9	use matchers to verify AST shape [pr] (#8828) ... * use matchers to verify kernel AST [pr] * work * use swizzle_cnt * add comment * imports * modified_ast comment * brief	2025-01-31 09:17:42 +02:00
Ankit Avinash	7647cd8428	[bounty] Stride is flip (#8792) ... * replace stride with flip * Complete replacing stride with flip clean flip function in view.py fix tests * fix tests for multi shapetracker * fix tests for fuzz shapetracker * fix tests for fuzz shapetracker * debug * debug * fix * fix * fix --------- Co-authored-by: George Hotz <geohot@gmail.com> Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-31 11:34:10 +09:00
Sieds Lykles	7cdc607544	add max as associative (#8816)	2025-01-30 16:01:42 -05:00
qazal	5643429c17	give BUFFER UOp a ShapeTracker [pr] (#8811) ... * give BUFFER UOp a ShapeTracker [pr] * move that * update contiguous * test_advancedindex should use movement ops	2025-01-30 22:33:32 +02:00
qazal	ba17786068	do not construct unmasked VALID (#8759) ... * new lines that exist in codegen/ops * update tests * update sops.gz (13071 -> 13070 asts) * fix viz too * remove that TODO * diff pruning * mask assert + device * work * diff pruning * re: fix viz too --------- Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-28 20:51:21 +02:00
qazal	e8be8a5835	support lowering CONST(VIEW) in lowerer (#8785)	2025-01-28 12:04:41 +02:00
George Hotz	80089536e5	Revert "move llvm_bf16_cast to renderer for CLANG and LLVM [pr] (#8720)" (#8786) ... This reverts commit af0452f116.	2025-01-28 18:59:02 +09:00
mesozoic-egg	af0452f116	move llvm_bf16_cast to renderer for CLANG and LLVM [pr] (#8720) ... * handle bf16 via bitcasting for CLANG and LLVM * On LLVM, skip float16 cast * float32 on llvm lite, float32 elsewhere * code format * trigger pr * move to rewriter --------- Co-authored-by: Mesozoic Egg <mesozoic.egg@proton.mail> Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-28 18:16:43 +09:00
qazal	aefbc2637f	test fixups from unmasked valid deletion [pr] (#8776)	2025-01-28 09:23:30 +02:00
George Hotz	b4bf6a7dea	switch backward to use gradient [pr] (#8235) ... * switch backward to use gradient [pr] * set device correctly, dedup * why does that fail? * add noop cast * simple backward * fix beautiful_mnist * touchups * set in compute_gradient * uop_count * uop_count was wrong * collections * no note * skip that test * update sched kernel counts * train mnist is 65 * fix metadata and gc * fixes * materialize_grads * no pathlib stuff * add contiguous_backward, fix bugs * add some realize * fix multi	2025-01-26 09:12:16 +09:00