4,667 commits

Author	SHA1	Message	Date
chenyu	48349efdc1	copy is already contiguous (#8886)	2025-02-04 17:53:33 -05:00
qazal	6a0da51ed0	truncate process replay logs [pr] (#8891) ... * truncate process replay logs [pr] * work * max_lines * bump to 1K	2025-02-04 20:26:48 +01:00
qazal	acf0baefee	process replay from tensor uops to kernel ast (#8883) ... * process replay from tensor uops to kernel ast * this dedups * switch back to string key	2025-02-04 18:09:20 +01:00
George Hotz	56fa5c1191	dsp simulator (#8869) ... * dsp simulator * progress * fix * close on test tiny * working * less waste * line savings * Device DSP compiler * mock DSP at the bottom * DSP tests * docker caching * test update * need load * skip that test for CI DSP * last touch * ugh	2025-02-04 09:45:04 +08:00
chenyu	836cf42c2e	fix rand_like for multi (#8880)	2025-02-03 19:00:14 -05:00
chenyu	746d899dbd	move multi axis to property (#8879) ... also updated tests so that axis is known prior to realize	2025-02-03 16:02:09 -05:00
chenyu	cce26009f0	simplify pow to not call cos (#8877) ... use %2 instead of cos to detect even numbers	2025-02-03 12:54:18 -05:00
George Hotz	af2c2837f6	hotfix: skip broken test, add KERNEL Op	2025-02-03 14:02:55 +08:00
qazal	83a904aaad	just schedule in test_recursive_pad [pr] (#8860)	2025-02-02 15:01:24 +02:00
FICTURE7	66306b5321	Fix disk tensor assignment (#8855) ... * Add test for disk tensor assignment failure * Fix disk tensor assignment --------- Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>	2025-02-02 13:50:34 +02:00
Ali Ladjevardi	6e523e4d17	Remove size arg from DEFINE_LOCAL [pr] (#8845) ... * remove size arg form DEFINE_LOCAL * make mypy happy * whitespace * dont change code in extra * revert to temp1 to pass pr	2025-02-02 19:47:32 +08:00
nimlgen	7841852870	hcq pci signal fuzzer (#8854) ... * hcq pci signal fuzzer * kk * correct	2025-02-01 23:42:27 +03:00
qazal	dc34a4146f	better process_replay context print [pr] (#8856) ... * better process_replay context print [pr] * test: revert push cast * Revert "test: revert push cast" This reverts commit 38a2aef6f8.	2025-02-01 21:50:23 +02:00
chenyu	5b1fc4dcb2	push cast to branches in UOp where (#8850)	2025-02-01 13:55:24 -05:00
chenyu	73ee2d74c0	raise RuntimeError for int base pow (#8852) ... current implementation is not precise and blocking other simplification change	2025-02-01 12:11:57 -05:00
qazal	72e1f41f8e	add unbind_vars pattern matcher (#8851) ... * add unbind_vars pattern matcher [pr] * this can be cvar * this is empty	2025-02-01 18:25:44 +02:00
George Hotz	431a86615d	fix multi Ops.CONTIGUOUS_BACKWARD [pr] (#8843)	2025-02-01 09:21:31 +08:00
Ahmed Harmouche	07d3676019	weights_only=False (#8839)	2025-01-31 17:16:47 -05:00
chenyu	1f730ae8f8	remove retain_graph in Tensor.backward [pr] (#8835) ... not used. gradient accumulation works directly	2025-01-31 13:41:26 -05:00
chenyu	0a59db936a	raise RuntimeError in schedule_step if not Tensor.training [pr] (#8834)	2025-01-31 12:03:04 -05:00
qazal	af4f9d1aa9	use matchers to verify AST shape [pr] (#8828) ... * use matchers to verify kernel AST [pr] * work * use swizzle_cnt * add comment * imports * modified_ast comment * brief	2025-01-31 09:17:42 +02:00
George Hotz	643c09a6c6	tensor uop spec should be in spec.py [pr] (#8827) ... * tensor uop spec should be in spec.py [pr] * err, spec.py * print uops can stay	2025-01-31 13:54:04 +08:00
qazal	a78f0f85d3	remove support for checking tensor uops in FUSE_ARANGE [pr] (#8829)	2025-01-31 07:48:28 +02:00
qazal	1fce864a6d	delete multi output support (#8822) ... * delete multioutput for now * test_schedule * test_assign too * linter * 515 for sd * update tests and ctx * update that assign check	2025-01-30 22:45:50 -05:00
Ankit Avinash	7647cd8428	[bounty] Stride is flip (#8792) ... * replace stride with flip * Complete replacing stride with flip clean flip function in view.py fix tests * fix tests for multi shapetracker * fix tests for fuzz shapetracker * fix tests for fuzz shapetracker * debug * debug * fix * fix * fix --------- Co-authored-by: George Hotz <geohot@gmail.com> Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-31 11:34:10 +09:00
chenyu	0513b0c17d	lower green test_gemm_8192 tflops to 125 [pr] (#8820) ... flaky	2025-01-30 17:30:08 -05:00
Ignacio Sica	f0924e0857	fix and test (#8814) ... Co-authored-by: chenyu <chenyu@fastmail.com>	2025-01-30 16:35:53 -05:00
qazal	530961f7d5	realized only exists on base (#8815) ... * realized only exists on base [pr] * shorter * update that too	2025-01-30 23:02:25 +02:00
Sieds Lykles	7cdc607544	add max as associative (#8816)	2025-01-30 16:01:42 -05:00
qazal	5643429c17	give BUFFER UOp a ShapeTracker [pr] (#8811) ... * give BUFFER UOp a ShapeTracker [pr] * move that * update contiguous * test_advancedindex should use movement ops	2025-01-30 22:33:32 +02:00
chenyu	5527f86a8f	skip tests in test_indexing that set stride with lazydata.view [pr] (#8813)	2025-01-30 15:17:35 -05:00
nimlgen	a2faa5e49b	am: fix pt free (#8810)	2025-01-30 15:14:55 +03:00
Sieds Lykles	78c0455c7a	Better stable sigmoid (#8806) ... Uses `1/(x*x) -> 1/x * 1/x` together with `x/(1+x) -> 1-1/(1+x)` to rewrite sigmoid instead of `x/((x+1)(x+1)) -> 1/(x+1)*(1-1/(x+1))` Co-authored-by: chenyu <chenyu@fastmail.com>	2025-01-29 16:08:53 -05:00
Ignacio Sica	260df1a17f	tc_select noop (#8801) ... * tc_select noop * revert changes in test	2025-01-29 13:53:23 -05:00
qazal	ba17786068	do not construct unmasked VALID (#8759) ... * new lines that exist in codegen/ops * update tests * update sops.gz (13071 -> 13070 asts) * fix viz too * remove that TODO * diff pruning * mask assert + device * work * diff pruning * re: fix viz too --------- Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-28 20:51:21 +02:00
qazal	3417bc1814	fix ShapeTracker spec for const [pr] (#8791)	2025-01-28 19:53:36 +02:00
qazal	e8be8a5835	support lowering CONST(VIEW) in lowerer (#8785)	2025-01-28 12:04:41 +02:00
George Hotz	80089536e5	Revert "move llvm_bf16_cast to renderer for CLANG and LLVM [pr] (#8720)" (#8786) ... This reverts commit af0452f116.	2025-01-28 18:59:02 +09:00
mesozoic-egg	af0452f116	move llvm_bf16_cast to renderer for CLANG and LLVM [pr] (#8720) ... * handle bf16 via bitcasting for CLANG and LLVM * On LLVM, skip float16 cast * float32 on llvm lite, float32 elsewhere * code format * trigger pr * move to rewriter --------- Co-authored-by: Mesozoic Egg <mesozoic.egg@proton.mail> Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-28 18:16:43 +09:00
qazal	aefbc2637f	test fixups from unmasked valid deletion [pr] (#8776)	2025-01-28 09:23:30 +02:00
qazal	ed672881b0	remove additions/deletion in pr + check uops are equal [pr] (#8779) ... * use warnings there [pr] * remove those + move assert_diff [pr] * warn after log * remove * back	2025-01-28 08:57:34 +02:00
George Hotz	62655e4999	move multi into engine [pr] (#8778) ... * move multi into engine [pr] * all runtime is one sz	2025-01-28 09:15:29 +09:00
Ignacio Sica	b240f12593	[TIP-9] rename Opt's amt to arg 2 (#8770) ... * rename Opt amt to arg * ignore_beam_cache for test_tiny * move ignore_beam_cache to test_tiny * move to separate pr * revert space change --------- Co-authored-by: chenyu <chenyu@fastmail.com>	2025-01-27 14:19:04 -05:00
Ignacio Sica	ed1b573868	ignore beam cache in test_tiny for stateless beam (#8771)	2025-01-27 12:56:30 -05:00
George Hotz	3ed146a5ff	Revert "rename Opt amt to arg (#8767)" (#8769) ... This reverts commit bf041659a5.	2025-01-27 23:46:37 +09:00
Ignacio Sica	bf041659a5	rename Opt amt to arg (#8767)	2025-01-27 23:36:47 +09:00
George Hotz	96bff0b4f7	contiguous is no longer needed in SGD [pr] (#8760) ... * contiguous is no longer needed in SGD [pr] * add allow condition	2025-01-27 15:19:11 +09:00
George Hotz	a9d9f98d05	hotfix: those tests fail locally on mac due to buffer count	2025-01-27 07:53:48 +09:00
qazal	ac70f63d4b	tensor_map cleanups [pr] (#8754) ... * tensor_map cleanups [pr] * update test_schedule too	2025-01-26 11:41:54 +02:00
George Hotz	b53fe7c2fc	remove unused ctx [pr] (#8751) ... * remove unused ctx [pr] * fix test	2025-01-26 17:59:15 +09:00