95 commits

Author	SHA1	Message	Date
George Hotz	d1cce7a476	put the ranges on store instead of after (#15759) ... * put the ranges on store instead of after * better assert * fix stuff * comment out slow rules i don't understand * simpler rule * closer * return false for store * fix loop * only a few schedule failures remain * remove stores to self * all tests pass locally * remove junk * regression test and fix * better test, bump broken torch count * bugfix with regression test * new fusion is better	2026-04-16 19:06:40 +08:00
chenyu	1483f7e71c	support shift by Tensor (#15623) ... * support shift by Tensor * use mixin	2026-04-06 15:14:57 -04:00
chenyu	6e30a5f5ea	update shifts in torch backend (#15622)	2026-04-06 14:08:33 -04:00
wozeparrot	b45edeb965	fix: rand supports large tensors (#15329)	2026-03-17 15:45:41 -07:00
chenyu	842c978df3	remove staticmethod dtypes.max/min (#15227) ... always use x.dtype.max/min	2026-03-11 23:11:24 -04:00
Roelof van Dijk	d65923bda5	tensor.py: add normalize function (#15159) ... * tensor.py: add normalize function * p==0 should match torch	2026-03-05 18:55:53 +08:00
chenyu	71f228f80f	test exact kernel count in torch_backend/test_kernel_fusion (#15091)	2026-03-02 14:26:32 -05:00
George Hotz	8ef5544e4a	realized PYTHON copies (#14934) ... * realized PYTHON copies * comment that out * fix that test * append afters * contig * disk copies * should be 124 * 332	2026-02-21 20:29:31 +08:00
George Hotz	55d3a5def9	preallocate all realized buffers (#14823) ... * preallocate all realized buffers * contiguous * work * comment that out * move to schedule * better * correct fix * just buffer * disk bufs * fixes disk tensor stuff * fix symbolic stuff * fix multi * 162 failures * bugfixes * don't check that anymore * fix schedule tests * mnist should be contiguious * type and buffer * fix tests * shrink axis correction * mypy fixes * tests skips * same 37 failures * dedup * no shrink in the graph * 29 failures * skips * fix custom kernel * fix training * those optimizations aren't supported currently * simpler * more correct * tests * 14 failures * works * fix that test * broken * 11 failures * only kernel counts left * fixes * all tests pass * remove tensor_map * op test * 200 -> 230 * test fixes * fixes * revert test_tiny thing * guard * revert that * test tiny passes * no contigs there * base realize back * Revert "no contigs there" This reverts commit c45bb9fcfd. * revert that * chop many assigns * 12 failures * fix tests * tests * apply after * pre-commit * remove old code * delete that * fix types * remove extra contig * fix dataloader * torch fix * disk fix * update kernel fusion numbres * runs on amd * restore kernel count * add that rule back * that * disable that * wrong * add the correct rule for that folding * more tests * guard c1.arg * no newlines * realize those * split into a different file * remove detach/contig back * skip 2 * update that	2026-02-20 20:05:54 +08:00
chenyu	9052db678f	remove allow_shape_mismatch in Tensor.replace (#14536) ... move all logic to torch_backend and not hacking Tensor method	2026-02-04 12:38:18 -05:00
chenyu	67f91e897b	UOp.is_contiguous -> UOp.has_buffer_identity [pr] (#14530) ... one more confusing buffer related method, but it's definitely not is_contiguous	2026-02-04 09:21:26 -05:00
chenyu	e3601788fa	update torch backend function (#14333) ... those have tensor.py implementation	2026-01-25 16:39:34 -05:00
chenyu	986e865830	fix TINY_BACKEND=1 cumsum (#14138) ... * fix TINY_BACKEND=1 cumsum old hack was wrong, need to apply contiguous on the input * test time * test_linalg_svd is slow	2026-01-14 09:54:49 -05:00
chenyu	fe00682502	clean up svd tests (#14133) ... removed from test_ops and added to TestTorchBackend	2026-01-13 16:32:21 -05:00
chenyu	e610821c52	Tensor.cummin and Tensor.nonzero (#14131)	2026-01-13 15:09:56 -05:00
chenyu	176a934ddd	Tensor.diagonal support offset and dims (#14130)	2026-01-13 14:49:06 -05:00
chenyu	2a217ba206	tinybackend isin and log10 (#14120) ... can use tinygrad directly	2026-01-13 14:14:09 -05:00
chenyu	05fcb57696	also return index in Tensor.cummax (#14117) ... * also return index in Tensor.cummax * fix	2026-01-12 22:42:10 -05:00
Roelof van Dijk	1058748440	torch backend: no aten.detach for torch 2.10 compat (#13381) ... * this works, less cpp? * simpler = better * keep torch 2.9 working as well	2025-11-20 09:12:15 -08:00
Roelof van Dijk	0dc2ff431d	fix: revive torch backend (#13280) ... * fix: revive torch backend * as_strided view vs copy * Revert "as_strided view vs copy" This reverts commit 82a61223f2. * add extra tests (move inplace, add fusion tests) * better fusion with inplace_op * no optimizer hooks (break mnist training fusion) * split off fusion tests in separate file, assert on resnet fusion fix: remove comments * cleanup, reduce diff * reduce diff * better fusion and identity checks --------- Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-11-19 15:26:50 -08:00
Daniel	d65bd669f8	update tiny torch backend hook (#12575) ... * update the backend to fix torch deprecation warning * use param_hook to avoid full backward hook needlessly firing on inputs which do not require gradients * fix indentation --------- Co-authored-by: chenyu <chenyu@fastmail.com>	2025-10-15 14:02:33 -04:00
George Hotz	fb61f3519f	remove assign contiguous hack (#12659) ... * remove assign contiguous hack * remove bad contiguous usage in torch backend * assign	2025-10-14 16:42:14 +08:00
chenyu	e701106a64	remove FUSE_ARANGE (#12511) ... it was the default already	2025-10-08 04:54:07 -04:00
George Hotz	0f25b4b289	move frontend dir to nn [pr] (#12470)	2025-10-07 10:42:22 +08:00
chenyu	12a910f1d2	update torch 2.8 (#12172) ... support _reshape_alias. something is wrong with one case of unfold	2025-09-14 15:19:03 -04:00
chenyu	fb8ee02424	Tensor.logaddexp (#11793)	2025-08-23 09:15:00 -04:00
Joshua Kissoon	c44760c89d	torch backend: fix arange, add linalg.cross, add tests (#11628)	2025-08-11 23:34:41 -04:00
kevvz	c3cfcb50cb	Add linalg_det and test for torch backend (#11405) ... * add linalg_det and test * space --------- Co-authored-by: chenyu <chenyu@fastmail.com>	2025-07-30 22:04:44 -04:00
वेदांत	e368628736	Add amin support to Tensor operations in Torch backend (#11290) ... * intiger div mod fix * Revert "intiger div mod fix" This reverts commit d5d2f201bf. * feat arg_min support * tets update * test fix	2025-07-21 09:14:08 -04:00
kevvz	b7af9cf849	clean svd tests, set full_matrices false in torch backend (#11113) ... * clean tests, set full_matrices false * add more shape asserts	2025-07-06 13:55:49 -04:00
chenyu	ba88ec3ad0	pipe linalg svd to torch (#11109) ... and found a bug in svd	2025-07-06 08:37:25 -04:00
chenyu	49bba2f0a0	improve test_nll_loss (#10986) ... build target and weight tensors outside so it tests backward too.	2025-06-26 02:46:55 -04:00
chenyu	ffb032e31d	test_diagonal touchup (#10962)	2025-06-24 15:51:19 -04:00
Utkarsh Gill	7f9958b632	Fix torch.linalg.diagonal crash due to invalid shrink in to_movement_ops (#10945) ... * fix as_strided shrink bug breaking torch.linalg.diagonal on tinygrad backend * cleanup * generic fix * tests * cmp with diagonal too * oops * move tests * fix test * remove unnecessary import * fix assert * compare against numpy --------- Co-authored-by: Utkarsh Gill <engelbart@Utkarshs-MacBook-Pro.local>	2025-06-24 15:36:06 -04:00
chenyu	18e264a449	Tensor.logsigmoid (#10955)	2025-06-24 11:16:14 -04:00
George Hotz	32e9949052	rename lazydata to uop (#10698)	2025-06-08 08:42:22 -07:00
Xingyu	7a1bfb668d	Implement linalg_eigh function for tensor eigenvalue decomposition in torch backend (#10612) ... * Implement private _linalg_eigh function for tensor eigenvalue decomposition in torch backend * Add unit test for linalg.eigh function in TestTorchBackend This test verifies the eigenvalue decomposition of a 2x2 tensor using the linalg.eigh function, ensuring the computed eigenvalues and reconstructed tensor match the expected results.	2025-06-04 07:59:50 -04:00
geohotstan	602a145f8f	Add Tensor.unfold (#10518) ... * yoinked 10272 * eitanturok's fixes * hmmm should size be sint? * add test	2025-05-26 11:15:44 -04:00
Xingyu	1e0a59aca4	fix: handle buffer size calculation in to_movement_ops and add scalar assignment test in torch_backend (#10464)	2025-05-22 10:54:13 -07:00
George Hotz	411392dfb7	move files into uop dir (#10399) ... * move files into uop dir [pr] * tinygrad.uop is a thing * fix uop docs, no pr * fix viz	2025-05-18 11:38:28 -07:00
Xingyu	286b0f4051	Add equal function implementation and corresponding test (#10351) ... - Implemented a new function `equal` in the torch backend to compare two tensors for equality. - Added unit tests for the `equal` function to verify its correctness with different tensor inputs.	2025-05-16 23:39:49 -07:00
Xingyu	a21369d039	Enhance tensor random functions with dtype support (#10214) ... * Enhance tensor random functions with dtype support - Updated `aten.uniform_` and `aten.normal_` to include dtype parameter in backend.py - Added unit tests for uniform and normal tensor generation with specific dtypes in test.py * Refactor test name for clarity - Renamed `test_normal_dtype` to `test_normal` in `extra/torch_backend/test.py` - Aims to improve readability and better reflect the test's purpose	2025-05-08 20:48:07 -04:00
George Hotz	690dac79b5	don't modify the ranges on reduce rewrite (#10062) ... * bug in div range folding * simpler * oh, this is right for indexing, but the div mod folding needs to be fixed * reenable * Passing test_complexity_w_unroll2 (#10068) * Passing * remove non_folded_divs * Add check for negative tern in div folding * Add test * bump that limit * fix casted --------- Co-authored-by: Sieds Lykles <93992551+S-Lykles@users.noreply.github.com>	2025-04-28 12:01:19 -04:00
George Hotz	ea5dddc537	reduce collapse generic (#10045) ... * reduce collapse generic * new arange folder * new range folding * correct with sym * all tests pass * indexing ops passes * failing tests * fix tests, remove unused * revert that * torch indexing is fast * skip on webgpu * touchups * comments	2025-04-26 09:13:24 -04:00
Nishant Rajadhyaksha	55942a8d8e	[Bounty] moved index_tensor off cpu in torch_backend (#9916) ... * moved index tensor off cpu in torch_backend * added support for None based indexing * fix_to_pass_tests * fix segfault tests	2025-04-24 14:12:37 -04:00
Park Jun	c3ad7b2a84	create randperm and support pytorch backend (#10019)	2025-04-24 07:29:02 -04:00
Matthew Daiter	b545338e59	isin_Tensor_out added (#10018)	2025-04-24 07:26:51 -04:00
qazal	e20ef7196a	Tensor.kernelize (#9845) ... * add kernelize * remove that * kernelize returns self * update abstractions2.py * kernelize in test_schedule * temp: assert BUFFER_VIEW's existence * ASSIGN must have a buffer or subbuffer target * assert and shrink * fix * padded setitem * var * toposort once * extra * base_buffer * end with BUFFER_VIEW * setitem for disk * test_setitem_becomes_subbuffer * mul slice test * torch backend fix 1 * non-deterministic * keep subbuffer	2025-04-20 20:53:49 +08:00
Xingyu	047c8fd70d	Add amax support to Tensor operations in Torch Backend (#9905) ... * Add amax support to Tensor operations - Implemented amax function in backend.py for tensor max operations. - Added unit tests for amax in test.py to ensure correct functionality. * Fix formatting in amax output function - Adjusted spacing in the amax output lambda function in backend.py - Improved code readability for better maintenance	2025-04-16 10:35:50 +01:00
George Hotz	5c7b549eab	use functools.cache instead of lru_cache(None) [pr] (#9714) ... * use functools.cache instead of lru_cache(None) [pr] * more cache	2025-04-03 11:47:13 +08:00