33 commits

Author	SHA1	Message	Date
George Hotz	689ab6a49f	move buffer view offset to src (#16364) ... * this work? * failed	2026-05-25 17:07:55 -07:00
chenyu	4dbe6a2ee7	remove _force_unique from Tensor init (#16277)	2026-05-20 14:13:05 -04:00
chenyu	dcee90aa3f	remove requires_grad use in extra/examples (#16238) ... except the ones fed into optimizer	2026-05-16 18:40:26 -04:00
chenyu	0ddc50d050	do not gate backward on requires_grad (#16230) ... DETACH is filtered in _deepwalk. instead of None, it gets 0 grad now	2026-05-16 12:29:49 -04:00
chenyu	07a172dbbb	remove noop requires_grad_ calls (#16213)	2026-05-15 13:31:10 -04:00
chenyu	409bb0c9ad	requires_grad cannot be None (#16212) ... final goal is to remove requires_grad, first change the default to True, and don't allow None	2026-05-15 02:01:04 -04:00
chenyu	a75c14f010	some setitem tests (#16209)	2026-05-14 22:36:25 -04:00
chenyu	ffa1aac7b1	gradient for STORE/AFTER ala clone (#16205)	2026-05-14 20:17:27 -04:00
chenyu	09096ea565	test_gradient_through_clone (#16203) ... backward through clone crashes now	2026-05-14 19:26:47 -04:00
chenyu	da3b7e89a4	atol in test_custom_kernel_multi_output_backward_interacting (#16166)	2026-05-12 14:42:12 -04:00
wozeparrot	419d525553	feat: handle multioutput kernel grads (#16028)	2026-05-02 22:31:45 -07:00
chenyu	bf33c5f796	remove gradient materialize_grads (#15367) ... effectively default to True and removed *0 hack in Tensor.copysign. now dy/dx=0 if y does not depend on x remove	2026-03-19 23:36:03 -04:00
chenyu	c9f6d8751b	don't remove_bufferize for Invalid (#15053) ... * don't remove_bufferize for Invalid * replaced	2026-02-27 15:16:09 -05:00
George Hotz	d59e6e7a37	move more tests to test/null, split some existing ones (#14512) ... * move more tests to test/null, split some existing ones * null work * null work * move more * fixes * move PIL * PIL in CLIP * don't move that	2026-02-03 20:20:20 +08:00
chenyu	185a000882	gradient of COPY (#13760)	2025-12-19 13:33:59 -05:00
chenyu	ed962786d6	use assign in Tensor.backward (#13674) ... preserve the grad object so that jit works	2025-12-13 22:43:06 -05:00
George Hotz	32e9949052	rename lazydata to uop (#10698)	2025-06-08 08:42:22 -07:00
George Hotz	41e3d07d7f	view gradient is tricky (#10528) ... * view gradient is tricky * explicit	2025-05-26 22:28:30 -07:00
chenyu	8cc2dff4d8	only float Tensors have gradient [pr] (#10475)	2025-05-22 21:02:11 -04:00
George Hotz	411392dfb7	move files into uop dir (#10399) ... * move files into uop dir [pr] * tinygrad.uop is a thing * fix uop docs, no pr * fix viz	2025-05-18 11:38:28 -07:00
qazal	14aa2395d0	allow VIEW(BUFFER) in Tensor UOps [pr] (#9210) ... * allow VIEW(BUFFER) in Tensor UOps [pr] * still reshapes * update becomes_map tests * bring copy folder to the scheduler * lint * only sgd left * optimizer assign * 13 kernels * rename to test_reorder_expand + assert VIEW	2025-02-24 13:06:15 +01:00
chenyu	287de4ecc6	use torch in test_gradient (#9186) ... used torch.autograd.grad, but not sure if it can be a template like jax	2025-02-20 12:26:11 -05:00
qazal	fd9f9ec772	realized base tensors become RESHAPE(BUFFER) [pr] (#8994)	2025-02-10 10:17:54 +01:00
George Hotz	b4bf6a7dea	switch backward to use gradient [pr] (#8235) ... * switch backward to use gradient [pr] * set device correctly, dedup * why does that fail? * add noop cast * simple backward * fix beautiful_mnist * touchups * set in compute_gradient * uop_count * uop_count was wrong * collections * no note * skip that test * update sched kernel counts * train mnist is 65 * fix metadata and gc * fixes * materialize_grads * no pathlib stuff * add contiguous_backward, fix bugs * add some realize * fix multi	2025-01-26 09:12:16 +09:00
George Hotz	46a8c5e1e5	delete forced_realize (#8615) ... * delete forced_realize * put that back * expectedFailures * cleaner create_subbuffer * more comments --------- Co-authored-by: qazal <qazal.software@gmail.com> Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>	2025-01-20 09:40:36 -08:00
George Hotz	c85737c200	assert to prepare for grad uop [pr] (#8280) ... * assert to prepare for grad uop [pr] * fix test_nn * fix most of test_tensor * few more tests * fix multi * uniform gradient * acc_dtype * any for multi * fix typing * fix assert, CAST_BEFORE_VIEW is still the issue * explict test for CAST_BEFORE_VIEW --------- Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>	2025-01-14 13:26:56 -08:00
George Hotz	bd9c015b09	tests from grad uop path [pr] (#8313)	2024-12-18 09:25:05 -08:00
George Hotz	bcd7ea60f0	hotfix: a few more grad tests	2024-12-13 21:03:02 -08:00
George Hotz	734f2c5344	compute gradient [pr] (#8237) ... * compute gradient [pr] * schedule_step_with_grads * second deriv works	2024-12-13 20:46:01 -08:00
George Hotz	8396d90f91	non controversial changes from optim branch [pr] (#8234)	2024-12-13 19:24:16 -08:00
George Hotz	37fa38d272	Revert "switch beautiful_mnist to use new optimizer [pr] (#8231)" (#8233) ... This reverts commit e9ee39df22.	2024-12-13 19:07:09 -08:00
George Hotz	e9ee39df22	switch beautiful_mnist to use new optimizer [pr] (#8231) ... * switch beautiful_mnist to use new optimizer [pr] * fix abstractions3 + docs * fix OptimizerGroup with schedule_step api	2024-12-13 18:27:16 -08:00
George Hotz	e2f87ecf36	start work on new gradient (#7838) ... * start work on new gradient * more correct * working tests * more tests * work * add (faliing) gradient test * add view and reduce gradient * test_add works, many failing test_ops * add max and reduce max * add max and reduce max * 129 failing * 108 failed * better view drawing * 101 failed * i got 99 failures * 94 failures * it's tons of terrible code, but only 50 tests fail * only 19 failures * same 19 but shorter * minimal doesn't matter * shorter * lil simpler * simpler * simpler * simpler * 13 test failures * nine tests fail * all ops tests pass * add contiguous gradient + fix sched tests * faster by removing toposort calls * missed one * add jax to testing	2024-12-13 16:45:53 -08:00