mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
9,834 commits 280 branches 15 tags 325 MiB
Commit graph

4,142 commits

Author SHA1 Message Date
George Hotz
b7c195bf7e
 		Merge branch 'master' into no_merge_views 2025-08-13 16:21:41 -07:00
chenyu
4fe19eec72
 		Ops.TRUNC (#11659) 2025-08-13 18:40:48 -04:00
George Hotz
8592fba874
 		Merge branch 'master' into no_merge_views 2025-08-13 12:46:52 -07:00
George Hotz
22bdf48cdd
 		render ranges in viz, name gbufs with sizes. changes from rangeify (#11656) 
* render ranges in viz, name gbufs with sizes. changes from rangeify

* fix unit test dtypes
 2025-08-13 12:46:16 -07:00
kevvz
e2873a3a41
 		[bounty] Muon optim (#11414) 
* newton schulz

* add muon + move newton schulz to tensor

* compact newton schulz

* better tests

* cleanup

* add comments for muon

* cleanup

* add export with tests

* match muon optim with test optim

* cleanup

* unsed import

* correct comment

* whitespace

* move export

* muon test fix

* match reference impl + tests

* remove export by moving muon device

* add credit

* cleanup

* remove print

* spacing

* spacing

* comma

* cleanup

* removal

* fix tests + optim momentum

* consistent is not/ not

* more consistency

* fix test

* cleanup

* fix the nones

* remove comment

* cast

* comment

* comment

* muon teeny test

* muon flag beautiful mnist

* set steps

* steps as hyperparam

* match default test steps

* name

* large cleanup

* dont care about steps

* nesterov false default

* match each other impl

* steps

* switch nest

* swap defaults

* update docstring

* add no nesterov test

* ban fuse_optim

* prints

* classical momentum

* alternative condition

* recon

* pre + post wd

* false default

* detach

* signature changes

* context

* swap order

* big cleanup

* 0 step instead

* parity

* remove fuse

* remove fused

* better paper

* assert message

* correct shape check + eps

* multidim

* add eps

* cleanup

* correct assert message

* lint

* better tests

* naming

* ns_steps,ns_params

* update docstring

* docstring

* match sgd and muon together

* sandwich

* add back fused

* parity

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-08-13 14:27:55 -04:00
George Hotz
cbf85fbfd0
 		Merge branch 'master' into no_merge_views 2025-08-13 09:40:44 -07:00
George Hotz
d2521d828a
 		transcendental+idiv+threefry are uop decompositions (#11636) 
* transcendental+idiv+threefry are uop decompositions [pr]

* threefry decomp

* fix randomness tests

* fix webgpu

* unneeded now

* fix

* move prematcher

* all cast should probably be cast_vec
 2025-08-13 09:37:12 -07:00
geohotstan
925555b62a
 		Fix onnx Domain bug (#11650) 2025-08-13 08:20:50 -07:00
chenyu
0d8a0d7a96
 		update test_multi_const_folding_tensor to include pow (#11635) 
pow folds now
 2025-08-12 13:35:37 -04:00
Sieds Lykles
4d6e407eb0
 		Extend fast_idiv to negative ints (#11632) 
* fast idiv for signed ints

* Add rule and test

* fix tests

* redo fuzz_fast_idiv to do negative ints as well

* adjust comments

* remove unused imports
 2025-08-12 19:34:49 +02:00
geohotstan
ad9dec25b3
 		combine onnx parser and onnx (#11485) 
* start

* more

* fix onnx_runner test

* pass

* patch for disk and add domains from huggingface

* simpler docs

* revert domain changes

* rerun ci

* revert onnx ops test change

* add fix from strenum stuff

* correct way

* revert correct way to leave the fix for another PR

* test segfault

* Revert "test segfault"

This reverts commit 4e1aaf41e7.

* remove some unnecessary documentation

* test segfault again

* Revert "test segfault again"

This reverts commit 56fc5f03e7.

* try gemini suggested patch for sys._getframe

* keep trying with gemini

* revert not working gemini suggestions and try faulthandler

* remove pythonfaulthandler

* trigger CI a few times

* minimize diff

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-08-12 12:56:39 -04:00
Sieds Lykles
4c3982c44e
 		Take sign out of mod (#11631) 
* Add rule and test

* fix tests
 2025-08-12 18:44:36 +02:00
chenyu
0d7075f2de
 		assign should broadcast input tensor (#11629) 
fixed test_assign_broadcast
 2025-08-11 23:36:35 -04:00
George Hotz
b8b28e1135
 		Merge branch 'master' into no_merge_views 2025-08-11 18:29:15 -07:00
George Hotz
ca41b5e38b
 		skip_0 in graph rewrite [pr] (#11627) 
* skip_0 in graph rewrite [pr]

* no track_rewrites on test

* use dict instead of set
 2025-08-11 18:29:04 -07:00
chenyu
0c97d6de1b
 		don't round pow output for int pow int (#11625) 
also added atol=0 and big pows for the tests
 2025-08-11 20:57:47 -04:00
George Hotz
9d46bc2939 endrange 2025-08-11 17:19:02 -07:00
chenyu
d623f6d850
 		support int Tensor pow to const non-negative int (#11624) 
matches torch
 2025-08-11 19:50:19 -04:00
George Hotz
2b7957e765 map_expand 2025-08-11 15:22:56 -07:00
George Hotz
4102e46370 cache has issues 2025-08-11 14:35:23 -07:00
chenyu
857a830dcc
 		fix test_arange_float_step (#11623) 2025-08-11 16:58:42 -04:00
George Hotz
6da4784c66
 		Merge branch 'master' into no_merge_views 2025-08-11 13:23:14 -07:00
ttomsa
ae0c3cfff6
 		change clang -march flag to -mcpu on arm (#10970) 
Co-authored-by: wozeparrot <wozeparrot@gmail.com>
 2025-08-11 13:38:48 -04:00
George Hotz
2feeb8c8a6 cleanups 2025-08-11 08:57:30 -07:00
geohotstan
27bcb9fd1c
 		Support cubic mode for ONNX Resize OP (#11612) 
* start

* add reference

* this is so much slower

* this makes sense but differs from official impl, but results are still correct..?

* add a comment

* Just keep it simple for now since I don't fully get it yet

* address comments

* correct

* teeny clean up

* another small comment improvement lol
 2025-08-11 11:49:30 -04:00
nimlgen
d2bb1bcb97
 		cloud: a bit better err handling (#11616) 
* cloud: err propagation to client

* fix

* print exc

* linter

* excs

* fix

* hm

* flaky
 2025-08-11 15:51:22 +03:00
chenyu
a67e0917c3
 		list indexing can normalize in python (#11609) 
* list indexing can normalize in python

list index does not need to be normalized in tensor

* update those
 2025-08-10 20:02:38 -04:00
chenyu
1181ec0cd2
 		few more tensor indexing test cases (#11608) 2025-08-10 18:56:42 -04:00
George Hotz
fbe9909d90 update for master 2025-08-10 15:43:27 -07:00
George Hotz
16d2d9daac
 		Merge branch 'master' into no_merge_views 2025-08-10 15:39:37 -07:00
George Hotz
996c907c0b
 		rewrite not ready + children machinery (#11607) 
* rewrite not ready + children machinery

* it doesn't like track rewrites
 2025-08-10 15:28:30 -07:00
George Hotz
b7ea16f161 localish fa 2025-08-10 14:30:25 -07:00
George Hotz
cc34518a52 RewriteNotReady 2025-08-10 13:56:38 -07:00
George Hotz
76a97e04b0 cleanups 2025-08-10 12:24:16 -07:00
geohotstan
b0dab6a4cd
 		onnx Resize OP clean up (#11603) 
* start

* slight clean up
 2025-08-10 14:10:39 -04:00
Sieds Lykles
10540414cd
 		Add Ops.CMPEQ (#10431) 
* Add op

* add to Groupop.ALU

* fix spec

* fix ptx

* temporary pickle by name to see process replay

* add Ops.EQ to binary ops

* Actuall rename properly

* add test to assert CMPEQ is being used

* Ops.CMPEQ is automatic cast to bool

* add Ops.CMPEQ to llvm

* add Ops.CMPEQ to llvm
 2025-08-10 13:13:16 +02:00
chenyu
dfb702ef33
 		fix sort for small dim (#11601) 
* fix sort for small dim

* fixed test_sort_empty
 2025-08-10 01:17:41 -04:00
Sieds Lykles
01c770c77b
 		Fix z3 float cast in indexing (#11590) 
* adjust dtype of z3_renderer and add rule for cast

* dtypes.bool is also cast noop

* add regression test

* make embedding smaller

* even smaller test
 2025-08-09 17:59:23 +02:00
Sieds Lykles
10d388499d
 		Refactor optional.py (#11578) 
* move fast_idiv to transcendental

* move optional.py

* adjust comment

* change import

* mypy needs this?
 2025-08-09 17:35:05 +02:00
George Hotz
7ddcb8632f simpler 2025-08-09 08:14:02 -07:00
George Hotz
ee06481036 ranges 2025-08-08 18:18:27 -07:00
George Hotz
38c9b5ed2c conv hack 2025-08-08 14:36:48 -07:00
George Hotz
7249a711c2 half contig 2025-08-08 08:43:41 -07:00
qazal
16f0edbe90
 		pass opts arg in get_program process replay [pr] (#11571) 
* fix ptx process replay

* keyword arg

* renderer is also optional [pr]

* test_linearizer fixup

* name function order is args,ret,kwargs

* can use opts_to_apply

* pass through p.applied_opts

* sink_arg

* now it opens devices too
 2025-08-08 03:05:09 +03:00
qazal
960cc6533a
 		pass through name function args in track_rewrites (#11572) 2025-08-08 02:28:52 +03:00
George Hotz
82be8abfd2
 		move opt under codegen (#11569) 2025-08-07 14:19:17 -07:00
George Hotz
6ed2dfd187
 		delete the arange dim mismatch restriction (#11568) 
* delete the arange dim mismatch restriction

* skip that test race
 2025-08-07 13:46:17 -07:00
chenyu
aa1a6f2132
 		support threshold in Tensor.softplus (#11564) 
fix gradient for large input
 2025-08-07 13:43:18 -04:00
chenyu
7ee3770961
 		FUSE_ARANGE=1 (#11427) 
* FUSE_ARANGE=1

* fix test

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-08-07 13:32:34 -04:00
George Hotz
9764c6cdee
 		fix mismatch reduce, try 2 (#11560) 
* fix mismatch reduce, try 2

* fix heuristic

* delete that test

* don't start allowing ones
 2025-08-07 07:57:58 -07:00