mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
13,471 commits 280 branches 15 tags 325 MiB
Commit graph

297 commits

Author SHA1 Message Date
George Hotz
4c1fb18a09
 		Revert "Revert "Tests for GatedDeltaNetBlock + fix multi after assign issue (…" (#15703) 
This reverts commit 0cec42db71.
 2026-04-13 19:09:38 +08:00
George Hotz
0cec42db71
 		Revert "Tests for GatedDeltaNetBlock + fix multi after assign issue (#15700)" (#15702) 
This reverts commit 6f5d756282.
 2026-04-13 19:06:44 +08:00
George Hotz
6f5d756282
 		Tests for GatedDeltaNetBlock + fix multi after assign issue (#15700) 
* broken after/assign test

* test for GatedDeltaNet

* better comments

* fix issue 1 with multi kernel

* fix 2

* fix

* linter

* public api + cleanup
 2026-04-13 18:43:23 +08:00
chenyu
f7ff480fa6
 		start mixin getitem tests (#15695) 
goal is to make Tensor[idx].uop equal to Tensor.uop[idx]
 2026-04-12 18:54:33 -04:00
George Hotz
b5a9465b13
 		llm: add support for moonlight (deepseek MLA) (#15466) 
* add gguf Q5_0

* it works

* rebase

* simpler test

* class

* less diff

* dicts

* normal names

* simplify

* this

* simpler

* work

* work
 2026-04-11 10:32:48 +08:00
b1tg
9ab1415937
 		llm: fix streaming UTF-8 decode (#15653) 2026-04-10 17:01:02 +08:00
Christopher Milan
dbc23e8a1b
 		move HCQ_VISIBLE_DEVICES into DEV (#15668) 2026-04-09 22:01:35 -04:00
Christopher Milan
d08c76d9cb
 		c.Struct cleanup (#15640) 2026-04-08 20:07:16 -04:00
qazal
dc6a51e44d
 		viz: add # of bytes to sdma (#15639) 
* viz: add # of bytes to sdma

* update test_viz
 2026-04-08 17:43:37 +09:00
Christopher Milan
19e96497ee
 		interface in DEV (#15620) 2026-04-06 19:59:28 -04:00
qazal
8ba58304f7
 		viz: reenable tests (#15626) 2026-04-07 07:52:44 +09:00
chenyu
2f7d085450
 		shared _normalize_indices for getitem (#15625) 
* shared _normalize_indices for getitem

* list
 2026-04-06 17:45:36 -04:00
chenyu
01b49c8647
 		support int operand for shifts (#15618) 
matches torch/jax, also symbolic rule to remove mask
 2026-04-06 12:32:12 -04:00
Christopher Milan
645d45d968
 		DEV has arch (#15577) 
Co-authored-by: Comma Device <device@comma.ai>
 2026-04-03 19:17:19 -04:00
Christopher Milan
0ed8d9271d
 		Renderers accept Target or nothing (#15590) 2026-04-03 01:09:41 -04:00
chenyu
1aa04eab08
 		simple CreationMixin (#15567) 
start with full_like, zeros_like, ones_like
 2026-04-01 23:00:56 -04:00
Christopher Milan
6c67bd4c14
 		better error message when invalid renderer is specified (#15573) 2026-04-01 17:12:55 -04:00
b1tg
20497f2840
 		fold BIND to CONST when min==max (#15568) 2026-04-01 11:19:04 -04:00
chenyu
f5c0794df2
 		fix Tensor.const_like (#15565) 
used to always return a 0-d tensor, now returns an expanded Tensor based on self.shape and matches UOp
 2026-04-01 08:35:19 -04:00
Christopher Milan
acf239e4d2
 		specify renderer in DEV, <dev>_<ren>=1 is deprecated (#15551) 2026-03-31 18:35:14 -04:00
chenyu
4ac2552642
 		improve ReduceMixin.all (#15544) 
use prod instead of min since `mul` lowered to `and` directly
 2026-03-31 07:54:27 -04:00
chenyu
89ec22131a
 		tests to show double negation in min is not cancelled (#15543) 2026-03-31 06:59:13 -04:00
qazal
467c0af8aa
 		viz: skip flaky sever tests (#15538) 2026-03-31 17:20:30 +09:00
Christopher Milan
adbfd82d1d
 		DEV is ContextVar, setting Device.DEFAULT is deprecated (#15508) 2026-03-30 17:10:49 -04:00
chenyu
c0753ab62f
 		XOR simplifcation rules (#15512) 
x^-1 has good vmin/vmax, and x^y^y is x
 2026-03-27 23:23:27 -04:00
nimlgen
0d6fc0f571
 		jit: graphing in uops (#15489) 
* jit: graphing as rewrite rule

* f

* +metal,cuda

* x

* cl

* x

* x

* simpler

* f

* m

* x

* revert?

* revert2

* back

* back

* t

* x

* m

* x

* c

* x

* l

* x

* comment

* smaller

* rv

* x

* x
 2026-03-27 19:09:02 +03:00
chenyu
30ebbe7f17
 		few more fold valid tests (#15509) 
from remove CORRECT_DIVMOD_FOLDING attempt
 2026-03-27 10:38:42 -04:00
chenyu
323fcefd7d
 		Revert "DEV is a ContextVar (#15505)" (#15506) 
This reverts commit fdb30cba96.
 2026-03-27 02:22:40 -04:00
Christopher Milan
fdb30cba96
 		DEV is a ContextVar (#15505) 2026-03-27 00:57:09 -04:00
Christopher Milan
67a50fb738
 		move where on load with casts (#15492) 2026-03-26 22:11:27 -04:00
Christopher Milan
bc180a963c
 		deprecate <dev>=1 in favor of DEV=<dev> (#15467) 
* start work on target

* add test

* update actions to use DEV

* update docs

* update readmes

* tests need that too

* update example

* update tests (comments)

* fix that test

* ruff

* mypy

* oops

* remove getenvs

* don't add Target yet

* and the test

* lint

* and docs

* more stuff

* assert

* few more fixes

* test assert
 2026-03-26 03:48:03 -04:00
chenyu
7c8f992894
 		move EXPAND dtype cast back to gradient.py (#15481) 
only a concern for gradient, not mixin
 2026-03-25 19:25:26 -04:00
chenyu
713b322e70
 		add weakint to promo_lattice (#15463) 
sits between bool and smallest int
 2026-03-25 00:27:34 -04:00
George Hotz
fe2690399b
 		llm: support assistant prefill + refactor to TransformerConfig (#15457) 
* llm: support assistant prefill

* refactor to ModelConfig

* TransformerConfig

* more
 2026-03-25 10:50:48 +08:00
qazal
652bab8aad
 		viz: support nested track_rewrites (#15454) 
* simple test

* stack active groups
 2026-03-25 05:01:30 +09:00
chenyu
b7960841af
 		support shape broadcast in UOp.alu (#15442) 
i think it can integrate tighter, but now Tensor also does ufix from UOp and implicit dtype upcast
 2026-03-24 10:14:57 -04:00
George Hotz
a33ac869aa
 		llm server: temperature + test client (#15444) 
* improvements to the llm server

* eval script

* eval llm

* better eval gets 58.71

* cleanups

* add temperature, but multinomial is absurdly slow

* claude is so smart

* lint

* remove slop

* no more stop
 2026-03-24 21:07:15 +08:00
George Hotz
85dee83f5d
 		amd flash attention cleanups + emulator fixes (#15431) 
* amd flash attention cleanups

* simpler

* params

* fix emulator bugs

* fix idiv bug

* remove that test

* more emu fixes
 2026-03-24 10:10:46 +08:00
nimlgen
fa4cdb422e
 		memplan on linears (#15422) 
* memplan

* test

* x

* arenas

* correct

* set any size

* ugh

* make hevc happy

* x

* x

* held

* rm old

* del

* x

* fu

* f

* cl

* cl

* ok
 2026-03-23 19:50:16 +08:00
George Hotz
c62dea6881
 		ai slop flash attention (it works) (#15401) 
* ai slop flash attention (it works)

* speed up, 2 TFLOPS + 7 GB/s

* simpler

* simpler

* optimize

* faster

* warp shuffle

* sqtt: link dispatch to exec (#15396)

* sqtt packet linking infra

python

* javascript

* ~doubly linked list

* ui works

* work

* exec can also highlight the pc, coloring work

* more work

* rm sqtt/model.py, doesn't need to be upstreamed

* viz: no context enters in cli, update llama profile (#15404)

* removed unused named arg in rules [pr] (#15414)

* viz: sqtt printer in viz/cli.py (#15411)

* work

* sqtt timeline in CLI

* format all printers nicely

* s/Showed/Printed

* ansistrip

* sys.exit

* keep colors in list

* work from amd_copy_matmul

* has_more always gets returned

* linter

* don't print colors

* more colors

* wow this is so deep

* work

* minor details

* selected

* improve progress bar

* remove it

* 22, global_load_vaddr is so long

* remove *0 hack in sign, gradient materializes zeros for unconnected nodes (#15416)

Amp-Thread-ID: https://ampcode.com/threads/T-019d1612-6322-706b-a94d-a812400a55cb

Co-authored-by: Amp <amp@ampcode.com>

* works

* cnt=20

* revert that

* uop slice tests

* simpler

---------

Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
Co-authored-by: chenyu <chenyu@fastmail.com>
Co-authored-by: gg <ggordbegli@gmail.com>
Co-authored-by: Amp <amp@ampcode.com>
 2026-03-23 16:15:10 +08:00
nimlgen
9656d97d97
 		jit: captures linears, not execitems (#15399) 
* jit: captures linears, not execitems

* x

* um

* etsts

* mockcuda
 2026-03-21 16:32:12 +08:00
Christopher Milan
1560b534a5
 		remove IMAGE=2 (#15312) 2026-03-20 06:26:52 -04:00
Christopher Milan
0c89340a1e
 		automatically emulate unsupported (tiny) floats [skip_process_replay] (#15366) 2026-03-20 02:31:44 -04:00
chenyu
da1700e16b
 		dtypes.index -> dtypes.weakint (#15377) 2026-03-20 01:08:46 -04:00
nimlgen
86eec01f97
 		limit gl*lc (#15359) 2026-03-19 12:38:55 +08:00
nimlgen
d4836ddbb0
 		canonicalize device from tuple (#15348) 
* will it ifx ci?

* test

* um
 2026-03-18 20:35:52 +08:00
George Hotz
5524916e39
 		llama compute gradients explicitly + 243 GB of RAM on MP=8 (#15343) 
* llama compute gradients explicitly

* apply grads

* fix multi issue

* multi BUFFER_VIEW support

* simpler

* skip the flaky test
 2026-03-18 19:54:40 +08:00
nimlgen
f853371c83
 		fix compilers autoselect (#15346) 2026-03-18 18:19:53 +08:00
chenyu
94926d00d8
 		fix rand > uint32.max (#15330) 
need to keep low and high as 1D tensor.
`PYTHONPATH=. LLAMA3_SIZE=405B python3 examples/mlperf/models/flat_llama.py` works now
 2026-03-17 22:00:01 -04:00
qazal
00817cf65e
 		viz: all tests can run on the NULL device (#15328) 
* remove that

* move to test_viz

* get_cfg

* do not use os.environ

* hm

* it's always on NULL

* import renderer

* no import *
 2026-03-18 04:14:20 +09:00