mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
11,106 commits 280 branches 15 tags 325 MiB
Commit graph

11,106 commits

This branch
This branch
All branches
Author SHA1 Message Date
chenyu
8dd88ad476
 		don't div_and_mod_folding for negative numerator with remainder (#9674) 
can be wrong in C div since it truncates towards zero
 2025-04-01 16:26:23 -04:00
chenyu
0e34f9082e
 		helper functions for cstyle div mod [pr] (#9673) 2025-04-01 08:06:56 -04:00
qazal
eee0dcc37a
 		merge viz back into one file (#9672) 
* merge viz back into one file

* work

* rename lib to js directory

* fix diff

* less indenting

* memory graph is back

* viz_sz.py
 2025-04-01 19:52:02 +08:00
Ignacio Sica
870b545ace
 		LDS noop and spec (#9669) 
* init lds noop and lds_0 spec

* refactor lds helper test

* fix typo

* test all lds at the same time

* change comment

* comment

* start test_lds_full

* test_lds_tc

* add tc spec
 2025-04-01 18:44:55 +08:00
uuuvn
609a006242
 		AMDComputeQueue.wreg (#9628) 
* AMDComputeQueue.wreg

Used to be part of #9428, i think it's much more readable than repeating
the ~same pm4 things over and over again, especially with separate .encode

* fix indentation
 2025-04-01 17:01:33 +07:00
qazal
fa373e15a3
 		hotfix: NULL=1 Buffer does not have _buf (#9661) 2025-04-01 17:43:55 +08:00
nimlgen
3e2f42c2e8
 		autogen: remove am headers from extra (#9666) 2025-04-01 14:45:30 +07:00
Ignacio Sica
cfad139189
 		bump assembly debug to 7 (#9662) 2025-04-01 11:51:33 +08:00
Ignacio Sica
ac533e89a2
 		remove duplicated ast print (#9660) 2025-04-01 10:29:24 +08:00
Ignacio Sica
846ef84cda
 		move uops print to debug >= 6 (#9659) 2025-04-01 10:29:09 +08:00
b1tg
d9af4cfc1b
 		AMD_LLVM: tensor cores support (#9613) 
* tensor cores support

* test tesor cores codegen

* use rewrite rules

---------

Co-authored-by: b1tg <b1tg@users.noreply.github.com>
 2025-04-01 09:56:27 +08:00
qazal
1658eb4e63
 		always fit fresh viz graph into view [pr] (#9657) 2025-04-01 09:34:26 +08:00
Anish Umale
a1ee4d587f
 		Fix test_ops for tiny backend (#9302) 
* fix some tests in test_ops for torch backend(171 failing)

* fix more tests (135 failures)

* fix tests (126 failing)

* handle transposed convs (109 tests failing)

* fix slice

* fix lshift & rshift and more tests (87 tests failing)

* revert accidental change

* remove unnecessary changes (82 failures)

* fix backward for avg_pool2d (78 failures)

* fix backward for avg_pool2d (78 failures)

* fix replication backpass

* fix reflection pad back pass (71 failures)

* cummax with indicies, aten.mv and move out methods (67 failures)

* extract avg_pool2d and avg_pool3d to separate functions (62 failures)

* revert changes for cat_out

* rewrite avg_pool and pad without repetition

* remove duplicates from decomps

* slice rewrite and add slice_backward (59 failures)

* add dtype fixup from https://github.com/tinygrad/tinygrad/pull/9297

* fix linter error and remove Tensor.pad (48 failures)

* add select_backward and index_put (40 failures)

* fix some more tests (36 failures)

* fix more tests (12 failures)

* some cleanups and fix couple more tests (10 failures)

* cleaner way to write upsample

* some more upsample cleanups

* use lambda for upsample

* add autowrapper for upsample forward

* cumsum and max_dim without aten functions

* revert _log_softmax

* fix more tests (1 failure)

* make linter happy

* move import to appropriate func

* make linter happy

* add codes for noqa

* some more refactors

* remove comment

* remove dependency on aten function for conv backward

* some more refactors

* add returns

* revert a change from merge

* some cleanups

* remove whitespace

* remove ruff change

* revert upsample

* add masked_fill_.Tensor and scatter.src_out

* add todo

* fix test_biased_conv2d

* fix test_var_one_in_axis & test_std_one_in_axis but break test_biased_conv2d :(

* revert torch_debug

* revert torch_debug

* skip test_gather_failure for the tiny backend

* make padding registration more consise

* add nonzero

* remove scatter_add since we already have the out

* fix scatter

* remove some repetition

* make upsample backward registrations more concise

* remove select.int

* use Tensor.cumsum

* realize conv2d outputs before backward to fix test_biased_conv2d

* add a todo for realize(1 failure)

* add new_empty and new_empty_strided

* make test_pad_circular_mode forward only and remove redundant stuff

* fix linter errors

* remove expect failure

* just tb

* slice is a view_op

* contiguous only when lazydata.is_realized

* fix backward for test_pad_circular_mode

* revert torch.nn.functional.pad override

* add transpose.int and make constant_pad_nd contiguous

* slice_backwards has no kwargs

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-31 21:13:09 -04:00
qazal
a0b4465412
 		bring GroupOp.Meta back (#9656) 2025-04-01 01:02:29 +08:00
Ignacio Sica
f277f407f2
 		remove smem_prefix_for_cast for amd (#9651) 2025-03-31 23:03:35 +08:00
chenyu
f7cb2e8da3
 		bert dev_beam for mi300x box (#9648) 
* bert dev_beam for mi300x box

* terminate BENCHMARK properly
 2025-03-31 08:35:51 -04:00
qazal
5171b098e5
 		merge_double_reduce without asserts [pr] (#9650) 2025-03-31 19:17:05 +08:00
Ignacio Sica
1444069c09
 		Uppercase K for dimension and lowercase k for kernel in linearizer tc helper test (#9649) 2025-03-31 19:05:36 +08:00
Ignacio Sica
baa67fd124
 		Uppercase N and M (standalone syntax change) (#9647) 2025-03-31 18:45:30 +08:00
chenyu
aca0f1befb
 		print idx when OUT OF BOUNDS ACCESS (#9646) 
in some cases (if there's a where in idx) the vmin/vmax might not be tight
 2025-03-31 06:12:44 -04:00
Priyank Patel
e2d9322d21
 		torch backend: partial fix for strided related test fails (#9642) 
* partial fix for strided related test fails

* cleanup

* fix lint
 2025-03-31 05:45:18 -04:00
qazal
76c1b1edf6
 		viz kernel list cleanup (#9643) 2025-03-31 15:53:39 +08:00
George Hotz
e4c545b396
 		linearizer fix from dsp branch (#9641) 
* linearizer fix from dsp branch

* revert that
 2025-03-31 14:26:39 +08:00
George Hotz
ec405b919f
 		Revert "Revert "do not block gc in UOp.toposort (#9623)" (#9624)" (#9639) 
This reverts commit 7ef02d0e1c.
 2025-03-31 14:03:38 +08:00
George Hotz
49b1c46d16
 		good changes from the dsp branch (#9638) 2025-03-31 13:02:53 +08:00
qazal
9d67d3a2f3
 		simpler viz codeblocks (#9636) 
* simpler viz codeblocks

* err
 2025-03-31 11:48:35 +08:00
chenyu
60eb0c4ed7
 		exclude slow tests on PYTHON (#9634) 2025-03-30 22:55:05 -04:00
chenyu
5012ba3f04
 		cumalu touchup [pr] (#9632) 2025-03-30 22:43:11 -04:00
chenyu
d8d7ac1bb1
 		fix bert free_intermediates (#9633) 
fix when only run eval `TRAIN=0 BERT_SIZE=tiny examples/mlperf/training_submission_v5.0/tinycorp/benchmarks/bert/implementations/tinybox_green/dev_beam.sh`
 2025-03-30 22:42:52 -04:00
qazal
ff984c807d
 		hotfix: less lines for viz helpers (#9631) 2025-03-31 10:10:34 +08:00
qazal
c206a7ae6d
 		refactor viz state updates (#9630) 
* refactor viz state updates

* onclick
 2025-03-31 09:54:54 +08:00
Yvon Manzi
6652003839
 		Add cumprod to Tensor (#9629) 
* probably how cumprod should look like

* update _cumalu to work with MUL

* shorter

* cumprod testing

* clean

* more cleanup

* add cumprod to torch backend.

* make it look like cumsum

* mypy fix

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-30 21:49:18 -04:00
geohotstan
d52e91db7b
 		ONNX ops clean ups (#9622) 
* combine work from remove numpy and onnx ops tests

* clippy

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-30 21:39:22 -04:00
uuuvn
962c0f65f8
 		Fix generate_am (#9626) 
This should be a comment
 2025-03-31 01:15:44 +08:00
uuuvn
2a4247b8c2
 		RDNA 3.5 support (#9627) 2025-03-31 01:15:20 +08:00
geohotstan
a08b07b4da
 		Bump onnx==1.17.0 (#9618) 
* bump

* remove resize tf_crop_and_resize

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-30 03:21:51 -04:00
qazal
7ef02d0e1c
 		Revert "do not block gc in UOp.toposort (#9623)" (#9624) 
This reverts commit f1a35bbb54.
 2025-03-30 12:57:06 +08:00
qazal
f1a35bbb54
 		do not block gc in UOp.toposort (#9623) 2025-03-30 11:54:17 +08:00
nimlgen
54e1e59b44
 		am: rdna 4 support (#9621) 
* hm

* fix

* return this

* fine

* g

* ruff

* fix
 2025-03-29 23:16:27 +07:00
nimlgen
118bd1cbed
 		hotfix: amd imports (#9620) 2025-03-29 20:19:53 +07:00
uuuvn
5908b89f71
 		MI300X support (WIP) (#9585) 2025-03-29 19:46:42 +08:00
George Hotz
77f0d09ecf hotfix: HIP supports parallel BEAM search 2025-03-29 11:49:53 +08:00
chenyu
162f286a0e
 		add a few Tensor method to doc (#9614) 
* add a few Tensor method to doc

* clone
 2025-03-28 13:47:16 -04:00
uuuvn
dd9aae02c3
 		Refactor ops_amd.py (MI300X prereq) (#9428) 2025-03-29 00:17:20 +07:00
uuuvn
3e1168ff5e
 		am: module import in common (#9615) 2025-03-28 21:29:34 +07:00
nimlgen
a8ff85369e
 		cpugraph for dsp (#9601) 
* cpugraph init

* fixes

* no cpu for now

* mypy

* fix
 2025-03-28 19:06:31 +07:00
nimlgen
fa0ebbd237
 		jit: optimize before pickle (#9611) 
* jit: optimize before pickle

* optimize weights

* fix

* mypy

* mypy2
 2025-03-28 19:06:09 +07:00
George Hotz
392a311312
 		Revert "add copy button in VIZ code-block (#9605)" (#9610) 
This reverts commit d1e8598c81.
 2025-03-28 17:05:44 +08:00
Harsh Natuskar
d1e8598c81
 		add copy button in VIZ code-block (#9605) 
* works

* only second block has copy

* better function

* better

* ...

* smol function

* update copy-btn css

* updates
 2025-03-28 16:52:21 +08:00
qazal
b4ea45b4a6
 		fix viz recenter + worker cleanup (#9607) 2025-03-28 15:24:53 +08:00