mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
8,422 commits 280 branches 15 tags 325 MiB
Commit graph

702 commits

Author SHA1 Message Date
qazal
16afe04f45
 		move process replay to grouper (#9830) 
* simpler

* sched
 2025-04-10 18:27:42 +08:00
chenyu
c462162db8
 		update benchmark bert scripts with BS and ACC_DTYPE (#9826) 
BS=16, ACC_DTYPE=half for tinybox, BS=128, ACC_DTYPE=float for mi300x
 2025-04-10 02:06:02 -04:00
George Hotz
fefee5d3ab
 		single kernel softmax (#9776) 
* real single kernel softmax

* cleanup

* fix blockend insertion

* add to bert test
 2025-04-08 12:35:48 +08:00
George Hotz
db22094d35 hotfix: update softmax fusion test 2025-04-08 11:23:19 +08:00
Sieds Lykles
07d1aefaf4
 		fast idiv (#9755) 
* fast idiv with tests and fuzzer

* Add todo comment

* Add env variable to toggle fast_idiv

* Move env check

* Add fuzz fast_idiv to ci

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-04-07 08:32:24 -04:00
chenyu
b190d85ad7
 		benchmark script bert softmax (#9759) 2025-04-07 00:31:18 -04:00
chenyu
43e4565148
 		weighted linear in external_benchmark_bert_matmuls (#9757) 
include the linear to get qkv, and permute so that stride matches with the real run
 2025-04-06 23:35:42 -04:00
chenyu
8a585dc5c1
 		benchmark script for matmuls in bert (#9752) 
2 main matmuls in the bert layers. getting these to be fast makes bert fast
 2025-04-06 19:34:25 +08:00
George Hotz
926b0bcc57
 		cache folded upcast [pr] (#9733) 2025-04-04 11:23:19 +08:00
geohotstan
ac713e04db
 		ONNX add output shape validation (#9720) 
* add output shape validation and remove support for sequence_type

* nit better err msg

* add sequence_type back

* improve err msg

* Revert "improve err msg"

This reverts commit dc9eaea4bb.

* Revert "add sequence_type back"

This reverts commit 288170b2d9.

* do explicit shape equality

* small nit
 2025-04-03 05:44:53 -04:00
George Hotz
49dafe6d43
 		add gc tests [pr] (#9718) 
* add gc tests [pr]

* del

* more gc tests

* add NullGraph
 2025-04-03 14:08:32 +08:00
geohotstan
e1d7e47cca
 		fix ONNX IsInf unintended dtype promotion (#9711) 
* add IsInf

* add corresponding test

* that float16 is kinda silly
 2025-04-02 22:46:15 -04:00
qazal
bb94f13e58
 		add RECORD_TRACEBACKS=1 option to process replay (#9679) 
* add RECORD_TRACEBACKS=1 option to process replay

* stack
 2025-04-02 11:58:27 +08:00
chenyu
c672716b38
 		improve vmin/vmax for IDIV (#9678) 2025-04-01 23:16:01 -04:00
geohotstan
d52e91db7b
 		ONNX ops clean ups (#9622) 
* combine work from remove numpy and onnx ops tests

* clippy

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-30 21:39:22 -04:00
geohotstan
a08b07b4da
 		Bump onnx==1.17.0 (#9618) 
* bump

* remove resize tf_crop_and_resize

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-30 03:21:51 -04:00
nimlgen
54e1e59b44
 		am: rdna 4 support (#9621) 
* hm

* fix

* return this

* fine

* g

* ruff

* fix
 2025-03-29 23:16:27 +07:00
nimlgen
118bd1cbed
 		hotfix: amd imports (#9620) 2025-03-29 20:19:53 +07:00
George Hotz
9115ce8860
 		linearizer fixups from DSP branch (#9581) 2025-03-26 18:28:15 +08:00
George Hotz
74d98eafb8
 		add onnx frontend stub [pr] (#9558) 2025-03-24 12:24:34 +08:00
nimlgen
d5667419af
 		am: move out pte creation logic (#9548) 
* am: move out pte creation logic

* emu

* ops
 2025-03-23 18:29:10 +07:00
geohotstan
309afa20b7
 		add Tensor.max_unpool2d (#9518) 
* why does max_unpool2d feel slower than out.gradient ...

* slightly cleaner

* what happened to ruff

* need to think about this some more

* slightly faster now?

* clean up, 1 more failing edge case

* ok good

* working TINY_BACKEND

* nit doc wording

* retry CI
 2025-03-22 12:11:33 -04:00
Francis Lata
1a1087e3a0
 		cleanups on losses and dataset tests (#9538) 2025-03-21 17:03:18 -04:00
Francis Lata
8cbe4009fc
 		RetinaNet losses (#9536) 
* add sigmoid_focal_loss and l1_loss

* update ref implementation comment
 2025-03-21 15:52:54 -04:00
Francis Lata
e6389184c5
 		update comment for retinanet dataloader implementations (#9534) 
Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-21 15:07:45 -04:00
Francis Lata
eb95825eea
 		RetinaNet dataloader (#9442) 
* retinanet dataloader

* remove batch_size from generate_anchors

* refactor kits19 dataset tests

* add tests for dataloader

* fix testing setup and cleanups

* remove unused import
 2025-03-21 13:36:41 -04:00
geohotstan
1d64c12f2b
 		add Topk to tensor (#9343) 
* terrible but somewhat working impl

* linux behaves differently than macos?

* slightly better impl

* small clean up; haven't figured this out yet

* better

* torch has different behavior on linux and macos for duplicated values

* add sum docs

* fix test

* add torch return_type test

* add an exception test

* wrap_fxn instead, and move op lower in order

* better repeated values test

* rerun ci
 2025-03-09 20:01:42 -04:00
nimlgen
243078dda9
 		am: optimize tlb usage (#9049) 
* am: optimize tlb usage

* fxies

* comments

* tiny
 2025-03-07 19:37:29 +03:00
geohotstan
088d86691b
 		fix onnx gather and onnx auto_pad VALID mode (#9375) 
* fix gather and auto_pad

* long -> int64
 2025-03-07 10:27:23 -05:00
nimlgen
9bd13de44c
 		lower test_gemv_4096_16384 to 750 for red (#9367) 2025-03-05 22:44:48 +03:00
chenyu
2cb2fce8d9
 		lower test_gemm_8192 amd_tflops to 65 (#9364) 2025-03-05 14:06:11 -05:00
nimlgen
14c88abf27
 		add some options to allreduce bench (#9348) 2025-03-04 23:46:36 +03:00
George Hotz
ba97fd0b9c hotfix: add test/external/external_benchmark_disk_raw 2025-03-02 02:32:15 +00:00
geohotstan
d9ec05cea6
 		Test Onnx quantization behavior (#9301) 
* add DynamicDequantizeLinear and corresponding tests

* wow qlinearops are round away from zero

* this passes locally...

* again

* try

* try separate test

* round to even again

* also add QLinearMul

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-03-01 19:21:58 -05:00
chenyu
38d7aae3b7
 		onnx fmod (#9307) 2025-02-28 14:09:22 -05:00
chenyu
4342300eff
 		lower test_gemm_8192 amd to 70 (#9277) 
flaky
 2025-02-26 16:32:08 -05:00
chenyu
aaf0a8069f
 		xor -> bitwise_xor (#9264) 2025-02-26 10:21:14 -05:00
geohotstan
f0b24d230c
 		add test_onnx_ops.py (#8569) 
* boom

* fix webgpu

* use exact variable names in test so that AI can read easier

* add tag for specific test name like test a specific dtype

* fix ruff

* astype everything

* dtype in array creation

* just arange

* is 67% considered fixed?

* move test up

* small cleanups

* share function

* add qgemm as well

* add qgemm too

* make sure qgemm comes out as int

* take out qgemm for now

* fixed test

* add correct qgemm

* addressing feedback here too, early naive fix for now

* simplify bias and c to be minimalistic enough to test correctness

* refactored qlinearops

* maybe these asserts aren't the best..

* fix test

* updated tests to cover new ops

* try to add to CI

* move test_onnx_ops into testextra/

* more attention tests

* qlinear_add atol=1

* attention still not fullllllly correct

* it is what it is

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-02-24 16:15:22 -05:00
George Hotz
c9493e41a6
 		reorder expand (#9051) 
* reorder expand

* symbolic ops needs resolve here

* s/arg/st + whitespace

* viz

---------

Co-authored-by: qazal <qazal.software@gmail.com>
 2025-02-24 13:55:47 +01:00
chenyu
2e7c2780a9
 		CLANG -> CPU (#9189) 2025-02-20 18:03:09 -05:00
George Hotz
a4dab3ec3f
 		add name uop (#9149) 
* add name uop, TODO: refactor renderer to use

* renderer uses name uop

* fix tests

* render

* ptx
 2025-02-18 15:26:58 +08:00
George Hotz
df3b320f46
 		rewriter -> devectorizer [pr] (#9147) 2025-02-18 12:42:08 +08:00
Josh Moore
1f9d2442b9
 		Add Tensor.scatter_reduce (#8947) 
* pytorch scatter -> scatter_reduce

* WIP scatter_reduce implementation

* _pre_scatter return type hint

* split out src, mask to satisfy linter

* Add src cast back in

* dict of lambdas instead of ifs

* sum and prod reduction ops with include_self

* add reduce arg error message

* add amax and amin reduction ops

* Fix include_self for higher dims

* Simplify

* Simplify amax and amin too

* Pull include_self logic out into _inv_mask function

* reduce arg cannot be None for scatter_reduce

* Fix self-mask issue

* Add mean reduce op

* Add tests

* any() not needed here

* remove comment

* End support for Tensor src with reduce arg in tinygrad scatter

* Process index, dim inside actual functions

* Add scatter_reduce to onnx

* Add excluded onnx ScatterElements reduction tests back in

* Save 2 lines on the mask helpers

* Update docs

* Add include_self=False tests

* cleanup

* Remove unneeded helper function

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-02-13 09:08:54 -05:00
chenyu
f4f56d7c15
 		move time_linearizer to extra.optimization.helpers [pr] (#9048) 
no longer used in tinygrad
 2025-02-12 15:49:58 -05:00
nimlgen
e5a3f60fc2
 		am: remove libpciaccess dep (#8980) 
* am: remove libpciaccess dep

* offset in mockhwiface

* op

* fake regions
 2025-02-09 16:06:55 +03:00
George Hotz
ae45826758 hotfix: GRAPH_ONE_KERNEL + fix timing 2025-02-06 17:52:20 +08:00
George Hotz
1c53e8bf27
 		Revert "objc fast msg (#8922)" (#8926) 
This reverts commit c3f99a727e.
 2025-02-06 17:50:49 +08:00
George Hotz
c3f99a727e
 		objc fast msg (#8922) 
* benchmark kernel launch

* don't realize unneeded

* faster

* faster metal

* fix mypy

* new objc message style [pr]

* without sync

* no div 0

* lru cache that

* no sync in the profile

* fix

* update all to new style

* remove comment

* graph one kernel

* fix graph one kernel

* remove that sync
 2025-02-06 17:49:06 +08:00
George Hotz
a8e54df363
 		benchmark single kernel launch (#8921) 
* benchmark kernel launch

* don't realize unneeded

* faster

* faster metal

* fix mypy

* without sync

* no div 0

* lru cache that

* no sync in the profile
 2025-02-06 13:35:34 +08:00
qazal
6f0cc2e9c5
 		rename to KernelContext and move the linearize_sched comment [pr] (#8899) 
* rename to KernelContext and move that comment [pr]

* 500
 2025-02-05 07:49:58 +01:00