mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
9,139 commits 280 branches 15 tags 325 MiB
Commit graph

160 commits

Author SHA1 Message Date
chenyu
b7198fdcfd
 		linearizer failure from wino fuse arange cifar (#10739) 2025-06-09 23:10:19 -04:00
George Hotz
81b9c04574
 		move high level stuff to unit tests [pr] (#10708) 
* move high level stuff to unit tests [pr]

* process replay on unit tests

* fix pr, less compute

* set omp num threads

* set 200MB buffer size limit

* delete junk

* fix tests

* faster

* move test_indexing to unit

* faster
 2025-06-08 14:05:56 -07:00
qazal
5b59728c75
 		refactor LOAD(DEFINE_GLOBAL, VIEW) in kernels to LOAD(VIEW(DEFINE_GLOBAL)) (#10541) 
* changes to core tinygrad

* fixups pt1

TC=3
docs/abstractions2.py
IMAGE=2
test_quantize_dsp
test_schedule

* more tests

* green now

* images stay images
 2025-05-30 14:27:58 +03:00
qazal
7051bf3fd5
 		fixup hardcoded asts ptr dtype and constants [pr] (#10570) 
* fixup hardcoded asts ptr dtype and constants [pr]

* use kernelize for test_kernel_count
 2025-05-30 09:38:32 +03:00
George Hotz
e140f8f0d8
 		linearizer test_failure_61 (#10552) 
* enumerate cases of Tensors in the JIT

* optional fused optimizers

* add fused optimizer test

* move that there

* ugh

* work on beautiful_cifar

* speed close to hlb_cifar

* test_failure_61

* just the failure
 2025-05-28 21:30:50 -07:00
George Hotz
411392dfb7
 		move files into uop dir (#10399) 
* move files into uop dir [pr]

* tinygrad.uop is a thing

* fix uop docs, no pr

* fix viz
 2025-05-18 11:38:28 -07:00
Ignacio Sica
bda116d773
 		fix use_tensor_cores propagation (#10048) 
* propagate use_tensor_cores

* add use_tensor_core to arg in test and search

* bugfix

* get TC val from ContextVar in search

* revert minor space change

* add tc emulation test to ci and benchmark

* revert

* revert whitespace change

* remove test for ptx

* add comment and remove llvm test run
 2025-04-28 19:30:50 -03:00
George Hotz
ecff82a698
 		fixing single kernel softmax: resolve (#10086) 
* fixing single kernel softmax: resolve

* add failing lin test
 2025-04-28 13:46:20 -04:00
George Hotz
129bddde74
 		lin failure from SINGLE_KERNEL_SOFTMAX (#10073) 
* lin failure from SINGLE_KERNEL_SOFTMAX

* fix lin issue

* more pure diff
 2025-04-27 13:02:10 -04:00
Sieds Lykles
e75be6eafc
 		[bounty] [pr] index validation with z3 (#9981) 
* index validation with z3

* Change comment

* toposort -> toposort()

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-04-24 08:06:08 -04:00
George Hotz
2ed3acd767
 		toposort is a function [pr] (#10004) 2025-04-23 16:25:03 +01:00
chenyu
f5256e0020
 		Kernel.apply_opts [pr] (#9917) 
* Kernel.apply_opts [pr]

updated all `for opt in`. also updated a few test_liinearizer tests to not implcitly depend on hand_coded_optimization

* not you yet
 2025-04-17 08:00:56 -04:00
chenyu
fe998798fb
 		linearizer failure test for OUT OF BOUNDS ACCESS (#9738) 2025-04-04 03:48:43 -04:00
chenyu
2e7c2780a9
 		CLANG -> CPU (#9189) 2025-02-20 18:03:09 -05:00
chenyu
f53b819648
 		UOps. -> Ops. [pr] (#9044) 
updated the comments and doc except extra
 2025-02-12 12:53:23 -05:00
George Hotz
e618efce22
 		COMMUTATIVE flipping is only for ints (#8996) 
* COMMUTATIVE flipping is only for ints [pr]

* no pr

* comm fixes this
 2025-02-10 12:01:28 +08:00
Ignacio Sica
260df1a17f
 		tc_select noop (#8801) 
* tc_select noop

* revert changes in test
 2025-01-29 13:53:23 -05:00
qazal
ba17786068
 		do not construct unmasked VALID (#8759) 
* new lines that exist in codegen/ops

* update tests

* update sops.gz (13071 -> 13070 asts)

* fix viz too

* remove that TODO

* diff pruning

* mask assert + device

* work

* diff pruning

* re: fix viz too

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-01-28 20:51:21 +02:00
Ignacio Sica
b240f12593
 		[TIP-9] rename Opt's amt to arg 2 (#8770) 
* rename Opt amt to arg

* ignore_beam_cache for test_tiny

* move ignore_beam_cache to test_tiny

* move to separate pr

* revert space change

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-01-27 14:19:04 -05:00
George Hotz
3ed146a5ff
 		Revert "rename Opt amt to arg (#8767)" (#8769) 
This reverts commit bf041659a5.
 2025-01-27 23:46:37 +09:00
Ignacio Sica
bf041659a5
 		rename Opt amt to arg (#8767) 2025-01-27 23:36:47 +09:00
George Hotz
b4bf6a7dea
 		switch backward to use gradient [pr] (#8235) 
* switch backward to use gradient [pr]

* set device correctly, dedup

* why does that fail?

* add noop cast

* simple backward

* fix beautiful_mnist

* touchups

* set in compute_gradient

* uop_count

* uop_count was wrong

* collections

* no note

* skip that test

* update sched kernel counts

* train mnist is 65

* fix metadata and gc

* fixes

* materialize_grads

* no pathlib stuff

* add contiguous_backward, fix bugs

* add some realize

* fix multi
 2025-01-26 09:12:16 +09:00
George Hotz
f17af70d17
 		replace all sparents with toposort (#7983) 2024-12-02 15:00:30 +08:00
ignaciosica
597a239e28
 		Remove UnaryOps, BinaryOps, TernaryOps, MetaOps [pr] (#7725) 
* remove unaryops

* remove ternaryops

* remove metaops

* hotfix

* remove binaryops

* hotfix: test_pattern_matcher

---------

Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
 2024-11-16 20:56:56 +08:00
qazal
0914c2fec9
 		add TestLinearizerFailures test_failure_56 and test_failure_57 (#7682) 
* add test_failure_56 and test_failure_57

* so it's only METAL=1
 2024-11-14 12:00:33 +08:00
George Hotz
bbc64bf305
 		x|(x&y) -> x (#7629) 
* x|(x&y) -> x

* fix tests
 2024-11-11 10:00:18 +08:00
George Hotz
205befa788
 		move is_dtype_supported to device [pr] (#7575) 2024-11-07 20:38:03 +08:00
Carl Basho
630a7f37cf
 		update tests (#7554) 
Co-authored-by: John Doe <null@mail.com>
Co-authored-by: chenyu <chenyu@fastmail.com>
 2024-11-05 11:35:15 -05:00
George Hotz
c8bf09b7d4
 		s/UOps/Ops (#7500) 
* s/UOps/Ops [pr]

* fix
 2024-11-03 11:26:10 +08:00
George Hotz
4e2895f8d2
 		safe changes from new dtype branch [pr] (#7397) 
* safe changes from new dtype branch [pr]

* only image test on GPU
 2024-10-30 17:18:48 +08:00
George Hotz
2fdfcffe4c
 		improve ci speed [pr] (#7357) 2024-10-29 17:00:35 +08:00
chenyu
0a4d01f6d4
 		disable simplify_valid (#7312) 
fixed test_failure_55. will reenable it later after fixing the bug
 2024-10-26 12:42:48 -04:00
nimlgen
3c62315aa8
 		add resnet pf (#7310) 
* add resnet pf

* all platforms
 2024-10-26 13:20:32 +03:00
chenyu
f511ad9103
 		No pyint again (#7156) 
* Revert "bring back pyint (#7150)"

This reverts commit 37e83ca6fc.

* remove truncate in const folding

* truncate_output=False
 2024-10-19 13:48:59 -04:00
nimlgen
54c6a317f8
 		test_failure_54 (#7155) 
* test_failure_54

* metal
 2024-10-18 23:31:18 +03:00
chenyu
37e83ca6fc
 		bring back pyint (#7150) 
fixed test_failure_52 and resnet. need to understand this better
 2024-10-18 14:54:37 -04:00
chenyu
12ff52b88b
 		test_failure_52 fails on real METAL (#7138) 2024-10-17 15:37:28 -04:00
chenyu
84e98900e8
 		test linearizer failure 53 (#7137) 
variable scope issue caused compile error
 2024-10-17 15:23:43 -04:00
George Hotz
ded1b38b84
 		minor dtype cleanup [pr] (#7124) 
* minor dtype cleanup [pr]

* use ptr() function
 2024-10-17 17:41:23 +08:00
nimlgen
9f00eacde5
 		nv tagged memory + resnet failed kernel (#7061) 
* nv tagged memory

* linter

* metal fix?
 2024-10-15 18:19:58 +03:00
chenyu
1a27417262
 		remove arbitrary multiplication case (#7033) 
adds the wrongly simplified kernel in test_linearizer_failures
#7019
 2024-10-13 15:06:05 -04:00
qazal
20d3c2d113
 		unify UOps.SHAPETRACKER and UOps.SWIZZLE with UOps.VIEW (#6955) 
* add UOps.VIEW

* update hardcoded asts

* update sops.gz
 2024-10-09 02:00:17 +08:00
George Hotz
14ad47b515
 		rewrite to use uops if (#6764) 
* rewrite to use uops if

* does this pass

* careful penalty

* fix tests

* remove unused stuff

* that's a cstyle rewrite

* Update test_linearizer_dumb.py
 2024-09-26 18:09:09 +08:00
George Hotz
bdd0c06f29
 		add void type to uop (#6471) 
* unwrap_dtype maybe

* uopgraph stuff that hardcoded None

* test_ops passes

* dtypes.py fixups

* update test_linearizer and friends

* more ast updates

* test_beam and test_schedule too

* add void type to uop [run_process_replay]

* remove dumb casts

* start making it green

* more cast cleanups

* more cls methods to fix

* regenerate dataset

* split UOp and NOp const

* maybe that too

* fix docs

* update test_uop_symbolic

* test_verify_ast

* new sops with no diff

* meh, type_ignore is alright

* remove that assert

---------

Co-authored-by: qazal <qazal.software@gmail.com>
 2024-09-11 18:16:28 +08:00
qazal
442150a8df
 		more ast_const for hardcoding consts [run_process_replay] (#6418) 2024-09-09 11:35:08 +08:00
George Hotz
66e7e51c79
 		Revert beam failure (#6376) 
* Revert "late gate creation for STORE [run_process_replay] (#6373)"

This reverts commit c26744de9f.

* Revert "gated store rewrite to UOps.IF (#5976)"

This reverts commit 48061e8400.
 2024-09-06 09:36:44 +08:00
Ian Paul
48061e8400
 		gated store rewrite to UOps.IF (#5976) 
* Core change to gate stores in IFs

* Updates to cstyle renderer to handle IFs around STOREs

* Make uops asserts happy

* Add tests and fix newly broken tests

* make ruff happy

* make mypy happy

* Simplify renderer to have all gated stores use IF

* Revert some changes

* Make test_where_fold happy

* Revert unnecessary handling of ifs rendering. Was included before when changes weren't fully built out

* Rewrite graph to have IFs be dependent on RANGEs if STORE is already dependent on RANGE

* Re-change broken test

* Make ifs be grouped together

* get non-merged IFs working. ALl tests pass except grouping related ifs together

* Fix tests by making the IF UOp dependent on the correct node of the STORE UOp

* Changes to uopgraph

* Simplify graph rewrite logic

* Changes to get test_padto_where_multireduce working

* Simplify uops.store renderer

* Make test_padto_where_multireduce pass but now other tests fail

* Clean up uopgraph from scrach work

* Ignore sudo IF srcs when rendering

* Attempt to fix llvm tests

* rm comment

* reduce lines

* Add line to make mypy happy :(

* llvmir fix pt 1

* Mods after rebasing to master

* Fix llvmir

* Fix ptx tests

* Fix other ptx tests

* Move changes from uops.py to ops.py

* rm uops.py

* Fix TestGateStoreRewrite tests

* Get multireduce tests working

* reset to remote branch

* Fix linearizer tests

* uop_graph test patch

* Add comment to create_gate

* hotfix: uncomment those tests

* Attempt to fix ptx tests by including whitespace inside if block

* Patch from remote tinybox. Tests passing here

* Min changes to get some ptx tests passsing

* Changes after rebase

* Exclude ifs and endifs from ptx

* IF conditional branching within ptx

* Save lines on delete_redundant_gates

* Simplify merge_gates

* rm noqa

* Remove unnecessary checks when merging gates

* Fix ops error msg

* Smarter check for if/endif in llvmir

* simplify delete redundant gates to only have 2 returns

* spacing

* Smarter check at beginning of merge_gates

* patches from comments

* Remove need for merge_gates

* include proper srcs in IF from the get-go

* test expand ifs dumb will result in 4 ifs, not 1 now

* Make tests happy

* Fix uops stats

* rm merge_gates method. Will add back in separate PR

* Spacing

* cleaner error msg

* Fix uops rendering when expanding. test_failure_43

* patch tests

* undo changes in delete_redundant_gates

* process replay attempt

* re-intro deletion of redundant gates

* fix addition of gates when they get nested in stores and loads

* patch tests

* smarter init of IF srcs when adding gate to STORE

* make ruff happy

* Resp to comment

* include all src[2]'s srcs in IF for gated store

* add reference of the storing value to the gate's src

* minor patch after rebasing

* change ptx renderer

---------

Co-authored-by: qazal <qazal.software@gmail.com>
 2024-09-06 01:05:30 +08:00
George Hotz
e882294c02
 		uops touchups [run_process_replay] (#6368) 
* uops touchups [run_process_replay]

* those are classmethods

* oops, kwargs

* no kwargs there
 2024-09-05 17:22:32 +08:00
George Hotz
0d6922edb4
 		faster local tests. copy torch permuted to defautl device [run_process_replay] (#6363) 2024-09-05 13:57:20 +08:00
George Hotz
406ec8240e hotfix: lin_fail_41 passes on my M3 Max 2024-08-31 11:46:46 -07:00