mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
9,878 commits 280 branches 15 tags 325 MiB
Commit graph

50 commits

Author SHA1 Message Date
George Hotz
82be8abfd2
 		move opt under codegen (#11569) 2025-08-07 14:19:17 -07:00
chenyu
a0438012af
 		remove Kernel.get_program [pr] (#11203) 2025-07-12 20:50:29 -04:00
chenyu
a6485d00c8
 		very tiny generate_dataset (#11013) 
one minute to gen on my mac
 2025-06-27 17:10:45 -04:00
qazal
712980e167
 		fix extract_dataset + add tests to CI (#10995) 
* fix extract_dataset + tests

* add CI

* sops.gz itself is same as master

* yml + gzip -c + ge

* don't commit that

* bump limit to 1000

* axis=7

* test_tiny
 2025-06-27 01:51:36 +03:00
George Hotz
92678e59ee
 		move kernel to opt (#10899) 2025-06-20 15:22:28 -07:00
George Hotz
411392dfb7
 		move files into uop dir (#10399) 
* move files into uop dir [pr]

* tinygrad.uop is a thing

* fix uop docs, no pr

* fix viz
 2025-05-18 11:38:28 -07:00
chenyu
f5256e0020
 		Kernel.apply_opts [pr] (#9917) 
* Kernel.apply_opts [pr]

updated all `for opt in`. also updated a few test_liinearizer tests to not implcitly depend on hand_coded_optimization

* not you yet
 2025-04-17 08:00:56 -04:00
chenyu
1fda98d14f
 		fix import time_linearizer [pr] (#9118) 
only test that used it was skipped in CI due to being slow
 2025-02-15 21:33:28 -05:00
chenyu
f4f56d7c15
 		move time_linearizer to extra.optimization.helpers [pr] (#9048) 
no longer used in tinygrad
 2025-02-12 15:49:58 -05:00
chenyu
a092b6395d
 		Tuple -> tuple, List -> list [pr] (#8936) 2025-02-06 14:21:19 -05:00
ignaciosica
597a239e28
 		Remove UnaryOps, BinaryOps, TernaryOps, MetaOps [pr] (#7725) 
* remove unaryops

* remove ternaryops

* remove metaops

* hotfix

* remove binaryops

* hotfix: test_pattern_matcher

---------

Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
 2024-11-16 20:56:56 +08:00
qazal
e84d089ef1
 		delete ReduceOps, only use REDUCE_AXIS (#7667) 2024-11-13 19:04:27 +08:00
chenyu
e7b18cf5c0
 		fix load_worlds filter_novariable (#7564) 
filter based on "DEFINE_VAR" instead of "Variable". also added a unit test to make sure dataset includes image and variable kernels
 2024-11-05 16:06:39 -05:00
chenyu
207bca6cea
 		set PAGE_SIZE=1 and generate new dataset (#7559) 
13080 rows in total. both generating and loading this are pretty broken now. filters are wrong for example
 2024-11-05 11:25:01 -05:00
chenyu
7581a57aac
 		show the actual dataset size in error message (#7557) 2024-11-05 09:16:30 -05:00
chenyu
0db5f52b2a
 		check datasets/sops.gz size to be > 5000 (#7555) 
it has > 12000 rows now, but it depends on the backend that generates these so setting a lower but meaningful threshold
 2024-11-05 09:03:19 -05:00
George Hotz
c8bf09b7d4
 		s/UOps/Ops (#7500) 
* s/UOps/Ops [pr]

* fix
 2024-11-03 11:26:10 +08:00
qazal
8ff6514ba3
 		delete extra/ops.py [pr] (#7072) 2024-10-15 22:14:21 +03:00
chenyu
bd8ecf7fd6
 		remove NumNode (#7035) 2024-10-13 16:42:19 -04:00
George Hotz
a71bb09ec3
 		remove symbolic file [pr] (#7012) 2024-10-12 18:44:44 +08:00
George Hotz
5ae2de9845
 		UOp.variable (#7010) 
* UOp.variable [pr]

* fix tests

* clean

* improve name rendering

* last bug
 2024-10-12 18:20:44 +08:00
George Hotz
a0cb16ac61
 		node cleanup + local metal test speed [pr] (#6880) 
* node cleanup [pr]

* fix tests, including the double one on metal

* no time tqdm tests
 2024-10-04 18:14:23 +08:00
qazal
9295bc0189
 		viz more work [run_process_replay] (#6568) 
* infra

* found it

* real work

* bring those back

* cleanup test_viz

* comment that out
 2024-09-17 19:27:09 +08:00
gswangg
94a72d44d2
 		update CI tests in extra with UOp AST (#6290) 2024-08-28 22:26:50 +03:00
chenyu
e745e16441
 		remove UnaryOps.NEG (#6238) 
* Remove UnaryOps.NEG

generated new dataset with
```
time JIT=2 PYTHONPATH=. ./extra/optimization/generate_dataset.sh
gzip /tmp/sops
mv /tmp/sops.gz extra/datasets/
```

* fix that
 2024-08-22 14:21:39 -04:00
qazal
c23d44c779
 		AST is UOp (#6030) 
* most of the work from the uops2 branch

* schedule

* realize

* kernel

* lowerer

* search

* green

* merge uops with ops

* Revert "merge uops with ops"

This reverts commit 1408a59f12.

* fix benchmark

* remove extra dedup
 2024-08-16 22:09:00 +03:00
George Hotz
fa7e734b49
 		MetaOps.KERNEL (#5543) 2024-07-17 19:41:23 -07:00
Francis Lam
2d53abb04a
 		test/external/fuzz_linearizer: fix for new AST changes (#5519) 
* test/external/fuzz_linearizer: fix for new AST changes

also add beautiful_mnist failures

* add CLANG and LLVM to test_failure_35 failed_platforms

* fix test_linearizer_failure names
 2024-07-17 00:08:07 -04:00
George Hotz
03c2dc8bd7
 		lowerer is kernel [run_process_replay] (#5437) 2024-07-12 18:50:55 -07:00
George Hotz
870dc8c350
 		s/Linearizer/Lowerer [run_process_replay] (#5428) 2024-07-12 15:54:07 -07:00
George Hotz
6707c778d0
 		scheduleitem is not Tuple [run_process_replay] (#5425) 
* scheduleitem is not Tuple [run_process_replay]

* fix tests

* fix op + fuzzers

* fix mop test
 2024-07-12 15:13:19 -07:00
Francis Lam
5587594a00
 		fuzz_linearizer: add --ast and --file params to read kernels (#3877) 
also fix up ast_str_to_str to support the new tuple of LazyOps
 2024-03-22 14:27:40 -04:00
Francis Lam
6d5dec2fef
 		log optimized kernels and a script to compare with non-optimized ones (#3829) 
* search: add BEAM_VERIFY option to validate search results

refactor fuzz_linearizer comparison to allow it to be used in for
BEAM_VERIFY in device.py

* search: fix to verify the beam_search result and not the fastest

* search: fix typing and clean up

* device: remove imports from test and add LOGKERN options

LOGKERN output can be used with test/external/verify_kernel.py
to validate correctness

* fix example in verify_kernel.py

* cleanup fixes

* fix to use f-strings
 2024-03-20 19:22:08 -04:00
qazal
aec4c4f01b
 		linearizer ast as a tuple of lazyops (#3689) 
* multi store op linearizer

* currently we do only one output per kernel

* named opts
 2024-03-11 15:39:04 -07:00
George Hotz
ac02e7347d
 		ptx timing vs cuda timing (#3659) 2024-03-08 10:17:49 -08:00
George Hotz
c003be7309
 		Revert "track size in shapetracker" (#3043) 
* Revert "track size in shapetracker (#3026)"

This reverts commit a8ba1ac08f.

* st.size
 2024-01-08 13:13:39 -08:00
George Hotz
a8ba1ac08f
 		track size in shapetracker (#3026) 
* track size in shapetracker

* shapetracker adapter

* size is an int

* create Buffer with st.size

* only compare the views for the jit

* fix webgpu
 2024-01-05 20:15:53 -08:00
chenyu
b1d9e54ea3
 		regenerate kernel ast dataset (#2968) 
added back the log ast function and removed hacks that work around the old dataset
 2024-01-01 20:26:17 -05:00
George Hotz
a280cfe169
 		move dtypes to dtype.py (#2964) 
* move dtypes to dtype.py

* fix urllib
 2024-01-01 14:58:48 -08:00
qazal
12996d3a7d
 		green linearizer asserts for ops (#2800) 
* these asserts should pass

* fix that assert

* ALU dtypes

* acc dtype for group_for_reduce

* cast image ALUs to the base dtype

* remove all casts from linearizer

* fix argmax

* fix multinomial

* fix __getitem__

* Revert "fix __getitem__"

This reverts commit 62ad719bfa.

* fix MemBuffer outputs being wrong when there is an arange + ALU with a different dtype

eg. fancy slicing (int, float), bert embeddings (int, long)

this should be fixed in lazy instead of having to break the kernel

* cleanup argmax fix

* fix matmul in ints

cast in the end

* fix llama

* skip wrong hardcoded asts in the worlds dataset

* fix llama p2

* cleanup missing parts of the diff

---------

Co-authored-by: George Hotz <geohot@gmail.com>
 2023-12-25 10:41:54 -05:00
chenyu
765f8b05e5
 		TernaryOps.WHERE has vin[0] as bool and BinaryOps.CMPLT always outputs bool (#2782) 
* vin[0] to where is always bool

* due to better hack

* update test

* fix test_uops
 2023-12-15 14:51:51 -05:00
chenyu
7fec966b5e
 		bye bye NOOP (#2534) 
* bye bye NOOP

* SIN

* NEG
 2023-11-30 23:10:35 -08:00
George Hotz
5629fc368c
 		Use Buffer.STORE at the end of ASTs (#2494) 
* work

* store broken

* interpreteds work

* this passes

* symbolic cpu

* fix tests

* fix opt tests

* images fail

* fix InterpretedFlopCounter

* stupid hack for images
 2023-11-28 20:11:37 -08:00
George Hotz
ab5d14d4ba
 		MEM -> LOAD (#2492) 
* MEM -> LOAD

* keep legacy working
 2023-11-28 16:46:37 -08:00
chenyu
822d6e6f18
 		Simpler mops verify (#2325) 
* rewrite the to_movement_ops check using symbolic

* tweak
 2023-11-15 21:47:18 -05:00
George Hotz
e0201922e3
 		Q network for pruning BEAM / uops deduping / BEAM_ESTIMATE (#2142) 
* stable diffusion < 324ms

* revert swap action

* fix tests due to more sum splitting

* REDUCEOP_SPLIT_THRESHOLD env var

* added from unaligned np test (#2134)

* align cpu buffer before copy into cl buffer (#2135)

* remove shelve from handcode_resnet50_opt.py (#2139)

* Add dictionary keys to reduce db size (#2131)

* work

* ignore beam cache

* dictionary keys are generic

* minor db cleanups

* fix baseline and extract dataset

* fix training

* log likelihood

* more lin to feats

* sts

* training policynet

* net sort of works

* dedup

* refactor, stupid new actions

* fix uops deduping

* BEAM_ESTIMATE

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
Co-authored-by: imaolo <56898718+imaolo@users.noreply.github.com>
 2023-10-27 10:53:06 -10:00
George Hotz
c5edb3c374
 		train value net, improve API, add BCE (#2047) 
* api cleanups, BCE losses

* valuenet

* fixup examples

* learning okay

* add valuenet runner

* net improvements

* net improvements

* 40% win rate
 2023-10-12 07:56:38 -07:00
George Hotz
0ba629c7b9
 		add world dataset (#2045) 2023-10-11 15:54:30 -07:00
George Hotz
0c3b6f13a8
 		Latest opt (#2044) 
* split out actions

* rl algorithm
 2023-10-11 15:46:14 -07:00
George Hotz
41bfeb2c1e
 		start work on auto opt (#2034) 
* start work on auto opt

* lin failure

* not beating hcopt

* greedy

* timing is fast

* codegen.search

* greedy search in handcode_opt

* track running gflops

* clean up those files

* no failure
 2023-10-11 12:54:53 -07:00