mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
6,220 commits 280 branches 15 tags 325 MiB
Commit graph

6,220 commits

This branch
This branch
All branches
Author SHA1 Message Date
George Hotz
6b063450df
 		move hcq device to runtime [pr] (#6879) 
* things that are only used in one place don't belong in helpers [pr]

* start moving hcq device [pr]

* fix paths
 2024-10-04 22:26:50 +08:00
George Hotz
5be2bd18a6
 		use UOps.BIND instead of ASSIGN, it's different (#6885) 2024-10-04 22:26:33 +08:00
chenyu
4c3895744e
 		type annotation for layernorm (#6883) 2024-10-04 09:03:56 -04:00
George Hotz
8ca506ee37
 		remove the magic methods for moving between devices [pr] (#6881) 
* remove the magic methods for moving between devices [pr]

* remove unneeded clang
 2024-10-04 20:27:52 +08:00
chenyu
7c8849010a
 		fix var_vals in MCTS (#6882) 
tested with JITBEAM=100 llama
 2024-10-04 08:19:35 -04:00
George Hotz
a0cb16ac61
 		node cleanup + local metal test speed [pr] (#6880) 
* node cleanup [pr]

* fix tests, including the double one on metal

* no time tqdm tests
 2024-10-04 18:14:23 +08:00
George Hotz
cdff1d75b6
 		things that are only used in one place don't belong in helpers [pr] (#6878) 
* things that are only used in one place don't belong in helpers [pr]

* pretty print moved
 2024-10-04 17:27:38 +08:00
George Hotz
f4ec39fe58
 		switch symbolic from old to uops, final PR (#6872) 
* switch symbolic from old to uops, final PR

* two wrong answers

* not needed resolves

* symbolic ops passes

* symbolic ops passes

* progress

* tests pass (almost)

* fix last test

* fix some tests

* global binding and unbinding

* Revert "global binding and unbinding"

This reverts commit 9456725630.

* that test works now

* vars on uop doesn't recurse

* fix fuzzer

* update

* fix type

* fix gpt, it's UOp now

* ssimplify symbolics
 2024-10-04 16:42:27 +08:00
George Hotz
738a5794a9
 		last update for new symbolic [pr] (#6877) 2024-10-04 14:58:51 +08:00
chenyu
7391376528
 		update bert hparams (#6876) 
4h32m with this https://wandb.ai/chenyuxyz/MLPerf-BERT/runs/q99frv1l/overview.

loss scaler 2**13->2**10. matched the closest submission, no nan for ~10 runs.

increased lr and total step a bit.

`PARALLEL=0` after setup, same as resnet.
 2024-10-04 00:39:06 -04:00
George Hotz
0dee49637e
 		small symbolic changes [pr] (#6874) 
* small symbolic changes [pr]

* need that unbind
 2024-10-04 12:03:08 +08:00
George Hotz
c50d3c4979
 		move const mover to ops [pr] (#6873) 
* move const mover to ops [pr]

* move more
 2024-10-04 11:49:32 +08:00
Tim Becker
d42cb5596f
 		Restore fast path for matching new_src in rewrite (#6870) 2024-10-04 11:22:24 +08:00
ignaciosica
8931f20765
 		CLANG fixed ops python [run_process_replay] (#6866) 
* hotfix: fixed values in ops_python for AMX

* hotfix: remove unused import
 2024-10-03 20:40:04 +08:00
George Hotz
4b6732c4f6
 		safe changes for new symbolic [pr] (#6864) 2024-10-03 20:39:15 +08:00
qazal
17068410e6
 		give EXT schedules metadata [pr] (#6865) 2024-10-03 20:14:18 +08:00
qazal
5517a07a09
 		viz late to_program and benchmarks [pr] (#6851) 
* viz late to_program [pr]

* benchmark resnet

* delete all of checkStatus

* revert that

* fixup

* get from kernel
 2024-10-03 18:29:04 +08:00
qazal
c7925414df
 		don't default print the whole graph in buf limit error [pr] (#6861) 2024-10-03 18:02:19 +08:00
George Hotz
e10245909a
 		explore global uop cache [pr] (#6863) 
* explore global uop cache

* wvd uops

* remove useless lru caches

* key is is

* simpler rewriter
 2024-10-03 13:08:13 +08:00
George Hotz
a26c6a0ad0
 		cleanup with smax [pr] (#6854) 
* cleanup with smax [pr]

* add that resolve
 2024-10-03 08:11:02 +08:00
nimlgen
8bbf6fb88c
 		use mv_address in ops_gpu (#6856) 2024-10-02 22:31:51 +03:00
chenyu
c3c93f332a
 		symbolic bool raise ValueError when not sure [pr] (#6853) 2024-10-02 09:10:58 -04:00
chenyu
08850da026
 		minor rand_like change [run_process_replay] (#6848) 2024-10-02 07:27:51 -04:00
George Hotz
7214450c23
 		little symbolic changes [pr] (#6849) 
* little symbolic changes [pr]

* symbolic needs resolve too

* no resolve

* less change
 2024-10-02 17:12:30 +08:00
qazal
fc78716d31
 		Buffer arg from big graph [pr] (#6847) 
* Buffer arg from big graph [pr]

* x.dtype
 2024-10-02 15:28:47 +08:00
qazal
29363fb85e
 		add dtype.ptr() [pr] (#6839) 2024-10-02 15:03:05 +08:00
George Hotz
be12409b51
 		changes for symbolic (#6844) 
* changes for symbolic

* only for ints

* check int first
 2024-10-02 12:57:16 +08:00
qazal
1735f8ef1c
 		viz rewrite part 1 [pr] (#6842) 
* core viz spec

* leaaan

* refine docs

* .

* add rewrite_count back in ui
 2024-10-02 11:56:25 +08:00
mesozoic-egg
d2e02b47e1
 		Construct c_ulong in blitCommandEncoder copy method (#6793) 
* Construct c_ulong in blitCommandEncoder copy method

* line too long

---------

Co-authored-by: Mesozoic Egg <mesozoic.egg@proton.me>
 2024-10-02 11:09:37 +08:00
George Hotz
567e10efcb
 		lil symbolic changes [pr] (#6841) 2024-10-02 10:56:22 +08:00
George Hotz
100ce7a684 hotfix: min/max on CMPNE was wrong 2024-10-02 10:15:03 +08:00
chenyu
5f77217772
 		bert default CKPT to 0 (#6840) 
not required
 2024-10-01 21:55:56 -04:00
George Hotz
1ac83aaa4b
 		lil sym changes (#6837) 
* lil sym changes [pr]

* fix inf crap

* Update ops.py

* remove that, it's wrong
 2024-10-02 09:54:17 +08:00
Tobias Fischer
33f7599158
 		Compute FID Score (#6802) 
* compute fid score code

* cleaner s1 and m1 loading
 2024-10-01 19:47:58 -04:00
ignaciosica
6a73ad89a2
 		get global, local and shared max from cudarenderer (#6836) 2024-10-01 16:32:57 +03:00
George Hotz
84726e8855
 		good changes from symbolic removal [run_process_replay] (#6835) 
* good changes from symbolic removal [run_process_replay]

* fix __ne__
 2024-10-01 18:49:09 +08:00
qazal
c5b252cdb3
 		add pr alias [pr] (#6834) 2024-10-01 18:48:44 +08:00
George Hotz
e907b25792
 		move some pm rules to uopgraph.py [run_process_replay] (#6831) 
* move some pm rules to uopgraph.py [run_process_replay]

* move more

* move lt and clean

* end maybe

* put back
 2024-10-01 18:28:41 +08:00
qazal
0cb82f308c
 		viz don't include graph_rewrites that return a non-UOp (#6832) 
* viz don't include graph_rewrites that return a non-UOp

* delete bad things
 2024-10-01 18:13:53 +08:00
George Hotz
2a540d87e7
 		don't use is_int [run_process_replay] (#6833) 2024-10-01 18:13:34 +08:00
vladov
501cfde7e6
 		Fix GPT2 with OpenCL backend. (#6821) 
* Fix GPT2 with OpenCL backend.

* Add test for unaligned copies into OpenCL buffers.
 2024-10-01 16:57:22 +08:00
qazal
a16a8c5958
 		color process replay stats [run_process_replay] (#6830) 2024-10-01 15:29:11 +08:00
George Hotz
547733e57c
 		stunning_mnist [run_process_replay] (#6828) 
* stunning_mnist [run_process_replay]

* add loss to stunning mnist
 2024-10-01 15:00:48 +08:00
qazal
391497a311
 		schedule independent of Device [run_process_replay] (#6829) 2024-10-01 14:46:26 +08:00
George Hotz
8a93c48901
 		pickle main pattern matcher [run_process_replay] (#6827) 
* pickle main pattern matcher [run_process_replay]

* del line
 2024-10-01 13:58:42 +08:00
George Hotz
d726eb6f48
 		uop resolve [run_process_replay] (#6826) 
* uop bool and int and stuff [run_process_replay]

* add ne support

* can't even be None anymore

* BinaryOps.AND support

* less compare
 2024-10-01 13:11:42 +08:00
qazal
a42b177533
 		express CONST view as SWIZZLE, uop VALID only once [run_process_replay] (#6823) 
* construct VALID once and SWIZZLE

* make Variable work

* image dtype

* test: merge views happens already
 2024-10-01 11:44:26 +08:00
George Hotz
50dd6bd951
 		move cmp tuple out [run_process_replay] (#6825) 
* move cmp tuple out [run_process_replay]

* was unneeded
 2024-10-01 10:38:28 +08:00
qazal
a1dee0e532
 		early uop UOps.BUFFER (only once) [run_process_replay] (#6820) 
* buf_uops lookup [run_process_replay]

* next diff will be this

* fix ImageDType
 2024-10-01 08:46:05 +08:00
nimlgen
e213bea426
 		nv shorter (#6819) 2024-09-30 19:39:32 +03:00