mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
13,471 commits 280 branches 15 tags 325 MiB
Commit graph

1,025 commits

Author SHA1 Message Date
George Hotz
63ba2d05d1
 		uops dfs cleanup (#5147) 
* uops dfs cleanup

* Update uops.py
 2024-06-25 18:51:42 -07:00
chenyu
e356807696
 		tinytqdm.set_description and tinytrange (#5101) 2024-06-22 14:45:06 -04:00
chenyu
8080298739
 		s/tinytqdm/tqdm (#5103) 
except in unit test where tqdm is imported
 2024-06-22 14:18:26 -04:00
nimlgen
f1e758bacb
 		graph fuzzer (#5082) 
* graph fuzzer

* more options

* mypy

* no underscores for funcs
 2024-06-21 18:47:23 +03:00
qazal
8aa786232d
 		docs for running process replay locally (#5083) 2024-06-21 09:55:08 -04:00
George Hotz
6f6b3b10c9
 		import from uops, not linearizer (#5064) 2024-06-20 08:08:44 -07:00
qazal
ee01e464e3
 		use process replay as a diff creator (#4903) 
* add no_assert option [run_process_replay] [no_assert]

* test [run_process_replay] [no_assert]

* [run_process_replay]

* back to normal [run_process_replay]

* remove the log
 2024-06-19 18:17:31 +03:00
chenyu
a3ed4176c8
 		use tinytqdm in active tests and examples (#5038) 
* use tinytqdm in active tests and examples

stress test this before 0.9.1

* no set_description
 2024-06-18 16:01:19 -04:00
kormann
7c3b877216
 		rename uop [run_process_replay] (#5031) 
* rename

* fix unittests

* rename vin

* fix test

* fix type [run_process_replay]

* rm pre commit hook change
 2024-06-18 21:34:05 +03:00
nimlgen
794acefbf3
 		hcq update waits and signals in place (#4984) 
* hcq update waits and signals in place

* start amd

* amd works

* prettier

* test

* normal messages

* linetr

* linter 2
 2024-06-17 17:19:07 +03:00
qazal
71aad183fd
 		check Program from HEAD [run_process_replay] (#4996) 
* use the same prg [run_process_replay]

* put var back
 2024-06-16 20:12:30 +03:00
chenyu
67e8df4969
 		remove numpy from dtype (#4969) 
replaced all dtype.np with _to_np_dtype defined in tensor.py.

after this, the only numpy usages are (1) Tensor(np.ndarray), (2) construct .numpy() output, (3) numpy random buffer
 2024-06-14 15:38:45 -04:00
George Hotz
14189bca68
 		graph_dedup function [run_process_replay] (#4955) 2024-06-14 04:24:37 -07:00
George Hotz
63a8add2c2
 		move uops add logic to linearize (#4952) 
* move logic to linearize

* idk how this should work

* empty
 2024-06-14 03:52:37 -07:00
Jhenner Tigreros
dc9e9e4363
 		Convert BinaryOps.DIV to UnaryOps.RECIP and BinaryOps.IDIV (#4887) 
* Create UnaryOps.RECIP and BinaryOps.IDIV and changing uses of BinaryOps.DIV

* Delete unused import

* Add cstyle renderer

* Fix formatting text

* Fix test error due to bad implementation of renderer

* Add PTX support

* Add RECIP to LLVMIR

* Remove BinaryOps.DIV from symbolic test

* Change some test and fix C floor division

* Change references to DIV for the RECIP or IDIV

* Add mimic idiv for symbolic test

* Restore floor

* Mimic idiv

* cast to int

* Fix some test and renderer

* Remove DIV for render nodes

* Resolve issue with div

* Add TestRenderer

* Fix test

* fix error

* Fix PAD test

* Fix div implementation

* Remove DIV

* Add upcast to rshift, due to use of MUL and RECIP on DIV

* Fix linter

* Remove complete BinaryOps.DIV

* Fix lint

* Fix some test

* Revert mul modification

* Fix tests

* Fix CLANG for uops

* Revert IDIV function

* Minor fix

* modify pattern matching rule to support nan

* Fix UNSAFE_PADS_OPS to add UnaryOps.RECIP

* Remove const folding for IDIV and fix PTX

* Complete remove IDIV from extra

* Remove test_div from TestFloatUOps due to test on recip

* Fix linearizer

* fix

* Fix test_22

* Fix llvm

* Apply trunc function for llvmlit

* use floor instead of trunc

* Use correct type

* Generate new fuzz db

* Fix rshift, do not cast to float to support idiv

* Return upcast=false to rshift

* Add to unsafepad BinaryOps.IDIV

* Remove RECIP override for CUDA

* add atol / rtol for the test

* Remove cast to int on IDIV

* Regenerate sops

* delete sops.gz

* regenerate

* regenerate

* regenerate

* Reduce margins

* pass atol and rtol as parametersg for _test_metrics

* regenerated dataset

* Regenerate

* Remove duplicated

* Revert changes on extra

* Remove changes extra and NOQA for test

* Remove E501

* Remove and change line

* Remove E501

* Fix atan2

* Revert import and E501

* Remove E501

* Add hrcp to halp ops

* Remove 1 of hrcp

* Remove last DIV and add type check on uops for IDIV

* Fix new tests

* Fix tests and custom function

* Regenerate dataset

* Regenerate dataset

* Revert dataset

* Change generate dataset script

* Remove line

* Change IDIV, type checker validate if x,y and z are int

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2024-06-14 02:43:46 -07:00
chenyu
fdbb4305cb
 		skip unsupported dtype in fuzz_linearizer (#4917) 
resolve issues in #4887. dataset generated from ubuntu but metal does not support double
 2024-06-11 18:18:21 -04:00
chenyu
b886d250fb
 		improve test_dropout_on_shard (#4912) 
tested some basic property, also minor formatting for a few Tensor.training setups
 2024-06-11 11:36:02 -04:00
nimlgen
d24e57c615
 		amd support kernel with bf16 (#4863) 
* amd support kernels with dispatch_ptr

* fixes

* line savings

* one line

* try

* Revert "try"

This reverts commit 5f340dfdd4.

* not used will be back when hsa is gone

* gone will be back

* add this as well
 2024-06-08 22:52:32 +03:00
qazal
1e3325f369
 		raise assert [run_process_replay] (#4879) 2024-06-08 08:31:44 -04:00
qazal
66dfd5e7bf
 		faster codegen process replay (#4858) 
* faster codegen process replay

* use self.copy

* regenerate

* delete copy

* test a real error [run_process_replay]

* revert the error change
 2024-06-07 16:20:57 +03:00
Francis Lam
890e7c12bb
 		test/external/verify_kernel: add support for single pickled kernel (#4836) 2024-06-04 18:59:21 -04:00
Elias Wahl
04e237328b
 		Refactor to class style (#4804) 2024-06-04 14:08:31 -07:00
chenyu
cde7a7cda7
 		isolate the 134ms kernel in train_gpt2.py (#4773) 
133ms on tinybox red with BEAM=2
 2024-05-29 17:26:24 -04:00
chenyu
59c6472b9f
 		check contiguous in View.create after canonicalizing mask and offset (#4770) 
mask / offset / strides can change during canonicalization, and contiguous can be True at the end
 2024-05-29 11:31:13 -04:00
nimlgen
019f4680e5
 		check dims before execution on nv (#4756) 
* check dims before execution on nv

* fix linter
 2024-05-28 16:57:28 +03:00
qazal
c170ddceaf
 		fix commavq benchmark (#4712) 
* fix _slice and assert explicit device

* with _slice
 2024-05-24 19:40:57 +03:00
qazal
498cf3e7e0
 		fuzzer path search for DEFINE_ACC (#4656) 
* insert acc

* add test_ops

* find toposorts

* todo - not yet ready

* remove the import

* atol and childless children
 2024-05-23 00:50:01 +03:00
Francis Lam
721f9f6acf
 		test/external/verify_kernel: fix LOGKERNS variable name in comments (#4685) 
should've been changed with the LOGKERN to LOGKERNS change
 2024-05-22 17:08:40 -04:00
nimlgen
c9f7f2da70
 		nv hcq bind api (#4629) 
* hcq bind api for nv

* linter

* linter

* add test

* small comment
 2024-05-19 23:17:10 +03:00
qazal
d308f4fa9a
 		correctly insert UOps.END* in fuzz result (#4653) 2024-05-19 21:10:28 +03:00
qazal
954718e6bf
 		reorder DEFINE_GLOBAL in fuzz_uops (#4651) 
* globals base

* test: opt out of DEFINE_GLOBAL

* do it like ExecItem
 2024-05-19 20:51:31 +03:00
qazal
b0cb02f719
 		uops fuzzing infra (#4641) 
* base with bfs

* find paths

* get last

* try blocks

* Revert "try blocks"

This reverts commit 25f8e3fe85.

* this should be simpler

* full exec

* support debug

* fix lint

* add todo

* copy in_degree
 2024-05-18 20:19:57 +03:00
qazal
a5204fe89d
 		refactor UOps.CONST (#4639) 
* delete more

* nit: dont need assign

* can this be simpler

* use scalars

* always cast

* clang needs cast

* format
 2024-05-18 10:07:36 +03:00
nimlgen
10cf8e459b
 		hcq update queue in place (#4626) 
* do not self wait in hcq

* faster enqueue

* comments

* tests

* linter

* fix typo
 2024-05-17 22:18:20 +03:00
qazal
f3f2b96583
 		pick schedule tests from external_test_opt (#4615) 
* conv tests

* misc

* that shouldnt const fold
 2024-05-16 15:43:41 +03:00
nimlgen
65f7e3b3ab
 		nv setup constbuf4 (#4511) 
* nv correct constbuf 4

* compare results to cuda

* test fixed

* failed kernel

* repro

* revert this change
 2024-05-16 10:42:35 +03:00
George Hotz
5ba611787d
 		move image into tensor.py. delete features (#4603) 
* move image into tensor.py

* change setup.py

* openpilot tests need pythonpath now
 2024-05-15 10:50:25 -07:00
qazal
cd4d7e18c7
 		_recurse_lb small cleanup (#4601) 
* minor cleanups

* comments

* extend env in replay
 2024-05-15 19:10:42 +03:00
George Hotz
ff64bcab69
 		move graph/search to engine (#4596) 2024-05-14 23:12:59 -07:00
George Hotz
fd02ab1e8b
 		move disassemblers and openpilot (#4592) 
* move disassemblers and openpilot

* delete junk

* put that in pre-commit

* fixup readme
 2024-05-14 19:30:02 -07:00
Szymon Ożóg
5eb81ff764
 		Fix speed compare script (#4581) 
* Fix speed compare script

* Update speed_compare_cuda_ptx.py

* Update speed_compare_cuda_ptx.py

* Remove unused function
 2024-05-14 17:47:03 +03:00
nimlgen
2131556c2c
 		amd mockgpu (#4535) 
* start mock amd gpu

* virt files

* cleaner

* init ci

* small fixes

* linter

* better?

* ugh

* linter

* fix

* diable some

* run shorter

* fixes

* add hcq test

* fix

* fix cmd revert
 2024-05-14 14:28:04 +03:00
George Hotz
7a26bdac65
 		move scheduleitem to schedule.py (#4541) 
* move scheduleitem to schedule.py

* don't need that type checking anymore
 2024-05-11 21:13:04 -07:00
George Hotz
508e8a6666
 		add cpu objdump to LLVM/CLANG (#4537) 2024-05-11 14:28:44 -07:00
George Hotz
328b083e66 lil profiling script 2024-05-11 11:02:44 -07:00
George Hotz
2f970a4fc2
 		all realize 2 (#4527) 
* all realize 2

* tests fixup

* fix more tests

* fix openpilot

* fix tests

* unneeded
 2024-05-10 22:43:09 -07:00
George Hotz
347a3acb37
 		add renderer class (#4524) 
* add renderer class

* tests pass

* fix pylint

* fix tensor cores
 2024-05-10 21:40:02 -07:00
chenyu
b00b6b16f0
 		fix TRAIN_BEAM and Tensor.training for mlperf bert (#4525) 
also hard coded bert model config instead of looking up a file
 2024-05-11 00:18:36 -04:00
George Hotz
827058f030
 		update tests get_runner (#4522) 2024-05-10 20:09:22 -07:00
George Hotz
d438d5698d
 		bring buffer back to device (#4517) 2024-05-10 11:22:31 -07:00