mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
13,471 commits 280 branches 15 tags 325 MiB
Commit graph

1,025 commits

Author SHA1 Message Date
qazal
9a67ec6174
 		refactor to list of kernels [run_process_replay] (#6403) 2024-09-08 17:19:45 +08:00
George Hotz
282af21b95 hotfix: DEBUG_EXPAND -1 and NOOPT in benchmark schedule 2024-09-06 17:22:30 +08:00
nimlgen
a1a15b54c9
 		qcom cache flush (#6367) 
* qcom cache flush

* bench

* linter

* move
 2024-09-05 13:23:39 +03:00
qazal
99018a4aa1
 		minor schedule differ utils [run_process_replay] (#6348) 
* minor schedule differ utils [run_process_replay]

* rm
 2024-09-04 03:41:38 +08:00
nimlgen
3adb76894d
 		validate image=2 float16=1 openpilot benchmark (#6346) 
* validate image=2 float=16 openpilot

* linter

* linter2
 2024-09-03 20:13:40 +03:00
George Hotz
72939901fc hotfix: ebs print kernel names 2024-08-29 21:20:36 -07:00
George Hotz
365babe391
 		precompute early_reject [run_process_replay] (#6327) 
* precompute early_reject [run_process_replay]

* features for ebs

* fix ocelot cache
 2024-08-29 18:26:24 -07:00
qazal
dd4e5f1c8d
 		process replay rewrite (#6284) 
* process replay rewrite

p2

* start some unittests + exceptions and exits

* shebang

* remove extra kernel init
 2024-08-29 15:08:27 +03:00
qazal
ec34d9ee36
 		start benchmarking ast graph rewrite (#6297) 
* ast_rewrite to ctx var

* add external_benchmark_ast

* refactor to asts

* track lazybuffers

* more work

* record checkpoint

* cleanup
 2024-08-27 18:18:44 +03:00
qazal
d2f8eeed2e
 		make [compare_schedule] the default [run_process_replay] (#6273) 
* make [compare_schedule] the default

* capture ctx

* logging

* set capture to false
 2024-08-26 21:40:03 +08:00
qazal
ae23540d6e
 		refresh process replay schedule ref in reset.py (#6265) 2024-08-24 16:12:51 +03:00
George Hotz
26498b322e add BEAM to external_benchmark_schedule.py 2024-08-23 18:10:46 -07:00
chenyu
590c0922b6
 		Tensor.prod (#6250) 
* Tensor.prod

a new reduce op!

* onnx ReduceProd
 2024-08-23 10:06:32 -04:00
chenyu
3fc8203475
 		remove NEG from handwritten ast in tests (#6234) 
* remove NEG from handwritten ast in tests

* test_linearizer_failures
 2024-08-22 09:06:59 -04:00
George Hotz
2c42e9c2c6
 		faster rewrite, no folder in expand/reduce [run_process_replay] (#6216) 
* faster rewrite, no folder in expand/reduce [run_process_replay]

* is removing the expander there okay

* parens

* don't reconstruct exact match uop

* fast do_reduce

* expand pyint

* most of the parents gains with less lines
 2024-08-20 23:36:58 -07:00
qazal
074cf780dd
 		add option to only benchmark schedule [run_process_replay] (#6204) 2024-08-20 16:51:27 +03:00
qazal
478145cb8e
 		lowering error in diff_schedule is fine [run_process_replay] (#6185) 2024-08-19 20:51:12 +03:00
qazal
e28d29641f
 		more scheduler process replay tooling [run_process_replay] (#6178) 2024-08-19 15:35:51 +03:00
chenyu
b36a7273c6
 		RUF018 assignment-in-assert [run_process_replay] (#6172) 
assertion should not have side effect or `-O` breaks.

initially just wanted to fix the one in rearrange, but it also made some long lines less long
 2024-08-19 00:34:52 -04:00
George Hotz
912f01ed4b
 		UOpGraph -> linearize_uop [run_process_replay] (#6119) 2024-08-16 19:48:39 -07:00
George Hotz
74ee9febec
 		remove iter from uopgraph (#6110) 
* remove iter from uopgraph

* linearize returns uops

* fix tests

* linearize in linearize

* tests fix

* touchup

* test failures
 2024-08-16 15:58:29 -07:00
qazal
28c75bf2a6
 		merge uops with ops (#6111) 
Co-authored-by: chenyu <chenyu@fastmail.com>
 2024-08-16 18:17:57 -04:00
qazal
d5e3217076
 		hotfix: scheduler differ (#6115) 
* hotfix: scheduler differ

* add the test back

* track keys
 2024-08-16 23:34:49 +03:00
qazal
c23d44c779
 		AST is UOp (#6030) 
* most of the work from the uops2 branch

* schedule

* realize

* kernel

* lowerer

* search

* green

* merge uops with ops

* Revert "merge uops with ops"

This reverts commit 1408a59f12.

* fix benchmark

* remove extra dedup
 2024-08-16 22:09:00 +03:00
chenyu
6b3112d525
 		fix qcom process_replay for kernel diff (#6079) 
* debug why qcom process_replay does not run

skipping the wrong exception?

* um-hum

* get_step_times was parsed incorrectly

* cleanup
 2024-08-14 15:05:49 -04:00
qazal
30035df5a4
 		add metal process replay back (#6068) 
test this new one
 2024-08-14 12:29:56 +03:00
qazal
0e62076cf5
 		more process replay cleanups (#6013) 
* more process replay cleanups

* comma benchmark missing
 2024-08-10 17:29:10 +03:00
qazal
7373b05ee8
 		assert conv bw reduceops merge [compare_schedule] (#6001) 
* assert conv bw reduceops merge [compare_schedule]

* diff with ref_commit_hash
 2024-08-09 19:29:56 +03:00
qazal
a833f1a735
 		scheduler process replay with [compare_schedule] (#5997) 2024-08-09 16:58:22 +03:00
qazal
24c7c41ce0
 		diff LazyBuffer schedules in process replay (#5996) 
* start diff printing

* this should be 2

* add to process_replay.py

* enable schedule capture

* arange diff is process replay
 2024-08-09 14:16:43 +03:00
qazal
d6f4a61c42
 		graph LBScheduleItem [run_process_replay] (#5960) 
* add toposort key to LBScheduleItem

* use dedup

* graph LBScheduleItem

* make that comment beautiful again

* diff_schedule utils

* update fuzz_schedule
 2024-08-07 19:59:11 +03:00
qazal
39dda3d042
 		rename prescheduled items to lsi [run_process_replay] (#5959) 
* rename to lsi

* fuzz_schedule more typings

* rename fuzz_schedule
 2024-08-07 14:31:50 +03:00
qazal
728b7e189e
 		diff_schedule tests [run_process_replay] (#5958) 
* diff_schedule tests [run_process_replay]

* ok to run serial
 2024-08-07 13:50:27 +03:00
George Hotz
3a0515ea22 hotfix: process_replay/diff_schedule.py to LBScheduleItem 2024-08-06 17:01:05 -07:00
George Hotz
73d4d51845
 		add LBScheduleItem type [run_process_replay] (#5944) 
* add LBScheduleItem type [run_process_replay]

* minor cleanups

* fix

* fix fuzz tests

* add group cache type
 2024-08-06 14:49:40 -07:00
qazal
a7db4c3ee9
 		show timings for DIFF_ARANGE=1 (#5935) 
* show timings for DIFF_ARANGE=1

* always with DEBUG=2
 2024-08-06 17:20:38 +03:00
qazal
102a8c184b
 		diff fused arange schedules with ARANGE_DIFF=1 (#5934) 
* diff fused arange schedules with ARANGE_DIFF=1

* better llama diff
 2024-08-06 16:52:26 +03:00
wozeparrot
acadccf344
 		comma benchmark (#5518) 2024-08-02 14:36:54 -07:00
Elias Wahl
4a114756f6
 		New BERT dataloader (#5881) 
* One file == One topic

* update test

* new dataloader

* update train script

* get index is faster
 2024-08-02 15:12:23 -04:00
qazal
8611fa6c99
 		apply opts.extra_matcher in process replay [run_process_replay] (#5877) 2024-08-02 18:07:58 +03:00
qazal
2a791f7924
 		fuzz uops is simpler with List[UOp] [run_process_replay] (#5875) 
* remove from fuzz_uops

* update fuzz_uops.py

* add to realize.py
 2024-08-02 17:28:15 +03:00
nimlgen
f768935be8
 		add RING_ALLREDUCE_THRESHOLD (#5835) 
* add RING_ALLREDUCE_THRESHOLD

* becnhmark

* fixes

* fix n_gpus

* unused import

* remove debug=2
 2024-07-31 16:13:09 +03:00
George Hotz
e6879035a0
 		work to make GEMV fast (#5824) 
* work to make GEMV fast

* half8 cast

* align struct

* fix amd

* float8 is a later problem
 2024-07-30 17:41:40 -07:00
Francis Lata
ce61be16f1
 		clean up how preprocessed folder is defined (#5813) 2024-07-30 12:35:26 -04:00
qazal
5e827e51d2
 		add llama3 BEAM=2 failures to test_linearizer_failures (#5553) 
* skips

* opts.device

* benchmarks

* add to test_linearizer_failures

* remove hardcoded ones

* linter

* skip cpu
 2024-07-30 00:37:32 +03:00
qazal
b775db6b60
 		high-level benchmark timing diff (#5776) 
* high level timings

benchmark times

fix defs

* use the name map

* skip last task
 2024-07-28 23:42:57 +03:00
qazal
e0e7293b0a
 		make process replay unique in retries [run_process_replay] (#5773) 2024-07-28 20:44:15 +03:00
qazal
3e49d86c01
 		process replay diffs 3 things now (#5731) 
* github api infra

* process replay is 3 parts now

* parse benchmarks

* add gh_token

* complete diff

* move process replay tests

* last successful run

* add tempdir

* skip master
 2024-07-27 12:52:20 +03:00
qazal
57b4a8e98d
 		assert process replay asserts (#5737) 
* assert process replay asserts

* one ci job is fine

* test: Revert "separate process replay main loop (#5734)"

This reverts commit 94d578396f.

* mac sed needs that

* Revert "test: Revert "separate process replay main loop (#5734)""

This reverts commit e4ad7684d5.

* disable process replay capture

* save time

* amd is tiny

* send to /dev/null
 2024-07-27 12:07:50 +03:00
George Hotz
f8972ace38
 		test flops (and allow wide ALU in UOps) [run_process_replay] (#5749) 
* flops test in external_test_speed_theoretical.py

* test speed theo

* min SZMAX

* allow wide ALU for things that support it

* needed for mypy
 2024-07-26 21:07:28 -07:00