mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
9,797 commits 280 branches 15 tags 325 MiB
Commit graph

907 commits

Author SHA1 Message Date
ttomsa
ae0c3cfff6
 		change clang -march flag to -mcpu on arm (#10970) 
Co-authored-by: wozeparrot <wozeparrot@gmail.com>
 2025-08-11 13:38:48 -04:00
nimlgen
5403a4aeaf
 		null dev: support offset on buffers (#11606) 
* null dev: support offset on buffers

* nolimit
 2025-08-10 21:58:37 +03:00
chenyu
dd3d2eb36c
 		add training llama3 test in ci (#11599) 2025-08-09 22:35:39 -04:00
chenyu
b232c60def
 		benchmark openpilot 0.9.9 (#11575) 
* benchmark openpilot 0.9.9

not sure what to do with the 0.9.7 ones with IMAGE=2 and validate

* name
 2025-08-08 01:26:14 -04:00
chenyu
702e38dc19
 		remove FUSE_ARANGE_UINT (#11567) 
also add IGNORE_OOB=1 to bert runs. lowered BS on tinybox to 90 since 96 oom during eval without reset
 2025-08-07 16:49:06 -04:00
chenyu
594cbdc66f
 		skip AM ResNet50 benchmark (#11565) 
hanging with FUSE_ARANGE?
 2025-08-07 14:07:01 -04:00
chenyu
7ee3770961
 		FUSE_ARANGE=1 (#11427) 
* FUSE_ARANGE=1

* fix test

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-08-07 13:32:34 -04:00
George Hotz
21570545d3
 		move view pushing to codegen, try 2 (#11534) 
* move view pushing to codegen, try 2

* fix up some linearizer tests

* fix test search

* fix test schedule

* delete that test

* fix test arange

* fix a few tests

* update tests

* push views

* ebs cleanup

* fix local/reg

* test and lint

* fix more tests

* test cleanups

* skipped that one
 2025-08-06 15:58:38 -07:00
George Hotz
4fe11725c6
 		pass through sink arg, update linearizer test (#11536) 
* pass through sink arg, update linearizer test

* get_program help

* bump line count

* use new api
 2025-08-06 09:48:48 -07:00
geohotstan
1163292759
 		move onnx_parser into onnx (#11530) 2025-08-06 10:46:27 -04:00
nimlgen
1afb290027
 		ci: fix runner in nv (#11527) 2025-08-06 10:38:04 +03:00
chenyu
c9225d22ce
 		only disable flaky test_jit_multidev_xfer (#11523) 2025-08-05 22:17:25 -04:00
George Hotz
f58fd3143d
 		cleanup fix_kernel (#11520) 
* cleanup fix_kernel

* early load buffer

* early meta ops

* move those to fix_kernel_ops

* fix tests

* remote metal was flaky

* Revert "fix tests"

This reverts commit a27019383d.

* that hack broke things

* fine for ptx
 2025-08-05 18:38:43 -07:00
chenyu
3f742a5a7c
 		comma space lab models benchmark (#11461) 2025-07-31 19:06:18 -04:00
wozeparrot
d3da20eca6
 		feat: bump mlperf workflow timeout to 6 hours (#11440) 2025-07-30 14:12:12 -07:00
nimlgen
5fc5bb5237
 		ci: clear processes (#11434) 
* unified hcq_smi for managment

* fix

* fix

* no reset for amd
 2025-07-30 22:15:18 +03:00
nimlgen
4b4ba5454c
 		ci: move driver start higher (#11431) 2025-07-30 10:48:38 +03:00
chenyu
204da24cfc
 		increase driverbenchmark timeout-minutes to 15 (#11428) 2025-07-29 19:45:05 -04:00
nimlgen
c88e401d0e
 		ci: fix typos in h machine benchmarks (#11423) 2025-07-29 22:11:47 +03:00
George Hotz
1f1f99c287 hotfix: add DEBUG=3 to driver CI 2025-07-29 11:03:47 -07:00
nimlgen
d38d285489
 		ci: add h machines (#11416) 
* ci: add h machines

* more

* fix names

* names not collide

* 20

* 10
 2025-07-29 19:21:51 +03:00
Tom Clesius
2568bc0d99
 		ci: add caching for apt packages (#11162) 
* add caching for apt packages

* remove 'inputs' from apt cache key, use outputs instead of env

* remove unnecessary mkdir for partial

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-07-29 09:04:56 -07:00
uuuvn
052191eae4
 		Remote multihost (p2p with infiniband verbs) (#9746) 
Co-authored-by: wozeparrot <wozeparrot@gmail.com>
 2025-07-27 14:44:32 -07:00
uuuvn
76a2ddbd78
 		Move remote tests out of onnx (#11310) 
Co-authored-by: wozeparrot <wozeparrot@gmail.com>
 2025-07-23 13:25:55 -07:00
chenyu
86e7504111
 		mypy check extra/onnx.py (#11348) 
instead of running test with 3.10, add onnx to mypy which would have caught StrEnum regression. Several type annotation failed mypy now that does not affect running the code and were skipped for now
 2025-07-23 12:42:59 -04:00
chenyu
960da9319d
 		Remove StrEnum in onnx for python 3.10 (#11345) 
some training tests failed looks like parsing error?
 2025-07-23 11:52:25 -04:00
chenyu
7a9a5cfd28
 		isolate test/external/external_test_am.py (#11335) 
seems to be the one crashing, also remove -n=auto for that
 2025-07-22 19:02:20 -04:00
George Hotz
09431d4ad1
 		make DEFINE_REG behave like the others (#11273) 
* simpler define reg

* cast

* PTRCAT define_acc

* cleanups

* fix uops stats

* fix linearizer tests

* llvm

* define reg sets const

* define reg sets const

* no assign

* collapse that

* fix test_max_pool2d_bigger_stride_dilation

* use index, fix webgpu

* devec

* fix tests

* fix webgpu

* fix llvm

* threads for python

* fix ops_python

* only for reg

* acc_half is real now in the emulator

* fix llvm

* fix webgpu init

* fix wgpu test

* fix some tests

* fix ptx

* fix ptx bool acc

* cleanups

* broken, meh. will fix with ENDRANGE

* line count
 2025-07-22 13:53:56 -07:00
George Hotz
affd83961c
 		small changes from define_reg (#11327) 
* small changes from define_reg

* fix webgpu
 2025-07-22 11:11:48 -07:00
qazal
0c4e19f270
 		hotfix: disable process replay in REMOTE=1 tests (#11320) 
* hotfix: disable process replay in REMOTE=1 tests

* comment
 2025-07-22 10:41:58 +03:00
geohotstan
445ff8de56
 		ONNX onnx_parser and buffer_parse clean up (#11000) 
* start

* remove onnx.load from compile4 and move np to dropout

* clean up and enable test

* clean up

* move WebGPU ONNX test into MacOS (WebGPU)

* leave test in ONNX (CPU)

* fix raw_data init None, and simplify onnx_runner test a little?

* THESE TESTS ARE SO UGLY UGHH

* need to really think about how to structure the test

* wow LLMs are quite something

* not always on disk now

* also add external data loading test

* cleaner tests

* minimize diff and add const folding tests

* add external data loading too

* whoops add webgpu back.. but why was it not needed in the first place?

* better comment

* move webgpu test to macos(webgpu)?

* llm english so much better than me wow

* trigger CI to check flakiness

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-07-21 15:10:25 -04:00
chenyu
be2f4336e6
 		use onnx 1.18.0 in DSP test (#11279) 2025-07-18 14:09:23 -04:00
chenyu
c5a5d74642
 		Revert "image_dot of 2 half inputs returns half (#11007)" (#11274) 
This reverts commit fa8e08f922.
 2025-07-17 17:34:18 -04:00
Utkarsh Gill
fa8e08f922
 		image_dot of 2 half inputs returns half (#11007) 
* cast after sum

* comment out skipif

* minor fix

* only test IMAGE

* IMAGE is supported now

* simpler

* simplerr

* only cast if dtype is None

* dont need to change base_imaeg_type

* only cast when dtype is half

* add explicit test

* actually no, workflow seems better

* actually, keep both

* move test

* fix indent

---------

Co-authored-by: Utkarsh Gill <engelbart@Utkarshs-MacBook-Pro.local>
 2025-07-17 13:47:22 -07:00
wozeparrot
5878b189b8
 		don't const fold shape changing bitcast (#11236) 2025-07-14 16:42:16 -07:00
chenyu
85ddd72038
 		simpler grouptop in hcopt (#11219) 
* simpler grouptop in hcopt

keep the only perf relevant conditions and the rest is handled by try except

* update openpilot read image count
 2025-07-13 16:06:09 -04:00
chenyu
2b48b961be
 		fix a few broken AMX tests (#11204) 2025-07-12 21:42:38 -04:00
uuuvn
40da5f0c81
 		fix silent mypy failure in ci (#11201) 
Example: https://github.com/tinygrad/tinygrad/actions/runs/16215577171/job/45784110543?pr=11177#step:7:20

Caused by footguny exception in how `set -e` works:

```bash
python -m mypy --strict-equality --lineprecision-report . && cat lineprecision.txt
```

Will fail (and have non-zero exit code if run in interactive mode) but
because there is `&&` it won't count as script-terminating failure in a
script with `set -e` and instead as a test (similar to how fail of a
command in if condition won't count as a script-terminating failure
despite having non-zero exit code)
 2025-07-12 15:12:25 -04:00
chenyu
7ce9e45474
 		mypy onnx_parser (#11141) 2025-07-08 19:50:28 -04:00
chenyu
ffcc557986
 		lint onnx and onnx_parser (#11134) 2025-07-08 15:28:35 -04:00
George Hotz
397826f0b4
 		add a test for 1B llm (#11124) 
* add a test for 1B llm

* fix mbs

* add apps to release
 2025-07-07 18:47:25 -07:00
George Hotz
f7d4638e05
 		start LLM app, tons of clean up required. target is 200 line ollama (#11068) 
* start LLM app, tons of clean up required. target is 200 line ollama

* kind of works

* simpler

* add k/v cache

* with SYM=1, it loops

* no rope cache

* simpler

* more cleanups

* cleanups

* works

* argparse and comments

* from gguf

* generate is a function

* no copy from cpu

* fix max context pass in

* test

* improve test

* ai2_arc

* fix 8B, use less ram

* 136 lines
 2025-07-07 17:09:46 -07:00
chenyu
425d5f55c4
 		generate kernel dataset and upload artifact (#11063) 2025-07-02 17:21:25 -04:00
chenyu
4d57437a67
 		add timeout to benchmark_search and mlperf action (#11058) 
default timeout is 6 hours which is too long and occupies a box
 2025-07-02 14:17:34 -04:00
Ahmed Harmouche
e992ed10dc
 		WebGPU on Windows (#10890) 
* WebGPU on Windows

* Fix dawn-python install

* New test

* pydeps

* Minor fix

* Only install dawn-python on windows webgpu

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-07-02 08:38:45 -07:00
George Hotz
0597735f28
 		remove TC=3 not porting this (#11045) 2025-06-30 15:12:49 -07:00
George Hotz
5911b71404
 		early support for bidirectional pattern matcher (#11027) 
* early support for bidirectional pattern matcher

* expose it and add a test

* no bottom up arg there

* disable flaky test
 2025-06-29 16:54:07 -07:00
chenyu
126fcf4129
 		clean up AMD_LLVM in tests (#11021) 2025-06-28 22:45:47 -04:00
qazal
44257f25e4
 		bump line count to 14600 (#11010) 2025-06-27 22:48:14 +03:00
George Hotz
b4eb876d5a
 		kernel.py no longer permutes reduce axis [pr] (#10968) 
* kernel.py no longer permutes reduce axis [pr]

* delete tests that handcode uops

* regen of sops is broken...

* put import back

* just remove that

* disable those tests
 2025-06-26 17:44:58 -07:00