mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
11,106 commits 280 branches 15 tags 325 MiB
Commit graph

1,107 commits

Author SHA1 Message Date
chenyu
c5acb4e06e
 		run mlperf resnet daily (#10482) 
Runs at 08:05 UTC (12:05 AM Pacific Time)
 2025-05-23 07:16:20 -04:00
chenyu
116d9e6306
 		run mlperf resnet on red box (#10413) 
also made push to `update_mlperf` branch trigger
 2025-05-19 12:48:36 -04:00
George Hotz
f1fe1f93c1 hotfix: 14000 lines 2025-05-19 09:40:53 -07:00
qazal
90eb3c0e5d
 		add MobileNetV2 benchmark to comma CI (#10250) 
* add MobileNetV2 to comma CI

* symlink imagenet

* also the signature

* comment that out

* need imagenetmock

* same train and test set

* quantize on CPU=1

* verbose

* need __hexagon_divsf3

* 0x858d6c15

* quant cpu + CC=clang-19
 2025-05-19 18:22:50 +03:00
George Hotz
b06291077c
 		no amdgpu kernel driver (#10408) 
* no amdgpu kernel driver

* don't test hip

* lower req
 2025-05-18 20:52:39 -07:00
chenyu
485e80da69
 		run_and_time for resnet ci (#10405) 2025-05-18 23:39:57 -04:00
uuuvn
0f825e12f2
 		Remote fixedvars (#10371) 
* amd mockgpu graph support

For testing remote graph stuff (prompted by #10371) in ci

* Remote fixedvars

Somehow none of existing tests failed when fixedvars were added, looking
what to add as an regression test for this

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-05-18 09:57:13 -07:00
uuuvn
27c12be471
 		amd mockgpu graph support (#10385) 
For testing remote graph stuff (prompted by #10371) in ci
 2025-05-18 09:43:16 -07:00
chenyu
9b4e2a75cd
 		symlink datasets in mlperf workflow (#10391) 2025-05-18 03:26:05 -04:00
qazal
0294bfe507
 		simpler can_pad (#10364) 
* simpler can_pad [pr]

* 3 kernels

* tests

* less kernels
 2025-05-18 10:00:07 +03:00
chenyu
efa8dfe7fb
 		test cron job to run resnet (#10368) 2025-05-17 08:57:02 -04:00
chenyu
c798f2f427
 		brew --quiet to suppress already installed warnings (#10346) 
example https://github.com/tinygrad/tinygrad/actions/runs/15057000247
 2025-05-15 23:31:18 -04:00
wozeparrot
1ed04f993b
 		move benchmark stat tracking to influxdb (#10185) 2025-05-15 16:14:56 -07:00
Ignacio Sica
47b3055fe2
 		set fail-fast behavior (#10336) 2025-05-15 11:24:45 -07:00
George Hotz
50181ab09f hotfix: bump to 13500 lines 2025-05-14 18:49:59 -07:00
George Hotz
7a3d4de59a hotfix: add GRAPH_ONE_KERNEL=1 to UsbGPU openpilot test 2025-05-14 14:50:37 -07:00
George Hotz
f1130ab3d3
 		openpilot benchmark test (#10290) 
* openpilot benchmark test

* that
 2025-05-13 22:49:28 -07:00
George Hotz
ec46f658d7
 		openpilot llvm test [pr] (#10288) 2025-05-13 16:51:41 -07:00
uuuvn
ddff9857b8
 		Remote properties is a dataclass (#10283) 
Not strictly required for anything but soon there will be like 4 new
properties and having it be a huge json just seems like a bad taste.

It also seems right to not have a separate endpoint for this, just
`GetProperties` request that returns a repr of this similar to how
requests are sent in `BatchRequest`.

This will also make a switch to anything other than http much simpler
if it will be required for any reason, like just a tcp stream of
`BatchRequest`s
 2025-05-13 11:56:58 -07:00
uuuvn
ba87eca0f1
 		Remote multi (basic) (#10269) 
* Basic remote multi support

Simplest thing to be able to use remote with multiple gpus, very slow
because no transfers (copyin copyout for cross-device copies)

* tests
 2025-05-13 09:52:47 -07:00
chenyu
ad5cb2717d
 		FUSE_ARANGE=1 in bert bench (#10263) 
still fails, something multi related maybe

Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
 2025-05-13 09:12:19 -04:00
chenyu
0015b3921f
 		sleep more in CI Remove amdgpu (#10261) 
see if this is less flaky
 2025-05-12 08:13:44 -04:00
hooved
7b4f05fd00
 		Add test for correctness of Infinity in WebGPU (#10201) 
* use function for infinity instead of uniform

* test infinity math locally

* test infinity math in CI

* make pytest available to MacOS (WebGPU)

* revert to master except failing webgpu test
 2025-05-08 05:20:05 -07:00
nimlgen
7d6ed1b1e9
 		hotfix: mac ci (#10210) 
* fixed?

* cmnt
 2025-05-08 14:13:23 +03:00
nimlgen
ba52fce4b2
 		usbgpu: benchmark in ci (#10208) 
* usbgpu: benchmark

* usbgpu: benchmark
 2025-05-08 12:02:04 +03:00
uuuvn
dba073e5c0
 		Less messy broken graph on paravirtualized metal workaround (#10182) 
* Less messy broken graph on paravirtualized metal workaround

GitHub CI macOS runners use paravirtualized metal which is broken with
graph (some comments say that ICB in particular is broken but in my
testing it was fine sometimes, but other times hitting an assert inside
metal's code related to resouces, so not sure).

> Assertion failed: (resource != nil), function -[IOGPUMetalResource initWithResource:], file IOGPUMetalResource.m, line 458.

This can be reproduced locally with any virtualization software (like utm)
that can create macOS VMs with apple's own virtualization framework.

* unused import
 2025-05-06 20:41:02 +03:00
wozeparrot
10437904cd
 		refactor: ops_cloud -> ops_remote [pr] (#10166) 2025-05-05 15:59:51 -07:00
George Hotz
b68f036551
 		default on OSX is llvm 19 (#10159) 2025-05-04 18:13:50 -07:00
George Hotz
e07d8b147a hotfix: don't OOM in the osx unit test 2025-05-04 17:53:55 -07:00
George Hotz
a0240d8c2b
 		lil work on llvm speed (#10157) 
* lil work on llvm speed

* llvm failing test

* 1e-4

* simpler failing test

* once is fine

* gpt suggests this syntax change

* bump that debug
 2025-05-04 16:37:26 -07:00
George Hotz
fe0724eebf
 		prebuild all rewrites [pr] (#10154) 
* prebuild all rewrites [pr]

* fix that

* tests pass with linearizer
 2025-05-04 13:01:18 -07:00
qazal
230a369708
 		remove some IGNORE_OOB [pr] (#10142) 
* remove some IGNORE_OOB

* remove fuzz_schedule stuff

* test with global

* add for amd ci
 2025-05-03 01:16:14 +03:00
nimlgen
16e5376ae8
 		line limit 12800 for usb (#10130) 2025-05-01 16:57:44 +03:00
George Hotz
ef011ff5f9
 		flip Ops.COPY order [pr] (#10122) 
* flip Ops.COPY order [pr]

* fix copy and support multi device copy in _device
 2025-05-01 00:26:24 -04:00
Ignacio Sica
bf5fb97498
 		fix AMD_LLVM bf16 tc for gfx1100 (#10102) 
* fix amd_llvm bf16 tc

* cleanup pattern
 2025-04-30 20:06:38 -03:00
chenyu
4a04098389
 		fix llama3 with nf4 quantize (#10107) 
also int8 outputs is wrong
 2025-04-29 15:14:36 -04:00
Ignacio Sica
9d5677c12c
 		fix ptx linearizer bug 2 [pr] (#9967) 
* check for local buffer

* hotfix

* add test_tensor_cores_emulation run for ptx
 2025-04-29 14:30:07 -03:00
George Hotz
c3ff308abb
 		range has only one src now [pr] (#10100) 
* range has only one op now

* fix z3 checker

* ci fix

* needs shell

* try pip ensure update

* that ensurepip is useless

* upgrade pip before cache

* windows happy?
 2025-04-29 10:31:05 -04:00
Ignacio Sica
58cf8cd493
 		add support for "shared_mem" for LLVM (#10093) 
* init llvm shared

* add test_tensor_cores_emulation run for llvm
 2025-04-29 08:56:36 -04:00
Ignacio Sica
bda116d773
 		fix use_tensor_cores propagation (#10048) 
* propagate use_tensor_cores

* add use_tensor_core to arg in test and search

* bugfix

* get TC val from ContextVar in search

* revert minor space change

* add tc emulation test to ci and benchmark

* revert

* revert whitespace change

* remove test for ptx

* add comment and remove llvm test run
 2025-04-28 19:30:50 -03:00
chenyu
e996584685
 		olmoe in mac benchmark (#10077) 2025-04-27 21:07:02 -04:00
George Hotz
b6d2effaf5
 		assign is contiguous (#10066) 
* assign is contiguous

* disable process replay for SDXL
 2025-04-27 08:40:33 -04:00
George Hotz
ea5dddc537
 		reduce collapse generic (#10045) 
* reduce collapse generic

* new arange folder

* new range folding

* correct with sym

* all tests pass

* indexing ops passes

* failing tests

* fix tests, remove unused

* revert that

* torch indexing is fast

* skip on webgpu

* touchups

* comments
 2025-04-26 09:13:24 -04:00
chenyu
74c6cf8be3
 		lint mlperf model_train (#10038) 2025-04-24 16:19:44 -04:00
Ignacio Sica
51ca19d061
 		set test_tensor_cores_padded_amd to expectedFailure (#10036) 
* init

* add expected failure to correctly track progres

* hotfix

* skip for amd_llvm as well

* add skip

* add pr number

* move comment to amd test

* change reason
 2025-04-24 17:11:40 -03:00
b1tg
914d89fa0b
 		fix tensor cores for gfx1201 (#9838) 
* fix tensor cores for gfx1201

* fix typo

* fix python wmma

* AMDLLVMRenderer with arch + AMDLLVM tensor_cores

* fix ci

* clean up

* more tensor cores for RDNA4

* fix half/half, bfloat16/float, bfloat16/bfloat16 for amd_llvm

---------

Co-authored-by: nimlgen <138685161+nimlgen@users.noreply.github.com>
Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-04-24 14:57:41 -04:00
uuuvn
779aa1e2e9
 		Enable image tests on cloud if clouddev supports image (#9903) 
Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-04-24 14:30:12 -04:00
uuuvn
29a12b19ea
 		Add macos CLOUD tests (#10033) 
A lot more work is required to enable all of them and move into osxtests
matrix, for now i created a separate runner for them (copied from WebGPU)

Will add test/test_graph.py to those tests in #9876
 2025-04-24 14:14:13 -04:00
uuuvn
754d789f51
 		Fix and enable jit tests on CLOUD (#10031) 2025-04-24 18:39:31 +03:00
George Hotz
4e2ccfddc6
 		ci refactor to split AMD/NVIDIA [pr] (#10024) 
* ci refactor to split AMD [pr]

* split

* split amd tests

* explicit 0
 2025-04-24 08:59:54 -04:00