mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
13,471 commits 280 branches 15 tags 325 MiB
Commit graph

5,694 commits

Author SHA1 Message Date
George Hotz
f930579b7a llm: change the default port to 8000 so you can remember it (match vLLM) 2026-04-08 11:25:38 +08:00
George Hotz
2b01ca59dd
 		USB driver for custom ASM firmware (#15597) 
* USB driver for custom ASM firmware

* timeout

* fix mypy

* pcie mem read

* flip in f/w

* one tx

* litle endian

* autodetect custom

* mock bypass

* lint

* clean
 2026-04-07 13:45:41 +08:00
Christopher Milan
19e96497ee
 		interface in DEV (#15620) 2026-04-06 19:59:28 -04:00
qazal
8ba58304f7
 		viz: reenable tests (#15626) 2026-04-07 07:52:44 +09:00
chenyu
2f7d085450
 		shared _normalize_indices for getitem (#15625) 
* shared _normalize_indices for getitem

* list
 2026-04-06 17:45:36 -04:00
chenyu
a444be172d
 		lower fuzz_symbolic_symbolic_div timeout (#15619) 
mitigate timeout crash due to high total time
 2026-04-06 12:58:29 -04:00
chenyu
01b49c8647
 		support int operand for shifts (#15618) 
matches torch/jax, also symbolic rule to remove mask
 2026-04-06 12:32:12 -04:00
Valtteri Valo
86c4431d74
 		add gpu_family detection to Metal, target MSL 4.0 on macOS 26+ (#15079) 
use supportsFamily API to detect GPU generation instead of parsing
ICB debug description strings. also adds metal4.0 compiler target.
 2026-04-06 06:51:38 +08:00
Andrew Cappelli
e39cfe685a
 		validate lr, momentum, weight_decay in optimizers (#15576) 2026-04-06 06:37:34 +08:00
nimlgen
e3986a6b74
 		mlx: init runtime (#15612) 
* mlx: init

* x

* swap
 2026-04-05 22:52:29 +03:00
nimlgen
5e134aa087
 		hcq: add write/poll_bit commands (#15610) 
* hcq: add write/poll_bit commands

* x
 2026-04-05 18:09:44 +03:00
nimlgen
604cdbf2f7
 		am: large allocs aligned to 2mb to use 2mb pages (#15609) 2026-04-05 18:01:31 +03:00
qazal
b2d5b29f45
 		assembly/amd: validate dsl keyword args (#15608) 
* assembly/amd: validate dsl keyword args

* hm, this should use the SOP2 s_waits

* use the sop2 s_waits
 2026-04-05 23:00:24 +09:00
wozeparrot
7e54992bf6
 		fp8 llama (#15588) 
Co-authored-by: qazal <qazal.software@gmail.com>
 2026-04-04 18:24:57 -07:00
qazal
4d36366717
 		assembly/amd: match rdna4 hw gidx init in emulator (#15604) 
* simple rdna4 copy kernel with hw fault

* the trivial fix: use ttmp instead of s

* now copy kernel fails in mockgpu

* rm crashing kernel
 2026-04-05 02:28:18 +09:00
Christopher Milan
645d45d968
 		DEV has arch (#15577) 
Co-authored-by: Comma Device <device@comma.ai>
 2026-04-03 19:17:19 -04:00
nimlgen
902edc3781
 		hcq: hcqbuf in copy (#15595) 2026-04-03 22:47:36 +03:00
chenyu
8fdef2d3e4
 		mean/std/var to mixin (#15593) 2026-04-03 10:42:41 -04:00
Christopher Milan
0ed8d9271d
 		Renderers accept Target or nothing (#15590) 2026-04-03 01:09:41 -04:00
qazal
fefb0ebc2a
 		gemm/asm: fp8 cleanups (#15580) 
* normal gemm here

* s/dtypes.fp8e4m3/FP8_DTYPE

* gemm_bw

* device UOp stays NULL
 2026-04-02 19:02:38 +09:00
chenyu
1aa04eab08
 		simple CreationMixin (#15567) 
start with full_like, zeros_like, ones_like
 2026-04-01 23:00:56 -04:00
Christopher Milan
6c67bd4c14
 		better error message when invalid renderer is specified (#15573) 2026-04-01 17:12:55 -04:00
Christopher Milan
0d6fbc2355
 		remove flaky and redundant image test (#15574) 2026-04-01 16:33:13 -04:00
b1tg
20497f2840
 		fold BIND to CONST when min==max (#15568) 2026-04-01 11:19:04 -04:00
chenyu
f5c0794df2
 		fix Tensor.const_like (#15565) 
used to always return a 0-d tensor, now returns an expanded Tensor based on self.shape and matches UOp
 2026-04-01 08:35:19 -04:00
chenyu
fc5b94b902
 		fix UOp.where(const, const) (#15560) 
* fix UOp.where(const, const)

* fix
 2026-04-01 05:28:49 -04:00
Christopher Milan
acf239e4d2
 		specify renderer in DEV, <dev>_<ren>=1 is deprecated (#15551) 2026-03-31 18:35:14 -04:00
nimlgen
5181c8e23a
 		llm: fix nan in kvcache (#15552) 2026-04-01 00:38:45 +03:00
qazal
a15345a53e
 		viz/cli: improve --help message (#15546) 
* viz/cli: improve --help message

* not the default

* more work

* -s

* respect colored
 2026-03-31 22:31:33 +09:00
chenyu
4ac2552642
 		improve ReduceMixin.all (#15544) 
use prod instead of min since `mul` lowered to `and` directly
 2026-03-31 07:54:27 -04:00
chenyu
89ec22131a
 		tests to show double negation in min is not cancelled (#15543) 2026-03-31 06:59:13 -04:00
qazal
8feb8edc68
 		gemm/asm: add fp8 support to cdna asm_gemm (#15542) 
* work

* hmm, mixins

* rhs_transposed

* also fix the dtype

* check for hipcc

* Exception

* select dev

* default
 2026-03-31 19:32:54 +09:00
qazal
467c0af8aa
 		viz: skip flaky sever tests (#15538) 2026-03-31 17:20:30 +09:00
qazal
f88e255cea
 		gemm/asm: split and parameterize dtype in llama gemm tests (#15408) 
* gemm/asm: more tests for emulator, parameterize llama gemm tests

* bf16 atol
 2026-03-31 17:12:44 +09:00
b1tg
a63392a565
 		llm: pairwise ranking topk for MoE expert selection (#15499) 2026-03-31 12:46:39 +08:00
qazal
bc866a93f0
 		viz: rename exec to sqtt (#15527) 
* viz: rename exec to sqtt

* more
 2026-03-31 08:06:51 +09:00
Christopher Milan
adbfd82d1d
 		DEV is ContextVar, setting Device.DEFAULT is deprecated (#15508) 2026-03-30 17:10:49 -04:00
qazal
ad6347f6d8
 		sqtt: allow mapping sopk to IMMEDIATE packets (#15525) 
* work

* with s_waitcnt

* with the sopp variants, increase threads

* remove that

* sdst=NULL produces IMMEDIATE, otherwise is SALU
 2026-03-30 23:12:17 +09:00
chenyu
f0eaac4235
 		reduce mixin (#15523) 2026-03-30 05:23:58 -04:00
chenyu
f485d0b664
 		UOp.sum -> usum, prod -> uprod [pr] (#15522) 
rename to prep reduce mixin
 2026-03-29 04:51:55 -04:00
qazal
266fb07721
 		viz: show exec duration (#15484) 
* duration

* handwritten tests

* rdna3 pickle

* rdna4 pickle

* asserts

* rm that

* wmma work

* r4

* this shows the overlap well

* ohh okay it goes back

* are ds_load and ds_store different queues on RDNA4?

* print msg, v_mul_lo_u32 is 4 cycles?

* discover

* wmma something

* wmma comment

* less

* less

* better comments

* work

* inst st

* delay column

* better cli

* emit_alt

* update test_handwritten

* work
 2026-03-28 22:48:59 +09:00
chenyu
c0753ab62f
 		XOR simplifcation rules (#15512) 
x^-1 has good vmin/vmax, and x^y^y is x
 2026-03-27 23:23:27 -04:00
qazal
ccaa6bfc19
 		viz/cli cleanups (#15511) 
* one less function

* work

* layout

* better handling of rewrites

* mypy passes
 2026-03-28 08:50:38 +09:00
qazal
dcc2a5d23b
 		viz/cli: simplify to --source and --item flags (#15510) 
* viz/cli: simplify to --source and --item flags

* update viz cli test
 2026-03-28 04:46:39 +09:00
nimlgen
0d6fc0f571
 		jit: graphing in uops (#15489) 
* jit: graphing as rewrite rule

* f

* +metal,cuda

* x

* cl

* x

* x

* simpler

* f

* m

* x

* revert?

* revert2

* back

* back

* t

* x

* m

* x

* c

* x

* l

* x

* comment

* smaller

* rv

* x

* x
 2026-03-27 19:09:02 +03:00
chenyu
30ebbe7f17
 		few more fold valid tests (#15509) 
from remove CORRECT_DIVMOD_FOLDING attempt
 2026-03-27 10:38:42 -04:00
chenyu
323fcefd7d
 		Revert "DEV is a ContextVar (#15505)" (#15506) 
This reverts commit fdb30cba96.
 2026-03-27 02:22:40 -04:00
Christopher Milan
fdb30cba96
 		DEV is a ContextVar (#15505) 2026-03-27 00:57:09 -04:00
Christopher Milan
67a50fb738
 		move where on load with casts (#15492) 2026-03-26 22:11:27 -04:00
qazal
586c49642f
 		viz/cli: test in CI (#15501) 
* viz cli work

* baseline test

* make cli test work without subprocess

* more checks

* check itrace

* s/return/return None

* change

* minimal

* colored
 2026-03-27 06:47:15 +09:00