mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
13,471 commits 280 branches 15 tags 325 MiB
Commit graph

5,694 commits

Author SHA1 Message Date
chenyu
089703a390
 		cleanup test_dtype_alu (#2919) 
wrapped long lines and lowered atol for METAL.sin to 2 since atol of two sins are bounded by 2
 2023-12-22 17:29:31 -05:00
chenyu
50927defad
 		s/lazydata.realized/lazydata.base.realized/g (#2914) 
* s/lazydata.realized/lazydata.base.realized/g

* not that
 2023-12-22 14:45:13 -05:00
chenyu
2783e1b50d
 		bugfix Tensor.item when it's unbased (#2913) 
it's possible for numel 1 tensor lazydata to be unbased and should call lazydata.base.realized
 2023-12-22 13:50:06 -05:00
Oleg Rybalko
c3133adb8c
 		Disk shm refactor (#2912) 
* better support for platform dependent flags

* osx test support

* removed unused import and made line length <150

* changed osx ci shm

* lstrip in case SharedMemory._name is passed
 2023-12-22 09:23:37 -08:00
chenyu
3855432265
 		don't use numpy to create Tensor(None) (#2909) 
* don't use numpy to create Tensor(None)

empty suffices

* parentheses
 2023-12-22 01:07:44 -05:00
chenyu
50cfb1fb3a
 		update onnx model links (#2908) 
updated in https://github.com/onnx/models/pull/644
 2023-12-22 00:19:41 -05:00
chenyu
1bbeb3fe2f
 		remove the different rtol / atol for openpilot CUDA in benchmark (#2907) 
not sure what the issue was but seems to be fixed on master
 2023-12-21 22:23:39 -05:00
chenyu
a543d8bea8
 		fuzz default dtypes for some test_dtype tests (#2906) 
* fuzz default dtypes for some test_dtype tests

* ocd

* setUp and tearDown
 2023-12-21 22:00:21 -05:00
George Hotz
5cac6338a4
 		apply the multitensor optimizations in lazy.py (#2901) 
* apply the multitensor optimizations in lazy.py

* less lines

* hack for webgpu

* save a line
 2023-12-21 13:55:49 -08:00
chenyu
5bf43c9634
 		reenable one onnx test failed due to dtype (#2902) 2023-12-21 15:50:02 -05:00
George Hotz
193109a88c hotfix: compare on ids 2023-12-20 23:47:50 -08:00
George Hotz
f6c7833f9f
 		fast compare for lazyop (#2893) 2023-12-20 23:32:27 -08:00
George Hotz
41b2a25be6
 		Fix exponential behavior in lazyops (#2890) 
* add cache to ast_parse and lazyop builder

* add caches
 2023-12-20 22:06:50 -08:00
George Hotz
8c4a0f8e15
 		Fix int child count (#2882) 
* pad ops broke coder

* that contiguous fixes it

* Update lazy.py

* recursive add

* fix all

* revert that

* todo test
 2023-12-20 21:06:27 -08:00
George Hotz
7da2325dc7
 		get_lazyops() -> lazyops (#2884) 
* get_lazyops() -> lazyops

* don't compare empty mem
 2023-12-20 18:04:49 -08:00
George Hotz
e1861ab65e
 		remove realize from optimizer (#2880) 
* remove realize from optimizer

* one still needed

* opt realize
 2023-12-20 16:42:41 -08:00
George Hotz
1765849937
 		new lazy, benchmark (#2878) 
* lazy rewrite, try 2

* min fix tests

* pass contig test

* put broken pads back

* move that to realize

* no contig child fixes array packing

* so wrong

* now that's correct

* base children

* fix bind issues

* disable to_image_idx

* fix tests

* that failure shouldn't break other tests

* more fixes

* fix torch

* skip failing tests in CI

* 1e-7

* half is broken

* 1e-6 margin of error
 2023-12-20 14:33:21 -08:00
Peter Cawley
dae8976889
 		Fix reshape merging with masks (#2877) 2023-12-20 14:00:58 -08:00
George Hotz
8fe24038d8
 		Revert "mulacc fusion cleanup (#2871)" (#2876) 
This reverts commit 863c5b26ed.
 2023-12-20 13:26:25 -08:00
qazal
863c5b26ed
 		mulacc fusion cleanup (#2871) 
* add mulacc fusion tests

* cleanup the implementation

* fix indent in the test utility

* less verbose
 2023-12-20 15:39:54 -05:00
chenyu
e13b4964d7
 		remove the all_int(shape) check in Tensor._loadop (#2874) 
* remove the all_int(shape) check in Tensor._loadop

we can support jittable symbolic shape random with custom rand now, and we can formalize it in the test after threefry is ready

* MOCKHIP false positive
 2023-12-20 15:04:50 -05:00
qazal
5f07ef455e
 		update dtypes (#2872) 2023-12-20 15:04:02 -05:00
George Hotz
ca59054463
 		fix shapetracker math (#2861) 
* proper test

* all st math good now

* fix real_strides bug
 2023-12-19 22:17:34 -08:00
chenyu
5a739e8c20
 		update one skipped pad_reshape test that was fine (#2860) 
* update one skipped pad_reshape test that was fine

had a typo

* this one passed
 2023-12-19 23:25:52 -05:00
chenyu
ad233d557f
 		disable reshape merging with masks (#2858) 
fuzzer found a bug, and it's not complete
 2023-12-19 19:06:16 -05:00
Oleg Rybalko
42a038c83f
 		More readable torch_load ext check (#2853) 
* more readable extension check

* enable tarfile test

* detach tensor if requires grad in torch
 2023-12-19 14:53:15 -05:00
chenyu
172a88e719
 		skip slow test_indexing on METAL (#2852) 
LLVM still runs and is a lot faster, would be curious to know why.
also reworded some error messages and remove regex check
 2023-12-19 12:00:54 -05:00
geohotstan
fec8e9060c
 		Add simple fancy indexing exceptions (#2706) 
* fancy indexing raise error

* updated error message

* improved error check

* oops

* fixed onnx

* oops typo

* merge

* add full_flatten

* try

* merged and updated some tests

* more cleaning

* done

* temp fix onnx

* try

* add todo in onnx_test

* reword

* gah
 2023-12-19 11:23:51 -05:00
George Hotz
90fb09b55c remove unused _device_extra_args 2023-12-18 22:14:58 -08:00
George Hotz
b2192b5400
 		minor improvements (#2845) 2023-12-18 22:09:08 -08:00
George Hotz
d086325b1b hotfix: failing tests 2023-12-18 21:12:42 -08:00
George Hotz
07df14aa0e
 		HIP cleanups (#2843) 
* move everything to code_for_op to reason about it

* loop the loopable parts

* its not that unreadable

* these are loopable too

* nitpick

* tests p1 - replace these with the actual compiler running alu ops tests

* tests p2: compile test_dtype_alu in HIP!

+add to CI

* nobody liked test_renderer

* revert test_dtypes change

* isolated mockhip tests

* dont need the WHERE hack after #2782

+ruff

* bf16 is broken in HIP

job failed in: https://github.com/tinygrad/tinygrad/actions/runs/7232101987/job/19705951290?pr=2778#step:8:73

* picking this back up

* add compile tests for unary ops and binary ops

* MOD is only in ints

* CMPLT wont work after the dtypes pr is merged because it will always be bool

* test all combinations

* Update cstyle.py

* don't use vload

* no getenv

* set seed

---------

Co-authored-by: qazal <qazal.software@gmail.com>
Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
 2023-12-18 21:09:32 -08:00
George Hotz
b6d71b131e hotfix: push broken tests 2023-12-18 21:08:42 -08:00
George Hotz
80f53245e8
 		shapetracker add and invert (#2828) 
* invert (broken)

* decent invert

* shapetracker invert works

* plus is meh, invert is good

* support invert mask

* a few more invert tests

* shapetracker math invert test
 2023-12-18 16:03:27 -08:00
chenyu
73cadfbb3c
 		Remove pytest markers (#2831) 
* remove pytest marker

* fix some, skip some

* tweak

* fix

* skip slow

* skip more
 2023-12-18 18:53:28 -05:00
chenyu
264fe9c93f
 		clean up test_dtype.py (#2827) 
make is_dtype_supported a pure function and clean up long lines
 2023-12-18 16:06:09 -05:00
chenyu
20ea43b6e7
 		dtypes.from_py to convert py types to dtypes (#2826) 
also updated some tests to test against default dtypes
 2023-12-18 14:23:31 -05:00
chenyu
0723f26c80
 		dtypes.default_float and dtypes.default_int (#2824) 2023-12-18 12:21:44 -05:00
chenyu
8aab19ce3d
 		Tensor.full of bool has dtypes.bool (#2823) 2023-12-18 10:51:17 -05:00
chenyu
220abcd8ff
 		fix squeeze of 0-dim Tensor with negative dim (#2821) 
if ndim=0, only accepted dim is 0, -1, None. other negative dim results in IndexError
 2023-12-17 22:02:07 -05:00
Maksym Sobolyev
887f3d9933
 		Make torch backend more usable, fix bfloat support in the llvm backend (#2765) 
* Uncripple dtype tests, TestBFloat16DType never actually runs.

* Fix conversion from/to bfloat16.

Call cast() recursively, so that it works for any type combo.

* Run this test on torch backend as well.

* Add torch.bfloat16.

* Add support for ushort and uint.

* Convert np.uint32 to np.int32 when loading.

* Fix warning.
 2023-12-17 14:04:26 -05:00
chenyu
9c32474a1f
 		Revert "Revert "Tensor.randint is Tensor.uniform with dtypes.int32 (#2801)" (#2802)" (#2814) 
This reverts commit fa84998244.
 2023-12-17 12:14:17 -05:00
chenyu
b4fa189c8c
 		Revert "Revert "Make Tensor creation allow multi-dim list of int and bool (#2793)" (#2810)" (#2813) 
This reverts commit 71a60762ed.
 2023-12-17 11:48:27 -05:00
chenyu
71a60762ed
 		Revert "Make Tensor creation allow multi-dim list of int and bool (#2793)" (#2810) 
This reverts commit 798bf813b1.
 2023-12-17 02:03:52 -05:00
geohotstan
798bf813b1
 		Make Tensor creation allow multi-dim list of int and bool (#2793) 
* the universe is flat as a 2D tensor

* try this

* TESTS

* less lines in test

* don't change all_int since other places use it

* add tests and del noqa by making non-aesthetic spacing LOOOOOL

* some reordering

* fixed empty list and add tests

* more tests

* add list bool tensors

* clearer with least lines added

* added bool

* oops

* more tests

* improved tests

* oops
 2023-12-17 01:58:10 -05:00
chenyu
85c6250a3e
 		support Tensor.einsum with no "->" in formula (#2807) 
output is the sorted alphabets if there's no "->"
 2023-12-17 00:46:24 -05:00
chenyu
157c0be509
 		cleanup onnx, pass one more reshape test and remove some casts (#2806) 2023-12-16 20:40:43 -05:00
chenyu
baa94d6142
 		Tensor(False) has dtypes.bool (#2805) 2023-12-16 19:04:08 -05:00
chenyu
fa84998244
 		Revert "Tensor.randint is Tensor.uniform with dtypes.int32 (#2801)" (#2802) 
This reverts commit 86c2f267d4.
 2023-12-16 15:53:28 -05:00
chenyu
86c2f267d4
 		Tensor.randint is Tensor.uniform with dtypes.int32 (#2801) 2023-12-16 15:14:50 -05:00