tinygrad/extra/datasets
Jhenner Tigreros dc9e9e4363
Convert BinaryOps.DIV to UnaryOps.RECIP and BinaryOps.IDIV (#4887)
* Create UnaryOps.RECIP and BinaryOps.IDIV and changing uses of BinaryOps.DIV

* Delete unused import

* Add cstyle renderer

* Fix formatting text

* Fix test error due to bad implementation of renderer

* Add PTX support

* Add RECIP to LLVMIR

* Remove BinaryOps.DIV from symbolic test

* Change some test and fix C floor division

* Change references to DIV for the RECIP or IDIV

* Add mimic idiv for symbolic test

* Restore floor

* Mimic idiv

* cast to int

* Fix some test and renderer

* Remove DIV for render nodes

* Resolve issue with div

* Add TestRenderer

* Fix test

* fix error

* Fix PAD test

* Fix div implementation

* Remove DIV

* Add upcast to rshift, due to use of MUL and RECIP on DIV

* Fix linter

* Remove complete BinaryOps.DIV

* Fix lint

* Fix some test

* Revert mul modification

* Fix tests

* Fix CLANG for uops

* Revert IDIV function

* Minor fix

* modify pattern matching rule to support nan

* Fix UNSAFE_PADS_OPS to add UnaryOps.RECIP

* Remove const folding for IDIV and fix PTX

* Complete remove IDIV from extra

* Remove test_div from TestFloatUOps due to test on recip

* Fix linearizer

* fix

* Fix test_22

* Fix llvm

* Apply trunc function for llvmlit

* use floor instead of trunc

* Use correct type

* Generate new fuzz db

* Fix rshift, do not cast to float to support idiv

* Return upcast=false to rshift

* Add to unsafepad BinaryOps.IDIV

* Remove RECIP override for CUDA

* add atol / rtol for the test

* Remove cast to int on IDIV

* Regenerate sops

* delete sops.gz

* regenerate

* regenerate

* regenerate

* Reduce margins

* pass atol and rtol as parametersg for _test_metrics

* regenerated dataset

* Regenerate

* Remove duplicated

* Revert changes on extra

* Remove changes extra and NOQA for test

* Remove E501

* Remove and change line

* Remove E501

* Fix atan2

* Revert import and E501

* Remove E501

* Add hrcp to halp ops

* Remove 1 of hrcp

* Remove last DIV and add type check on uops for IDIV

* Fix new tests

* Fix tests and custom function

* Regenerate dataset

* Regenerate dataset

* Revert dataset

* Change generate dataset script

* Remove line

* Change IDIV, type checker validate if x,y and z are int

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
2024-06-14 02:43:46 -07:00
..
.gitignore gitignore open-images-v6TEST 2024-05-01 13:55:38 +00:00
__init__.py remove numpy from ops_torch (#3124) 2024-01-14 22:46:57 -05:00
coco.py move to new cached fetch (#2493) 2023-11-28 17:36:55 -08:00
fake_imagenet_from_mnist.py mock mnist data for imagenet trainer (#4095) 2024-04-06 08:08:40 -07:00
imagenet.py resnet mlperf logging (#4361) 2024-05-02 00:00:04 -04:00
imagenet_download.py move to new cached fetch (#2493) 2023-11-28 17:36:55 -08:00
kits19.py [MLPerf] UNet3D dataloader (#4343) 2024-04-28 22:34:18 -04:00
librispeech.py Update file paths (#1179) 2023-07-07 18:41:58 -07:00
openimages.py add mlperf train subset of openimages (#4841) 2024-06-05 10:10:11 -04:00
preprocess_imagenet.py move dtypes to dtype.py (#2964) 2024-01-01 14:58:48 -08:00
sops.gz Convert BinaryOps.DIV to UnaryOps.RECIP and BinaryOps.IDIV (#4887) 2024-06-14 02:43:46 -07:00
squad.py move to new cached fetch (#2493) 2023-11-28 17:36:55 -08:00
wikipedia.py MLPerf BERT: Main training loop (#4288) 2024-04-29 14:35:27 -04:00
wikipedia_download.py Refactor to class style (#4804) 2024-06-04 14:08:31 -07:00