tinygrad/examples
chenyu ac183568be
llama JIT python runtime speedup (#1633)
* no JIT call in TransformerBlock

* idea

* move 2 reshapes to jitted function

shrink inside jitted too, 6.3ms

remove back reshapes, 5.5ms

isinstance -> __class__ 4.99ms

* think

revert ops_gpu.py

revert symbolic.py too

PYOPENCL_COMPILER_OUTPUT=1

* cleanup

* fix cache shape for conversational model

only reshape if start_pos > 0

* small cleanup

* include var_vals.keys() to st.key

* add comments

* llama small update

* everything jitted again, similar structure to gpt2

* fix typing

* add TODO for in place update cache
2023-08-30 07:51:05 -07:00
..
mlperf np.argmax to Tensor.argmax (#1608) 2023-08-21 15:22:29 -07:00
sovits_helpers Implementation of SoftVC VITS SVC model (#1371) 2023-08-13 19:43:23 -07:00
vgg7_helpers Renamed examples/yolo to examples/vgg7_helpers because that directory contains no yolo-related code and only helper code for vgg7. This was confusing to a new user when trying to understand the examples. (#1086) 2023-07-01 12:04:28 -07:00
__init__.py failing llama test 2023-03-11 16:28:10 -08:00
benchmark_train_efficientnet.py add cache collector (#1595) 2023-08-28 19:59:55 -07:00
compile_efficientnet.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
compile_tensorflow.py moved extras/jit.py -> tinygrad/jit.py (#599) 2023-02-25 08:32:33 -08:00
deep_deterministic_policy_gradient.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
efficientnet.py Fix plt output comment (#1428) 2023-08-03 23:35:52 -07:00
gpt2.py move device to ops (#1646) 2023-08-23 08:30:17 -07:00
hlb_cifar10.py remove FAKEDATA (#1685) 2023-08-26 20:15:54 -04:00
index.html simple exporting models (#1344) 2023-08-01 09:35:48 -07:00
llama.py llama JIT python runtime speedup (#1633) 2023-08-30 07:51:05 -07:00
mask_rcnn.py MaskRCNN Inference (#884) 2023-06-25 15:37:51 -07:00
mnist_gan.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
serious_mnist.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
simple_conv_bn.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
so_vits_svc.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
stable_diffusion.py Fix: Stable Diffusion index (#1713) 2023-08-30 00:21:10 -04:00
train_efficientnet.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
train_resnet.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
transformer.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
vgg7.py Renamed examples/yolo to examples/vgg7_helpers because that directory contains no yolo-related code and only helper code for vgg7. This was confusing to a new user when trying to understand the examples. (#1086) 2023-07-01 12:04:28 -07:00
vit.py .cpu().numpy() -> .numpy() (#1594) 2023-08-21 09:53:29 -07:00
vits.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
whisper.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
yolov3.py .cpu().numpy() -> .numpy() (#1594) 2023-08-21 09:53:29 -07:00
yolov8-onnx.py Add pylint trailing whitespace rule (#1314) 2023-07-21 13:37:55 -04:00
yolov8.py move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00