mirrors/tinygrad
2
0
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-06-24 02:14:17 +00:00
Code Issues Projects Releases Packages Wiki Activity

hotfix: add note to relu

Browse source
This commit is contained in:
George Hotz 2025-05-22 09:13:38 -07:00
commit c46edbf262
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
tinygrad/tensor.py
View file

@ -2824,6 +2824,7 @@ class Tensor(SimpleMathTrait):
print(Tensor([-3., -2., -1., 0., 1., 2., 3.]).relu().numpy())
```
"""
# NOTE: if you write this as self.maximum(0) the gradient is wrong, passing through half when self is 0
return (self>0).where(self, 0)
def sigmoid(self) -> Tensor: