commaai
/
tinygrad
mirror of https://github.com/commaai/tinygrad.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

hotfix: ad for DEBUG=2 in the mnist tutorial

This commit is contained in:
George Hotz 2024-10-06 21:04:06 +08:00
parent 10ff1d6fb9
commit f588169fdc
1 changed files with 8 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
docs/mnist.md
View File

@ -98,6 +98,14 @@ timeit.repeat(step, repeat=5, number=1)
So around 75 ms on T4 colab.
If you want to see a breakdown of the time by kernel:
```python
from tinygrad import GlobalCounters, Context
GlobalCounters.reset()
with Context(DEBUG=2): step()
```
### Why so slow?
Unlike PyTorch, tinygrad isn't designed to be fast like that. While 75 ms for one step is plenty fast for debugging, it's not great for training. Here, we introduce the first quintessentially tinygrad concept, the `TinyJit`.