commaai
/
tinygrad
mirror of https://github.com/commaai/tinygrad.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tinygrad/docs/nn.md

745 B
Raw Permalink Blame History

Neural Network classes

::: tinygrad.nn.BatchNorm ::: tinygrad.nn.Conv1d ::: tinygrad.nn.Conv2d ::: tinygrad.nn.ConvTranspose1d ::: tinygrad.nn.ConvTranspose2d ::: tinygrad.nn.Linear ::: tinygrad.nn.GroupNorm ::: tinygrad.nn.InstanceNorm ::: tinygrad.nn.LayerNorm ::: tinygrad.nn.LayerNorm2d ::: tinygrad.nn.RMSNorm ::: tinygrad.nn.Embedding ::: tinygrad.nn.LSTMCell

Optimizers

::: tinygrad.nn.optim.SGD ::: tinygrad.nn.optim.LARS ::: tinygrad.nn.optim.AdamW ::: tinygrad.nn.optim.Adam ::: tinygrad.nn.optim.LAMB

Load/Save

::: tinygrad.nn.state.safe_load ::: tinygrad.nn.state.safe_save ::: tinygrad.nn.state.get_state_dict ::: tinygrad.nn.state.get_parameters ::: tinygrad.nn.state.load_state_dict ::: tinygrad.nn.state.torch_load