George Hotz
|
f16c5577f0
|
useless parens
|
2020-10-23 06:29:57 -07:00 |
George Hotz
|
0f358a9cfb
|
remove the eps from the sqrt
|
2020-10-23 06:28:32 -07:00 |
George Hotz
|
2259c9faa1
|
low lr improves rmsprop
|
2020-10-23 06:22:32 -07:00 |
George Hotz
|
d56a0af6cb
|
t isn't used
|
2020-10-23 06:17:40 -07:00 |
George Hotz
|
49ae15a450
|
i like that comma
|
2020-10-23 06:12:04 -07:00 |
George Hotz
|
eda29fa0e0
|
clean up test
|
2020-10-23 06:11:38 -07:00 |
George Hotz
|
373b4e341b
|
Merge pull request #15 from f0ti/master
added RMSprop optim
|
2020-10-23 06:08:20 -07:00 |
f0ti
|
0b87aaca1e
|
update rsmprop
|
2020-10-23 14:46:45 +02:00 |
f0ti
|
c5f726ec2e
|
all three
|
2020-10-23 11:53:01 +02:00 |
f0ti
|
6a38ccb6b0
|
update rmsprop and readme
|
2020-10-23 11:49:43 +02:00 |
George Hotz
|
21ebb0b769
|
if you wait 24 seconds, that gets 98%
|
2020-10-22 21:49:14 -07:00 |
George Hotz
|
816f648161
|
chans doesn't need to be in self
|
2020-10-22 21:19:35 -07:00 |
George Hotz
|
77251cc6c3
|
7x7 conv = more accuracy
|
2020-10-22 21:10:27 -07:00 |
George Hotz
|
64b128b712
|
shorter and faster conv
|
2020-10-22 20:54:11 -07:00 |
George Hotz
|
1d612f17ce
|
remove float64 check
|
2020-10-22 20:27:21 -07:00 |
f0ti
|
7e1eddb0c5
|
added RMSprop optim
|
2020-10-23 02:50:02 +02:00 |
George Hotz
|
65f3a9d499
|
Merge pull request #11 from 0xNaN/master
tiny gradcheck
|
2020-10-22 10:22:42 -07:00 |
Adrian Garcia Badaracco
|
5ed2bbfa0a
|
remove newline
|
2020-10-21 18:43:11 -05:00 |
Adrian Garcia Badaracco
|
81fe70a3c0
|
make single line
|
2020-10-21 18:42:40 -05:00 |
Adrian Garcia Badaracco
|
fa99c2c723
|
actually add files
|
2020-10-21 18:38:48 -05:00 |
Adrian Garcia Badaracco
|
466a67f4dd
|
Add requirements.txt
|
2020-10-21 18:37:47 -05:00 |
0xNaN
|
4bdb524da7
|
moving `mask_like` to utils
|
2020-10-22 01:30:59 +02:00 |
0xNaN
|
ac4ef3a588
|
removing docs since interface is now the same of pytorch, LOC < 50 ;)
|
2020-10-22 01:28:52 +02:00 |
0xNaN
|
f6cad1d7d8
|
s/model/func/
|
2020-10-22 01:28:52 +02:00 |
0xNaN
|
d95adbddb4
|
`gradcheck` now returns only a bool, refactoring of test_gradcheck
|
2020-10-22 01:28:52 +02:00 |
0xNaN
|
adbfc67456
|
test `jacobian` and `numerical_jacobian` against torch.autograd.functional.jacobian
|
2020-10-22 01:28:52 +02:00 |
0xNaN
|
7458089b3b
|
fix shape of Jacobian to (n_out, n_in)
|
2020-10-22 01:28:52 +02:00 |
0xNaN
|
1561d3b9c0
|
extracting `jacobian` and `test_jacobian`
|
2020-10-22 01:28:52 +02:00 |
0xNaN
|
93bc3c22a0
|
tiny gradcheck
|
2020-10-22 01:28:52 +02:00 |
George Hotz
|
e8feaa53d6
|
Merge pull request #12 from adriangb/pytest-again
TST: Pytest round 2
|
2020-10-21 16:19:43 -07:00 |
Adrian Garcia Badaracco
|
9a8be135a7
|
incorporate changes
|
2020-10-21 13:21:44 -05:00 |
Adrian Garcia Badaracco
|
58b4f191a4
|
Merge remote-tracking branch 'upstream/master' into pytest-again
|
2020-10-21 13:19:58 -05:00 |
George Hotz
|
5a1ff084d8
|
Merge pull request #13 from geohot/numba
use numba to double conv speed
|
2020-10-21 09:51:42 -07:00 |
George Hotz
|
685ce5ba7e
|
scope better and don't break tests
|
2020-10-21 09:44:28 -07:00 |
George Hotz
|
a68ead09c0
|
use numba to double conv speed
|
2020-10-21 09:34:16 -07:00 |
Adrian Garcia Badaracco
|
02adb0ac3a
|
Make test_mnist runnable by pytest and directly
|
2020-10-21 11:30:08 -05:00 |
Adrian Garcia Badaracco
|
5afe6b1f68
|
rename files
|
2020-10-21 11:28:03 -05:00 |
George Hotz
|
dc325af392
|
sneaky float64s
|
2020-10-21 09:26:01 -07:00 |
George Hotz
|
ecdf2239fc
|
todo
|
2020-10-21 09:14:37 -07:00 |
George Hotz
|
d91902948b
|
add reshape support and OMG the CONVS are SO SLOW
|
2020-10-21 09:12:19 -07:00 |
George Hotz
|
03fc6e8a49
|
layer init for all sizes
|
2020-10-21 08:48:16 -07:00 |
George Hotz
|
e3110c9922
|
backward pass for conv2d, lol i mostly guessed and made shapes match
|
2020-10-21 08:45:35 -07:00 |
George Hotz
|
9172bc9c38
|
Merge pull request #10 from TheMrGhostman/master
fixing adam
|
2020-10-21 07:37:31 -07:00 |
George Hotz
|
3a111c832c
|
Merge pull request #9 from orena1/patch-1
easier to find what micrograd is...
|
2020-10-21 07:36:58 -07:00 |
TheMrGhostman
|
fc6f355c6a
|
fixing adam
|
2020-10-20 23:29:26 +02:00 |
Oren Amsalem
|
a3839f0fef
|
easier to find what micrograd is...
Added pytorch link just for fun
|
2020-10-20 08:29:27 +03:00 |
George Hotz
|
4faf3a0aed
|
simpler
|
2020-10-19 09:37:07 -07:00 |
George Hotz
|
bee89a4840
|
one less loop
|
2020-10-19 09:34:55 -07:00 |
George Hotz
|
5c2ac48c11
|
write forward pass for convolution
|
2020-10-19 09:33:06 -07:00 |
George Hotz
|
d5662e09e3
|
run both tests
|
2020-10-19 08:59:20 -07:00 |