Commit Graph

6331 Commits

Author SHA1 Message Date
George Hotz f16c5577f0 useless parens 2020-10-23 06:29:57 -07:00
George Hotz 0f358a9cfb remove the eps from the sqrt 2020-10-23 06:28:32 -07:00
George Hotz 2259c9faa1 low lr improves rmsprop 2020-10-23 06:22:32 -07:00
George Hotz d56a0af6cb t isn't used 2020-10-23 06:17:40 -07:00
George Hotz 49ae15a450 i like that comma 2020-10-23 06:12:04 -07:00
George Hotz eda29fa0e0 clean up test 2020-10-23 06:11:38 -07:00
George Hotz 373b4e341b
Merge pull request #15 from f0ti/master
added RMSprop optim
2020-10-23 06:08:20 -07:00
f0ti 0b87aaca1e update rsmprop 2020-10-23 14:46:45 +02:00
f0ti c5f726ec2e all three 2020-10-23 11:53:01 +02:00
f0ti 6a38ccb6b0 update rmsprop and readme 2020-10-23 11:49:43 +02:00
George Hotz 21ebb0b769 if you wait 24 seconds, that gets 98% 2020-10-22 21:49:14 -07:00
George Hotz 816f648161 chans doesn't need to be in self 2020-10-22 21:19:35 -07:00
George Hotz 77251cc6c3 7x7 conv = more accuracy 2020-10-22 21:10:27 -07:00
George Hotz 64b128b712 shorter and faster conv 2020-10-22 20:54:11 -07:00
George Hotz 1d612f17ce remove float64 check 2020-10-22 20:27:21 -07:00
f0ti 7e1eddb0c5 added RMSprop optim 2020-10-23 02:50:02 +02:00
George Hotz 65f3a9d499
Merge pull request #11 from 0xNaN/master
tiny gradcheck
2020-10-22 10:22:42 -07:00
Adrian Garcia Badaracco 5ed2bbfa0a
remove newline 2020-10-21 18:43:11 -05:00
Adrian Garcia Badaracco 81fe70a3c0
make single line 2020-10-21 18:42:40 -05:00
Adrian Garcia Badaracco fa99c2c723
actually add files 2020-10-21 18:38:48 -05:00
Adrian Garcia Badaracco 466a67f4dd
Add requirements.txt 2020-10-21 18:37:47 -05:00
0xNaN 4bdb524da7 moving `mask_like` to utils 2020-10-22 01:30:59 +02:00
0xNaN ac4ef3a588 removing docs since interface is now the same of pytorch, LOC < 50 ;) 2020-10-22 01:28:52 +02:00
0xNaN f6cad1d7d8 s/model/func/ 2020-10-22 01:28:52 +02:00
0xNaN d95adbddb4 `gradcheck` now returns only a bool, refactoring of test_gradcheck 2020-10-22 01:28:52 +02:00
0xNaN adbfc67456 test `jacobian` and `numerical_jacobian` against torch.autograd.functional.jacobian 2020-10-22 01:28:52 +02:00
0xNaN 7458089b3b fix shape of Jacobian to (n_out, n_in) 2020-10-22 01:28:52 +02:00
0xNaN 1561d3b9c0 extracting `jacobian` and `test_jacobian` 2020-10-22 01:28:52 +02:00
0xNaN 93bc3c22a0 tiny gradcheck 2020-10-22 01:28:52 +02:00
George Hotz e8feaa53d6
Merge pull request #12 from adriangb/pytest-again
TST: Pytest round 2
2020-10-21 16:19:43 -07:00
Adrian Garcia Badaracco 9a8be135a7
incorporate changes 2020-10-21 13:21:44 -05:00
Adrian Garcia Badaracco 58b4f191a4
Merge remote-tracking branch 'upstream/master' into pytest-again 2020-10-21 13:19:58 -05:00
George Hotz 5a1ff084d8
Merge pull request #13 from geohot/numba
use numba to double conv speed
2020-10-21 09:51:42 -07:00
George Hotz 685ce5ba7e scope better and don't break tests 2020-10-21 09:44:28 -07:00
George Hotz a68ead09c0 use numba to double conv speed 2020-10-21 09:34:16 -07:00
Adrian Garcia Badaracco 02adb0ac3a
Make test_mnist runnable by pytest and directly 2020-10-21 11:30:08 -05:00
Adrian Garcia Badaracco 5afe6b1f68
rename files 2020-10-21 11:28:03 -05:00
George Hotz dc325af392 sneaky float64s 2020-10-21 09:26:01 -07:00
George Hotz ecdf2239fc todo 2020-10-21 09:14:37 -07:00
George Hotz d91902948b add reshape support and OMG the CONVS are SO SLOW 2020-10-21 09:12:19 -07:00
George Hotz 03fc6e8a49 layer init for all sizes 2020-10-21 08:48:16 -07:00
George Hotz e3110c9922 backward pass for conv2d, lol i mostly guessed and made shapes match 2020-10-21 08:45:35 -07:00
George Hotz 9172bc9c38
Merge pull request #10 from TheMrGhostman/master
fixing adam
2020-10-21 07:37:31 -07:00
George Hotz 3a111c832c
Merge pull request #9 from orena1/patch-1
easier to find what micrograd is...
2020-10-21 07:36:58 -07:00
TheMrGhostman fc6f355c6a fixing adam 2020-10-20 23:29:26 +02:00
Oren Amsalem a3839f0fef
easier to find what micrograd is...
Added pytorch link just for fun
2020-10-20 08:29:27 +03:00
George Hotz 4faf3a0aed simpler 2020-10-19 09:37:07 -07:00
George Hotz bee89a4840 one less loop 2020-10-19 09:34:55 -07:00
George Hotz 5c2ac48c11 write forward pass for convolution 2020-10-19 09:33:06 -07:00
George Hotz d5662e09e3 run both tests 2020-10-19 08:59:20 -07:00