Commit Graph

6388 Commits

Author SHA1 Message Date
Göktuğ Karakaşlı 4b163ee270
efficient version of adam (#20)
* counteracted bias initialization

* test new adam

* add optimizer tests

* rename helper function names to fix the test

* remove redundant import
2020-10-27 15:54:40 -07:00
George Hotz 8d75c9e4c4 we have matmul too 2020-10-27 08:57:17 -07:00
George Hotz f9788eba14 parameters, and start on efficientnet 2020-10-27 08:53:35 -07:00
George Hotz 0b68c08de0 literally just bump version for picture on pypi 2020-10-27 08:14:22 -07:00
George Hotz 6b5982b6b3 push pypi 2020-10-27 08:13:15 -07:00
George Hotz 716f86a572 sections 2020-10-27 08:10:51 -07:00
Liam 4a663d31da
less than 1000 lines (#24)
* Actions sloccount check for < 1000 lines (tests and source)

* Sudo lol

* Test sloccount in actions ci

* More tests for the expression

* apt install test to do validation in cli

* fuck test

* try something that probably won't work

* ofcourse not

* test that test fails if lines greater than 1000

* more than 1000 results in 1,000 not 1000. Delete

* remove test lines. Should pass now

* Untouch file

Untouched a file that was changed in testing
2020-10-27 08:07:15 -07:00
George Hotz dcf630dbeb
Merge pull request #22 from tsmcalister/master
adds beautiful and meaningful logo
2020-10-26 16:41:10 -07:00
= 6b44a7f729 adds beautiful and meaningful logo 2020-10-26 18:12:49 +01:00
George Hotz c5db2cf517 readme more 2020-10-26 09:21:48 -07:00
George Hotz 43591a1e71 make the example simpler 2020-10-26 09:19:20 -07:00
George Hotz 1f0514e5df pip 2020-10-26 09:15:31 -07:00
George Hotz 64bd4f7936 lol, it's not 1.0 2020-10-26 09:11:32 -07:00
George Hotz dec2f1c31a
Merge pull request #18 from goktug97/master
add setup.py and change imports to relative
2020-10-26 09:09:31 -07:00
Göktuğ Karakaşlı 81040d926d import only the module 2020-10-26 19:02:06 +03:00
Göktuğ Karakaşlı 8d80726207 two spaces 2020-10-26 18:54:55 +03:00
George Hotz 1654008c1f conv stride support 2020-10-26 08:54:43 -07:00
George Hotz 2a55d7402b clean up ops, refactor pool backward. add stride test 2020-10-26 08:47:11 -07:00
George Hotz 93dceb4bee fix kernel_size bug, name like torch, add test 2020-10-26 08:38:53 -07:00
Göktuğ Karakaşlı cc9bd45b44 add setup.py and change imports to relative 2020-10-26 18:19:50 +03:00
George Hotz d0c9be3e25
Merge pull request #17 from tsmcalister/master
makes maxpool2d parameterizable
2020-10-26 06:35:34 -07:00
Timothy Mc Alister 15e5988323 make default parameters work for functions 2020-10-26 12:43:36 +01:00
George Hotz 2d37fd686b test ops 2020-10-25 19:03:49 -07:00
George Hotz 2eebbd32c6 ops test speed 2020-10-25 19:01:02 -07:00
George Hotz b27bcbe4b4 avgpool and test refactor 2020-10-25 18:40:01 -07:00
George Hotz 4c42676cb6 400 -> 200 2020-10-25 17:19:59 -07:00
George Hotz 567707a5f6 rename max_pool2d to match torch, remove more fast conv crap 2020-10-25 17:16:47 -07:00
George Hotz 5d1373c71b if you want fast convs, revert this 2020-10-25 17:10:34 -07:00
George Hotz ea41f5e1c1 seems more generic 2020-10-25 16:40:37 -07:00
George Hotz 2333c4dea7 no tqdm in actions 2020-10-25 16:40:08 -07:00
George Hotz ad48061927 better sort in torch profiler 2020-10-25 16:07:49 -07:00
George Hotz 82f8e10813 no hacks in that test 2020-10-25 15:52:05 -07:00
George Hotz 4baa4c041f it's crazy how much faster pytorch is than numpy 2020-10-25 15:42:33 -07:00
George Hotz 5ddbd7f04b 2 to 3x slower than torch 2020-10-25 15:27:33 -07:00
George Hotz f8311f5ecd print fp/bp mnist 2020-10-25 15:08:18 -07:00
George Hotz d38367b561 cleaner relu 2020-10-25 14:35:04 -07:00
George Hotz 5c179d18ad add profiling for mnist net 2020-10-25 14:20:55 -07:00
George Hotz 8fcada8071 faster and better convnet 2020-10-25 13:48:44 -07:00
George Hotz 1255903519 hmm, no reason it should have been wrong, numpy weirdness 2020-10-25 13:14:12 -07:00
George Hotz 96f9cdb8a0 woah, fastconv is wrong 2020-10-25 12:56:42 -07:00
George Hotz bb98cdfef7 improve conv testing 2020-10-25 12:46:04 -07:00
George Hotz ef24aac09e finally, fast convs 2020-10-25 12:39:44 -07:00
George Hotz 0f02084805 conv isn't fast yet 2020-10-25 12:13:58 -07:00
George Hotz 12641d5bd7 umm, okay slow col2im 2020-10-25 12:01:59 -07:00
George Hotz 67506eb6ba fast im2col 2020-10-25 11:49:35 -07:00
George Hotz c9968756d1 allow the line profiler to work 2020-10-25 11:13:40 -07:00
George Hotz 5062c2c8ff profile conv better 2020-10-25 11:11:00 -07:00
George Hotz c74764bac3 oops, set to None 2020-10-25 08:28:18 -07:00
George Hotz 935f5ddaaa always keep batch size out front 2020-10-25 08:14:07 -07:00
George Hotz b91fd3afad maxpool 2020-10-25 07:43:34 -07:00