Commit Graph

693 Commits

Author SHA1 Message Date
George Hotz 81c9438ea1 keepdim avoids reshapes 2022-06-05 15:56:42 -07:00
George Hotz 60b8689ea2 code2 was unneeded for reduce op 2022-06-05 15:15:04 -07:00
George Hotz 46aaac5aaf clean up loops 2022-06-05 15:00:21 -07:00
George Hotz 44168c4c40 remove all ctxes 2022-06-05 14:55:39 -07:00
George Hotz f01bad36c2 factor out convs 2022-06-05 14:48:42 -07:00
George Hotz b49bfb6e02 fix conv args. fix spacing 2022-06-05 14:35:31 -07:00
George Hotz 365e62a609 refactor out matmul 2022-06-05 14:33:06 -07:00
George Hotz 11d0cfec77 more readable and faster 2022-06-05 14:13:08 -07:00
George Hotz d1b6f9822c UnaryOp class should make linecount 2022-06-05 14:07:02 -07:00
George Hotz 24ed95e667 gpu refactors 2022-06-05 13:55:49 -07:00
George Hotz 7a3fe34db1 GPU llops 2022-06-05 13:49:39 -07:00
George Hotz f0fe37bd34 simpler graph demo 2022-06-05 12:40:12 -07:00
George Hotz 89acf6742d more graph docs 2022-06-05 12:16:50 -07:00
George Hotz 88de42fb6e document graph mode 2022-06-05 12:13:05 -07:00
George Hotz 2097d814f6 Sum doesn't need to save the tensor 2022-06-05 12:04:51 -07:00
George Hotz c8b569a8c7 cleaner comments 2022-05-14 21:28:39 -07:00
Adrian Bakke 8a7bbcc240
Accel/cuda (#319)
* start work

* right a wrong

* mimimal reduce example

* save

* get tests to pass

* fix stupid bug

* tests passing

* out of bounds error fixed, all tests passing

* revert changes to other files

* clean

* getting better, will drink a glass of wine and finish over the weekend

* clean
2022-05-14 21:25:30 -07:00
Drew Hintz 7ad60eb8b2
remove redundant list comprehensions (#317)
any() accepts a generator. This saves a few characters and can also return early without evaluating each item.
2022-04-05 10:30:50 -07:00
namliz 8ce8664024
Golfed -1 (#315)
* Golfed -1

To please the orange website

* Typo
2022-04-05 10:16:27 -07:00
Edward Betts a6203b5ecd
Correct spelling mistakes (#314) 2022-04-05 05:22:18 -07:00
Andrei Augustin 050636bcb1
here's two extra lines of precious code (#307) 2022-02-21 11:45:19 -08:00
Ildar Kashaev d065040df0
Fix yolo param name (#306) 2022-02-10 01:40:24 -07:00
George Hotz cfb7a4c41a back to 1000 lines 2022-01-17 10:44:39 -08:00
George Hotz a482d56229 don't save for backward pass if we don't need to. add purple edges to graph 2022-01-16 12:18:41 -08:00
George Hotz 8dfdc4e11f GRAPH and DEBUG can be independent. under 1k lines 2022-01-16 12:04:10 -08:00
George Hotz 2f531e35be add ctx saved tensors to graph 2022-01-16 11:18:36 -08:00
George Hotz 2a10116bfa support drawing graphs 2022-01-16 10:45:58 -08:00
George Hotz 6a5cb6842e make profiler work for backward pass too 2022-01-16 09:35:10 -08:00
George Hotz 2cae2dfa07 don't crash the dataloader for imagenet 2022-01-16 08:41:26 -08:00
George Hotz 907ff7dbb6 imagenet is training 2022-01-15 23:27:31 -08:00
George Hotz d1e082e0ef add imagenet training support 2022-01-15 23:16:38 -08:00
George Hotz ade2af7ac0 data doesn't require grad 2022-01-15 22:41:27 -08:00
George Hotz 0973e54eb0 fix DEBUG for GPU 2022-01-15 22:14:28 -08:00
George Hotz d844ecee27 track running stats by default, and detach 2022-01-15 21:46:54 -08:00
George Hotz d541e2a8e5 move assert, remove comment 2022-01-15 21:36:58 -08:00
George Hotz 845bb1fc34 bs 4 -> 2 in training test 2022-01-15 21:34:21 -08:00
George Hotz c0d1254003 don't run unneeded grads 2022-01-15 21:32:13 -08:00
George Hotz ecc0903451 Revert "faster deepwalk"
This reverts commit 931500a098.
2022-01-15 21:02:18 -08:00
George Hotz 931500a098 faster deepwalk 2022-01-15 20:57:57 -08:00
cjg91 7025c9bbeb
Transfer learning for ResNet (#295)
* Transfer learning for ResNet

* moved ResNet depth specifics into the class
2022-01-15 23:22:10 -05:00
George Hotz 55d792b065 Revert "fixup resnet"
This reverts commit 4eabe677ed.
2022-01-15 20:22:01 -08:00
George Hotz 4eabe677ed fixup resnet 2022-01-15 20:21:02 -08:00
George Hotz e0bef0bd01 training is False by default 2022-01-15 19:57:41 -08:00
George Hotz 8ba3d1f803 fix bn test, affine is True 2022-01-15 19:52:15 -08:00
George Hotz 8ec2341cca fix bn training 2022-01-15 19:47:01 -08:00
George Hotz 0e6832a8ea support torch GPU, only autoinit cuda in the buffer 2022-01-15 19:15:12 -08:00
George Hotz d8d19ed468 wikimedia wasn't returning 200 2022-01-15 19:09:29 -08:00
George Hotz 52918fbf78 cuda stub 2022-01-15 19:02:17 -08:00
Jacky Lee 81664baf64
Fix OpenCL installation (#301) 2022-01-06 10:35:48 -05:00
George Hotz b0511f9392 Revert "does pybind fix CI?"
This reverts commit d128e4fcae.
2021-12-30 14:13:58 -05:00