Commit Graph

63 Commits

Author SHA1 Message Date
Adeeb Shihadeh
ee33f8a8cd tools/lib/route: expose raw file paths 2021-11-04 20:32:02 -07:00
Willem Melching
252f3c1c87 tools/lib/auth.py: support github/apple login (#22766)
* tools/lib/auth.py: support github/apple login

* print some info about logged in user

* add docstring
2021-11-01 15:00:00 +01:00
Willem Melching
b816b5b644 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
2021-10-28 15:14:37 +02:00
Adeeb Shihadeh
431f6eac95 docs for tools/lib 2021-10-12 20:58:04 -07:00
Adeeb Shihadeh
b6514a5cb3 lib/route: support for e/d cams (#22529)
* lib/route: support for e/d cams

* comment
2021-10-12 00:34:53 -07:00
Dean Lee
c43d35a04d remove tools/lib/route_framereader.py (#22486) 2021-10-08 11:10:44 +02:00
Willem Melching
a31c6ce3f9 tools: make auth optional for public routes (#22386)
* tools: make auth optional for public routes

* handle 403

* show warning from c++ replay
2021-09-30 20:13:46 +02:00
George Hotz
3a6c8d4678 Fix test relying on SAFETY.md being in the root 2021-09-14 16:02:36 -07:00
Willem Melching
dddab597bc Less open file permissions (#21922)
* Less open file permissions

* add test back

* remove params test for permissions

* remove umask

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-08-28 18:25:05 -07:00
arfy slowy
d74def61f8 fix: spelling typos (#21861)
* fix: typo spelling grammar

* revert

* Update selfdrive/locationd/calibrationd.py

* more revert

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-08-05 12:05:49 -07:00
Greg Hogan
8f1806602c FrameIterator that uses 1+ GB less RAM (#21687) 2021-07-22 12:08:56 -07:00
Adeeb Shihadeh
594877e4a8 fix route_framereader when segments are missing 2021-06-10 23:12:56 -07:00
Adeeb Shihadeh
4b6ec3bca6 unlogger: put YUV vipc send behind flag 2021-06-03 21:53:16 -07:00
Josh Smith
77321dbac4 Add type hints, small cleanups (#21080)
* improve tools.lib.kbhit and tools.sim.lib.keyboard_ctrl

* unpack more efficiently

* minor improvements

* agnos.py match spec better

* manual_ctrl test missing queue arg

* fix incorrect type annotation

* queues are generic

* varname reuse resulting in incorrect type inference

* bytes().hex() rather than bytes.hex(bytes())

* a bit of type hinting stuff
2021-06-03 12:21:04 +02:00
Willem Melching
476ee91845 fix route framereader when using signed urls (#21029) 2021-05-26 11:36:53 +02:00
Mitchell Goff
0dc27e3d6d Updated RouteFrameReader to work on routes with missing segments (#20971) 2021-05-23 14:15:48 -07:00
Willem Melching
0252072729 tools/lib/auth.py update oauth redirect url 2021-05-17 14:51:29 +02:00
Willem Melching
3755081145 add qcamera support to Route (#20521) 2021-03-30 11:48:27 +02:00
Greg Hogan
78808961c5 fix log values with non-utf8 characters and remove index_log (#20173)
* remove index_log

* handle non-unicode characters in values

* dump.py better handling of printing non-unicode characters

* only replace errors in main
2021-03-01 13:03:44 -08:00
iejMac
d4feecd803 plotjuggler falling back to qlog (#20105)
* fallback to qlogs

* minor fixes

* removed extra line

* help on no args

* Update tools/plotjuggler/juggle.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-02-17 22:59:31 -08:00
Adeeb Shihadeh
59d7c5e64a move to github container registry + CI speedup (#19621) 2020-12-31 14:57:01 -08:00
Adeeb Shihadeh
8674b023ba HW abstraction layer (#19530)
* start hw refactor

* move that

* pins

* put that back
2020-12-16 21:30:23 -08:00
Adeeb Shihadeh
9a605d2617 bump c++ version for index_log 2020-10-23 22:12:30 -07:00
Willem Melching
529e9a23ea add check for partial response code (#2282) 2020-10-07 12:14:22 +02:00
Greg Hogan
2293a6a36c eliminate round-trip reading entire file (#2275)
* eliminate round-trip reading entire file

* only if reading entire file

* print headers in errors

* fix end
2020-10-05 16:59:19 -07:00
Willem Melching
927ef086f7 remove parallel url downloader 2020-09-21 10:32:08 +02:00
grekiki
05b64257df FileReader: cache files locally (#2170)
* framework for updates

* File caching

* update .gitignore

* update .gitignore

* Store in home tmp directory

* fix bugs in old code, add tests

* add test

* revert bug

* Fixed some bugs, more testing

* doing some style fixes

* Update caching with lenghts

* doing some style fixes

* doing some style fixes

* doing some style fixes

* subrepositories

* try to fix the tests

* change submodules back

* doing some style fixes

* if we don't cache, we don't cache length either

* fix curls

* make sure tests run in ci

* Cleanup tests

* Use int for cache flag

* fix linter

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-09-17 13:03:34 +02:00
Greg Hogan
1e6c7c94e4 fix pylint errors 2020-09-03 18:46:13 -07:00
Willem Melching
c7152d5419 Hardware abstraction class (#2080)
* hardware abstraction class

* De Morgan

* Rename pc hardware class

* Fix sound card in controlsd

* Pc get sim info

* fix hardware in test

* two more

* No more random imei on android

* no randomness on android

* Need to return something that looks like imei for registration to work

* Return proper network strength

* Unused import

* Bug fixes + gpsd is only android
2020-08-26 14:57:17 +02:00
Willem Melching
c70700758d Speedup URLFile (#1888)
* add parallel download support to URLFile

* make python 3.8 happy

* Fix chunk size

* Automatic number of threads

* No daemon threads in unlogger

* Cache length

* dont touch old filereader

* Remove debug info

* remove debug script

* Ignore type
2020-07-20 17:10:08 +02:00
Greg Hogan
32c4367ffb ffmpeg hwaccel is better 2020-06-12 16:11:40 -07:00
Adeeb Shihadeh
3463f1165e quick LGTM fixes 2020-06-05 11:29:09 -07:00
Willem Melching
63c8e8439b Model + camerad test (#1622)
* kind of works

* move that

* hack to get camerad to reliably terminate

* not sure why SIGTERM wasn't working before

* compare bytes

* clean up some hacks

* gitignore

* fix that

* WIP

* no reboot

* comparison works

* pretty print

* fix build

* run in jenkins

* python path

* space

* raise timeout

* new eon

* skip the copy

* spinner

* spin less

* update model ref commit

* reenable that

* clean up

* fix jenkinsfile

* parallel

* wrap it in a stage

* fix linter

* better progress

* lower timeout

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-06-04 18:57:25 -07:00
Adeeb
367155168a Update Flake8 config (#1624)
* update flake8 checks

* add E502

* no whitespace warnings

* fix violations

* no W391

Co-authored-by: Jason Young <jason@comma.ai>
2020-06-03 16:13:34 -07:00
Adeeb
ab83e48ec4 Add pre-commit hooks (#1629) 2020-06-03 12:54:49 -07:00
Willem Melching
843a64c72f Make pylint more strict (#1626)
* make pylint more strict

* cleanup in progress

* done cleaning up

* no opendbc
2020-06-02 16:29:32 -07:00
Adeeb Shihadeh
f3dcf861c7 enable flake8 E303: too many blank lines 2020-05-31 17:21:11 -07:00
Adeeb Shihadeh
27754a277c enable E261 in flake8: two spaces before inline comment 2020-05-31 14:07:29 -07:00
Adeeb Shihadeh
efd5dffb1e enable flake8 E231: missing whitespace after comma 2020-05-31 12:49:11 -07:00
Adeeb
d9bf9f0a40 Enable more flake8 checks (#1602)
* enable some more flake8 checks

* some more quick ones

* bump opendbc

* e401

* e711 e712

* e115 e116

* e222

* e301

* remove that

* e129

* e701 e702

* e125 e131

* e227

* e306

* e262

* W503

* e713

* e704

* e731

* bump opendbc

* fix some e722
2020-05-30 20:14:58 -07:00
Greg Hogan
d112a58366 FrameReader env vars FFMPEG_THREADS and FFMPEG_CUDA 2020-05-28 17:33:34 -07:00
Willem Melching
3d08dcc3b2 Run mypy commit hook (#1591)
* run mypy commit hook

* fix mypy errors
2020-05-28 15:05:04 -07:00
Greg Hogan
2d0686faa1 framereader single threaded env var 2020-05-28 13:39:28 -07:00
Willem Melching
639cf2288f framereader only has to support h265 and raw (#1588) 2020-05-28 12:45:38 -07:00
Willem Melching
29aaa44740 flake8 in pre-commit(#1583) 2020-05-27 20:33:05 -07:00
Willem Melching
bd06434243 pre-commit pylint (#1580)
* "The commit-hook project sounds interesting though. I would definitely merge something that runs flake8 and pylint on the modified files!"
-  pd0wm, https://github.com/commaai/openpilot/pull/1575#issuecomment-634974344

* add pylint to pre-commit and make everything pass

* Remove uncommented stuff

Co-authored-by: J <user@4800.lan>
2020-05-27 20:00:14 -07:00
Willem Melching
43f7fe178d not needed 2020-05-14 17:59:26 -07:00
Willem Melching
43873c9600 use system capnp 2020-05-14 17:58:43 -07:00
Willem Melching
cd79cee41a ffprobe use -f instead of -format 2020-05-11 15:32:40 -07:00
Adeeb Shihadeh
a25d535793 Revert "function doesn't have that arg"
This reverts commit d712d9cf3b.
2020-05-09 17:26:24 -07:00