Commit Graph

96 Commits

Author SHA1 Message Date
Adeeb Shihadeh
1f9970ba3d stricter file size limits (#30839)
* move all pics to lfs

* wav and rest of so

* more to lfs

* ignore a few

* push that up
2023-12-26 15:22:59 -08:00
Justin Newberry
3713e4d5ea add script to automatically format fingerprints file (#30792)
* Add script

* fix script

* fix script

* fix for subaddr

* run the script

* old style can fingerprints

* cleanup

* sort imports, make executable, fix path

* newline w/o newline

* match og can formatting

* match og formatting

* generate template once

* standard name

* less nested

* can fingerprints comments

* fix spacing

* no need for PLATFORM_TO_ENUM_NAME!

* prep for PRs

* comments for all, add honda comments

* Auto-generated fingerprint PR from fuzzy fingerprinting cars

* Revert "Auto-generated fingerprint PR from fuzzy fingerprinting cars"

This reverts commit 97bc9e3bdb9d819dcbe684ceba92ea702d40eaf0.

* even closer to original

* readd this comment

* and run script

* add to precommit

* add comments

* add comments

* add to release

* use for auto fingerprint

* disable precommit for now

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-12-20 11:18:29 -08:00
Kacper Rączy
f058b5d64e webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
2023-12-01 21:13:37 -08:00
Adeeb Shihadeh
eb3833037f Update Python packages and pre-commit hooks (#30529) 2023-11-26 09:31:20 -08:00
Adeeb Shihadeh
2a55ff4f55 Update Python packages and pre-commit hooks (#30509)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-11-21 11:50:35 -08:00
Logan Lasiter
5b2bcf6bf2 adding --local-partial-types mypy opt (#30491) 2023-11-18 22:47:11 -08:00
Kacper Rączy
2de13bea91 Remove laika submodule (#30453)
* Remove laika submodule

* Remove laika check for minimal builds

* Fix minimal build check

* Bring back exclude for opendbc in codespell

* Fix typo

* Copy GNSS indices from laika

* Delete laika dependencies
2023-11-15 10:06:37 +01:00
Adeeb Shihadeh
51207aaae2 Update Python packages and pre-commit hooks (#30463)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-11-14 15:18:42 -08:00
Adeeb Shihadeh
3c043ba570 Update Python packages and pre-commit hooks (#30403)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-11-07 10:58:01 -08:00
Adeeb Shihadeh
c04e019af4 Update Python packages and pre-commit hooks (#30352)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-10-31 11:31:57 -07:00
Adeeb Shihadeh
d3d51980bc Update Python packages and pre-commit hooks (#30321)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-10-24 11:25:39 -07:00
Adeeb Shihadeh
13bf8c26f3 Update Python packages and pre-commit hooks (#30269)
* Update Python packages and pre-commit hooks

* fix pyqt

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-10-18 20:18:08 -07:00
Adeeb Shihadeh
ac21dcbdcb Update Python packages and pre-commit hooks (#30215)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-10-10 10:37:54 -07:00
Adeeb Shihadeh
377722fd5e Update Python packages and pre-commit hooks (#30149)
* Update Python packages and pre-commit hooks

* fixes

* Update common/transformations/README.md

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* fix

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-10-03 15:31:26 -07:00
Adeeb Shihadeh
2d5a2e3ab6 Update Python packages and pre-commit hooks (#30062)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-09-27 21:42:41 -07:00
Adeeb Shihadeh
425fa316d1 pre-commit: always check all file sizes (#30050)
* pre-commit: always check all file sizes

* fix release
2023-09-25 22:22:48 -07:00
Shane Smiskol
37422d0437 pre-commit: use non-deprecated lock file check command (#30003)
Update .pre-commit-config.yaml
2023-09-21 17:41:44 -07:00
Justin Newberry
1f8ceb4ca1 Simulator: fix port issues in devcontainer (#29977)
* fix sim devcontainer

* use host.docker.internal instead

* devcontainer supports jsonc
2023-09-20 16:34:29 -07:00
Adeeb Shihadeh
cd75dcb03f Update Python packages and pre-commit hooks (#29974)
* Update Python packages and pre-commit hooks

* fix linter

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-09-19 16:24:58 -07:00
Adeeb Shihadeh
ac2d052512 Update Python packages and pre-commit hooks (#29891)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-09-12 13:12:55 -07:00
Justin Newberry
d3c5ac5545 Precommit: do a sanity check on github workflows (#29790)
* sanity check on github actions

* That one doesn’t apply to us
2023-09-06 10:40:52 -07:00
Justin Newberry
4e69937d0d Precommit: ensure executable bit is set (#29784)
* precommit ensure executable

* exclude tinygrad

* bump submodules

* exclude tinygrad globally
2023-09-05 16:33:26 -07:00
Adeeb Shihadeh
e0eb4d726c Update Python packages and pre-commit hooks (#29774)
Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-09-05 20:02:21 +01:00
Adeeb Shihadeh
9719b22761 Update Python packages and pre-commit hooks (#29739)
* Update Python packages and pre-commit hooks

* fix linter

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-08-31 15:00:13 -07:00
Dean Lee
7bfd3dac81 cpplint: add filter whitespace/comma (#29595) 2023-08-24 10:42:06 -07:00
Dean Lee
9c7bf50703 cpplint: add filter whitespace/tab (#29588) 2023-08-24 08:06:58 -07:00
Dean Lee
21da5a216f cpplint: add filter build/include_subdir (#29585) 2023-08-24 15:42:17 +01:00
Dean Lee
ac93902983 cpplint: add filter whitespace/forcolon (#29582)
whitespace/forcolon
2023-08-23 22:46:02 -07:00
Dean Lee
f203648de0 cpplint: add filter whitespace/semicolon (#29568) 2023-08-23 15:00:30 -07:00
Dean Lee
5480d32bb5 cpplint: add filter whitespace/parens (#29565) 2023-08-23 14:25:05 -07:00
Dean Lee
2d99521e75 cpplint: build/include_what_you_use (#29556)
* include_what_you_use

* remove comments

* include <memory>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-08-23 13:25:17 -07:00
Dean Lee
363740a497 cpplint: add readability/braces filter (#29554) 2023-08-23 10:13:46 -07:00
Adeeb Shihadeh
952d720b6e add cpplint (#26855)
* setup cpplint

* only start that

* check line length

* check these

* rm exceptions
2023-08-22 13:55:23 -07:00
Adeeb Shihadeh
c5c73c4ddb pre-commit: autoupdate hooks (#29524)
Update pre-commit hook versions

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-08-22 10:39:45 -07:00
Adeeb Shihadeh
3b849811e5 pre-commit: autoupdate hooks (#29407)
Update pre-commit hook versions

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-08-15 10:29:02 -07:00
Justin Newberry
7fdd9fc37c CI: Pylint to ruff (#29294)
* pylint to riff

* pylint to riff

* pylint to riff

* revert more

* undo exclude removal

* exclude tinygrad

* set line length

* pylint exclusions to ruff

* same excludes as old linter

* fix tools QA

* remove unrequired check

* revert linting third_party

* ignore e402
2023-08-09 13:26:54 -07:00
Justin Newberry
a91764954b Revert "CI: pylint to ruff (#29276)" (#29284)
This reverts commit cb31a53d8a.
2023-08-08 14:24:04 -07:00
Vivek Aithal
e7d307ca1b [commabody] Add new body teleop ui (#29282)
* Revert "Revert "[commabody] Add new body teleop ui (#29119)" (#29249)"

This reverts commit 623351e4ed.

* add to release files

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-08-08 14:12:51 -07:00
Justin Newberry
cb31a53d8a CI: pylint to ruff (#29276)
* pylint to riff

* pylint to riff

* pylint to riff

* revert more

* undo exclude removal

* exclude tinygrad
2023-08-08 13:41:30 -07:00
Harald Schäfer
623351e4ed Revert "[commabody] Add new body teleop ui (#29119)" (#29249)
This reverts commit a7304d059c.
2023-08-05 07:15:35 -07:00
Vivek Aithal
a7304d059c [commabody] Add new body teleop ui (#29119)
* add new ui

* move body tele op ui to new dir

* fix codespell errors

* resolve mediablackhole pylint error

* fix import error

* style fixes

* use logging, not print

* fix js styling

* resolve comments
2023-08-04 13:56:46 -07:00
Adeeb Shihadeh
39ce23420c pre-commit: autoupdate hooks (#29198)
* Update pre-commit hook versions

* fix

* bump submodules

* one more

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-08-01 12:32:21 -07:00
Vivek Aithal
ee4fcff0c9 Fix mypy path error (#29091) 2023-07-21 18:36:51 -07:00
Adeeb Shihadeh
4b90117dd8 pre-commit: autoupdate hooks (#28605)
Update pre-commit hook versions

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-06-20 10:41:21 -07:00
Kacper Rączy
23de5f1bac pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh
bf8e6d0d29 pre-commit: autoupdate hooks (#28271)
Update pre-commit hook versions

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
2023-05-23 11:09:40 -07:00
Adeeb Shihadeh
2adab40565 pre-commit: add check-toml + update hooks (#27906)
* pre-commit: add check-toml

* update

* fix typo
2023-04-13 21:45:12 -07:00
Mitchell Goff
6f1d5edab8 Add osmnx to xx packages (#27342) 2023-02-14 14:32:08 -08:00
Adeeb Shihadeh
cd8e03d53e move all third party stuff into third_party/ (#26853)
* mv fastcluster

* move msm_kgsl.h

* camerad include

* update path

* mv pyextra

* fix tici build

* add acados_template to release build

Co-authored-by: Comma Device <device@comma.ai>
2022-12-31 21:00:50 -08:00
HaraldSchafer
a98d105cb9 Pipenv -> poetry (#24858)
* Try poetry

* Remove casadi for now

* Update docker

* Copy pipfiles

* add casadi back

* Too many slashes

* New poetry api

* Install system

* Try again

* No more pipenv

* new dependencies

* updates

* poetry 1.2.1, install dev dependencies

* keep install pipenv for xx for now?

* add pre-commit checks for poetry

* poetry lock is too slow

* update pip

* migrate to poetry groups

* update lockfile

* don't need to specify dev group unless it is made optional

* always install poetry

* set POETRY_VIRTUALENVS_CREATE instead, and use pipenv for xx

* use env for docs docker image

* alphabetical

* poetry 1.2.2

* add dev dependencies for typing

added in 4e310b80

* remove constraint

* fix PIPENV_SYSTEM

* remove constraint

* don't need this here

* bump

* bump pipenv

adds support for installing local pyprojects (can add openpilot as dependency of xx)

* README improvements

* probably not necessary

* bump pip

* maybe not necessary?

* revert

* don't install openpilot itself into the virtual env

* remove PySide2 and shiboken2

reverts c6b749fb96

* remove Pipenv, add xx dependencies, sync system python

* add pipenv as xx dep

* semver package constraints, use old lockfile versions

* fix casadi

* remove whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* disable poetry cache

* cleanup

* prefer config file

Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-10-21 16:23:56 -07:00