Commit Graph

504 Commits

Author SHA1 Message Date
ZwX1616
03fa24ee82 camerad: use os binning (#33161)
* all

* right sz

* what is this

* Revert "what is this"

This reverts commit 3ff771926f109452a055dfb61cee06b34e498164.

* ok

* big

* update intrs

* fl

* more specifuc

* fish

* revert

* revert

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 3ccc63deec85f454521d465c4e0e3438e76cb547
2024-07-31 19:10:44 -07:00
Shane Smiskol
5cc7d1c36b deprecate busTime (#33146)
* deprecate busTime

* bump

* do car can + more

* forgot some

* bump opendbc

* fix that too

* bump
old-commit-hash: 42f2601416bcb53c25e24b899131e66ee00177b8
2024-07-30 21:26:58 -07:00
Dean Lee
3c1af12490 uploader.py: ensure proper resource management with io.BytesIO (#33108)
* ensure proper resource management with io.BytesIO

* improve
old-commit-hash: 2728c95b0d8f95faca4c1ee11a77a050f0d1c5fb
2024-07-29 13:43:31 -07:00
Adeeb Shihadeh
8cc6b66cde docs: add concepts section
old-commit-hash: 5ebc65f254f66ff13c679f9f699a92458c41aa8a
2024-07-28 16:38:41 -07:00
Shane Smiskol
7b67994a05 use zstandard library (#33110)
* use zstandard

* run 10

* bye bye

* this was a little overzealous

* clean up
old-commit-hash: 1b3b5ab75857465f58ec8a687db04c8ee0470e05
2024-07-28 02:03:47 -07:00
Shane Smiskol
b0a8b3bc9d uploader: compress with zstd (#32736)
* zstd uploader

* fix that

* fix name of function

* comment

* log failed

* fix comma_api_source for routes with both bz2 and zst rlogs

* TODO

* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time

* these aren't written out

* regen: specify any list of sources

ooh this is pretty nice

* regen and process replay

* damn, actually we don't need all this (cool tho)

Revert "regen: specify any list of sources"

This reverts commit ceb0b4abed9ad463a9fe98d9b98a05875a52806f.

* just let it auto resolve

* fix athenad/uploader tests

* zst here too

* TODOs

* yes

* Revert "TODOs"

This reverts commit 8c7da1dbd0340c72290b5eb5563b642080ddc131.

* Revert "zst here too"

This reverts commit 23b0023ddfd22c8090be7a7caa09e7026a12aa5c.

* Revert "just let it auto resolve"

This reverts commit f296d62424227ad05facc62abc18a6f81b474e84.

* Revert "regen and process replay"

This reverts commit 0768330e96974a42616d229d159780619d049cd0.

* revert readme

* not in save_log either

* lfg

* Revert "lfg"

This reverts commit 3718559c6c4de7d1f0c80dc9f1a1d335fe679a89.
old-commit-hash: 7dec7c39bec0b7015c9cc12ee78f07a07ed47ee6
2024-07-26 19:33:35 -07:00
Dean Lee
01ac526046 camerad: merge thread functions into one (#33025)
merge multiple thread functions into one
old-commit-hash: ccd369ee9639beae479704615f198902d58135b9
2024-07-25 15:05:14 -07:00
Dean Lee
757cb2eb6c mcid.py: optimize FFT and A-weighting calculations (#33057)
* Precomputing weighting

* add comments back

* use cache

* spacing

spacing

* clean up

* lower by diff

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 313a2826c268a7974ce7422084ab294767b7c9bd
2024-07-25 13:36:44 -07:00
Dean Lee
5b5e3ef053 camerad: add CameraConfig struct for initializing CameraState in constructor (#33065)
* Add CameraConfig struct for initializing CameraState in constructor

* init member variables
old-commit-hash: 75f49f84f3b71c970e7f4a5768016a092175e870
2024-07-25 13:09:03 -07:00
Shane Smiskol
5fdbd73ba3 athenad: log failed upload items
old-commit-hash: add958bb08890c653be89999701cb3d794c5c717
2024-07-24 14:48:33 -07:00
Dean Lee
4d6d229820 camerad: refactor camera_open() into separate functions for clarity (#33056)
split function
old-commit-hash: 0fa6745a67b60a572cfa4060d8155ac50f4e4e06
2024-07-24 10:07:10 -07:00
Adeeb Shihadeh
5025140f37 Revert "camerad: add CameraConfig struct for initializing CameraState in constructor (#33034)"
This reverts commit 8ef650da47eec8b64e2aedcba5114ca1a2428a89.

old-commit-hash: cefe00c964d41f5ac15f13bc83b3e389d8965a5e
2024-07-21 20:36:45 -07:00
Dean Lee
3f327ef4d3 camerad: add CameraConfig struct for initializing CameraState in constructor (#33034)
* Add CameraConfig struct for initializing CameraState in constructor

* Update system/camerad/cameras/camera_qcom2.h

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dc886e195f9815c77b721a8a438bbdffe9067e38
2024-07-21 19:19:34 -07:00
Dean Lee
cc3f9090bf cereal: deprecate FrameData.frameType (#33019)
deprecate FrameData.frameType
old-commit-hash: 917ea5699f3af241e60311455af5f20c0c55a8c4
2024-07-19 10:14:04 -07:00
Kacper Rączy
4efe8d8118 Fix msgq context overrides (#33014)
* Fix msgq context overrides

* Remove unneccesary changes

* add reset_context helper

* Remove redundant import
old-commit-hash: c96dbd5a0b681c76b94191d1b928e29eb2b72119
2024-07-18 20:19:39 -07:00
Adeeb Shihadeh
acdbe2440f tici: set STM_BOOT0 in reset (#33015)
* tici: reset panda boot0

* ooops
old-commit-hash: 560e37cd83c51149328aedc83b7d34c40941bf46
2024-07-18 18:48:54 -07:00
Shane Smiskol
1d480761bd hardwared: don't ignore quick ignition cycles (#32938)
* check on either edge

* clean up

* clean up

* good thing I tested this first :P
old-commit-hash: 11db7b683b4ea0427c0060b48bd17ac5b61b11ff
2024-07-11 02:49:42 -07:00
Adeeb Shihadeh
1490a714a0 mvp of new docs.comma.ai (#32926)
* ssh docs

* strict

* need an index

* push to prod
old-commit-hash: f6189568eab0244ed792ef299fb781cc4c92fb9b
2024-07-08 16:55:16 -07:00
Dean Lee
9f6dae8f44 logmessaged: remove the redundant nested print (#32872)
remove the redundant nested print
old-commit-hash: cec8d5a305c6dd91a9e7c965e23884ca9ed84aac
2024-06-29 17:34:46 -07:00
Maxime Desroches
8adfc992e3 fix pytest tests (#32867)
* fix tests

* no dot
old-commit-hash: 6f10b8a20989031d4cc04e8b8ce38eaea4a4824e
2024-06-28 23:58:19 +00:00
Shane Smiskol
82ebea3d12 deleter: preserve two previous segments on user flag (#32822)
preserve 2 segs
old-commit-hash: dc418485970952a780baef7ef069d858220e58e5
2024-06-24 15:11:20 -07:00
Mauricio Alvarez Leon
8d8c2a29c9 remove timezone from timed.py (#32665)
* use timezone from tilequery mapbox api

* add timezone into cereal

* better clean

* more

* one line

* poetry lock
old-commit-hash: 7013eed50cd350a9b329280b0eccfc9db051a72b
2024-06-19 20:34:57 -07:00
Adeeb Shihadeh
3b8ed67aa3 remove navigation (#32773)
* remove navigation

* lil more

* fix cabana

* revert for now

* fix docs

* move that over

* lock

* rm assets
old-commit-hash: e491c9d964a2aef07eeaa7b47f4aa9f992130482
2024-06-19 19:14:13 -07:00
Adeeb Shihadeh
9cfdd6200d Remove setproctitle (#32716)
* Custom setproctitle (#32667)

* add custom setproctitle

* add test

* Update poetry.lock

* fix lint

* support only Linux

* test only Linux

* final lint

* Update test_setproctitle.py

* Update setproctitle.py

* convert to threadnames

* delete proctitles

* Check str len and use PR_GET_NAME

* fix poetry.lock

* lint fix

* Update common/threadname.py

---------

Co-authored-by: reddyn12 <nikhilr.ssm@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert that for now

* use last 15

* fix

* use name

* update those

* and modeld

* rm

---------

Co-authored-by: schlimeszn <138847413+schlimeszn@users.noreply.github.com>
Co-authored-by: reddyn12 <nikhilr.ssm@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 83ac80c6c899dbf4b5b2d422947b02b57d83bccd
2024-06-11 21:57:32 -07:00
Mauricio Alvarez Leon
008008b03a Update to Python 3.12 (#32548)
* 3.12

* pprofile is broken

* use modified metadrivepy3-12

* 0.3.0 metadrive

* add metadrive/commaai git dependency

* metadrive git set

* pin sounddevice 0.4.6

* datetime.utcnow() deprecation

* poetry lock

* make datetime not aware

* poetry lock

* pin pytools

* google_crc32c wheel

* unpin sounddevice

* clean metadrive

* use python crc

* mypy

* 3.12.4

* allow python3.11

* test

* no pip

* poetry

* better

* better

* merge

* remove

* try

* test

* try  this

* snok

* python

* simpler

* setuptools

* lower

* try

* try

* work?

* ubuntu deps

* ubuntu

* try

* remove

* move

* remove this

* names

* Update .github/workflows/tools_tests.yaml

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* python<4

* <3.13

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 148eaf8fa6c9b23cdd346e926f58fad61f79ff1d
2024-06-11 20:45:15 +00:00
Adeeb Shihadeh
e920e57530 Revert "Custom setproctitle (#32667)"
This reverts commit 1f45e163559baa2a6127d5a5e8deb7067e32f813.

old-commit-hash: 5b51f039675edbbdfbeac72cd9c518450a85bc04
2024-06-10 19:55:41 -07:00
schlimeszn
afea57ae2a Custom setproctitle (#32667)
* add custom setproctitle

* add test

* Update poetry.lock

* fix lint

* support only Linux

* test only Linux

* final lint

* Update test_setproctitle.py

* Update setproctitle.py

* convert to threadnames

* delete proctitles

* Check str len and use PR_GET_NAME

* fix poetry.lock

* lint fix

* Update common/threadname.py

---------

Co-authored-by: reddyn12 <nikhilr.ssm@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3365ed5effa48d34ffe0e2e9bbe9f6941336bed5
2024-06-10 18:59:01 -07:00
commaci-public
0ee93c6a90 [bot] Update Python packages and pre-commit hooks (#32682)
* Update Python packages and pre-commit hooks

* fix linter

* poetry lock

---------

Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 71063d66cd526bf1e498618e1aec3440736ab5b7
2024-06-10 17:19:01 -07:00
Kacper Rączy
7acd2e6159 webrtc: fix patch in tests (#32686)
* Fix patch

* Fix it again
old-commit-hash: 2b1ac1ffa145543ac62075479123d71806bd3f62
2024-06-10 14:22:47 -07:00
Harald Schäfer
05ed3d8c15 Restructure msgq (#32652)
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a452e7c045d9a207f3680d846406ef789
2024-06-09 17:44:34 -07:00
Adeeb Shihadeh
a4745aa158 tici: improve power save test (#32674)
* tici: improve power save test

* Update system/hardware/tici/tests/test_hardware.py
old-commit-hash: da1cb2276bf28ee906e61a717da2e2699bdba34d
2024-06-09 11:51:43 -07:00
Adeeb Shihadeh
92ad30cbd6 Replace markdown-it-py with small function in common/ (#32664)
* Replace markdown-it-py with small function in common/

* simple test

* unused

* lock

* linting fixes
old-commit-hash: 5265d13fe087972311592febd4071c16cece65e0
2024-06-08 15:39:26 -07:00
Adeeb Shihadeh
ad42b61427 test_encoder: adjust file size tolerance
old-commit-hash: b51472048ce5b37f4069ad14a60fc911e47b724e
2024-06-07 23:09:41 -07:00
Shane Smiskol
2d4f0e2af8 remove old cache wrapper (#32653)
* remove wrapper that is functools.cache

* format
old-commit-hash: 451e171ad9bef27d87f4124dbf032881d3ccc485
2024-06-07 21:24:32 -07:00
Shane Smiskol
2532cab5d1 update TOTAL_SCONS_NODES
from 8c15c5b0d6

old-commit-hash: 280a284b760c2a0519ffedcdb7228be23c90edf9
2024-06-06 16:24:09 -07:00
Harald Schäfer
f870a968e9 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
old-commit-hash: e71ec4e8d7e39a56235f590227e7cb361cd8b79d
2024-06-06 14:31:56 -07:00
Adeeb Shihadeh
30c41788dc thermald is hardwared (#32637)
* thermald is deviced

* hardwared

* rename
old-commit-hash: 51fdf2330453fe863597db0eb8daf87c2ec4ff8d
2024-06-05 15:58:00 -07:00
Adeeb Shihadeh
389daf4018 pandad: move to core 3 (#32402)
* move to core 3

* core is fully offlined now

* move to init

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 7b092858172220efd6805d3586355c0f393b2d86
2024-06-05 14:50:25 -07:00
Adeeb Shihadeh
2c6829ed67 boardd is pandad (#32628)
* boardd is pandad

* rename tests
old-commit-hash: 34e329649d7a388d4cd1f25dac9dda9d5409bf4a
2024-06-04 19:16:55 -07:00
Adeeb Shihadeh
86b6103657 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
old-commit-hash: c59887c8109dd8d33ea2e7169995184fbe38cc3a
2024-06-03 15:48:56 -07:00
Adeeb Shihadeh
cc4f53e6c6 manager: move to system/ (#32538)
* manager: move to system/

* one more
old-commit-hash: accdade4cfe73cdca41f5afa73cf4ad085802930
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
4356b74cca updated: finish system/ move (#32535)
* updated: finish system/ move

* add those back

* skip that

* skip whole file

* one more time
old-commit-hash: 73b02f2cda858d4ad08bc7fa4116d0d11ff79a02
2024-05-25 12:22:02 -07:00
Adeeb Shihadeh
14e7c7d260 thermald: move to system/ (#32494)
* thermald: move to system/

* fix path

* revert
old-commit-hash: b2cf9b35f68061587fd6ab7a94a58f7b433b2da2
2024-05-20 22:51:29 -07:00
Adeeb Shihadeh
7a3e454d27 move sentry/stats to system/ (#32490)
* move sentry/stats to system/

* fix
old-commit-hash: da6fd751257bcd3aa087ac4114e9f1529f7d3d12
2024-05-20 22:39:25 -07:00
Adeeb Shihadeh
70d14c99e1 ruff: enable TRY
old-commit-hash: 0e3df5ae4d673c3644f04861a73e3aa599dd03ae
2024-05-20 17:47:48 -07:00
Adeeb Shihadeh
3358745103 ruff: enable UP
old-commit-hash: b2e4c64cf8fe3256d1e411e8715c29e2eb6f4f00
2024-05-20 17:43:54 -07:00
Adeeb Shihadeh
18970afb0e athena: move to system/ (#32488)
* athena: move to system/

* slash
old-commit-hash: 3279dbeff7d4f696804c94de1573be2b5f3f2f9d
2024-05-20 14:59:43 -07:00
Dean Lee
46183bc11b encoderd: publish i-frame as thumbnail (#32202)
* pusblish i-frame as thumbnail

* generic

* disable for now

* fix

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: b742776bffb3e49649c17b54197a993e9d547403
2024-05-18 17:46:34 -07:00
cl0cks4fe
639a634f7c Unittest to pytest (#32366)
* add pytest-asyncio

* switch common

* switch selfdrive

* switch system

* switch tools

* small fixes

* fix setUp and valgrind pytest

* switch to setup

* fix random

* switch mock

* switch test_lateral_limits

* revert test_ui

* fix poetry.lock

* add unittest to banned-api

* add inline ignores to remaining unittest imports

* revert test_models

* revert check_can_parser_performance

* one more skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528ff0a61c7699abc1b63ba8fd282632f
2024-05-17 11:01:44 -07:00
Adeeb Shihadeh
583fa3bfbf agnos 10.1 (#32373)
old-commit-hash: 7ff66986c1a7bcfc9b459a5bb635a9f394cf2fa1
2024-05-08 16:51:27 -07:00