mawei
/
openpilot0
mirror of https://github.com/commaai/openpilot.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
13,775 Commits 81 Branches 81 Tags 4.7 GiB
Commit Graph

106 Commits

Author SHA1 Message Date
Adeeb Shihadeh 139f4034a8 Revert "uploader.py: simplify clear_locks by using rglob (#32974)" 
This reverts commit 870f5cbeb39fa63829e6f3a64fa8df57e82d52c3.

old-commit-hash: 9474523add
 2024-08-03 12:12:42 -07:00
Dean Lee 7fcba71725 uploader.py: simplify clear_locks by using rglob (#32974) 
simplify clear_locks
old-commit-hash: cafca4f891
 2024-08-02 13:40:57 -07:00
Dean Lee d802a423a6 loggerd: Initialize atomic variables to zero (#33130) 
Initialize atomic variables in LoggerdState to zero
old-commit-hash: 8f3fc699d4
 2024-08-02 12:01:56 -07:00
Hoang Bui cb306fd7a8 CI: fix recent test_rotation skip (#33167) 
old-commit-hash: 5b4b7a08fc
 2024-08-01 16:28:26 -07:00
Adeeb Shihadeh d59f9262c8 disable test_rotation until it's fixed 
old-commit-hash: bfa8e0b2ec
 2024-08-01 15:36:44 -07:00
Dean Lee 3c1af12490 uploader.py: ensure proper resource management with io.BytesIO (#33108) 
* ensure proper resource management with io.BytesIO

* improve
old-commit-hash: 2728c95b0d
 2024-07-29 13:43:31 -07:00
Adeeb Shihadeh 8cc6b66cde docs: add concepts section 
old-commit-hash: 5ebc65f254
 2024-07-28 16:38:41 -07:00
Shane Smiskol 7b67994a05 use zstandard library (#33110) 
* use zstandard

* run 10

* bye bye

* this was a little overzealous

* clean up
old-commit-hash: 1b3b5ab758
 2024-07-28 02:03:47 -07:00
Shane Smiskol b0a8b3bc9d uploader: compress with zstd (#32736) 
* zstd uploader

* fix that

* fix name of function

* comment

* log failed

* fix comma_api_source for routes with both bz2 and zst rlogs

* TODO

* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time

* these aren't written out

* regen: specify any list of sources

ooh this is pretty nice

* regen and process replay

* damn, actually we don't need all this (cool tho)

Revert "regen: specify any list of sources"

This reverts commit ceb0b4abed.

* just let it auto resolve

* fix athenad/uploader tests

* zst here too

* TODOs

* yes

* Revert "TODOs"

This reverts commit 8c7da1dbd0.

* Revert "zst here too"

This reverts commit 23b0023ddf.

* Revert "just let it auto resolve"

This reverts commit f296d62424.

* Revert "regen and process replay"

This reverts commit 0768330e96.

* revert readme

* not in save_log either

* lfg

* Revert "lfg"

This reverts commit 3718559c6c.
old-commit-hash: 7dec7c39be
 2024-07-26 19:33:35 -07:00
Shane Smiskol 82ebea3d12 deleter: preserve two previous segments on user flag (#32822) 
preserve 2 segs
old-commit-hash: dc41848597
 2024-06-24 15:11:20 -07:00
Harald Schäfer 05ed3d8c15 Restructure msgq (#32652) 
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a45
 2024-06-09 17:44:34 -07:00
Adeeb Shihadeh ad42b61427 test_encoder: adjust file size tolerance 
old-commit-hash: b51472048c
 2024-06-07 23:09:41 -07:00
Harald Schäfer f870a968e9 Split cereal into cereal/msgq (#32631) 
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
old-commit-hash: e71ec4e8d7
 2024-06-06 14:31:56 -07:00
Adeeb Shihadeh 86b6103657 test_*.py files are no longer executable (#32610) 
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
old-commit-hash: c59887c810
 2024-06-03 15:48:56 -07:00
Adeeb Shihadeh cc4f53e6c6 manager: move to system/ (#32538) 
* manager: move to system/

* one more
old-commit-hash: accdade4cf
 2024-05-25 12:41:17 -07:00
Adeeb Shihadeh 3358745103 ruff: enable UP 
old-commit-hash: b2e4c64cf8
 2024-05-20 17:43:54 -07:00
Dean Lee 46183bc11b encoderd: publish i-frame as thumbnail (#32202) 
* pusblish i-frame as thumbnail

* generic

* disable for now

* fix

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: b742776bff
 2024-05-18 17:46:34 -07:00
cl0cks4fe 639a634f7c Unittest to pytest (#32366) 
* add pytest-asyncio

* switch common

* switch selfdrive

* switch system

* switch tools

* small fixes

* fix setUp and valgrind pytest

* switch to setup

* fix random

* switch mock

* switch test_lateral_limits

* revert test_ui

* fix poetry.lock

* add unittest to banned-api

* add inline ignores to remaining unittest imports

* revert test_models

* revert check_can_parser_performance

* one more skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528
 2024-05-17 11:01:44 -07:00
Dean Lee 0147c559c0 loggerd/logger.cc: use std::stoul instead of std::stol (#32133) 
old-commit-hash: 99285ef1f2
 2024-04-09 10:46:07 -07:00
Dean Lee fc1d2edf81 loggerd/logger.cc: fix typo (#32134) 
old-commit-hash: cad7b96c3a
 2024-04-09 10:45:48 -07:00
Adeeb Shihadeh da31ce154a refactor camera transformations (#31818) 
* refactor camera transormations

* update users

* more stuff

* more fix

* swap

* tici

* lil shorter
old-commit-hash: e3589e4b5c
 2024-03-10 16:56:50 -07:00
Adeeb Shihadeh b73a5fba4c fix old route sorting (#31787) 
* fix old route sorting

* cleanup

* Update system/loggerd/uploader.py

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 158e36976b
 2024-03-07 19:22:06 -08:00
Adeeb Shihadeh 402e8f8b0e encoderd: fix large frames (#31681) 
* encoderd: fix large frames

* Update camera_common.cc

* just do this for now

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 84797482e9
 2024-03-06 16:19:08 -08:00
Adeeb Shihadeh 9735cf2eb6 timeless routes (#31119) 
* timeless route

* update sort

* update test

* fix param name
old-commit-hash: 7cfc571f56
 2024-03-05 20:43:33 -08:00
Cameron Clough a09300385b mypy: use implicit-optional (#31590) 
* mypy: set implicit-optional = true

* find and replace '| None = None' -> '= None' in function args
old-commit-hash: 80da3aee14
 2024-02-25 13:29:18 -08:00
Cameron Clough 9bd90112d0 use pyupgrade to update to new typing syntax (#31580) 
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae49
 2024-02-24 16:41:23 -08:00
Adeeb Shihadeh dd3b005456 uploader: sleep more when no files in queue (#31523) 
* uploader: sleep more when no files in queue

* fix test
old-commit-hash: 1c794b710c
 2024-02-20 17:25:12 -08:00
Adeeb Shihadeh df6154b591 log git commit date (#31490) 
* log git commit date

* unix ts

* fix

* bump cereal

* cleanup
old-commit-hash: 0723c2bc5f
 2024-02-16 13:19:10 -08:00
Adeeb Shihadeh 35c9578c5e fix bootlog count (#31319) 
old-commit-hash: cbd46802b0
 2024-02-05 23:00:45 -08:00
Adeeb Shihadeh 2632a41c1e encoderd: get frame size over vipc (#31276) 
* encoderd: get frame size over vipc

* bump cereal

* fix ffmpeg

* no print
old-commit-hash: a5766e2796
 2024-02-02 12:53:12 -08:00
Adeeb Shihadeh 048629564e bootlog: remove timestamp from filename (#31187) 
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
old-commit-hash: 2504341070
 2024-01-26 19:17:38 -08:00
Adeeb Shihadeh 5441587c6b mark as flaky for now 
old-commit-hash: 6fbd844216
 2024-01-26 14:37:22 -08:00
Justin Newberry 1e197545c6 Revert "test_loggerd: make rotation test more robust" (#31168) 
old-commit-hash: 979dba33cd
 2024-01-25 17:11:03 -08:00
Justin Newberry 1dae90e219 test_loggerd: make rotation test more robust (#31160) 
* no randomness

* lots

* Revert "lots"

This reverts commit 2052fd6f7b.
old-commit-hash: 35374f4d57
 2024-01-25 12:13:43 -08:00
Adeeb Shihadeh dc6a23a1bc loggerd: speedup unit tests (#31115) 
* first speed it up

* pytestify

* no sleep
old-commit-hash: 694fc378dd
 2024-01-22 17:24:42 -08:00
Adeeb Shihadeh 972650f0eb remove dashcam branch (#31081) 
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
old-commit-hash: 7cd9568423
 2024-01-19 14:05:03 -08:00
Adeeb Shihadeh 6124ecf1c1 uploader: restrict qcam upload on metered connctions (#31047) 
* uploader: restrict qcam upload on metered connctions

* route requesting

* rename

* str

* cleanup

* strip dongle

* upload bookmarked segments

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2280ac50b7
 2024-01-17 21:41:58 -08:00
Adeeb Shihadeh 3d85d3d857 uploader: delay uploading crash and boot logs on metered connections (#31045) 
* uploader: delay uploading some files on metered connections

* just crash and boot for now
old-commit-hash: 19630c5af9
 2024-01-17 17:43:41 -08:00
Adeeb Shihadeh 6c21bbacae update param in loggerd unit test 
old-commit-hash: 5f1e7649e3
 2024-01-17 15:08:36 -08:00
Adeeb Shihadeh d6a8213c80 uploader cleanup (#31035) 
* Reapply "uploader cleanup" (#31033)

This reverts commit a2723989bced503a4506684a4a6fdc6c8101f7b2.

* always sleep

* more cleanup

* little more

* fix linter

* little more
old-commit-hash: 0b5fd7287e
 2024-01-17 14:24:09 -08:00
Justin Newberry 7f09117bf0 Revert "uploader cleanup" (#31033) 
old-commit-hash: 5e4df41b2f
 2024-01-17 11:07:38 -08:00
Adeeb Shihadeh 4580cd1eb9 uploader cleanup (#31029) 
* cleanup

* startup cleanup

* step

* Update test_uploader.py
old-commit-hash: c6c6a441eb
 2024-01-16 19:54:07 -08:00
Dean Lee 16266338c6 uploader.py/listdir_by_creation: list directories only (#30806) 
list only directories

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a1f53c70e6
 2023-12-26 16:05:45 -08:00
Adeeb Shihadeh c0c898d83a uploader: reduce max qlog/qcam size (#30746) 
old-commit-hash: 37351cbdc1
 2023-12-14 22:30:46 -08:00
Dean Lee 5ab1fc7674 encoder: reduce memory allocations and copying (#28704) 
* reduce memory allocations and copying

* #include <vector>
old-commit-hash: a4179a7c23
 2023-12-12 19:15:47 -08:00
Adeeb Shihadeh 59eb2988de swaglog.py goes in common/ (#30631) 
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c823
 2023-12-06 17:27:51 -08:00
Adeeb Shihadeh 1cc4f1a634 new msgs default to invalid (#30587) 
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
old-commit-hash: a1d36961cf
 2023-12-03 10:50:17 -08:00
Justin Newberry 661132be5a Pytest: more post-test path cleanup (#30556) 
* test cleanup

* missed this one

* remove that

* static class
old-commit-hash: 4086795c29
 2023-11-30 09:55:48 -08:00
Adeeb Shihadeh e56998ca26 one more 
old-commit-hash: c055fdc853
 2023-11-18 22:22:31 -08:00
Adeeb Shihadeh 07ea94cf7b rm old loggerd debug scripts 
old-commit-hash: 3d36a0f70d
 2023-11-18 22:20:10 -08:00