Commit Graph

94 Commits

Author SHA1 Message Date
Harald Schäfer
e71ec4e8d7 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
2024-06-06 14:31:56 -07:00
Adeeb Shihadeh
c59887c810 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
2024-06-03 15:48:56 -07:00
Adeeb Shihadeh
accdade4cf manager: move to system/ (#32538)
* manager: move to system/

* one more
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
b2e4c64cf8 ruff: enable UP 2024-05-20 17:43:54 -07:00
Dean Lee
b742776bff encoderd: publish i-frame as thumbnail (#32202)
* pusblish i-frame as thumbnail

* generic

* disable for now

* fix

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-05-18 17:46:34 -07:00
cl0cks4fe
dd9d5d4528 Unittest to pytest (#32366)
* add pytest-asyncio

* switch common

* switch selfdrive

* switch system

* switch tools

* small fixes

* fix setUp and valgrind pytest

* switch to setup

* fix random

* switch mock

* switch test_lateral_limits

* revert test_ui

* fix poetry.lock

* add unittest to banned-api

* add inline ignores to remaining unittest imports

* revert test_models

* revert check_can_parser_performance

* one more skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-05-17 11:01:44 -07:00
Dean Lee
99285ef1f2 loggerd/logger.cc: use std::stoul instead of std::stol (#32133) 2024-04-09 10:46:07 -07:00
Dean Lee
cad7b96c3a loggerd/logger.cc: fix typo (#32134) 2024-04-09 10:45:48 -07:00
Adeeb Shihadeh
e3589e4b5c refactor camera transformations (#31818)
* refactor camera transormations

* update users

* more stuff

* more fix

* swap

* tici

* lil shorter
2024-03-10 16:56:50 -07:00
Adeeb Shihadeh
158e36976b fix old route sorting (#31787)
* fix old route sorting

* cleanup

* Update system/loggerd/uploader.py

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-03-07 19:22:06 -08:00
Adeeb Shihadeh
84797482e9 encoderd: fix large frames (#31681)
* encoderd: fix large frames

* Update camera_common.cc

* just do this for now

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-03-06 16:19:08 -08:00
Adeeb Shihadeh
7cfc571f56 timeless routes (#31119)
* timeless route

* update sort

* update test

* fix param name
2024-03-05 20:43:33 -08:00
Cameron Clough
80da3aee14 mypy: use implicit-optional (#31590)
* mypy: set implicit-optional = true

* find and replace '| None = None' -> '= None' in function args
2024-02-25 13:29:18 -08:00
Cameron Clough
995250ae49 use pyupgrade to update to new typing syntax (#31580)
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
2024-02-24 16:41:23 -08:00
Adeeb Shihadeh
1c794b710c uploader: sleep more when no files in queue (#31523)
* uploader: sleep more when no files in queue

* fix test
2024-02-20 17:25:12 -08:00
Adeeb Shihadeh
0723c2bc5f log git commit date (#31490)
* log git commit date

* unix ts

* fix

* bump cereal

* cleanup
2024-02-16 13:19:10 -08:00
Adeeb Shihadeh
cbd46802b0 fix bootlog count (#31319) 2024-02-05 23:00:45 -08:00
Adeeb Shihadeh
a5766e2796 encoderd: get frame size over vipc (#31276)
* encoderd: get frame size over vipc

* bump cereal

* fix ffmpeg

* no print
2024-02-02 12:53:12 -08:00
Adeeb Shihadeh
2504341070 bootlog: remove timestamp from filename (#31187)
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
6fbd844216 mark as flaky for now 2024-01-26 14:37:22 -08:00
Justin Newberry
979dba33cd Revert "test_loggerd: make rotation test more robust" (#31168) 2024-01-25 17:11:03 -08:00
Justin Newberry
35374f4d57 test_loggerd: make rotation test more robust (#31160)
* no randomness

* lots

* Revert "lots"

This reverts commit 2052fd6f7b8dc4c53fbb7c726026070918d5de00.
2024-01-25 12:13:43 -08:00
Adeeb Shihadeh
694fc378dd loggerd: speedup unit tests (#31115)
* first speed it up

* pytestify

* no sleep
2024-01-22 17:24:42 -08:00
Adeeb Shihadeh
7cd9568423 remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
2024-01-19 14:05:03 -08:00
Adeeb Shihadeh
2280ac50b7 uploader: restrict qcam upload on metered connctions (#31047)
* uploader: restrict qcam upload on metered connctions

* route requesting

* rename

* str

* cleanup

* strip dongle

* upload bookmarked segments

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-01-17 21:41:58 -08:00
Adeeb Shihadeh
19630c5af9 uploader: delay uploading crash and boot logs on metered connections (#31045)
* uploader: delay uploading some files on metered connections

* just crash and boot for now
2024-01-17 17:43:41 -08:00
Adeeb Shihadeh
5f1e7649e3 update param in loggerd unit test 2024-01-17 15:08:36 -08:00
Adeeb Shihadeh
0b5fd7287e uploader cleanup (#31035)
* Reapply "uploader cleanup" (#31033)

This reverts commit 5e4df41b2f.

* always sleep

* more cleanup

* little more

* fix linter

* little more
2024-01-17 14:24:09 -08:00
Justin Newberry
5e4df41b2f Revert "uploader cleanup" (#31033) 2024-01-17 11:07:38 -08:00
Adeeb Shihadeh
c6c6a441eb uploader cleanup (#31029)
* cleanup

* startup cleanup

* step

* Update test_uploader.py
2024-01-16 19:54:07 -08:00
Dean Lee
a1f53c70e6 uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
2023-12-26 16:05:45 -08:00
Adeeb Shihadeh
37351cbdc1 uploader: reduce max qlog/qcam size (#30746) 2023-12-14 22:30:46 -08:00
Dean Lee
a4179a7c23 encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
2023-12-12 19:15:47 -08:00
Adeeb Shihadeh
35f819c823 swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
2023-12-06 17:27:51 -08:00
Adeeb Shihadeh
a1d36961cf new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
2023-12-03 10:50:17 -08:00
Justin Newberry
4086795c29 Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
2023-11-30 09:55:48 -08:00
Adeeb Shihadeh
c055fdc853 one more 2023-11-18 22:22:31 -08:00
Adeeb Shihadeh
3d36a0f70d rm old loggerd debug scripts 2023-11-18 22:20:10 -08:00
Dean Lee
3527c1da67 loggerd: c++ LoggerState (#25869)
* c++ LoggerState

* trigger ci

* trigger ci

* merge master

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-11-18 22:11:13 -08:00
Justin Newberry
aec7cea30d Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh
f616dd77a1 loggerd: add wall time to initData (#30251)
* loggerd: add wall time to initData

* bump cereal

* fix
2023-10-15 15:21:51 -07:00
Adeeb Shihadeh
c347096c3e finish hardware move to system/ (#30140)
* finish hardware move to system/

* fix release

* couple more
2023-10-02 16:49:07 -07:00
Shane Smiskol
7f073483bb services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
2023-09-21 18:25:15 -07:00
Adeeb Shihadeh
2c1dfc2f34 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
2023-09-11 14:01:50 -07:00
Justin Newberry
73eda51a11 System: use paths for download folders too (#29818)
* use paths for download folders too

* trailing slash

* reset that
2023-09-07 12:49:03 -07:00
Justin Newberry
bfe990b112 System: cleanup paths to use a common class (#29816)
* use OP prefix for logmessage

* cleanup paths too

* cleanup the paths too

* add hw.py to release

* fix those issues

* fix unittests

* fix unittests

* fix unittests

* do swaglog_ipc properly across all the files

* fix that

* fix swaglog in c++

* review suggestions
2023-09-07 11:32:47 -07:00
Justin Newberry
4e69937d0d Precommit: ensure executable bit is set (#29784)
* precommit ensure executable

* exclude tinygrad

* bump submodules

* exclude tinygrad globally
2023-09-05 16:33:26 -07:00
Kacper Rączy
0bda43d71c encoderd: fix crash when filename is null (#29748)
Use publish_name for thread name and debugging messages
2023-09-01 11:51:59 -07:00
Justin Newberry
a5ef9febb9 Tests: loggerd reduce iterations (#29713)
* reduce those iterations

* sleep time could be decreased too

* in case it's negative
2023-08-30 13:36:55 -07:00
Adeeb Shihadeh
72e2e2c9ec pytest: strict config (#29676)
* pytest: strict config

* collection works

* fixes
2023-08-28 10:26:19 -07:00