Dean Lee
a0a9df2d55
loggerd: enhance ZstdFileWriter test coverage with variable data sizes ( #34812 )
...
enhance ZstdFileWriter test coverage
2025-03-07 10:23:46 -08:00
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
2025-02-08 12:55:31 -08:00
Maxime Desroches
7d5031a6d6
ci: reduce sleep in test_uploader ( #34009 )
...
less
2024-11-12 19:41:00 -08:00
Maxime Desroches
ce7317407f
ci: faster test_encoder ( #33968 )
...
* try
* timeout
* fix
2024-11-08 11:49:04 -08:00
Maxime Desroches
e0acd86ca1
ci: faster unit_tests ( #33962 )
...
faster
2024-11-07 18:44:12 -08:00
Adeeb Shihadeh
853febe21d
visionipc: remove RGB support ( #33739 )
...
* visionipc: remove RGB support
* bump
* msgq master
* fix sim
2024-10-07 13:24:57 -07:00
Hoang Bui
cb306fd7a8
CI: fix recent test_rotation skip ( #33167 )
...
old-commit-hash: 5b4b7a08fc
2024-08-01 16:28:26 -07:00
Adeeb Shihadeh
d59f9262c8
disable test_rotation until it's fixed
...
old-commit-hash: bfa8e0b2ec
2024-08-01 15:36:44 -07:00
Shane Smiskol
b0a8b3bc9d
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed9ad463a9fe98d9b98a05875a52806f.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0340c72290b5eb5563b642080ddc131.
* Revert "zst here too"
This reverts commit 23b0023ddfd22c8090be7a7caa09e7026a12aa5c.
* Revert "just let it auto resolve"
This reverts commit f296d62424227ad05facc62abc18a6f81b474e84.
* Revert "regen and process replay"
This reverts commit 0768330e96974a42616d229d159780619d049cd0.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c4de7d1f0c80dc9f1a1d335fe679a89.
old-commit-hash: 7dec7c39be
2024-07-26 19:33:35 -07:00
Adeeb Shihadeh
ad42b61427
test_encoder: adjust file size tolerance
...
old-commit-hash: b51472048c
2024-06-07 23:09:41 -07:00
Harald Schäfer
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7
2024-06-06 14:31:56 -07:00
Adeeb Shihadeh
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810
2024-06-03 15:48:56 -07:00
Adeeb Shihadeh
cc4f53e6c6
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
old-commit-hash: accdade4cf
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8
2024-05-20 17:43:54 -07:00
cl0cks4fe
639a634f7c
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: dd9d5d4528
2024-05-17 11:01:44 -07:00
Adeeb Shihadeh
da31ce154a
refactor camera transformations ( #31818 )
...
* refactor camera transormations
* update users
* more stuff
* more fix
* swap
* tici
* lil shorter
old-commit-hash: e3589e4b5c
2024-03-10 16:56:50 -07:00
Adeeb Shihadeh
9735cf2eb6
timeless routes ( #31119 )
...
* timeless route
* update sort
* update test
* fix param name
old-commit-hash: 7cfc571f56
2024-03-05 20:43:33 -08:00
Cameron Clough
a09300385b
mypy: use implicit-optional ( #31590 )
...
* mypy: set implicit-optional = true
* find and replace '| None = None' -> '= None' in function args
old-commit-hash: 80da3aee14
2024-02-25 13:29:18 -08:00
Cameron Clough
9bd90112d0
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae49
2024-02-24 16:41:23 -08:00
Adeeb Shihadeh
df6154b591
log git commit date ( #31490 )
...
* log git commit date
* unix ts
* fix
* bump cereal
* cleanup
old-commit-hash: 0723c2bc5f
2024-02-16 13:19:10 -08:00
Adeeb Shihadeh
048629564e
bootlog: remove timestamp from filename ( #31187 )
...
* bootlog: remove timestamp from filename
* revert route
* test
* revert that
* fix loggerd test
old-commit-hash: 2504341070
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
5441587c6b
mark as flaky for now
...
old-commit-hash: 6fbd844216
2024-01-26 14:37:22 -08:00
Justin Newberry
1e197545c6
Revert "test_loggerd: make rotation test more robust" ( #31168 )
...
old-commit-hash: 979dba33cd
2024-01-25 17:11:03 -08:00
Justin Newberry
1dae90e219
test_loggerd: make rotation test more robust ( #31160 )
...
* no randomness
* lots
* Revert "lots"
This reverts commit 2052fd6f7b8dc4c53fbb7c726026070918d5de00.
old-commit-hash: 35374f4d57
2024-01-25 12:13:43 -08:00
Adeeb Shihadeh
dc6a23a1bc
loggerd: speedup unit tests ( #31115 )
...
* first speed it up
* pytestify
* no sleep
old-commit-hash: 694fc378dd
2024-01-22 17:24:42 -08:00
Adeeb Shihadeh
6c21bbacae
update param in loggerd unit test
...
old-commit-hash: 5f1e7649e3
2024-01-17 15:08:36 -08:00
Adeeb Shihadeh
d6a8213c80
uploader cleanup ( #31035 )
...
* Reapply "uploader cleanup" (#31033 )
This reverts commit a2723989bced503a4506684a4a6fdc6c8101f7b2.
* always sleep
* more cleanup
* little more
* fix linter
* little more
old-commit-hash: 0b5fd7287e
2024-01-17 14:24:09 -08:00
Justin Newberry
7f09117bf0
Revert "uploader cleanup" ( #31033 )
...
old-commit-hash: 5e4df41b2f
2024-01-17 11:07:38 -08:00
Adeeb Shihadeh
4580cd1eb9
uploader cleanup ( #31029 )
...
* cleanup
* startup cleanup
* step
* Update test_uploader.py
old-commit-hash: c6c6a441eb
2024-01-16 19:54:07 -08:00
Adeeb Shihadeh
59eb2988de
swaglog.py goes in common/ ( #30631 )
...
* swaglog.py goes in common/
* all of these go in release
* we'll even include the pyx
old-commit-hash: 35f819c823
2023-12-06 17:27:51 -08:00
Adeeb Shihadeh
e56998ca26
one more
...
old-commit-hash: c055fdc853
2023-11-18 22:22:31 -08:00
Dean Lee
00e5f37d2a
loggerd: c++ LoggerState ( #25869 )
...
* c++ LoggerState
* trigger ci
* trigger ci
* merge master
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: 3527c1da67
2023-11-18 22:11:13 -08:00
Justin Newberry
3027a428cb
Pytest: tici mark for skipping on-device tests ( #30412 )
...
* mark tici
* not those ones
* missed that one
* add those
* add pypoetry
* oops
old-commit-hash: aec7cea30d
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh
61eb6f4f66
finish hardware move to system/ ( #30140 )
...
* finish hardware move to system/
* fix release
* couple more
old-commit-hash: c347096c3e
2023-10-02 16:49:07 -07:00
Shane Smiskol
13381ed446
services: capitalize constant service list ( #30005 )
...
* rename
* bump
* Apply suggestions from code review
old-commit-hash: 7f073483bb
2023-09-21 18:25:15 -07:00
Adeeb Shihadeh
1f8459d285
use pytest for cpp tests ( #29833 )
...
* add pytest-cpp package (#29828 )
* add pytest-cpp package
* disable for now
* use in ci
* use pytest cpp
* use my branch
* add missing tests
* that doesn't make sense
* it was merged upstream
* replace TEST_RLOG_URL with a publicly accessible url
* PR Cleanup
* assert instead
* update poetry lock
* add comment about pytest-cpp
---------
Co-authored-by: Justin Newberry <jnewberry0502@gmail.com >
Co-authored-by: Justin Newberry <justin@comma.ai >
Co-authored-by: deanlee <deanlee3@gmail.com >
old-commit-hash: 2c1dfc2f34
2023-09-11 14:01:50 -07:00
Justin Newberry
dc6078a6c3
System: use paths for download folders too ( #29818 )
...
* use paths for download folders too
* trailing slash
* reset that
old-commit-hash: 73eda51a11
2023-09-07 12:49:03 -07:00
Justin Newberry
c7029ea15a
System: cleanup paths to use a common class ( #29816 )
...
* use OP prefix for logmessage
* cleanup paths too
* cleanup the paths too
* add hw.py to release
* fix those issues
* fix unittests
* fix unittests
* fix unittests
* do swaglog_ipc properly across all the files
* fix that
* fix swaglog in c++
* review suggestions
old-commit-hash: bfe990b112
2023-09-07 11:32:47 -07:00
Justin Newberry
e3053e6659
Tests: loggerd reduce iterations ( #29713 )
...
* reduce those iterations
* sleep time could be decreased too
* in case it's negative
old-commit-hash: a5ef9febb9
2023-08-30 13:36:55 -07:00
Adeeb Shihadeh
cc29c6640d
pytest: strict config ( #29676 )
...
* pytest: strict config
* collection works
* fixes
old-commit-hash: 72e2e2c9ec
2023-08-28 10:26:19 -07:00
Adeeb Shihadeh
16ec56398c
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.
* fix pm test
old-commit-hash: a9626f95b6
2023-08-20 20:49:55 -07:00
Adeeb Shihadeh
f50fedb647
Fixes for PYTHONWARNINGS=error ( #29381 )
...
old-commit-hash: db287496d8
2023-08-13 17:22:56 -07:00
Justin Newberry
a14f162bc7
Ruff: comprehensions conventions ( #29317 )
...
ignore c408
old-commit-hash: 4a9afd7554
2023-08-10 16:40:30 -07:00
Cameron Clough
b120aec2f5
deleter: preserve flagged segments ( #28814 )
...
old-commit-hash: 98a30f10f4
2023-07-20 21:30:26 +01:00
Cameron Clough
182ef3fe52
loggerd: add types to tests and use pathlib ( #28943 )
...
old-commit-hash: 5d45d1fadc
2023-07-14 15:12:11 +01:00
Shane Smiskol
8a7283d315
uploader: check upload key value ( #28206 )
...
* fix check
* tests
* fix test
* fix
* xattr truthy and falsy tests
---------
Co-authored-by: Cameron Clough <cameronjclough@gmail.com >
old-commit-hash: 7f7637f3e5
2023-05-16 21:55:24 -07:00
Adeeb Shihadeh
2f8939dd0e
bootlog: log agnos partition hashes ( #28141 )
...
* bootlog: log agnos partition hashes
* full path
* trimming
* slot
* boot is big
* give some time to start
---------
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 1a3125bb8f
2023-05-10 13:56:44 -07:00
Harald Schäfer
515645da51
LaikaD new cache version ( #27596 )
...
old-commit-hash: 38cb42f76a
2023-03-15 20:26:19 -07:00
Adeeb Shihadeh
3a968c67e1
loggerd: move to system/ ( #27534 )
...
old-commit-hash: 94eb215980
2023-03-08 11:20:49 -08:00
