Commit Graph

88 Commits

Author SHA1 Message Date
Dean Lee
0147c559c0 loggerd/logger.cc: use std::stoul instead of std::stol (#32133)
old-commit-hash: 99285ef1f2da4ba3852c376f4cae0c50e5dc3c79
2024-04-09 10:46:07 -07:00
Dean Lee
fc1d2edf81 loggerd/logger.cc: fix typo (#32134)
old-commit-hash: cad7b96c3a12e58c17f0d80936a8b9e4c39e7365
2024-04-09 10:45:48 -07:00
Adeeb Shihadeh
da31ce154a refactor camera transformations (#31818)
* refactor camera transormations

* update users

* more stuff

* more fix

* swap

* tici

* lil shorter
old-commit-hash: e3589e4b5cc783001c95b52cce066647b4ae0c6c
2024-03-10 16:56:50 -07:00
Adeeb Shihadeh
b73a5fba4c fix old route sorting (#31787)
* fix old route sorting

* cleanup

* Update system/loggerd/uploader.py

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 158e36976b8793610ac1f39f51d82f5eeeb099b2
2024-03-07 19:22:06 -08:00
Adeeb Shihadeh
402e8f8b0e encoderd: fix large frames (#31681)
* encoderd: fix large frames

* Update camera_common.cc

* just do this for now

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 84797482e909ce017385fb3510d564ee5b08045d
2024-03-06 16:19:08 -08:00
Adeeb Shihadeh
9735cf2eb6 timeless routes (#31119)
* timeless route

* update sort

* update test

* fix param name
old-commit-hash: 7cfc571f5698c8f5d5bce2e39ccbd8a56c729395
2024-03-05 20:43:33 -08:00
Cameron Clough
a09300385b mypy: use implicit-optional (#31590)
* mypy: set implicit-optional = true

* find and replace '| None = None' -> '= None' in function args
old-commit-hash: 80da3aee147867e46f566b63a96f4fe199e0628d
2024-02-25 13:29:18 -08:00
Cameron Clough
9bd90112d0 use pyupgrade to update to new typing syntax (#31580)
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae4967943ee33a3699a1d89a7a770d95e9
2024-02-24 16:41:23 -08:00
Adeeb Shihadeh
dd3b005456 uploader: sleep more when no files in queue (#31523)
* uploader: sleep more when no files in queue

* fix test
old-commit-hash: 1c794b710cdcf682205b3f3724d8858073e5370c
2024-02-20 17:25:12 -08:00
Adeeb Shihadeh
df6154b591 log git commit date (#31490)
* log git commit date

* unix ts

* fix

* bump cereal

* cleanup
old-commit-hash: 0723c2bc5f22a079685c1643fa2d72f70eeff087
2024-02-16 13:19:10 -08:00
Adeeb Shihadeh
35c9578c5e fix bootlog count (#31319)
old-commit-hash: cbd46802b05b8883d6fa3f64fa069a5d5aaabd17
2024-02-05 23:00:45 -08:00
Adeeb Shihadeh
2632a41c1e encoderd: get frame size over vipc (#31276)
* encoderd: get frame size over vipc

* bump cereal

* fix ffmpeg

* no print
old-commit-hash: a5766e27967707d51c4e7181a3509c78b3671d16
2024-02-02 12:53:12 -08:00
Adeeb Shihadeh
048629564e bootlog: remove timestamp from filename (#31187)
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
old-commit-hash: 25043410705f2a7a275e69ec513c8889465d4ba3
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
5441587c6b mark as flaky for now
old-commit-hash: 6fbd8442164fbc4dde8949d63c67a9a600a3f896
2024-01-26 14:37:22 -08:00
Justin Newberry
1e197545c6 Revert "test_loggerd: make rotation test more robust" (#31168)
old-commit-hash: 979dba33cda2c54686e0e07f439ce06aa2598b1f
2024-01-25 17:11:03 -08:00
Justin Newberry
1dae90e219 test_loggerd: make rotation test more robust (#31160)
* no randomness

* lots

* Revert "lots"

This reverts commit 2052fd6f7b8dc4c53fbb7c726026070918d5de00.
old-commit-hash: 35374f4d577d0bf835ae146954010ef61a3c2fa4
2024-01-25 12:13:43 -08:00
Adeeb Shihadeh
dc6a23a1bc loggerd: speedup unit tests (#31115)
* first speed it up

* pytestify

* no sleep
old-commit-hash: 694fc378dd1b4dc4b26847efb25af538133d0685
2024-01-22 17:24:42 -08:00
Adeeb Shihadeh
972650f0eb remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
old-commit-hash: 7cd9568423a2e78187d16018b70a78f56c02027d
2024-01-19 14:05:03 -08:00
Adeeb Shihadeh
6124ecf1c1 uploader: restrict qcam upload on metered connctions (#31047)
* uploader: restrict qcam upload on metered connctions

* route requesting

* rename

* str

* cleanup

* strip dongle

* upload bookmarked segments

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2280ac50b76264dadd170e8f23bf0c3bf68ef61c
2024-01-17 21:41:58 -08:00
Adeeb Shihadeh
3d85d3d857 uploader: delay uploading crash and boot logs on metered connections (#31045)
* uploader: delay uploading some files on metered connections

* just crash and boot for now
old-commit-hash: 19630c5af989fb62d1c920e54f838969c6158453
2024-01-17 17:43:41 -08:00
Adeeb Shihadeh
6c21bbacae update param in loggerd unit test
old-commit-hash: 5f1e7649e3725667a7a753a89f31834aa28eb2b1
2024-01-17 15:08:36 -08:00
Adeeb Shihadeh
d6a8213c80 uploader cleanup (#31035)
* Reapply "uploader cleanup" (#31033)

This reverts commit a2723989bced503a4506684a4a6fdc6c8101f7b2.

* always sleep

* more cleanup

* little more

* fix linter

* little more
old-commit-hash: 0b5fd7287e715707e32b7e6978e296918dd34234
2024-01-17 14:24:09 -08:00
Justin Newberry
7f09117bf0 Revert "uploader cleanup" (#31033)
old-commit-hash: 5e4df41b2f4c379157844dc4c19ef496ca658088
2024-01-17 11:07:38 -08:00
Adeeb Shihadeh
4580cd1eb9 uploader cleanup (#31029)
* cleanup

* startup cleanup

* step

* Update test_uploader.py
old-commit-hash: c6c6a441eb61c7ac28fb94b05b91fbb8837b9236
2024-01-16 19:54:07 -08:00
Dean Lee
16266338c6 uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a1f53c70e6d955898a3ddb95b74d1d6b3f40da3e
2023-12-26 16:05:45 -08:00
Adeeb Shihadeh
c0c898d83a uploader: reduce max qlog/qcam size (#30746)
old-commit-hash: 37351cbdc1e40c5d990035d867008aec44b64c76
2023-12-14 22:30:46 -08:00
Dean Lee
5ab1fc7674 encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
old-commit-hash: a4179a7c230e687bebd15581ccdb3f7d34a690f4
2023-12-12 19:15:47 -08:00
Adeeb Shihadeh
59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
Adeeb Shihadeh
1cc4f1a634 new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
old-commit-hash: a1d36961cf9fa0c6a9c41fe92d6504de5d36cbaa
2023-12-03 10:50:17 -08:00
Justin Newberry
661132be5a Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
old-commit-hash: 4086795c29bacd245a7cc372a16730e1a6ff974f
2023-11-30 09:55:48 -08:00
Adeeb Shihadeh
e56998ca26 one more
old-commit-hash: c055fdc8539c3c89ffa6b71b82fe70a599fac768
2023-11-18 22:22:31 -08:00
Adeeb Shihadeh
07ea94cf7b rm old loggerd debug scripts
old-commit-hash: 3d36a0f70d2cd64dc8e6002b803f844f470d0731
2023-11-18 22:20:10 -08:00
Dean Lee
00e5f37d2a loggerd: c++ LoggerState (#25869)
* c++ LoggerState

* trigger ci

* trigger ci

* merge master

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3527c1da6759e54e42f80ab7cfde038a8ae96680
2023-11-18 22:11:13 -08:00
Justin Newberry
3027a428cb Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
old-commit-hash: aec7cea30d48dc8915eea38c86de7d4effa0548d
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh
eeecc35e0b loggerd: add wall time to initData (#30251)
* loggerd: add wall time to initData

* bump cereal

* fix
old-commit-hash: f616dd77a18197e8d1d25bf8afbfc01c1ab2562b
2023-10-15 15:21:51 -07:00
Adeeb Shihadeh
61eb6f4f66 finish hardware move to system/ (#30140)
* finish hardware move to system/

* fix release

* couple more
old-commit-hash: c347096c3ee275ccedc3c39e1888c44d40f77a56
2023-10-02 16:49:07 -07:00
Shane Smiskol
13381ed446 services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
old-commit-hash: 7f073483bb2586053d6c5508ef3f420947941d90
2023-09-21 18:25:15 -07:00
Adeeb Shihadeh
1f8459d285 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f341b09381af2cc7872c4092df28dc9d5
2023-09-11 14:01:50 -07:00
Justin Newberry
dc6078a6c3 System: use paths for download folders too (#29818)
* use paths for download folders too

* trailing slash

* reset that
old-commit-hash: 73eda51a11955627f4d149fdf12c1c781983d52e
2023-09-07 12:49:03 -07:00
Justin Newberry
c7029ea15a System: cleanup paths to use a common class (#29816)
* use OP prefix for logmessage

* cleanup paths too

* cleanup the paths too

* add hw.py to release

* fix those issues

* fix unittests

* fix unittests

* fix unittests

* do swaglog_ipc properly across all the files

* fix that

* fix swaglog in c++

* review suggestions
old-commit-hash: bfe990b112a83f245bb5244553c84202aec7d86c
2023-09-07 11:32:47 -07:00
Justin Newberry
3b91610c0b Precommit: ensure executable bit is set (#29784)
* precommit ensure executable

* exclude tinygrad

* bump submodules

* exclude tinygrad globally
old-commit-hash: 4e69937d0d3fbdc7d1d42cbc18d7ccf8ddb115f1
2023-09-05 16:33:26 -07:00
Kacper Rączy
4040d85159 encoderd: fix crash when filename is null (#29748)
Use publish_name for thread name and debugging messages
old-commit-hash: 0bda43d71c46b02b8d9d2043243388f8a2839497
2023-09-01 11:51:59 -07:00
Justin Newberry
e3053e6659 Tests: loggerd reduce iterations (#29713)
* reduce those iterations

* sleep time could be decreased too

* in case it's negative
old-commit-hash: a5ef9febb9bb2ddd646ea8051fc31bb7247ad73a
2023-08-30 13:36:55 -07:00
Adeeb Shihadeh
cc29c6640d pytest: strict config (#29676)
* pytest: strict config

* collection works

* fixes
old-commit-hash: 72e2e2c9ec4e3a42cf35c23dfc0d66ea0565ace6
2023-08-28 10:26:19 -07:00
Dean Lee
d5631664d3 v4l_encoder: convert macro checked_ioctl to funtion (#29609)
* break to multiple lines

* convert to function

* format errno

* use safe_ioctl

* cleanup
old-commit-hash: 1e62999e75b2ba85b7c443af0d8b3132e8e909d2
2023-08-25 11:05:22 -07:00
Adeeb Shihadeh
61cf541322 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
old-commit-hash: 4917e22615adbfcc9b3c3ec89b00d240e0b48883
2023-08-24 14:58:30 -07:00
Dean Lee
86692bf177 v4l_encoder: fix error handling for poll (#29166)
* fix error handling for poll

* revert

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: d54fa5c7f198af93474a73643b9363fc2a2043ba
2023-08-24 12:56:06 -07:00
Dean Lee
de809632bf cpplint: add filter whitespace/comma (#29595)
old-commit-hash: 7bfd3dac811ae95bfd09495e88377dfbaacda393
2023-08-24 10:42:06 -07:00
Dean Lee
0984736972 cpplint: add filter build/include_subdir (#29585)
old-commit-hash: 21da5a216fc8f5269d2deedc538c2f543a1c270a
2023-08-24 15:42:17 +01:00
Dean Lee
56b582a059 cpplint: add filter whitespace/forcolon (#29582)
whitespace/forcolon
old-commit-hash: ac939029835542a02b866e8a0d174f09773e4e6e
2023-08-23 22:46:02 -07:00