Commit Graph

347 Commits

Author SHA1 Message Date
Adeeb Shihadeh
8277f37c4b camerad: move ae test to pytest/catch2 (#30994)
* mv ae gray test

* cleanup
old-commit-hash: 3e601b5e8fcaf2fd0885cc64949fa1349a8069eb
2024-01-13 15:40:25 -08:00
Justin Newberry
f087595f90 test_proclog: fix conflict with pytest (#30989)
old-commit-hash: 884de6e4570545ccf4ee3e6ff8d2f59e4a0847c6
2024-01-13 00:30:55 -05:00
Justin Newberry
c8cc30112d rename segmentrangereader to logreader (#30981)
* Replace multilogiterator

* replace logreader

* update readme

* fix from_Bytes

* new section

* reset before iter

* selector

* fix internal

* whitespace
old-commit-hash: 3d73512c0702598d27e04039976fe0a91d5952f0
2024-01-12 12:53:50 -08:00
Justin Newberry
5087dcc5bb More migration to segmentrangereader (#30959)
* filter log message

* ffr

* gtfs

* gtfs
old-commit-hash: 32dfb3f8f28df60657e8d94c53d219e4606f2375
2024-01-11 10:14:10 -08:00
Adeeb Shihadeh
1d1514449c OS04C10 support (#30658)
* getting frames

* ok

* support both output

* cleanup

* fix unused

* undo

* fix release files

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: cd1d7eb4d2e590c56a570e6f45189eb10401401c
2024-01-09 14:19:10 -08:00
Adeeb Shihadeh
e905a35467 tici: check that peripherals are fully booted (#30942)
* tici: check that peripherals are fully booted

* default

* typo

* fix

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 5f191321fddca4eafb55c992415209a9389e2617
2024-01-08 15:09:38 -08:00
Adeeb Shihadeh
cef8286550 camerad: log request id (#30935)
* camerad: log request id

* bump cereal

* bump cereal
old-commit-hash: 91c5c5eca765c990ff185a4a0bda7207eb55787d
2024-01-08 09:16:50 -08:00
Adeeb Shihadeh
5a6275785f timezoned: set only from gps (#30904)
* timezoned: set only from gps

* unused
old-commit-hash: 3c4150c542c6117292f29f2fa4906b0090d8e9b9
2024-01-03 20:18:29 -08:00
Adeeb Shihadeh
6e43c6af77 timezoned: run while onroad (#30903)
old-commit-hash: 115047d85860806958f50e241155d5f2bde5fa53
2024-01-03 17:53:40 -08:00
Dean Lee
16266338c6 uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a1f53c70e6d955898a3ddb95b74d1d6b3f40da3e
2023-12-26 16:05:45 -08:00
Dean Lee
cbbbaf22b7 camerad: zero memory before returning from MemoryManager::alloc (#30781)
* zero memory

* remove redundant memset

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: b9080d23627849aafc4969d39df50cc615ffecdf
2023-12-18 13:54:11 -08:00
Dean Lee
6ae3e95542 camerad: cleanup includes (#30782)
* cleanup includes

* continue

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ab0b26d2b8dc8b3957812856917084af2cb3df0a
2023-12-17 22:42:52 -08:00
royjr
d41f215df8 dependency: remove pycurl package (#30771)
* Update qcomgpsd.py

* Update url_file.py

* remove pycurl

* requests -> urllib3

* unused

* redundant

* fix import

* Revert "requests -> urllib3"

This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.

* headless

* fix trail

* use requests.exceptions.RequestException

* use fp.tell

* fix indents

* reorder imports

* change timeout

* fix debug timing

* remove exception

* add timeout

* missing headers

* move to constructor

* move import

* unused import

* fix debug

* try

* no retries
old-commit-hash: 70624ffc819c29d842cb68fd86f42eac95421b10
2023-12-17 16:25:25 -08:00
Dean Lee
9c4376a57f camerad/CameraBuf: remove deprecated rgb_stride (#30758)
old-commit-hash: ea7e701052f8da1fb562746c62bdb5a64410ea76
2023-12-15 19:48:26 -08:00
Adeeb Shihadeh
c0c898d83a uploader: reduce max qlog/qcam size (#30746)
old-commit-hash: 37351cbdc1e40c5d990035d867008aec44b64c76
2023-12-14 22:30:46 -08:00
Adeeb Shihadeh
ffc40a2fd1 athena: cleanup unused methods
old-commit-hash: ea94a6d89fa00f9852e8ee6b5c8203199c1a06e8
2023-12-13 20:27:54 -08:00
Dean Lee
5ab1fc7674 encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
old-commit-hash: a4179a7c230e687bebd15581ccdb3f7d34a690f4
2023-12-12 19:15:47 -08:00
Justin Newberry
b914f0a27f soundd/micd: retry getting stream (#30701)
retry soundd/micd
old-commit-hash: 4f3a186a6faa9f95b0764069a79f86693973bfb2
2023-12-12 15:58:24 -08:00
Dean Lee
89395a7a3f camerad/CameraBuf: rename yuv_type to stream_type (#30695)
old-commit-hash: 62670e66bfb93f2d203abcb675f93ccac39d768a
2023-12-11 21:53:27 -08:00
Justin Newberry
6601d7d8b5 soundd/micd: increase stream buffer size (#30685)
* increase buffer

* update cpu refs

* go to 100ms

* correct spot
old-commit-hash: b0831fb117dde77334b6355975011611afc5d76f
2023-12-11 17:25:37 -08:00
Shane Smiskol
f5d1c4f371 ruff: check newline (#30668)
* check newline

* nothing catches this
old-commit-hash: 97da129e11e58b07d5d136093827cd1c62311fea
2023-12-09 13:24:18 -08:00
Dean Lee
4dba841726 camerad: Remove deprecated 'fps' parameter (#30662)
remove parameter fps
old-commit-hash: 8a530621b482d57aaf6797d9169abb055302f50d
2023-12-09 08:10:53 -08:00
Justin Newberry
2d50661b94 soundd/micd: more robust setup procedure (#30640)
* just use the default device :/

* Ruff

* this seems like the most reliable way

* Ruff

* move comments too

* wait for devices

* fix that

* and that

* ruff

* add logging for avaliable devices

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: bc70c94f75f64c31998b9796f20ec6e310cae347
2023-12-08 17:59:31 -08:00
Dean Lee
2b98a08180 camerad: remove camera_id (#30654)
* remove camera_id

* use variable
old-commit-hash: ea0b8920f578e2b6f348d2e18b5783166731c880
2023-12-08 16:15:58 -08:00
Dean Lee
0b2219bb1f camerad: move ar0231_register_lut to AR0231 (#30652)
old-commit-hash: 21d5d7d07a278635a1166aef5d5b209e32986382
2023-12-08 14:57:29 -08:00
Dean Lee
8d17ed5bb8 camerad: c++ sensorInfo (#30650)
* move remaining sensor parameters to CameraInfo

* same order

* member functions

* fix segfault
old-commit-hash: fb2f2d9cb21d8109d14a9d9790fda7de07202910
2023-12-08 14:27:28 -08:00
Dean Lee
db18ad7467 camerad: define the constants directly in ctor (#30651)
old-commit-hash: 8fdcddec8a3798f2f100aec48a7e8047040c2c1d
2023-12-08 13:01:41 -08:00
Adeeb Shihadeh
f483812d07 camerad: renames (#30649)
* sensorinfo

* drop the camera
old-commit-hash: e757d9bae7bcd068d26224344e0227c12a5171cc
2023-12-08 11:39:40 -08:00
Dean Lee
27284c4049 camerad: move sensor related code to /sensors (#30647)
old-commit-hash: ef262ff9eb5e52a58838479510947552a88ae3bd
2023-12-08 11:19:10 -08:00
Dean Lee
8e1aa2e513 camerad: refactor sensor parameters to struct (#30644)
* refactor camerainfo

* include <memory>
old-commit-hash: 51328609d21d3d2c6ca211c2eeafcdc9511feb6f
2023-12-08 00:01:16 -08:00
Dean Lee
91dda81a69 camerad: fix use of uninitialized CameraInfo in camera_open() (#30642)
old-commit-hash: 9bff8ccd0fa8f29d3fa92e4505d9cdd7a72d0f12
2023-12-07 20:11:44 -08:00
Adeeb Shihadeh
65aad94f0d Revert "camerad: refactor sensor parameters to struct (#30639)"
This reverts commit 166fdc950c23ccff7c6223b769dc916b6fbbc06a.

old-commit-hash: 0586f86ad01323bc213c125e8584df277555456d
2023-12-07 16:21:16 -08:00
Dean Lee
90e0e68376 camerad: refactor sensor parameters to struct (#30639)
* refactor camerainfo

* include <memory>
old-commit-hash: a70911d6396a41fb006043b41e89281fa7a5d8b1
2023-12-07 16:06:55 -08:00
Dean Lee
164644e6b4 camerad: split sensor_ic2.h (#30641)
* split sensor_ic2.h

* move start_reg,stop_reg
old-commit-hash: bdf868ddc276e2cf8a644376afe1a9634bdf06fe
2023-12-07 15:45:49 -08:00
Dean Lee
3c4d6de5d1 camerad: move AR0231 functions to camera_ar0231.cc (#30635)
* move AR0231 functions to camera_ar0231.cc

* move to sensors/aro231.cc
old-commit-hash: ecfe201a57431e5dc1e4def58519f6493d489bab
2023-12-07 11:48:17 -08:00
Dean Lee
8c2f29dfb2 sensor2_i2c.h: add #pragma once (#30636)
old-commit-hash: 8bf78399e220a55855db7bd17872edb29cae7569
2023-12-07 10:21:14 -08:00
Adeeb Shihadeh
e59a830852 qcomgpsd: retry quectel setup (#30632)
old-commit-hash: 2f2b9c782e2cef0cc972b39bcdc484fe0d8c9dfb
2023-12-06 20:56:20 -08:00
Adeeb Shihadeh
5fbf86a4d9 qcomgpsd: move retry logic to a decorator (#30633)
* qcomgpsd: move retry logic to a decorator

* make that same

* fix

* fix that
old-commit-hash: 51fa7b227afbc1134bf4860eaee819cdc64174d2
2023-12-06 19:55:27 -08:00
Adeeb Shihadeh
59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
Justin Newberry
db3fbdae18 Soundd: only update ambient db when not playing an alert (#30620)
* move to soundd + only when quiet

* not filtered
old-commit-hash: 5600a8288909e0b6ca95becbdb5746a0a9e35af4
2023-12-06 14:59:16 -08:00
Greg Hogan
e91032efb3 replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion (#30618)
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
old-commit-hash: db35dcd0b5353d9c009fcf5817e611125a6b0b8b
2023-12-06 09:55:29 -08:00
Adeeb Shihadeh
df18770f81 agnos 9 (#30543)
* agnos 9

* new build

* update

* Soundd: use alsa (#30617)

* update release notes

* agnos does this now

* prod manifest

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 3b89c5fe29b3a63f34e9782ef71ac868d89c99d5
2023-12-05 21:17:49 -08:00
Justin Newberry
817161f3ac Soundd: move to python (#30567)
soundd python
old-commit-hash: abe39e50766c418818bf72d2567db78978dbd466
2023-12-05 18:10:01 -08:00
Kacper Rączy
d331250b7e webrtcd: endpoint for message schema retrieval vol. 2 (#30607)
* webrtcd: endpoint for message schema retrieval (#30578)

* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services

* Add schema.py to release
old-commit-hash: f46f00b373fac85a9b0c673feb4e809b57802216
2023-12-04 23:51:52 -08:00
Shane Smiskol
13fe4389f8 Revert "webrtcd: endpoint for message schema retrieval" (#30606)
Revert "webrtcd: endpoint for message schema retrieval (#30578)"

This reverts commit d8c45e7bb8e1c79a243bde3c448df51c07de0694.
old-commit-hash: 2ae7d99143751f2e81890ea2556c9fe0175b54d5
2023-12-04 22:59:35 -08:00
Kacper Rączy
a14ca845d6 webrtcd: endpoint for message schema retrieval (#30578)
* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services
old-commit-hash: 10eb70daf707760f785490f69b2d17621698ed75
2023-12-04 20:43:19 -08:00
Kacper Rączy
65c1f4fd17 webrtcd: stop cereal proxy runner when data channel is closed (#30601)
Stop the proxy when channel reaches invalid state
old-commit-hash: 6a354ddab75fee435da85f6dc89df90ef2d3baec
2023-12-04 19:14:11 -08:00
Adeeb Shihadeh
1cc4f1a634 new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
old-commit-hash: a1d36961cf9fa0c6a9c41fe92d6504de5d36cbaa
2023-12-03 10:50:17 -08:00
Kacper Rączy
d062a97a26 webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
old-commit-hash: f058b5d64eed31878533a85f25eb53386ff9e330
2023-12-01 21:13:37 -08:00
Adeeb Shihadeh
5acd765c1e camerad cleanup (#30573)
* misc cleanup

* rm those

* rm utils

* fix build

* rm pool

* little more

* goodbye imgproc
old-commit-hash: e34ee43eeae000d080cb923b722afaf4c06fbc59
2023-12-01 20:10:07 -08:00