Commit Graph

339 Commits

Author SHA1 Message Date
Dean Lee
a1f53c70e6 uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
2023-12-26 16:05:45 -08:00
Dean Lee
b9080d2362 camerad: zero memory before returning from MemoryManager::alloc (#30781)
* zero memory

* remove redundant memset

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-18 13:54:11 -08:00
Dean Lee
ab0b26d2b8 camerad: cleanup includes (#30782)
* cleanup includes

* continue

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-17 22:42:52 -08:00
royjr
70624ffc81 dependency: remove pycurl package (#30771)
* Update qcomgpsd.py

* Update url_file.py

* remove pycurl

* requests -> urllib3

* unused

* redundant

* fix import

* Revert "requests -> urllib3"

This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.

* headless

* fix trail

* use requests.exceptions.RequestException

* use fp.tell

* fix indents

* reorder imports

* change timeout

* fix debug timing

* remove exception

* add timeout

* missing headers

* move to constructor

* move import

* unused import

* fix debug

* try

* no retries
2023-12-17 16:25:25 -08:00
Dean Lee
ea7e701052 camerad/CameraBuf: remove deprecated rgb_stride (#30758) 2023-12-15 19:48:26 -08:00
Adeeb Shihadeh
37351cbdc1 uploader: reduce max qlog/qcam size (#30746) 2023-12-14 22:30:46 -08:00
Adeeb Shihadeh
ea94a6d89f athena: cleanup unused methods 2023-12-13 20:27:54 -08:00
Dean Lee
a4179a7c23 encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
2023-12-12 19:15:47 -08:00
Justin Newberry
4f3a186a6f soundd/micd: retry getting stream (#30701)
retry soundd/micd
2023-12-12 15:58:24 -08:00
Dean Lee
62670e66bf camerad/CameraBuf: rename yuv_type to stream_type (#30695) 2023-12-11 21:53:27 -08:00
Justin Newberry
b0831fb117 soundd/micd: increase stream buffer size (#30685)
* increase buffer

* update cpu refs

* go to 100ms

* correct spot
2023-12-11 17:25:37 -08:00
Shane Smiskol
97da129e11 ruff: check newline (#30668)
* check newline

* nothing catches this
2023-12-09 13:24:18 -08:00
Dean Lee
8a530621b4 camerad: Remove deprecated 'fps' parameter (#30662)
remove parameter fps
2023-12-09 08:10:53 -08:00
Justin Newberry
bc70c94f75 soundd/micd: more robust setup procedure (#30640)
* just use the default device :/

* Ruff

* this seems like the most reliable way

* Ruff

* move comments too

* wait for devices

* fix that

* and that

* ruff

* add logging for avaliable devices

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-08 17:59:31 -08:00
Dean Lee
ea0b8920f5 camerad: remove camera_id (#30654)
* remove camera_id

* use variable
2023-12-08 16:15:58 -08:00
Dean Lee
21d5d7d07a camerad: move ar0231_register_lut to AR0231 (#30652) 2023-12-08 14:57:29 -08:00
Dean Lee
fb2f2d9cb2 camerad: c++ sensorInfo (#30650)
* move remaining sensor parameters to CameraInfo

* same order

* member functions

* fix segfault
2023-12-08 14:27:28 -08:00
Dean Lee
8fdcddec8a camerad: define the constants directly in ctor (#30651) 2023-12-08 13:01:41 -08:00
Adeeb Shihadeh
e757d9bae7 camerad: renames (#30649)
* sensorinfo

* drop the camera
2023-12-08 11:39:40 -08:00
Dean Lee
ef262ff9eb camerad: move sensor related code to /sensors (#30647) 2023-12-08 11:19:10 -08:00
Dean Lee
51328609d2 camerad: refactor sensor parameters to struct (#30644)
* refactor camerainfo

* include <memory>
2023-12-08 00:01:16 -08:00
Dean Lee
9bff8ccd0f camerad: fix use of uninitialized CameraInfo in camera_open() (#30642) 2023-12-07 20:11:44 -08:00
Adeeb Shihadeh
0586f86ad0 Revert "camerad: refactor sensor parameters to struct (#30639)"
This reverts commit a70911d639.
2023-12-07 16:21:16 -08:00
Dean Lee
a70911d639 camerad: refactor sensor parameters to struct (#30639)
* refactor camerainfo

* include <memory>
2023-12-07 16:06:55 -08:00
Dean Lee
bdf868ddc2 camerad: split sensor_ic2.h (#30641)
* split sensor_ic2.h

* move start_reg,stop_reg
2023-12-07 15:45:49 -08:00
Dean Lee
ecfe201a57 camerad: move AR0231 functions to camera_ar0231.cc (#30635)
* move AR0231 functions to camera_ar0231.cc

* move to sensors/aro231.cc
2023-12-07 11:48:17 -08:00
Dean Lee
8bf78399e2 sensor2_i2c.h: add #pragma once (#30636) 2023-12-07 10:21:14 -08:00
Adeeb Shihadeh
2f2b9c782e qcomgpsd: retry quectel setup (#30632) 2023-12-06 20:56:20 -08:00
Adeeb Shihadeh
51fa7b227a qcomgpsd: move retry logic to a decorator (#30633)
* qcomgpsd: move retry logic to a decorator

* make that same

* fix

* fix that
2023-12-06 19:55:27 -08:00
Adeeb Shihadeh
35f819c823 swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
2023-12-06 17:27:51 -08:00
Justin Newberry
5600a82889 Soundd: only update ambient db when not playing an alert (#30620)
* move to soundd + only when quiet

* not filtered
2023-12-06 14:59:16 -08:00
Greg Hogan
db35dcd0b5 replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion (#30618)
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
2023-12-06 09:55:29 -08:00
Adeeb Shihadeh
3b89c5fe29 agnos 9 (#30543)
* agnos 9

* new build

* update

* Soundd: use alsa (#30617)

* update release notes

* agnos does this now

* prod manifest

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
2023-12-05 21:17:49 -08:00
Justin Newberry
abe39e5076 Soundd: move to python (#30567)
soundd python
2023-12-05 18:10:01 -08:00
Kacper Rączy
f46f00b373 webrtcd: endpoint for message schema retrieval vol. 2 (#30607)
* webrtcd: endpoint for message schema retrieval (#30578)

* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services

* Add schema.py to release
2023-12-04 23:51:52 -08:00
Shane Smiskol
2ae7d99143 Revert "webrtcd: endpoint for message schema retrieval" (#30606)
Revert "webrtcd: endpoint for message schema retrieval (#30578)"

This reverts commit 10eb70daf7.
2023-12-04 22:59:35 -08:00
Kacper Rączy
10eb70daf7 webrtcd: endpoint for message schema retrieval (#30578)
* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services
2023-12-04 20:43:19 -08:00
Kacper Rączy
6a354ddab7 webrtcd: stop cereal proxy runner when data channel is closed (#30601)
Stop the proxy when channel reaches invalid state
2023-12-04 19:14:11 -08:00
Adeeb Shihadeh
a1d36961cf new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
2023-12-03 10:50:17 -08:00
Kacper Rączy
f058b5d64e webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
2023-12-01 21:13:37 -08:00
Adeeb Shihadeh
e34ee43eea camerad cleanup (#30573)
* misc cleanup

* rm those

* rm utils

* fix build

* rm pool

* little more

* goodbye imgproc
2023-12-01 20:10:07 -08:00
Justin Newberry
4086795c29 Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
2023-11-30 09:55:48 -08:00
Justin Newberry
7f14bdfb22 allow onscreen cpu rendering (#30510)
* spinner POC cpu

* should be single threaded

* how tf did that get added

* allow non offscreen

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-22 12:44:32 -08:00
Harald Schäfer
8e88366955 Qcomgpsd: Dont use system timezone (#30508) 2023-11-21 11:12:39 -08:00
Adeeb Shihadeh
4cae08e636 rename rawgpsd to qcomgpsd (#30493)
* rename rawgpsd to qcomgpsd

* fix more paths

* that moved

* forgot the d
2023-11-18 23:23:16 -08:00
Dean Lee
335237aea0 modeld: remove modeldata.h (#30423)
* remove modeldata.h

* remove TRAJECTORY_SIZE
2023-11-18 22:45:26 -08:00
Adeeb Shihadeh
c055fdc853 one more 2023-11-18 22:22:31 -08:00
Adeeb Shihadeh
3d36a0f70d rm old loggerd debug scripts 2023-11-18 22:20:10 -08:00
Dean Lee
3527c1da67 loggerd: c++ LoggerState (#25869)
* c++ LoggerState

* trigger ci

* trigger ci

* merge master

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-11-18 22:11:13 -08:00
Adeeb Shihadeh
d3aad9ca46 esim is metered (#30486)
* esim is metered

* it's an enum

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-17 15:29:52 -08:00