Commit Graph

511 Commits

Author SHA1 Message Date
Kacper Rączy 032c0878b8
webrtcd: ability to have multiple streams publishing same message (#31700)
Use single PubMaster with dynamic services
2024-03-05 12:14:50 -08:00
Kacper Rączy 09e73f8fb6
webrtcd: allow empty bridge_services_out (#31694)
* Test case

* Add messaging only if services non empty

* Fix webrtcd

* Use parametrized_class

* Bump to master teleoprtc
2024-03-04 15:04:28 -08:00
Adeeb Shihadeh a38a5e8bb4
tici: enable SIM hot swap (#31680)
* tici: enable SIM hot swap

* only tizi

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-03-01 17:24:22 -08:00
Comma Device 9616b3f717 no amp 2024-03-01 15:32:33 -08:00
Harald Schäfer 85eb221e4c
GpsLocation: Rename accuracy to horizontal accuracy (#31629)
* Rename accuracy to horizontal accuracy

* typo in cereal
2024-02-28 19:55:57 -08:00
Justin Newberry 19db56b1f6
tici tests: remove pytest.main (#31622)
pytest.main is bad!
2024-02-27 14:06:18 -08:00
Comma Device 14ea615ae4 no amp config 2024-02-26 20:39:41 -08:00
Adeeb Shihadeh 3c4e82f14a
get name from kernel (#31602)
* get name from kernel

* revert that

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-26 20:21:44 -08:00
Cameron Clough 80da3aee14
mypy: use implicit-optional (#31590)
* mypy: set implicit-optional = true

* find and replace '| None = None' -> '= None' in function args
2024-02-25 13:29:18 -08:00
Cameron Clough 995250ae49
use pyupgrade to update to new typing syntax (#31580)
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
2024-02-24 16:41:23 -08:00
Adeeb Shihadeh 92475d653b
agnos 9.7 (#31564)
* agnos 9.7

* update
2024-02-23 17:41:03 -08:00
Adeeb Shihadeh 0b4d08fab8
remove deviceState.ambientTempC (#31533) 2024-02-21 13:57:49 -08:00
Adeeb Shihadeh 34138d0be9
qcomgpsd: use AT helper with retry for all AT commands (#31532) 2024-02-21 13:57:29 -08:00
Adeeb Shihadeh 1c794b710c
uploader: sleep more when no files in queue (#31523)
* uploader: sleep more when no files in queue

* fix test
2024-02-20 17:25:12 -08:00
Adeeb Shihadeh be4bbca9a3
[bot] Update Python packages and pre-commit hooks (#31508)
* Update Python packages and pre-commit hooks

* remove that

---------

Co-authored-by: jnewb1 <jnewb1@users.noreply.github.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
2024-02-19 10:45:10 -08:00
Adeeb Shihadeh 0723c2bc5f
log git commit date (#31490)
* log git commit date

* unix ts

* fix

* bump cereal

* cleanup
2024-02-16 13:19:10 -08:00
Justin Newberry c2b9f7163a
test_qcomgpsd: subtest the gps_runtime scenarios (#31485)
* subtest this

* runtime

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-15 13:12:11 -08:00
Justin Newberry 659cdec3d0
Revert "test_qcomgpsd: parametize tests" (#31441)
Revert "test_qcomgpsd: parametize tests (#31430)"

This reverts commit 6f4d388348.
2024-02-13 15:27:36 -08:00
Adeeb Shihadeh 3cf845d952
tici: log SOM ID (#31440)
* tici: log SOM ID

* no cat
2024-02-13 15:01:32 -08:00
Adeeb Shihadeh c5739651a2
timed: publish clocks periodically (#31434)
* timed: publish clocks periodically

* simplify

* Apply suggestions from code review
2024-02-13 14:22:46 -08:00
Justin Newberry 6f4d388348
test_qcomgpsd: parametize tests (#31430)
* parameterize qcomgpsd

* one line
2024-02-13 11:16:24 -08:00
Adeeb Shihadeh 279d2c3b23
SubMaster: improve service aliveness checks (#31391)
* bump cereal

* fix

* fixes

* single poll

* bump

* bump

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-12 10:11:37 -08:00
Justin Newberry c9951e9d6c
camerad: assert isp started successfully (#31385)
* isp assert

* disable this for testing

* Revert "disable this for testing"

This reverts commit e65cf6d4b457babcc1a980d40079a2d6aa6540b8.

* move below
2024-02-10 14:49:45 -08:00
Adeeb Shihadeh daceb171bd
bump cereal (#31392)
* bump cereal

* update those

* update refs

* bump cereal

* bump

* bump cereal

* bump

* fix

* bump

* typo:
2024-02-09 21:44:23 -08:00
Adeeb Shihadeh 135deb4324
sensord: fix IRQ affinity (#31384) 2024-02-08 16:40:43 -08:00
Justin Newberry 70288d1742
test_power_draw: combine mapsd and navmodeld (#31375)
* combine

* combine

* combine

* simpler

* nounion
2024-02-08 11:31:55 -08:00
Adeeb Shihadeh 4228b6420b
agnos 9.6 (#31357)
* agnos 9.6

* manifest
2024-02-07 16:15:09 -08:00
Justin Newberry caa9dff610
test_power_draw: wait for power instead of fixed warmup time (#31318)
* wait for valid

* reuuse that

* assert warmup

* Wip

* fix that

* reset

* none

* timeout

* maxlen

* consecutive

* proc

* fix

* local

* same as before

* mean

* fixes

* SA

* this is the real warmup time

* this is the real warmup time

* Cleanup

* Cleanup

* monotonic + len

* reduce duplication

* fix

* fix

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-07 13:54:46 -08:00
Adeeb Shihadeh ff1dd1f4dd
agnos 9.5 (#31313)
* agnos 9.4

* agnos 9.5
2024-02-07 13:23:58 -08:00
Adeeb Shihadeh cbd46802b0
fix bootlog count (#31319) 2024-02-05 23:00:45 -08:00
Kacper Rączy 35d848ad52
webrtcd: lazy import of aiortc (#31304)
* Lazy imports in webrtcd

* Lazy imports in web.py

* Type hints

* Remove FrameReaderVideoStreamTrack

* leave the aiohttp.web import

* Leave the client session

* main leftover
2024-02-05 19:04:59 -08:00
Adeeb Shihadeh a094179b4d
add cavli modem config (#31297)
* add cavli modem config

* fix linter

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-04 14:26:03 -08:00
Greg Hogan 7affba06d8
simplify git remote is comma check (#31284)
* simplify git remote is comma check

* cast to str

* eliminate default and always return string

* add type annotation for cache decorator

* fix up default handling
2024-02-02 21:23:32 -08:00
Justin Newberry 0277fc5548
Pytest: consistent hardware state for tici tests (#31279)
* consistent hardware

* consistent hardware

* moved

* this too

* ruff

* s

* duplicated

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-02 14:18:01 -08:00
Adeeb Shihadeh a5766e2796
encoderd: get frame size over vipc (#31276)
* encoderd: get frame size over vipc

* bump cereal

* fix ffmpeg

* no print
2024-02-02 12:53:12 -08:00
Adeeb Shihadeh 4962ffa14c camerad: flip OS04C10 image 2024-02-01 20:24:00 -08:00
Justin Newberry 086c509fde
Create message mocking tools (#31249)
* add mocking tools

* fix map renderer

* use for power draw

* fix those

* whitespace

* rename to services

* fix the rate

* remove
2024-01-31 18:47:49 -08:00
Adeeb Shihadeh 6caf89bca5
agnos 9.3 (#31163)
* agnos 9.2

* agnos 9.3
2024-01-29 17:44:14 -08:00
Adeeb Shihadeh 2504341070
bootlog: remove timestamp from filename (#31187)
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh 6fbd844216 mark as flaky for now 2024-01-26 14:37:22 -08:00
Adeeb Shihadeh fe4abaa6f6 add flaky package 2024-01-25 17:38:09 -08:00
Comma Device 076810d5bd allow a couple retries 2024-01-25 17:13:35 -08:00
Justin Newberry 979dba33cd
Revert "test_loggerd: make rotation test more robust" (#31168) 2024-01-25 17:11:03 -08:00
Justin Newberry 35374f4d57
test_loggerd: make rotation test more robust (#31160)
* no randomness

* lots

* Revert "lots"

This reverts commit 2052fd6f7b8dc4c53fbb7c726026070918d5de00.
2024-01-25 12:13:43 -08:00
Ruben Medina 8472ae5317
add size to system alt image manifest entry (#31154) 2024-01-24 23:35:39 -08:00
Adeeb Shihadeh 88757c12b3 Revert "Switch from json11 to nlohmann/json (#31093)"
This reverts commit ee036482b8.
2024-01-22 22:41:59 -08:00
mtribiere ee036482b8
Switch from json11 to nlohmann/json (#31093)
* Initial commit

* fix release/file_common

* Update common/swaglog.cc

* Swtiched serialize cc

* move to lfs

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-01-22 22:35:47 -08:00
Adeeb Shihadeh 827aa2e4fa
timed: always pull time and timezone from GPS (#31112)
* timed

* rm timezoned

* just gps

* ok

* little more

* fix

* datetime

* sleep a little

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-01-22 18:35:11 -08:00
Adeeb Shihadeh 694fc378dd
loggerd: speedup unit tests (#31115)
* first speed it up

* pytestify

* no sleep
2024-01-22 17:24:42 -08:00
Justin Newberry 3846130d8e
pytest: add marker for sharing the download cache (#31082)
* fix cache

* with a marker
2024-01-22 16:30:59 -08:00
Adeeb Shihadeh 78e20cff39
cleanup tests that are now useless (#31098)
* disable that onoe

* e2e tests catch this

* rm more useless checks
2024-01-21 14:49:57 -08:00
Harald Schäfer e6c97c3846
Delete lat planner (#31089)
* Initial commit

* Fixup

* typo

* ignore lateral plan

* Update cereal

* Remove lateralPlan

* Fix release build

* Fix release build

* give car params

* Add carParams to include_all_types

* Write car param in powerdraw test

* add demo mode

* Update model regf

* proc replay ref commit

* Try

* Move enum definition

* Update cereal

* typo

* Write car param for modeld test

* Update ref

* Update model ref again

---------

Co-authored-by: Kacper Rączy <gfw.kra@gmail.com>
2024-01-21 12:09:48 -08:00
Adeeb Shihadeh e0d0896dcf
test_power_draw: check msgs expect first for cleaner error 2024-01-20 17:20:21 -08:00
Adeeb Shihadeh 7cd9568423
remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
2024-01-19 14:05:03 -08:00
Comma Device e2df83089f fix param path 2024-01-18 20:12:04 -08:00
Adeeb Shihadeh c4362bd958
bootlog doesn't block startup (#31061)
* bootlog doesn't block startup

* keep params

* fix

* cleanup
2024-01-18 20:04:08 -08:00
Adeeb Shihadeh 2280ac50b7
uploader: restrict qcam upload on metered connctions (#31047)
* uploader: restrict qcam upload on metered connctions

* route requesting

* rename

* str

* cleanup

* strip dongle

* upload bookmarked segments

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-01-17 21:41:58 -08:00
Adeeb Shihadeh 19630c5af9
uploader: delay uploading crash and boot logs on metered connections (#31045)
* uploader: delay uploading some files on metered connections

* just crash and boot for now
2024-01-17 17:43:41 -08:00
Adeeb Shihadeh 5f1e7649e3 update param in loggerd unit test 2024-01-17 15:08:36 -08:00
Adeeb Shihadeh 7ce29ef08e
cleanup old params (#31039)
* cleanup old params

* one more
2024-01-17 14:42:07 -08:00
Adeeb Shihadeh 0b5fd7287e
uploader cleanup (#31035)
* Reapply "uploader cleanup" (#31033)

This reverts commit 5e4df41b2f.

* always sleep

* more cleanup

* little more

* fix linter

* little more
2024-01-17 14:24:09 -08:00
Justin Newberry 5e4df41b2f
Revert "uploader cleanup" (#31033) 2024-01-17 11:07:38 -08:00
Adeeb Shihadeh c6c6a441eb
uploader cleanup (#31029)
* cleanup

* startup cleanup

* step

* Update test_uploader.py
2024-01-16 19:54:07 -08:00
Adeeb Shihadeh 3e601b5e8f
camerad: move ae test to pytest/catch2 (#30994)
* mv ae gray test

* cleanup
2024-01-13 15:40:25 -08:00
Justin Newberry 884de6e457
test_proclog: fix conflict with pytest (#30989) 2024-01-13 00:30:55 -05:00
Justin Newberry 3d73512c07
rename segmentrangereader to logreader (#30981)
* Replace multilogiterator

* replace logreader

* update readme

* fix from_Bytes

* new section

* reset before iter

* selector

* fix internal

* whitespace
2024-01-12 12:53:50 -08:00
Justin Newberry 32dfb3f8f2
More migration to segmentrangereader (#30959)
* filter log message

* ffr

* gtfs

* gtfs
2024-01-11 10:14:10 -08:00
Adeeb Shihadeh cd1d7eb4d2
OS04C10 support (#30658)
* getting frames

* ok

* support both output

* cleanup

* fix unused

* undo

* fix release files

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-01-09 14:19:10 -08:00
Adeeb Shihadeh 5f191321fd
tici: check that peripherals are fully booted (#30942)
* tici: check that peripherals are fully booted

* default

* typo

* fix

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-01-08 15:09:38 -08:00
Adeeb Shihadeh 91c5c5eca7
camerad: log request id (#30935)
* camerad: log request id

* bump cereal

* bump cereal
2024-01-08 09:16:50 -08:00
Adeeb Shihadeh 3c4150c542
timezoned: set only from gps (#30904)
* timezoned: set only from gps

* unused
2024-01-03 20:18:29 -08:00
Adeeb Shihadeh 115047d858
timezoned: run while onroad (#30903) 2024-01-03 17:53:40 -08:00
Dean Lee a1f53c70e6
uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
2023-12-26 16:05:45 -08:00
Dean Lee b9080d2362
camerad: zero memory before returning from MemoryManager::alloc (#30781)
* zero memory

* remove redundant memset

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-18 13:54:11 -08:00
Dean Lee ab0b26d2b8
camerad: cleanup includes (#30782)
* cleanup includes

* continue

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-17 22:42:52 -08:00
royjr 70624ffc81
dependency: remove pycurl package (#30771)
* Update qcomgpsd.py

* Update url_file.py

* remove pycurl

* requests -> urllib3

* unused

* redundant

* fix import

* Revert "requests -> urllib3"

This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.

* headless

* fix trail

* use requests.exceptions.RequestException

* use fp.tell

* fix indents

* reorder imports

* change timeout

* fix debug timing

* remove exception

* add timeout

* missing headers

* move to constructor

* move import

* unused import

* fix debug

* try

* no retries
2023-12-17 16:25:25 -08:00
Dean Lee ea7e701052
camerad/CameraBuf: remove deprecated rgb_stride (#30758) 2023-12-15 19:48:26 -08:00
Adeeb Shihadeh 37351cbdc1
uploader: reduce max qlog/qcam size (#30746) 2023-12-14 22:30:46 -08:00
Adeeb Shihadeh ea94a6d89f athena: cleanup unused methods 2023-12-13 20:27:54 -08:00
Dean Lee a4179a7c23
encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
2023-12-12 19:15:47 -08:00
Justin Newberry 4f3a186a6f
soundd/micd: retry getting stream (#30701)
retry soundd/micd
2023-12-12 15:58:24 -08:00
Dean Lee 62670e66bf
camerad/CameraBuf: rename yuv_type to stream_type (#30695) 2023-12-11 21:53:27 -08:00
Justin Newberry b0831fb117
soundd/micd: increase stream buffer size (#30685)
* increase buffer

* update cpu refs

* go to 100ms

* correct spot
2023-12-11 17:25:37 -08:00
Shane Smiskol 97da129e11
ruff: check newline (#30668)
* check newline

* nothing catches this
2023-12-09 13:24:18 -08:00
Dean Lee 8a530621b4
camerad: Remove deprecated 'fps' parameter (#30662)
remove parameter fps
2023-12-09 08:10:53 -08:00
Justin Newberry bc70c94f75
soundd/micd: more robust setup procedure (#30640)
* just use the default device :/

* Ruff

* this seems like the most reliable way

* Ruff

* move comments too

* wait for devices

* fix that

* and that

* ruff

* add logging for avaliable devices

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-08 17:59:31 -08:00
Dean Lee ea0b8920f5
camerad: remove camera_id (#30654)
* remove camera_id

* use variable
2023-12-08 16:15:58 -08:00
Dean Lee 21d5d7d07a
camerad: move ar0231_register_lut to AR0231 (#30652) 2023-12-08 14:57:29 -08:00
Dean Lee fb2f2d9cb2
camerad: c++ sensorInfo (#30650)
* move remaining sensor parameters to CameraInfo

* same order

* member functions

* fix segfault
2023-12-08 14:27:28 -08:00
Dean Lee 8fdcddec8a
camerad: define the constants directly in ctor (#30651) 2023-12-08 13:01:41 -08:00
Adeeb Shihadeh e757d9bae7
camerad: renames (#30649)
* sensorinfo

* drop the camera
2023-12-08 11:39:40 -08:00
Dean Lee ef262ff9eb
camerad: move sensor related code to `/sensors` (#30647) 2023-12-08 11:19:10 -08:00
Dean Lee 51328609d2
camerad: refactor sensor parameters to struct (#30644)
* refactor camerainfo

* include <memory>
2023-12-08 00:01:16 -08:00
Dean Lee 9bff8ccd0f
camerad: fix use of uninitialized `CameraInfo` in `camera_open()` (#30642) 2023-12-07 20:11:44 -08:00
Adeeb Shihadeh 0586f86ad0 Revert "camerad: refactor sensor parameters to struct (#30639)"
This reverts commit a70911d639.
2023-12-07 16:21:16 -08:00
Dean Lee a70911d639
camerad: refactor sensor parameters to struct (#30639)
* refactor camerainfo

* include <memory>
2023-12-07 16:06:55 -08:00
Dean Lee bdf868ddc2
camerad: split sensor_ic2.h (#30641)
* split sensor_ic2.h

* move start_reg,stop_reg
2023-12-07 15:45:49 -08:00
Dean Lee ecfe201a57
camerad: move AR0231 functions to camera_ar0231.cc (#30635)
* move AR0231 functions to camera_ar0231.cc

* move to sensors/aro231.cc
2023-12-07 11:48:17 -08:00
Dean Lee 8bf78399e2
sensor2_i2c.h: add `#pragma once` (#30636) 2023-12-07 10:21:14 -08:00
Adeeb Shihadeh 2f2b9c782e
qcomgpsd: retry quectel setup (#30632) 2023-12-06 20:56:20 -08:00
Adeeb Shihadeh 51fa7b227a
qcomgpsd: move retry logic to a decorator (#30633)
* qcomgpsd: move retry logic to a decorator

* make that same

* fix

* fix that
2023-12-06 19:55:27 -08:00
Adeeb Shihadeh 35f819c823
swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
2023-12-06 17:27:51 -08:00
Justin Newberry 5600a82889
Soundd: only update ambient db when not playing an alert (#30620)
* move to soundd + only when quiet

* not filtered
2023-12-06 14:59:16 -08:00
Greg Hogan db35dcd0b5
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion (#30618)
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
2023-12-06 09:55:29 -08:00
Adeeb Shihadeh 3b89c5fe29
agnos 9 (#30543)
* agnos 9

* new build

* update

* Soundd: use alsa (#30617)

* update release notes

* agnos does this now

* prod manifest

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
2023-12-05 21:17:49 -08:00
Justin Newberry abe39e5076
Soundd: move to python (#30567)
soundd python
2023-12-05 18:10:01 -08:00
Kacper Rączy f46f00b373
webrtcd: endpoint for message schema retrieval vol. 2 (#30607)
* webrtcd: endpoint for message schema retrieval (#30578)

* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services

* Add schema.py to release
2023-12-04 23:51:52 -08:00
Shane Smiskol 2ae7d99143
Revert "webrtcd: endpoint for message schema retrieval" (#30606)
Revert "webrtcd: endpoint for message schema retrieval (#30578)"

This reverts commit 10eb70daf7.
2023-12-04 22:59:35 -08:00
Kacper Rączy 10eb70daf7
webrtcd: endpoint for message schema retrieval (#30578)
* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services
2023-12-04 20:43:19 -08:00
Kacper Rączy 6a354ddab7
webrtcd: stop cereal proxy runner when data channel is closed (#30601)
Stop the proxy when channel reaches invalid state
2023-12-04 19:14:11 -08:00
Adeeb Shihadeh a1d36961cf
new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
2023-12-03 10:50:17 -08:00
Kacper Rączy f058b5d64e
webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
2023-12-01 21:13:37 -08:00
Adeeb Shihadeh e34ee43eea
camerad cleanup (#30573)
* misc cleanup

* rm those

* rm utils

* fix build

* rm pool

* little more

* goodbye imgproc
2023-12-01 20:10:07 -08:00
Justin Newberry 4086795c29
Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
2023-11-30 09:55:48 -08:00
Justin Newberry 7f14bdfb22
allow onscreen cpu rendering (#30510)
* spinner POC cpu

* should be single threaded

* how tf did that get added

* allow non offscreen

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-22 12:44:32 -08:00
Harald Schäfer 8e88366955
Qcomgpsd: Dont use system timezone (#30508) 2023-11-21 11:12:39 -08:00
Adeeb Shihadeh 4cae08e636
rename rawgpsd to qcomgpsd (#30493)
* rename rawgpsd to qcomgpsd

* fix more paths

* that moved

* forgot the d
2023-11-18 23:23:16 -08:00
Dean Lee 335237aea0
modeld: remove modeldata.h (#30423)
* remove modeldata.h

* remove TRAJECTORY_SIZE
2023-11-18 22:45:26 -08:00
Adeeb Shihadeh c055fdc853 one more 2023-11-18 22:22:31 -08:00
Adeeb Shihadeh 3d36a0f70d rm old loggerd debug scripts 2023-11-18 22:20:10 -08:00
Dean Lee 3527c1da67
loggerd: c++ LoggerState (#25869)
* c++ LoggerState

* trigger ci

* trigger ci

* merge master

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-11-18 22:11:13 -08:00
Adeeb Shihadeh d3aad9ca46
esim is metered (#30486)
* esim is metered

* it's an enum

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-17 15:29:52 -08:00
Adeeb Shihadeh 460d9af5b7
more esim config (#30480)
* load single conn

* high priority

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-16 19:12:36 -08:00
Adeeb Shihadeh e6e073d099 Revert "tici: use BASEDIR to lookup nm connection path"
This reverts commit 30ab9f8482.
2023-11-16 14:20:55 -08:00
Adeeb Shihadeh 30ab9f8482 tici: use BASEDIR to lookup nm connection path 2023-11-16 14:19:02 -08:00
Justin Newberry f99939426f
thermald: recover from modemmanager restart (#30464)
* test modem recovery

* static analysis

* also test lte reload

* this should just be try catched as well

* maybe we can find a better way than this

* rm the test

* make it clear

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-14 16:57:34 -08:00
Adeeb Shihadeh e323191299
new sim connection settings (#30457)
* new sim connection settings

* fix att conflict

* sim id

* clenaup

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-13 21:38:22 -08:00
Adeeb Shihadeh cc32a6bf9f
tici: fix leftover APN config from AT&T (#30458) 2023-11-13 21:33:22 -08:00
Harald Schäfer c0942dbf9f
Rm laika deps in rawgpsd (#30452)
* Rm more laikad references

* rawgpsd usage of laika

* bugfix
2023-11-13 20:38:24 -08:00
Harald Schäfer 95c6d5140a
Rm more laika references (#30451)
Rm more laikad references
2023-11-13 16:52:57 -08:00
Justin Newberry 2ad82cbfb0
Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
2023-11-13 10:45:24 -08:00
Adeeb Shihadeh 72cc2e34cb camerad: reduce to 1s of buffers 2023-11-09 20:52:21 -08:00
Justin Newberry aec7cea30d
Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
2023-11-07 17:35:44 -08:00
Harald Schäfer 11855eab5d
power draw test: improve verbosity (#30402)
* improve verbosity

* unused import
2023-11-07 08:39:23 -08:00
Justin Newberry 9257066c4e
Mapsd: disable threading on PC too (#30396)
single threaded rendering
2023-11-06 16:36:48 -08:00
Justin Newberry bdf2fa0f83
Mapsd: move on the CPU (#30349)
* mapsd -> cpu

* link directly to mesa

* Fix gitignore

* without launcher script

* dont change that

* dont need that

* add to files_common

* rename to configure cpu rendering

* without a symlink!

* update time refs

* update ref

* update ref

* remove duplicate include

* bump up again

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-06 09:04:53 -08:00
Adeeb Shihadeh 7bee13e2d1
raise gpu clock (#30358)
* raise gpu clock

* update modeld power draw
2023-11-01 14:48:49 -07:00
Adeeb Shihadeh 9c7e5ca6ea
rawgpsd: add flag for cold start (#30224)
* rawgpsd: add flag for cold start

* other datasheet is wrong

* keep things in a good state
2023-10-25 15:05:07 -07:00
Harald Schäfer 56dea7b0b4
Rm laikad (#30299)
* rm laika

* Rm laika

* Needed this

* More rm

* More rm
2023-10-23 00:15:39 -07:00
Adeeb Shihadeh 67f2321060
delete clocksd (#30252) 2023-10-22 14:47:38 -07:00
Adeeb Shihadeh 2338f76fdd
eSIM profile management (#30262)
* eSIM profile management

* start download

* loaded a profile

* more stuff

* fixups

* fix linter

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-10-19 14:54:11 -07:00
YassineYousfi cad17b1255
modeld: parsing and publishing in python (#30273)
* WIP try modeld all in python

* fix plan

* add lane lines stds

* fix lane lines prob

* add lead prob

* add meta

* simplify plan parsing

* add hard brake pred

* add confidence

* fix desire state and desire pred

* check this file for now

* rm prints

* rm debug

* add todos

* add plan_t_idxs

* same as cpp

* removed cython

* add wfd width - rm cpp code

* add new files rm old files

* get metadata at compile time

* forgot this file

* now uses more CPU

* not used

* update readme

* lint

* copy this too

* simplify disengage probs

* update model replay ref commit

* update again

* confidence: remove if statemens

* use publish_state.enqueue

* Revert "use publish_state.enqueue"

This reverts commit d8807c8348338a1f773a8de00fd796abb8181404.

* confidence: better shape defs

* use ModelConstants class

* fix confidence

* Parser

* slightly more power too

* no inline ifs :(

* confidence: just use if statements
2023-10-19 14:23:51 -07:00
Adeeb Shihadeh f616dd77a1
loggerd: add wall time to initData (#30251)
* loggerd: add wall time to initData

* bump cereal

* fix
2023-10-15 15:21:51 -07:00
Adeeb Shihadeh f0aa631818
cleanup up old lib64 references (#30246)
* cleanup sensord

* rm rest

* fix that

* update that
2023-10-14 20:39:15 -07:00
Adeeb Shihadeh b68cfbb332
cleanup old sm pm args (#30241)
* cleanup sm pm

* fix controlsd

* fix
2023-10-13 23:27:04 -07:00
Adeeb Shihadeh 377722fd5e
Update Python packages and pre-commit hooks (#30149)
* Update Python packages and pre-commit hooks

* fixes

* Update common/transformations/README.md

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* fix

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-10-03 15:31:26 -07:00
Adeeb Shihadeh c347096c3e
finish hardware move to system/ (#30140)
* finish hardware move to system/

* fix release

* couple more
2023-10-02 16:49:07 -07:00
Adeeb Shihadeh 1dd4ade197 delete some old files 2023-09-30 16:07:26 -07:00
Adeeb Shihadeh e185e5ffcd
move remaining big files into LFS (#30053) 2023-09-25 21:53:03 -07:00
Shane Smiskol 7f073483bb
services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
2023-09-21 18:25:15 -07:00