Commit Graph

1339 Commits

Author SHA1 Message Date
Justin Newberry
be814ed447 SegmentRangeReader: log type selector (#30960)
* log type selector

* test this too

* and this

* invalid selector

* use strenum

* don't hardcode size

* oneline
2024-01-11 10:25:24 -08:00
Hoang Bui
1da08460cb Enable variable pass between test and metadrive processes (#30961)
pass started between processes
2024-01-10 18:13:21 -08:00
Justin Newberry
cfb23eb2d1 segmentrangereader: support sort_by_time (#30954)
support sort-by-time
2024-01-10 13:36:55 -08:00
Justin Newberry
0d126e1e9e SegmentRangeReader: new format for reading multiple segments (#30940)
* segment range reader

* rename that

* revert that

* cleanup

* revert this for now

* revert this for now

* Fix + test

* rm that

* rm that

* use for auto_fingerprint

* simpler

* for notebook too

* match numpy indexing

* just use numpy directly

* remove that

* spacing

* spacing

* use qlog for auto fingerprint

* add 'read mode'

* pass in read mode

* add test for modes

* numpy indexing

* fix that case

* more examples

* fix the notebook

* cleanup the notebook

* cleaner

* fix those
2024-01-10 11:55:19 -08:00
Hoang Bui
7fdd5c4a7d Python camerad for webcam (#30930)
* webcamd

* remove destroy windows

* block

* shebang execute

* executaleeeee

* executableeeeeee

* she bang for camerad.py

* listener

* no signal?

* good

* ruff fix

* delete listener

* recover sim

* remove assert

* refactor

* fix shell

* fix namedtuple

* little change

* to tuple

* cleanup

* update readme

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-01-08 19:22:21 -08:00
Shane Smiskol
d689a4e653 Fix string indentation (#30943)
* fix bad spacing

* more

* these aren't important
2024-01-08 15:36:43 -08:00
Adeeb Shihadeh
073fc89ad4 Revert "UI: single-threaded CameraView (#30397)"
This reverts commit 17ac1d3c7b.
2024-01-07 14:54:39 -08:00
Justin Newberry
03d6233743 move profiling tools to tools/profiling (#30917)
move profiling
2024-01-05 16:22:45 -08:00
Adeeb Shihadeh
46f3fdc090 Update Python packages and pre-commit hooks (#30597)
* Update Python packages and pre-commit hooks

* fix

---------

Co-authored-by: jnewb1 <jnewb1@users.noreply.github.com>
2024-01-05 15:17:49 -08:00
Justin Newberry
239b228ca6 add the notebook example to car port docs (#30920)
* add the notebook example

* fix link

* add image

* no lfs

* no lfs
2024-01-05 13:57:02 -08:00
Justin Newberry
e86d74b347 move car porting tools to tools/car_porting (#30916)
just this for now
2024-01-05 11:53:03 -08:00
Justin Newberry
15e0a906ad tools: add car porting example notebook (#30918)
* add car porting example notebooks

* not required
2024-01-05 11:52:24 -08:00
Dean Lee
17ac1d3c7b UI: single-threaded CameraView (#30397)
* single-threaded CameraView

* updateFrame

* inherit from CameraWidget

* clear frame on offroadTransition

* check frame_id

* optional

* unique_ptr

* CameraView

* cleanup

* cleanup

* log skipping frame

* fix driverview

* disconnectVipc

* debug inconsistent frame

* skip frame if uiPlan is outdate

* cleanup

* set connected = false

* support camerad reboot&seeking in replay

* cleanup

* qDebug

* use deque

* cleanup

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-01-03 13:14:29 -08:00
Justin Newberry
fba521ecc6 url_file: fix non-200 files being cached (#30886)
* fix + test

* fix unclosed

* easier to read

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* fix that

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2024-01-02 12:42:08 -08:00
Kacper Rączy
65ece2081a metadrive: Change camera position to reflect typical height of a vehicle (#30831) 2024-01-01 14:36:37 -08:00
Sliicy
6ccf2cbfde Fixed joystickd.py incorrect steering control (#30879) 2024-01-01 14:29:01 -08:00
Robbe Derks
eb805e889e [Cabana] Fix segfault in sparkline (#30870) 2023-12-31 13:02:05 -08:00
pencilpusher
ee3544d283 replay ui: fix typo in variable name (#30851)
fix typo in variable name
2023-12-26 16:03:59 -08:00
Adeeb Shihadeh
1f9970ba3d stricter file size limits (#30839)
* move all pics to lfs

* wav and rest of so

* more to lfs

* ignore a few

* push that up
2023-12-26 15:22:59 -08:00
Justin Newberry
a6b17fb1f6 Simulator: fix keyboard ctrl messing with pytest (#30827)
fix
2023-12-20 15:10:11 -08:00
Dean Lee
5f04517677 cabana: add csv export (#30800)
export csv
2023-12-19 11:50:16 -08:00
Justin Newberry
8017c25f0b Simulator: only send camera frames at rate that they are generated (#30802)
only send frames at rate that they are generated
2023-12-19 10:45:07 -08:00
Dean Lee
ab0b26d2b8 camerad: cleanup includes (#30782)
* cleanup includes

* continue

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-12-17 22:42:52 -08:00
Adeeb Shihadeh
51a93cf9aa fix unused 2023-12-17 16:32:56 -08:00
royjr
70624ffc81 dependency: remove pycurl package (#30771)
* Update qcomgpsd.py

* Update url_file.py

* remove pycurl

* requests -> urllib3

* unused

* redundant

* fix import

* Revert "requests -> urllib3"

This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.

* headless

* fix trail

* use requests.exceptions.RequestException

* use fp.tell

* fix indents

* reorder imports

* change timeout

* fix debug timing

* remove exception

* add timeout

* missing headers

* move to constructor

* move import

* unused import

* fix debug

* try

* no retries
2023-12-17 16:25:25 -08:00
Adeeb Shihadeh
2c30421b16 move common.window to xx (#30777) 2023-12-17 10:50:45 -08:00
Justin Newberry
da12a34ff6 Metadrive: set near clip (#30745)
set near
2023-12-14 21:03:02 -08:00
Kacper Rączy
5fe9f1459c metadrive: fix dual_camera mode (#30743)
* Use wide cam in metadrive

* 120 fov
2023-12-14 20:51:06 -08:00
Justin Newberry
977dd033c4 Simulator: fix safety param (#30738)
fix param
2023-12-14 19:34:06 -08:00
Justin Newberry
075e6ff3e6 Docker: add xvfb (#30727)
add xvfb
2023-12-14 12:46:24 -08:00
Adeeb Shihadeh
ae85ee0932 fixup can replay for jungle v2 and tres 2023-12-13 17:00:14 -08:00
Adeeb Shihadeh
73db7e8e3a Revert "compressed_vipc: fix issues with VisionIpcServer in ZMQ mode (#30115)"
This reverts commit 0e5cfa3426.
2023-12-12 19:16:46 -08:00
Kacper Rączy
e62756596b controlsd: require joystick mode param for the body (#30680)
* Update joystick mode in step

* Stop putting the body in joystick mode by default

* Toggle JoystickDebugMode by default for notCars in process_replay

* Remove subsection about web joystick

* Update param only in non-cars

* Make joystickDebug non-static event, and add it in a loop

* Add comment
2023-12-12 14:14:51 -08:00
Kacper Rączy
43e1409fd2 metadrive: fix wasd steer signs (#30623)
* Swap AD signs

* Fix type annotation

* fix user torque

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
2023-12-12 14:09:07 -08:00
Justin Newberry
be33d29d7a Simulator: --simulator is no longer an argument (#30700)
these are also gone
2023-12-12 09:45:34 -08:00
Justin Newberry
11ec5bf25e Simulator: remove carla (#30690)
* no carla

* no arg and stylize metadrive
2023-12-11 20:38:37 -08:00
royjr
84a3b10da9 cabana: fix typo (#30678) 2023-12-10 16:46:41 -08:00
Shane Smiskol
97da129e11 ruff: check newline (#30668)
* check newline

* nothing catches this
2023-12-09 13:24:18 -08:00
Dean Lee
aa744e8437 cabana: cleanp code (#30666) 2023-12-09 08:12:11 -08:00
Justin Newberry
bb9dda9764 simulator: set valid flags (#30656)
sim set valid
2023-12-08 16:31:30 -08:00
Greg Hogan
db35dcd0b5 replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion (#30618)
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
2023-12-06 09:55:29 -08:00
Kacper Rączy
7948a61b0e bodyteleop: toggle joystick debug mode (#30611)
* Enable joystick debug mode in web

* Remove mutable vals

* Rename thread back to main
2023-12-05 15:00:05 -08:00
Kacper Rączy
6c62a31466 joystickd: remove WEB (#30612)
Remove WEB option from joystickd
2023-12-05 14:42:44 -08:00
Dean Lee
33ee7530b3 cabana: add test case for parsing all opendbc files (#30584)
* test opendbc files

* bump opendbc

* bump opendbc

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-12-04 17:12:22 -08:00
Adeeb Shihadeh
99d51bf02c Revert "Simplify passive mode handling (#30593)" 2023-12-04 15:05:05 -08:00
Adeeb Shihadeh
5ccff25d88 Simplify passive mode handling (#30593)
* simplify passive handling

* makes more sense
2023-12-03 13:59:59 -08:00
Adeeb Shihadeh
b97e5b0e03 rename carEvents -> onroadEvents (#30577)
* rename carEvents -> onroadEvents

* bump cereal

* bump cereal
2023-12-01 22:48:29 -08:00
Kacper Rączy
f058b5d64e webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
2023-12-01 21:13:37 -08:00
Dean Lee
d87191c1c1 cabana: fix missing opendbc files (#30555)
* fix missing dbc files

* remove suffix
2023-11-30 20:46:31 -08:00
Greg Hogan
7e0f0165f4 replay: get api url from env var (#30562) 2023-11-30 10:42:18 -08:00