Commit Graph

462 Commits

Author SHA1 Message Date
Ross Fisher
a36e28f2a9 tools: add link to jungle repo (#24477)
old-commit-hash: 32e4dc3869
2022-05-09 14:24:09 -07:00
George Hotz
69558824b7 update compressed vipc to function on packets
old-commit-hash: dded24662f
2022-05-09 13:44:09 -07:00
Shane Smiskol
cf0c8aac08 URLFile: raise exception if remote URL doesn't exist when using cache (#24432)
* URLFile returns empty bytes if using cache and remote file doesn't exist

* better exception

* assert on cached files
old-commit-hash: 6163dd5ca0
2022-05-09 13:31:55 -07:00
ntegan1
d4d72ab938 Tools: allow uncompressed logs (#24471)
old-commit-hash: bf269bd883
2022-05-09 12:07:19 -07:00
Adeeb Shihadeh
0195ae1464 latency logger: better errors and minor cleanup
old-commit-hash: 930d0c01a9
2022-05-04 14:16:27 -07:00
Lukas Petersson
24c9e250f9 warning instead assert (#24424)
* warning instead assert

* warning description
old-commit-hash: 43d2a3c187
2022-05-04 14:05:41 -07:00
Jason Young
2708e96fab update joystick README for webjoystick (#24413)
old-commit-hash: 0771addd14
2022-05-03 17:03:17 -07:00
George Hotz
7119a98414 loggerd: switch to v4l encoder try 2 (#24380)
* start v4l encoder

* v4l encoder starts

* start and stop

* fill in proper controls

* it dequeued a buffer

* getting bytes

* it made a video

* it does make files

* getting close

* ahh, so that's how dequeue works

* qcam works (no remuxing)

* remuxing works

* we just need to make shutdown and rollover graceful

* graceful destruction

* switch to polling

* should work now

* fix pc build

* refactors, stop properly

* touchups, remove a copy

* add v4l encoder to release

* inlcude file

* move writing to it's own thread

* fix minor memory leak

* block instead of dropping frames

* add counter, fix tests maybe

* better debugging and test print

* print file path in assert

* format string in test

* no more oversized qlogs

* match qcam

* touchups, remove omx encoder

* remove omx include files

* checked ioctl, better debugging, open by name

* unused import

* move linux includes to third_party/linux/include

* simple encoderd

* full packet

* encoderd should be complete

* lagging print

* updates

* name dq thread

* subset idx

* video file writing works

* debug

* potential bugfix

* rotation works

* iframe

* keep writing support

* ci should pass

* loggerd, not encoderd

* remote encoder code

* support remote encoder

* cereal to master, add encoderd

* header no longer required

* put that back there

* realtime

* lower decoder latency

* don't use queue for VisionIpcBufExtra, disable realtime again

* assert all written

* hmm simpler

* only push to to_write if we are writing

* assert timestamp is right

* use at and remove assert

* revert to queue

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 0baa4c3e2a
2022-04-30 09:22:52 -07:00
Lukas Petersson
2d6ae65ea7 Latency logger bad data robustness (#24343)
* robustness against bad data

* sort by time logreader

* loop until last frameid
old-commit-hash: 1439867d16
2022-04-29 13:32:21 -07:00
Gijs Koning
d0fc9afa48 Simulator: Fix CI and set low_quality default (#24354)
* Change low_quality argument and fix closing carla bridge

* Some fixes

* Change carla process in test

* Change fov to 120, higher doesn't look good

* Update readme and remove redundant test

* update

* Add folder description
old-commit-hash: ee433dfa57
2022-04-29 07:15:05 -07:00
Shane Smiskol
66454c000e Fix can replay Jungle warning (#24364)
old-commit-hash: 2fa5a59e3f
2022-04-28 17:43:26 -07:00
Jason Young
9de3eb63c1 Fix PlotJuggler saved tuning layout (#24347)
old-commit-hash: be0f27ac85
2022-04-27 21:57:37 -07:00
Daniel
2201cf91a6 Update can_replay.py (#24346)
Fixed typo from PandaJugnle to PandaJungle
old-commit-hash: c60ce2a770
2022-04-27 21:43:36 -07:00
Adeeb Shihadeh
2130eae8b1 fix panda_jungle static analysis
old-commit-hash: bfeaf35d6d
2022-04-27 15:45:00 -07:00
grekiki
77d6d9a083 mypy: enable --warn-unused-ignores (#24287)
* this is the easy part to check

* Not sure what this fixes, 8aaf00c6a4

* bump laika

* works here

* cleanup

* add types-certifi

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 049b163ea0
2022-04-27 14:26:15 -07:00
George Hotz
d348193169 compressed_vipc: make yuv default
old-commit-hash: 3694f9801c
2022-04-25 21:44:37 -07:00
Comma Device
482801d4fd body: remove print spam
old-commit-hash: 729d7ae549
2022-04-25 20:07:12 -07:00
Cameron Clough
38e14ed47b Don't build OpenCV tests in webcam docker image (#24326)
Building opencv tests and apps are [on by default](https://docs.opencv.org/4.x/db/d05/tutorial_config_reference.html#tutorial_config_reference_general_tests),
but we don't need them.
old-commit-hash: 2d77a31cd5
2022-04-25 16:08:42 -07:00
MT
e80d78969d ubuntu_setup.sh: support 22.04 LTS (#24312)
* Build on 22.04 lts

- Removed python-dev from install_ubuntu_common_requirements()
- Added case ubuntu 22.04
- Added install_ubuntu_21.10_requirements()
- Modified install_ubuntu_latest_requirements() to include python3-dev instead of python-dev

* remove 21.10

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2a64f7b563
2022-04-25 14:06:30 -07:00
Gijs Koning
0112f4212f Simulator: Fix keyboard input (#24320)
* Fix keyboard input for simulator

* add unblock_stdout() to test

* Revert import change
old-commit-hash: 01968ca61b
2022-04-25 07:26:30 -07:00
Gijs Koning
4ed3a158af Simulator Tests (#24274)
* squash #24009

* Fix from other pr
Add low-quality arg

* Update tools/sim/test/test_carla_integration.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Updates for comments. Not finished yet

* commit

* fix arguments

* Final changes for comments

* Final fixes

* increase carla client timeout to 10

* make test executable

* actually wait for controlsd to send messages

* Error proof test. Starting up carla at each test and closing down using docker (tried many things).

* commit test carla

* Removed some time.sleeps
Add some more retries for bridge.

* Stop while loop on shutdown

* Increase teardown waiting time

Co-authored-by: Willem Melching <willem.melching@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9be23cbdb9
2022-04-22 18:00:49 +02:00
grekiki
cc943ac9a5 mypy: enable --warn-unreachable (#24282)
* Optional solves mypy assuming None is always None

* oops

* spaces

* Update registration.py

* fix local error

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: b8b15d5cf1
2022-04-21 18:27:45 +02:00
George Hotz
b872fe92ab loggerd: Separate writer from encoder (#24257)
* seperate writer from encoder

* video writer in release

* confirm loggerd on PC works, add YUV option to compressed_vipc

* make raw_logger use video_writer

* put this back to master

* close codec

* put this back

* use unique_ptr

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 8d24655787
2022-04-20 14:51:24 -07:00
Lukas Petersson
a9b23562ee Latencylogger list logreader (#24276)
old-commit-hash: e063f77acc
2022-04-20 12:02:05 -07:00
Gijs Koning
8ddeb3f531 Add wide camera to Carla (#23989)
* Add c3 camera flag to bridge.py

* Set c3_cameras to default

* add runtime error message

* Remove c2 arg

* Update to 163 fov to not see through car

* update comment

* Update tools/sim/bridge.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* Revert camera.py changes

* Remove focal_length

* cleanup

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 13254cef2f
2022-04-20 08:06:56 -07:00
Gijs Koning
7b4b8d3f58 Carla pip dependency and fix for git init (#24258)
* Add carla pip dependency for dev

* Revert other packages in pipfile

* Remove redundant carla install in docker

* Fix CI
Remove broken openpilot_build

* New run command
old-commit-hash: e95a250bca
2022-04-20 05:23:27 -07:00
Lukas Petersson
544375abcf Disambiguate frame id in latencylogger (#24164)
* add tools to disambiguate frame id

* Update selfdrive/camerad/cameras/camera_qcom2.cc

Co-authored-by: Gijs Koning <gijs-koning@live.nl>

* bug fix

* remove duplicate code

* PR comments

* bug fix

Co-authored-by: Gijs Koning <gijs-koning@live.nl>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 397bd25e97
2022-04-19 14:29:24 -07:00
Adeeb Shihadeh
ae71ecf8b8 manager: start bridge and web joystick for notcars (#24212)
* manager: start bridge and web joystick for notcars

* fix that

* bump cereal

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 76a8338197
2022-04-19 14:13:05 -07:00
Adeeb Shihadeh
db252b457a improve tici thermal control (#24228)
* improve tici thermals

* more i

* always 70
old-commit-hash: c5378cf8b9
2022-04-19 11:07:54 -07:00
George Hotz
5ce06c5016 joystickd: add send thread
old-commit-hash: 13e18b605a
2022-04-18 22:35:19 -07:00
George Hotz
8353786c69 joystickd: add WEB support, add logitech joystick support
old-commit-hash: e9ef650901
2022-04-18 22:13:09 -07:00
Adeeb Shihadeh
5a9644261f remove comma two support (#24248)
* remove comma two support

* cleanup release files

* little more

* more libs

* no more gralloc

* add snpe back
old-commit-hash: 5c48e7bc86
2022-04-18 17:55:23 -07:00
George Hotz
20119b5ef6 body: web joystick handle timeout
old-commit-hash: df6c2b6af9
2022-04-14 16:12:30 -07:00
George Hotz
d9a94cc785 body: web joystick
old-commit-hash: d7b849720c
2022-04-13 14:29:17 -07:00
Lukas Petersson
93d0e6b65a Latencylogger optimization (#24166)
old-commit-hash: 3ea92f6cd3
2022-04-13 13:50:57 -07:00
George Hotz
9720bb37b5 loggerd: broadcast encoder data (#24177)
* encode data try 1

* fix pc build

* low quality compressed streamer with pyav

* nvidia streamer

* timestamp support

* fix latency measurement

* refactor

* camerastream updates

* fix linter

* compressed to vipc, clean

* remove print

* touchups

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: dab978083b
2022-04-12 12:08:50 -07:00
Lukas Petersson
9705604939 latency logger usable in testing closet (#24183)
old-commit-hash: 7034888cdb
2022-04-11 16:44:24 -07:00
Lukas Petersson
156234ced3 latencylogger graph design (#24165)
* latencylogger graph design

* Update tools/latencylogger/latency_logger.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* quotes

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: fecaac8eda
2022-04-07 13:18:26 -07:00
Lukas Petersson
df8476118b Latency logging 2 (#24058)
* msg_order and gantt

* frameId in long/lat planner

* track frame id

* controls frame id

* graph tracked events

* graph json

* cloudlog timestamp

* c++ cloudlog

* add frame id

* bug fixes

* bug fixes

* frame id visionicp

* bug fixes and debug level

* timestamp log placement

* print timestamps in table

* translate events

* more logging

* bug fixes

* daemon boardd

* print logs with boardd

* more timestamp logs

* cleanup

* remove publish logs

* bug fix

* timestamp received

* timestamp received

* bug fixes

* use json lib

* ignore driver camera

* prep for new timestamp pipeline

* bug fix

* read new pipeline unfinnished

* read new pipeline

* bug fix

* add frame to controlsstate

* remove controlsstate

* print

* cleanup

* more cleanup + bug fix

* clock build issue

* remove unused imports

* format durations

* increase speed

* pr comments fixes

* conflicts

* set MANAGER_DAEMON for boardd

* clean script code

* bug fix + argparse

* remove rcv time

* bug fixes

* print without tabulate

* fix pre-commits

* plot gnatt

* color bug fix

* read without timestampextra

* bump panda

* mono time instead of frame id

* finnish script

* clean unused

* clean unused logging

* monotonic + json fixes

* del test

* remove whilelines

* bump laika

* cleanup

* remove deps

* logs nicer strings

* remove plotting from scirpt

* reset pipfile

* reset pipfile

* nicer strings

* bug fix

* bug fix

* pr comments cleaning

* remove plotting

* bug fix

* new demo route

* bump opendbc and panda

* cereal master

* cereal master

* script less komplex

* assertions

* matplotlib

* readme

* Update README.md

* graph html

* design fixes

* more code design

* Update common/logging_extra.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update tools/latency_logger/latency_logger.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* pr comments

* bug fix

* readme + env once

* clean swaglog

* bug fix

* Update tools/latencylogger/README.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert

* revert

* clean swaglog with error

* remove typo file

* revert graph

* cereal

* submodules

* whitespaces

* update refs

Co-authored-by: Bruce Wayne <batman@workstation-openpilot2.internal>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 65fca83abe
2022-04-05 21:05:45 -07:00
Shane Smiskol
38c74c325b PlotJuggler: fix support for Cabana links (#24037)
* support Cabana links better

* not needed

* Update tools/plotjuggler/juggle.py
old-commit-hash: a953d8222d
2022-04-05 11:24:03 -07:00
Erich Moraga
2b7ac102af Added embedded tuning wiki hyperlink (#24133)
https://github.com/commaai/openpilot/wiki/Tuning
old-commit-hash: f861854e25
2022-04-05 10:30:09 -07:00
Adeeb Shihadeh
69bfa59a81 sim: write params to enable in Dockerfile (#24113)
old-commit-hash: d1c3b7a20d
2022-04-04 09:05:20 -07:00
Adeeb Shihadeh
6f88ca1c6f MultiLogIterator: add function to reset
old-commit-hash: c95ec211e1
2022-03-25 19:56:22 -07:00
Adeeb Shihadeh
0c9aa1570b sim: add ignition toggling (#24043)
old-commit-hash: bb36a1c8b2
2022-03-25 14:17:45 -07:00
Jack Huang
d44266bed4 CARLA: fix setting camera EOF (#24034)
* Fix Openpilot in Carla isn't accelerating

The scalars of the timestamp are different in real-world and simulation,
which will cause an infinite loop in selfdrive/modeld/modeld.cc.

* Set eof based on the frame ID

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* remove global

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: db93275d87
2022-03-25 13:45:08 -07:00
Adeeb Shihadeh
bd71c594a2 pylint: enforce indentation (W0311) (#24039)
* pylint: enforce indentation (W0311)

* few more
old-commit-hash: 8af20af66d
2022-03-24 23:23:29 -07:00
Adeeb Shihadeh
fd37ab2d97 plotjuggler: add lag debugging layout
old-commit-hash: b57c2f4a14
2022-03-22 15:34:49 -07:00
mitchellgoffpc
b7e99b3f45 Ignore BrokenPipeError
old-commit-hash: 5c8c6faa9a
2022-03-22 12:52:25 -07:00
whokilleddb
e8d2ac0cdc Sanitize IP zookeeper/enable_and_wait.py (#24007)
* Sanitize IP zookeeper/enable_and_wait.py

* Fixed Identation

* Fixed Gaierror
old-commit-hash: 1bdf29dc5b
2022-03-21 17:49:03 +01:00
Adeeb Shihadeh
fe6209bd8c plotjuggle: add blockedCnt to controls mismatch debug layout
old-commit-hash: 7eb9416f6b
2022-03-18 15:48:07 -07:00