Commit Graph

488 Commits

Author SHA1 Message Date
Lukas Petersson
86f73a507e process replay: logreader as bytes (#24610)
* willem's changes

* classmethod for bytes

* submodules

* submodules

* Update tools/lib/logreader.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add back files

* little cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-06-01 22:02:42 -07:00
George Hotz
ea5b8cdfb1 nv12: encoderd avoids a full frame copy (#24519)
* rgb to nv12

* nv12 works (w memcpy)

* correct now

* no copy

* fix nv12 with fast debayer

* reverts of unused stuff

* ui use nv12

* comment out thumbnails for now

* rebase fix

* dm read nv12

* model read nv12

* fix ffmpeg encoder

* thumbnails from nv12

* replay to nv12

* python framereader support nv12

* remove hardcoded frame/buffer sizes

* fix build

* ffmpeg encoder fix buffers

* small cleanup

* reduce power usage test

* fix cpu usage test

* fix snapshot

* fix loggerd test

* bump cereal

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Joost Wooning <jwooning@gmail.com>
2022-06-01 17:18:28 +02:00
Gijs Koning
b5aed2bf67 Simulator: Speed up process by removing second camera (#24679)
* simulator: support running wide camera only

* proper frame id

* use param name that makes more sense

* do some cleanup

* Update tools/sim/bridge.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-05-30 15:25:07 +02:00
Willem Melching
85b07bf3e8 sim no encoderd, move to BLOCK env variable 2022-05-30 11:49:15 +02:00
Lukas Petersson
cc4107fd1f latency logger: add offset to visualize overlap (#24644)
* plot design

* readme

* y label

* readme img

* bigger gaps

* readme figs

* denser lines

* denser lines

* offset flag

* readme

* cleanup

* Update tools/latencylogger/latency_logger.py

* Update tools/latencylogger/latency_logger.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-05-26 13:41:08 -07:00
Adeeb Shihadeh
32a9ccfc37 visionipc python shim (#24660) 2022-05-25 20:49:56 -07:00
Willem Melching
2bdb2cb40a ui.py: use YUV stream 2022-05-25 17:37:21 +02:00
Adeeb Shihadeh
3d74b5429d latency logger: improve plot style 2022-05-23 20:57:14 -07:00
Adeeb Shihadeh
b8a32bbc46 little tools fix ups (#24629) 2022-05-23 16:10:36 -07:00
Lukas Petersson
8fbcc49ee3 Latency logger: binary search for frame ID (#24586)
binary search for frame id
2022-05-23 13:02:23 -07:00
Lukas Petersson
522b67f16d latency logger: update demo route (#24608)
* handle no segment

* dont handle no route
2022-05-23 12:48:11 -07:00
George Hotz
e4b7791044 compressed_vipc: use correct system timestamps 2022-05-18 13:18:00 -07:00
George Hotz
bb5a050840 add to compressed_vipc 2022-05-18 12:58:12 -07:00
Willem Melching
194e5fdf1c make normal logreader more robust (#24577) 2022-05-18 12:21:01 +02:00
ntegan1
07f7570840 Tools: allow using plotjuggler on local data (#24473)
local juggler
2022-05-17 19:50:23 +02:00
George Hotz
fe867df102 compressed_vipc: print frame latency 2022-05-16 20:40:11 -07:00
George Hotz
2a978e36ac compressed_vipc: set NV_LOW_LATENCY flag 2022-05-16 15:58:31 -07:00
Adeeb Shihadeh
319f3d1475 move models to selfdrive/modeld/ (#24539)
* move models to selfdrive/modeld/

* two more refs
2022-05-15 17:29:09 -07:00
Adeeb Shihadeh
ab75c53792 replay: cleanup unused RGB buffers (#24537)
* replay: cleanup unused RGB buffers

* update replay cam

* little more
2022-05-14 19:55:12 -07:00
Ross Fisher
01a237ef02 Fix gcc-arm-embedded for m1 mac (#24515)
* Fix gcc-arm-embedded for m1 mac

* put in /tmp

* update comment

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-05-13 11:12:59 +02:00
Jason Young
c007c7e681 Improved steering accuracy measurement script (#23583)
* move steering accuracy measurement script

* git rebase is utterly worthless

* fix header width
2022-05-12 15:09:37 +02:00
Dylan Herman
d2eef1955c add mypy check for return-any (#24379)
* add mypy check for return-any

* remove unused import

* typing

* remove unnecessary variable typing

* cleanup

* cleanup

* bump submodules

* small fixes

* only a problem on mac

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-05-12 14:59:00 +02:00
grekiki
17e33978cd Mypy fixes for --check-untyped-defs (#24372)
more type fixes
2022-05-12 14:08:11 +02:00
Mark Murnane
e84d073233 Add gamepad support for body (#24415)
This MR adds basic gamepad support to the joystick web client.
The mappings appear to be consistent between a few controllers I tried, so I think inverting both axes is the optimal mapping.
2022-05-12 13:40:05 +02:00
Adeeb Shihadeh
4b063a0246 pj: add fan rpm to thermal layout 2022-05-10 19:51:22 -07:00
George Hotz
2008db47c2 encoderd: make work on PC (#24483)
* don't use the codec in video_writer

* this produces broken videos for some reason

* bugfix

* refactor on the class

* works on device

* fix codec

* no codec enum

* fix pc

* move into dirs

* these includes also

* rename it ffmpegencoder

* add avcodec_close

Co-authored-by: Comma Device <device@comma.ai>
2022-05-10 15:20:51 -07:00
Ross Fisher
32e4dc3869 tools: add link to jungle repo (#24477) 2022-05-09 14:24:09 -07:00
George Hotz
dded24662f update compressed vipc to function on packets 2022-05-09 13:44:09 -07:00
Shane Smiskol
6163dd5ca0 URLFile: raise exception if remote URL doesn't exist when using cache (#24432)
* URLFile returns empty bytes if using cache and remote file doesn't exist

* better exception

* assert on cached files
2022-05-09 13:31:55 -07:00
ntegan1
bf269bd883 Tools: allow uncompressed logs (#24471) 2022-05-09 12:07:19 -07:00
Adeeb Shihadeh
930d0c01a9 latency logger: better errors and minor cleanup 2022-05-04 14:16:27 -07:00
Lukas Petersson
43d2a3c187 warning instead assert (#24424)
* warning instead assert

* warning description
2022-05-04 14:05:41 -07:00
Jason Young
0771addd14 update joystick README for webjoystick (#24413) 2022-05-03 17:03:17 -07:00
George Hotz
0baa4c3e2a loggerd: switch to v4l encoder try 2 (#24380)
* start v4l encoder

* v4l encoder starts

* start and stop

* fill in proper controls

* it dequeued a buffer

* getting bytes

* it made a video

* it does make files

* getting close

* ahh, so that's how dequeue works

* qcam works (no remuxing)

* remuxing works

* we just need to make shutdown and rollover graceful

* graceful destruction

* switch to polling

* should work now

* fix pc build

* refactors, stop properly

* touchups, remove a copy

* add v4l encoder to release

* inlcude file

* move writing to it's own thread

* fix minor memory leak

* block instead of dropping frames

* add counter, fix tests maybe

* better debugging and test print

* print file path in assert

* format string in test

* no more oversized qlogs

* match qcam

* touchups, remove omx encoder

* remove omx include files

* checked ioctl, better debugging, open by name

* unused import

* move linux includes to third_party/linux/include

* simple encoderd

* full packet

* encoderd should be complete

* lagging print

* updates

* name dq thread

* subset idx

* video file writing works

* debug

* potential bugfix

* rotation works

* iframe

* keep writing support

* ci should pass

* loggerd, not encoderd

* remote encoder code

* support remote encoder

* cereal to master, add encoderd

* header no longer required

* put that back there

* realtime

* lower decoder latency

* don't use queue for VisionIpcBufExtra, disable realtime again

* assert all written

* hmm simpler

* only push to to_write if we are writing

* assert timestamp is right

* use at and remove assert

* revert to queue

Co-authored-by: Comma Device <device@comma.ai>
2022-04-30 09:22:52 -07:00
Lukas Petersson
1439867d16 Latency logger bad data robustness (#24343)
* robustness against bad data

* sort by time logreader

* loop until last frameid
2022-04-29 13:32:21 -07:00
Gijs Koning
ee433dfa57 Simulator: Fix CI and set low_quality default (#24354)
* Change low_quality argument and fix closing carla bridge

* Some fixes

* Change carla process in test

* Change fov to 120, higher doesn't look good

* Update readme and remove redundant test

* update

* Add folder description
2022-04-29 07:15:05 -07:00
Shane Smiskol
2fa5a59e3f Fix can replay Jungle warning (#24364) 2022-04-28 17:43:26 -07:00
Jason Young
be0f27ac85 Fix PlotJuggler saved tuning layout (#24347) 2022-04-27 21:57:37 -07:00
Daniel
c60ce2a770 Update can_replay.py (#24346)
Fixed typo from PandaJugnle to PandaJungle
2022-04-27 21:43:36 -07:00
Adeeb Shihadeh
bfeaf35d6d fix panda_jungle static analysis 2022-04-27 15:45:00 -07:00
grekiki
049b163ea0 mypy: enable --warn-unused-ignores (#24287)
* this is the easy part to check

* Not sure what this fixes, 8aaf00c6a4

* bump laika

* works here

* cleanup

* add types-certifi

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-04-27 14:26:15 -07:00
George Hotz
3694f9801c compressed_vipc: make yuv default 2022-04-25 21:44:37 -07:00
Comma Device
729d7ae549 body: remove print spam 2022-04-25 20:07:12 -07:00
Cameron Clough
2d77a31cd5 Don't build OpenCV tests in webcam docker image (#24326)
Building opencv tests and apps are [on by default](https://docs.opencv.org/4.x/db/d05/tutorial_config_reference.html#tutorial_config_reference_general_tests),
but we don't need them.
2022-04-25 16:08:42 -07:00
MT
2a64f7b563 ubuntu_setup.sh: support 22.04 LTS (#24312)
* Build on 22.04 lts

- Removed python-dev from install_ubuntu_common_requirements()
- Added case ubuntu 22.04
- Added install_ubuntu_21.10_requirements()
- Modified install_ubuntu_latest_requirements() to include python3-dev instead of python-dev

* remove 21.10

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-04-25 14:06:30 -07:00
Gijs Koning
01968ca61b Simulator: Fix keyboard input (#24320)
* Fix keyboard input for simulator

* add unblock_stdout() to test

* Revert import change
2022-04-25 07:26:30 -07:00
Gijs Koning
9be23cbdb9 Simulator Tests (#24274)
* squash #24009

* Fix from other pr
Add low-quality arg

* Update tools/sim/test/test_carla_integration.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Updates for comments. Not finished yet

* commit

* fix arguments

* Final changes for comments

* Final fixes

* increase carla client timeout to 10

* make test executable

* actually wait for controlsd to send messages

* Error proof test. Starting up carla at each test and closing down using docker (tried many things).

* commit test carla

* Removed some time.sleeps
Add some more retries for bridge.

* Stop while loop on shutdown

* Increase teardown waiting time

Co-authored-by: Willem Melching <willem.melching@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-04-22 18:00:49 +02:00
grekiki
b8b15d5cf1 mypy: enable --warn-unreachable (#24282)
* Optional solves mypy assuming None is always None

* oops

* spaces

* Update registration.py

* fix local error

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-04-21 18:27:45 +02:00
George Hotz
8d24655787 loggerd: Separate writer from encoder (#24257)
* seperate writer from encoder

* video writer in release

* confirm loggerd on PC works, add YUV option to compressed_vipc

* make raw_logger use video_writer

* put this back to master

* close codec

* put this back

* use unique_ptr

Co-authored-by: Comma Device <device@comma.ai>
2022-04-20 14:51:24 -07:00
Lukas Petersson
e063f77acc Latencylogger list logreader (#24276) 2022-04-20 12:02:05 -07:00