Commit Graph

425 Commits

Author SHA1 Message Date
Lukas Petersson
156234ced3 latencylogger graph design (#24165)
* latencylogger graph design

* Update tools/latencylogger/latency_logger.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* quotes

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: fecaac8eda
2022-04-07 13:18:26 -07:00
Lukas Petersson
df8476118b Latency logging 2 (#24058)
* msg_order and gantt

* frameId in long/lat planner

* track frame id

* controls frame id

* graph tracked events

* graph json

* cloudlog timestamp

* c++ cloudlog

* add frame id

* bug fixes

* bug fixes

* frame id visionicp

* bug fixes and debug level

* timestamp log placement

* print timestamps in table

* translate events

* more logging

* bug fixes

* daemon boardd

* print logs with boardd

* more timestamp logs

* cleanup

* remove publish logs

* bug fix

* timestamp received

* timestamp received

* bug fixes

* use json lib

* ignore driver camera

* prep for new timestamp pipeline

* bug fix

* read new pipeline unfinnished

* read new pipeline

* bug fix

* add frame to controlsstate

* remove controlsstate

* print

* cleanup

* more cleanup + bug fix

* clock build issue

* remove unused imports

* format durations

* increase speed

* pr comments fixes

* conflicts

* set MANAGER_DAEMON for boardd

* clean script code

* bug fix + argparse

* remove rcv time

* bug fixes

* print without tabulate

* fix pre-commits

* plot gnatt

* color bug fix

* read without timestampextra

* bump panda

* mono time instead of frame id

* finnish script

* clean unused

* clean unused logging

* monotonic + json fixes

* del test

* remove whilelines

* bump laika

* cleanup

* remove deps

* logs nicer strings

* remove plotting from scirpt

* reset pipfile

* reset pipfile

* nicer strings

* bug fix

* bug fix

* pr comments cleaning

* remove plotting

* bug fix

* new demo route

* bump opendbc and panda

* cereal master

* cereal master

* script less komplex

* assertions

* matplotlib

* readme

* Update README.md

* graph html

* design fixes

* more code design

* Update common/logging_extra.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update tools/latency_logger/latency_logger.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* pr comments

* bug fix

* readme + env once

* clean swaglog

* bug fix

* Update tools/latencylogger/README.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert

* revert

* clean swaglog with error

* remove typo file

* revert graph

* cereal

* submodules

* whitespaces

* update refs

Co-authored-by: Bruce Wayne <batman@workstation-openpilot2.internal>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 65fca83abe
2022-04-05 21:05:45 -07:00
Shane Smiskol
38c74c325b PlotJuggler: fix support for Cabana links (#24037)
* support Cabana links better

* not needed

* Update tools/plotjuggler/juggle.py
old-commit-hash: a953d8222d
2022-04-05 11:24:03 -07:00
Erich Moraga
2b7ac102af Added embedded tuning wiki hyperlink (#24133)
https://github.com/commaai/openpilot/wiki/Tuning
old-commit-hash: f861854e25
2022-04-05 10:30:09 -07:00
Adeeb Shihadeh
69bfa59a81 sim: write params to enable in Dockerfile (#24113)
old-commit-hash: d1c3b7a20d
2022-04-04 09:05:20 -07:00
Adeeb Shihadeh
6f88ca1c6f MultiLogIterator: add function to reset
old-commit-hash: c95ec211e1
2022-03-25 19:56:22 -07:00
Adeeb Shihadeh
0c9aa1570b sim: add ignition toggling (#24043)
old-commit-hash: bb36a1c8b2
2022-03-25 14:17:45 -07:00
Jack Huang
d44266bed4 CARLA: fix setting camera EOF (#24034)
* Fix Openpilot in Carla isn't accelerating

The scalars of the timestamp are different in real-world and simulation,
which will cause an infinite loop in selfdrive/modeld/modeld.cc.

* Set eof based on the frame ID

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* remove global

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: db93275d87
2022-03-25 13:45:08 -07:00
Adeeb Shihadeh
bd71c594a2 pylint: enforce indentation (W0311) (#24039)
* pylint: enforce indentation (W0311)

* few more
old-commit-hash: 8af20af66d
2022-03-24 23:23:29 -07:00
Adeeb Shihadeh
fd37ab2d97 plotjuggler: add lag debugging layout
old-commit-hash: b57c2f4a14
2022-03-22 15:34:49 -07:00
mitchellgoffpc
b7e99b3f45 Ignore BrokenPipeError
old-commit-hash: 5c8c6faa9a
2022-03-22 12:52:25 -07:00
whokilleddb
e8d2ac0cdc Sanitize IP zookeeper/enable_and_wait.py (#24007)
* Sanitize IP zookeeper/enable_and_wait.py

* Fixed Identation

* Fixed Gaierror
old-commit-hash: 1bdf29dc5b
2022-03-21 17:49:03 +01:00
Adeeb Shihadeh
fe6209bd8c plotjuggle: add blockedCnt to controls mismatch debug layout
old-commit-hash: 7eb9416f6b
2022-03-18 15:48:07 -07:00
Gijs Koning
772cbb7753 Update carla script to easier install docker and nvidia-docker (#23986)
* Easier docker and nvidia-docker install in carla script

* Small cleanup

* cleanuo

* cleanup

* More comments

* Remove adding usergroup step
old-commit-hash: 3d8537ab23
2022-03-18 14:07:39 -07:00
George Hotz
e6748f0d9d camerastream: update receive.py with some options
old-commit-hash: fa4b434e43
2022-03-14 15:02:42 -07:00
Gijs Koning
cedd8abc05 Rename RGB vision streams to match YUV streams (#23961)
* Renaming VISION_STREAM_RGB_.. to match yuv names like VISION_STREAM_ROAD
VISION_STREAM_RGB_BACK -> VISION_STREAM_RGB_ROAD
VISION_STREAM_RGB_FRONT -> VISION_STREAM_RGB_DRIVER

* little more

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 57b6fdc17a
2022-03-14 14:03:54 -07:00
Adeeb Shihadeh
ec47e0fef0 break up selfdrive.config (#23959)
* break up selfdrive.config

* add to release files

* fix import order
old-commit-hash: 5c3f3e44bc
2022-03-13 21:42:39 -07:00
George Hotz
f13d8a6fce add script to receive camerastream supported by camerad
old-commit-hash: 69736877d6
2022-03-11 20:05:59 -08:00
Adeeb Shihadeh
8a682597ca can_print_changes improvements
old-commit-hash: 1680f1e251
2022-03-10 14:32:19 -08:00
Robbe Derks
6ad1d31896 Add --dbc argument to plotjuggler (#23919)
* add --dbc argument

* Update tools/plotjuggler/juggle.py

* update readme

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9facd366fb
2022-03-07 16:04:02 -08:00
xx979xx
663579dd78 tools: add MultiLogIterator example to readme (#23917)
* update LogReader doc

use MultiLogIterator to read the entire route, get timestamps and deal with exceptions

* bring back the old example

* clean f-strings

* simplify

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: da50930450
2022-03-07 10:04:41 -08:00
Adeeb Shihadeh
ce42e116c9 mac setup: add catch2
old-commit-hash: c65ca6ab1d
2022-03-05 15:29:06 -08:00
Andrew
c8ef3e4990 fix mac_setup w/ tools+plotjuggler (#23552)
* fix pycurl issue:
* use newer curl backend for pip install
* update lib paths based on brew prefix
* fix cert issue when using pycurl using certifi
* make output setup nicer

* fix linter

* typo

* dont need that actually

* revert

* pipenv in brew

* forgot this

* make brew available on fresh install

* undo

* more undo

* oops

* use sytem curl, but homebrew openssl

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: df627de7bf
2022-02-23 13:04:50 +01:00
Willem Melching
cc65efe7b0 ui.py: fix model lead plotting
old-commit-hash: efc9084409
2022-02-21 11:56:20 +01:00
Greg Hogan
8e9f3ae789 tools: fix segment end index in juggle.py (#23715)
old-commit-hash: a195603f6d
2022-02-06 13:55:41 -08:00
Adeeb Shihadeh
12dcbe8617 test car models improvements (#23668)
* run on all routes

* min segment length

* invalid

* revert that
old-commit-hash: c8429f913e
2022-01-30 11:17:51 -08:00
Adeeb Shihadeh
05ba2a5866 sim: fix bridge after default values removed from CANParser
old-commit-hash: 36a3ec04be
2022-01-29 18:22:14 -08:00
Willem Melching
772f394423 Revert "collect C++ code coverage (#23619)"
This reverts commit a97b2e613b275f407576ddb3d7a3bd52b05f612a.

old-commit-hash: a62e914090
2022-01-26 10:59:21 +01:00
Willem Melching
6c89b62dd9 collect C++ code coverage (#23619)
* collect cpp coverage

* install llvm

* compile with coverage

* cd to root

* remove broken gcda files

* remove newline

* delete more stuff

* script to collect coverage

* Update tools/collect_coverage.sh

* actually delete
old-commit-hash: 698ab6ac97
2022-01-25 23:15:24 +01:00
Adeeb Shihadeh
f8d4a599db tools: auto plotjuggler install
old-commit-hash: f295d51fe9
2022-01-24 15:32:27 -08:00
Greg Hogan
20670f0740 filereader better name for cd:/ replacement
old-commit-hash: a6b46c311e
2022-01-13 18:21:19 -08:00
Greg Hogan
c0e265b859 fix filereader cd:/ replacement
old-commit-hash: df35ebdceb
2022-01-13 16:09:56 -08:00
Greg Hogan
0b659ce9b6 eliminate xx filereader (#23514)
* eliminate xx filereader

* framereader cleanup
old-commit-hash: d5f4fdb1db
2022-01-13 15:56:54 -08:00
Adeeb Shihadeh
597535c014 linter: don't allow implicitly concatenated strings (#23513)
* linter: don't allow implicitly concatenated strings

* fix hyundai
old-commit-hash: 2c94f15584
2022-01-13 14:19:38 -08:00
Adeeb Shihadeh
8f9a6b06df tools: add bootlog helpers (#23504)
* tools: add bootlog helpers

* this is nice

* types
old-commit-hash: 7d7c0ff35f
2022-01-12 21:37:43 -08:00
Adeeb Shihadeh
9908210bd6 tools: better joystick instructions
old-commit-hash: 7eca4d6207
2022-01-10 12:03:27 -08:00
Adeeb Shihadeh
1ea1b9072a smaller docker image (#23469)
* save 2gb

* not used

* more cleanup

* little more

* wget too big

* follow

* needed for sim
old-commit-hash: fa3055f280
2022-01-10 11:43:18 -08:00
Andrew
192978753d mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
old-commit-hash: 6664421710
2022-01-07 15:15:18 -08:00
rzeydelis
3c7e41d900 tools: update README.md (#23447)
old-commit-hash: 207ce410b4
2022-01-07 14:03:27 -08:00
Adeeb Shihadeh
24314bdc3f fix up tools readme
old-commit-hash: f30a702414
2022-01-04 19:59:49 -08:00
Greg Hogan
bb3402b54d plotjuggler: support segment names (#23263)
* plotjuggler: support segment names

* update docs

* generic parser

* convert segment number to int when parsing

* add SegmentName

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 71132edf17
2022-01-04 15:55:46 +01:00
Cameron Clough
f9e8fb3145 Joystick: learn axis min/max (#23377)
* Joystick: learn axis min/max

* clean up updating max/min

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 5a77157ea4
2022-01-04 14:17:30 +01:00
Greg Hogan
f6a9445de8 tools: configure PYTHONPATH in pipenv (#23361)
* automatically set PYTHONPATH in pipenv

* remove other place this was set
old-commit-hash: 3e5a273022
2022-01-03 20:15:10 -08:00
Adeeb Shihadeh
ba30137b2a MultiLogIterator: fix after adding sort_by_time
old-commit-hash: bbb47dc860
2022-01-02 20:08:57 -08:00
Adeeb Shihadeh
c036e64c86 MultiLogIterator: remove wraparound mode (#23360)
old-commit-hash: 92f194decc
2022-01-02 15:16:44 -08:00
Adeeb Shihadeh
02f1866b61 CI: use ubuntu_setup.sh (#23349)
* CI: use ubuntu_setup.sh

* works?

* need to fix paths

* set paths

* no batman for now

* pyenv version

* rehash after install packages

* unify python install

* revert that

* fix pyenv path

* no pipenv

* flip that

* fix rehash

* skip that

* revert panda
old-commit-hash: 066e3e3626
2022-01-02 14:47:16 -08:00
Greg Hogan
2f843c3023 LogReader: add arg to sort by time (#23346)
* logreader optional sort by time

* robust logreader sort by time option
old-commit-hash: 9992ea1ae8
2022-01-02 11:56:53 -08:00
Greg Hogan
e58562bcb6 plotjuggler: fix layout param (#23348)
old-commit-hash: 92b553be3e
2022-01-01 17:17:24 -08:00
Shane Smiskol
0c267f7685 PC: dynamically set PYTHONPATH from real openpilot path (#23322)
* dynamic PYTHONPATH setting based on actual openpilot location

* right above

* fix path

* absolute path all the time

* Revert "absolute path all the time"

This reverts commit c0bc2e08e76bd6c0abd36fa082ee00b4746e62dc.

* Update tools/openpilot_env.sh

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: fed7cfeef0
2021-12-31 19:34:08 -08:00
Adeeb Shihadeh
55e0fb4a55 fix setup scripts if git isn't installed
old-commit-hash: 7cd6a88638
2021-12-31 19:29:38 -08:00