Commit Graph

1554 Commits

Author SHA1 Message Date
Shane Smiskol
ed80e9357a LogReader: improve error messages (#32747)
* better error messages

* clean up
old-commit-hash: 3ede1e2a7c850622beef2549315f320aa018105a
2024-06-13 22:37:00 -07:00
Shane Smiskol
e88cbb0162 add zstd Python library (#32731)
* add zstd

* fix

* uploader

* logreader: zst support

* caps

* only logreader
old-commit-hash: 04a93dd849461df7a3496706c6172d95e83149c9
2024-06-12 21:14:23 -07:00
Dean Lee
450d012166 logreader.py: optimize event loading and sorting in _LogFileReader (#32729)
* improve logfilereader

* less changes
old-commit-hash: c64bca97bac68462a63b47d33aedf869d21ac97e
2024-06-12 14:20:06 -07:00
Adeeb Shihadeh
632060c0dc remove .python-version (#32714)
* remove .python-version

* no cp
old-commit-hash: ddfb31f1bfa241aee1c250f5da5f2d364c51f610
2024-06-11 16:25:24 -07:00
Mauricio Alvarez Leon
008008b03a Update to Python 3.12 (#32548)
* 3.12

* pprofile is broken

* use modified metadrivepy3-12

* 0.3.0 metadrive

* add metadrive/commaai git dependency

* metadrive git set

* pin sounddevice 0.4.6

* datetime.utcnow() deprecation

* poetry lock

* make datetime not aware

* poetry lock

* pin pytools

* google_crc32c wheel

* unpin sounddevice

* clean metadrive

* use python crc

* mypy

* 3.12.4

* allow python3.11

* test

* no pip

* poetry

* better

* better

* merge

* remove

* try

* test

* try  this

* snok

* python

* simpler

* setuptools

* lower

* try

* try

* work?

* ubuntu deps

* ubuntu

* try

* remove

* move

* remove this

* names

* Update .github/workflows/tools_tests.yaml

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* python<4

* <3.13

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 148eaf8fa6c9b23cdd346e926f58fad61f79ff1d
2024-06-11 20:45:15 +00:00
Andrei Radulescu
5ef789daf5 compressed_vipc.py fixes (#32699)
* Restored VISION_STREAM_* to original index order

* Register exit handler
old-commit-hash: 4581f6c36812c535b3e63b258296ed920fb486e6
2024-06-11 07:57:56 -07:00
commaci-public
0ee93c6a90 [bot] Update Python packages and pre-commit hooks (#32682)
* Update Python packages and pre-commit hooks

* fix linter

* poetry lock

---------

Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 71063d66cd526bf1e498618e1aec3440736ab5b7
2024-06-10 17:19:01 -07:00
Hoang Bui
c34f76bc1a tools/rerun: correct reset to defined default blueprint (#32692)
old-commit-hash: 1e3d62c88a9805de6799f742ca4998b36b5e51e8
2024-06-10 16:58:51 -07:00
Harald Schäfer
7e4edcc8d5 MSGQ refactor: cleanup outstanding issues (#32685)
* Rm sim dockerfile from bad merge

* Add watch back

* Fix watch3 compilation
old-commit-hash: 1b2bd205b81bb473bbe176b58250fe038963d1f6
2024-06-10 13:18:47 -07:00
Harald Schäfer
05ed3d8c15 Restructure msgq (#32652)
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a452e7c045d9a207f3680d846406ef789
2024-06-09 17:44:34 -07:00
Harald Schäfer
eb2e5e335d Sim: don't need nvidia docker anymore (#32676)
Dont need nvidia docker anymore
old-commit-hash: b573a4cc48e4508a37f01a800b09b1fa8895d367
2024-06-09 14:49:20 -07:00
Dean Lee
40de8d615f replay: add stop() function (#32673)
add stop() func
old-commit-hash: 3f84fe3557099ba74895241e8f4059b1001cd6ec
2024-06-09 11:04:21 -07:00
Dean Lee
8bdeb04e72 cabana: fix potential dangling pointer Issue (#32672)
Fix Potential Dangling Pointer Issue
old-commit-hash: 6688d7b91c2ee6fad93d292edc0661a4522e9b10
2024-06-09 11:04:10 -07:00
Adeeb Shihadeh
8472df65ea tools/sim: remove special docker image (#32659)
old-commit-hash: 541b5cbf1387df07e76da55d3e332170d9e756f0
2024-06-08 09:18:28 -07:00
Harald Schäfer
f870a968e9 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
old-commit-hash: e71ec4e8d7e39a56235f590227e7cb361cd8b79d
2024-06-06 14:31:56 -07:00
Dean Lee
958bdeda8a cabana: stop stream thread before exiting main event loop (#32634)
stop stream thread before exiting main event loop
old-commit-hash: 1d61f320a8dafc067efdf3dcc68653c8fc5dee60
2024-06-05 08:49:58 -07:00
Adeeb Shihadeh
2c6829ed67 boardd is pandad (#32628)
* boardd is pandad

* rename tests
old-commit-hash: 34e329649d7a388d4cd1f25dac9dda9d5409bf4a
2024-06-04 19:16:55 -07:00
Shane Smiskol
19d9e7ac6b revert marking some files as unexecutable (#32613)
* this is not a test

* these are not tests!
old-commit-hash: c7b3ece37ef4445bcc18403b6a9e0217db4abd96
2024-06-03 17:19:27 -07:00
Adeeb Shihadeh
86b6103657 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
old-commit-hash: c59887c8109dd8d33ea2e7169995184fbe38cc3a
2024-06-03 15:48:56 -07:00
Hoang Bui
10b536f73f tools/rerun: streaming to one Viewer from multiple processes (#32595)
* one spawn only

* one blueprint

* comment
old-commit-hash: f717e1e4e6cd8dbc787d2b8260a6635dda23dc16
2024-06-02 21:05:15 -07:00
Hoang Bui
86e2641636 Simulator: update MetaDrive to latest (#32576)
* bump metadrive

* comment
old-commit-hash: aa081f574833bcb1db4c234b9ee3d5bcd303a6de
2024-05-30 11:25:21 -07:00
Dean Lee
cdea057d4b cabana: fix panda stream issues (#32537)
fix segfault
old-commit-hash: 6b3d2b5a80c61e83a925ff28cc2394f9a9c0a996
2024-05-28 12:02:15 -07:00
Hoang Bui
8d51127ef7 tools/simulator: Remove superseded build script for sim docker (#32546)
* remove

* add those back
old-commit-hash: d6a738bef7b8d8cfacfe8f7edf9fc01ba435f05a
2024-05-27 09:22:41 -07:00
Adeeb Shihadeh
549bc535cd Revert no pyenv (#32547)
* Revert "`ubuntu_setup`: fix `No module apt_pkg` error when setting up (#32526)"

This reverts commit d850f07acb58e4fc6d530241a31c0917c2b6613e.

* Revert "Removal of pyenv (#32512)"

This reverts commit 41f72d5ca75aab9a9beb3181aca9f177e5a003f8.
old-commit-hash: 1eb938b8e81a3321adf1064e8ef348b8c7073d4c
2024-05-26 21:21:50 -07:00
Adeeb Shihadeh
cc4f53e6c6 manager: move to system/ (#32538)
* manager: move to system/

* one more
old-commit-hash: accdade4cfe73cdca41f5afa73cf4ad085802930
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
f1c241361c speedup pj demo test
old-commit-hash: cd21d64058d161614b7504f344e8a26df28240c2
2024-05-25 11:40:10 -07:00
Hoang Bui
60b476a5b6 CI/simulator: metadrive test starts when OP engaged and world is initialized (#32523)
* fix metadrive start time

* fix
old-commit-hash: 613f73c53fa1cd3525a0cb3af0615783bd213fd0
2024-05-25 10:37:07 -07:00
Mauricio Alvarez Leon
f90655a1ff ubuntu_setup: fix No module apt_pkg error when setting up (#32526)
* no apt_pkg fix

* check arch

* fix if

* cleanup

* reorder

* increase shm size for selfdrive tests

* add comment explaining reinstall

* refine
old-commit-hash: f4322666c6adc4dd2da569f483f6e108f18fe32a
2024-05-24 21:38:23 -07:00
Mauricio Alvarez Leon
e665f05efe Removal of pyenv (#32512)
* initial removal of pyenv

* remove .python-version copy in dockerfile

* successful image build with ppa

* update prompt

* pip install scons

* apt install scons

* finally fix dockerfile to work with venv

* cleanup userflow

* increase memory to 100m

* typos

* wrong variable

* lmao
old-commit-hash: f5752121f8a2029050c63cfa04f2533901ae4f3a
2024-05-23 07:56:18 -07:00
Hoang Bui
b8fd64f3e7 CI: Drive a loop in MetaDrive (#32308)
* finish failure on crossing any line

* update

* standardize queue messages

* update control_command_gen

* fix

* fix logic

* update closing type

* update test

* update logic

* update test

* add out of lane to local

* ci arrive_dest

* pytest integration

* update ci_config

* fix ruff

* move test termination to time

* better

* better order

* curve_len

* add buffer

* cleanup

* cleanup

* cleanup

* cleanup

* out_of_lane

* cleanup

* merge tests

* run 90s

* change test name

* local out of lane detect

* out_of_lane

* static anal

* cleanup

* test_duration

* change setup_class -> setup_create_bridge

* no print state during test

* new out_of_lane detect

* cleanup print in common.py

* fix

* fix

* check distance vs time

* cleanup

* cleanup increase check time

* minimum bridge test time

* wording

* cleanup
old-commit-hash: fe9a091f116dc0c3bb55d35b31512866663af6af
2024-05-22 10:04:43 -07:00
Adeeb Shihadeh
64c444544f more apt dependency cleanup (#32502)
rm
old-commit-hash: 406f30add493006b99569bfbf49562e3192038cc
2024-05-21 15:40:00 -07:00
Mauricio Alvarez Leon
eca631af2d minimize ubuntu deps. needed to run build openpilot (#32492)
* minimize common deps list

* fix

* fix endline error

* add portaudio3

* add build-essential

* upload old loggerd deps

* libqt5charts5-dev

* libncurses5-dev

* libbz2-dev

* libsqlite3-dev
old-commit-hash: 1203f5eeb363f4ccdf149d6fa1c32380c0c90027
2024-05-20 20:47:53 -07:00
Adeeb Shihadeh
3358745103 ruff: enable UP
old-commit-hash: b2e4c64cf8fe3256d1e411e8715c29e2eb6f4f00
2024-05-20 17:43:54 -07:00
macdoos
52dbb6eae4 split out dev apt dependencies (#32476)
* init

* add more extra packages

* update Dockerfile

* cleanup

* Update Dockerfile.openpilot_base

* needed to build

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e0fa26b1a44bf54388392d54c8437459d870d78c
2024-05-20 17:35:33 -07:00
Hoang Bui
acd61af9fc CI/simulator: Fix metadrive test pyopencl.CompilerWarning (#32487)
* add pytest.mark.filterwarnings

* remove -W pyopencl.CompilerWarning

* add comment
old-commit-hash: f3f22a56980d7a3fb2cd7c07fec8ac0e9e376a38
2024-05-20 14:41:31 -07:00
Mauricio Alvarez Leon
1600939a38 deps: add rerun-sdk into pyproject.toml (#32472)
* add rerun-sdk into pyproject.toml

* install/wheel cleanup

* unpin version
old-commit-hash: bd6bea39bf9ff61ac0c5e942e929d12851c5c4b7
2024-05-18 17:21:04 -07:00
Adeeb Shihadeh
72b6504595 Revert "ui: single-threaded CameraView (#32291)"
This reverts commit 6adb53abf4d483e70bbe36725588a05cf75681fb.

old-commit-hash: c9531b463a6cb4a2a56792046fd69f9041006d81
2024-05-18 16:34:03 -07:00
Adeeb Shihadeh
0585f670f1 remove libopencv-dev (#32469)
old-commit-hash: 48e24321e814b4b8a805276a0adb3ea2ca19d2f8
2024-05-18 14:29:49 -07:00
Hoang Bui
6c438b8902 CI: fix metadrive test (#32457)
* fix test

* this?

* fix

* this?

* deprecation warning inside

* comment
old-commit-hash: 950aeae5443123e59177444d06a7654a41504373
2024-05-18 14:04:22 -07:00
Adeeb Shihadeh
a06c569595 remove gcc from mac_setup.sh
old-commit-hash: 3e023146d24364daf0a40311b3fe366e7bcd36cd
2024-05-17 21:06:18 -07:00
Dean Lee
4bade99d62 ui: single-threaded CameraView (#32291)
single thread cameraview
old-commit-hash: dd6e2a400b1b9543fad0c3c4a78463abf756da6b
2024-05-17 20:18:41 -07:00
Adeeb Shihadeh
678e05be08 remove dead webcam dockerfile
old-commit-hash: 52acae579763a15510b6788b31c22de975d54271
2024-05-17 20:00:10 -07:00
Hoang Bui
565e06b66a Simulator: standardize queue messages (#32313)
* standardize queue messages

* update control_command_gen

* fix

* fix logic

* update closing type

* qmessagetype -> enum

* update type hint

* old close() makes more sense

* cleanup

* fix

* revert that

* revert that

* better name

* actually this is better
old-commit-hash: 630e1529008ce0c996ba6a111df44877596acfea
2024-05-17 19:51:07 -07:00
Adeeb Shihadeh
eaa6fe2510 remove old valgrind replay test
old-commit-hash: e1a697fee521eedad2210d8e01d668e2bb020ace
2024-05-17 19:43:47 -07:00
cl0cks4fe
639a634f7c Unittest to pytest (#32366)
* add pytest-asyncio

* switch common

* switch selfdrive

* switch system

* switch tools

* small fixes

* fix setUp and valgrind pytest

* switch to setup

* fix random

* switch mock

* switch test_lateral_limits

* revert test_ui

* fix poetry.lock

* add unittest to banned-api

* add inline ignores to remaining unittest imports

* revert test_models

* revert check_can_parser_performance

* one more skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528ff0a61c7699abc1b63ba8fd282632f
2024-05-17 11:01:44 -07:00
Greg Hogan
a17639bddb logreader: skip internal source if connection refused (#32418)
* logreader: skip internal source if connection refused

* fix indentation

* fix spacing

* explicit ipv4 and tcp
old-commit-hash: 2a46d71fc885201d88ca63bc52d26ef715545a23
2024-05-13 16:02:28 -07:00
Adeeb Shihadeh
6e0d84d829 rerun.io proof of concept (#32416)
* Adding demo version for acceleration only

* Adding, plot any event

* Adding dynamic blueprint creation and menu to choose what to plot

* Adding, pool of processes for faster data visualization

* Adding, install rerun if not present

* Adding. thumbnail support

* Refactoring, minor cleanup

* -Use rerun pre-release
-Remove json as a middle format
-Replace recursion with stack-based approach

* Refactoring, using services from cereal instead of hardcoding them

* Use of lr.run_across_segments instead of pool,
Use of python dict instead of capnp objs - better performance
Use LogReader syntax

* Enable logging of liveTracks, pandaStates

* Use of plotjuggler user experience

* Fixing bug in log_msg function

* cleanup

---------

Co-authored-by: savojovic <jovo.savic00@gmail.com>
Co-authored-by: savojovic <74861870+savojovic@users.noreply.github.com>
old-commit-hash: 1c481c5ad32bc6c643ff7bd193b39f207e2acdf7
2024-05-13 15:04:37 -07:00
Julio Salamanca
190fec65f4 Remove qlog param from demo example (#32406)
Remove qlog param from demo instructions

qlog param was removed in this commit

fae2400f40
old-commit-hash: 6aa17ab10a182fac671b9aaef3d4ac0aebb24af2
2024-05-12 17:00:17 -07:00
Shane Smiskol
bd843cc5e7 Cleanup auto_fingerprints.py (#32377)
* messyyy

* super clean car wash

* rm
old-commit-hash: b895095031918dd092061481a9212acda5368c8f
2024-05-08 15:58:27 -07:00
Dean Lee
a2226ad906 cabana: Implement Remote Route Browsing Feature (#32332)
browse remote routes
old-commit-hash: b551e7c1a2d913b18752a45857c4675191eb4419
2024-05-07 19:59:30 -07:00