Commit Graph

1552 Commits

Author SHA1 Message Date
Adeeb Shihadeh
ddfb31f1bf remove .python-version (#32714)
* remove .python-version

* no cp
2024-06-11 16:25:24 -07:00
Mauricio Alvarez Leon
148eaf8fa6 Update to Python 3.12 (#32548)
* 3.12

* pprofile is broken

* use modified metadrivepy3-12

* 0.3.0 metadrive

* add metadrive/commaai git dependency

* metadrive git set

* pin sounddevice 0.4.6

* datetime.utcnow() deprecation

* poetry lock

* make datetime not aware

* poetry lock

* pin pytools

* google_crc32c wheel

* unpin sounddevice

* clean metadrive

* use python crc

* mypy

* 3.12.4

* allow python3.11

* test

* no pip

* poetry

* better

* better

* merge

* remove

* try

* test

* try  this

* snok

* python

* simpler

* setuptools

* lower

* try

* try

* work?

* ubuntu deps

* ubuntu

* try

* remove

* move

* remove this

* names

* Update .github/workflows/tools_tests.yaml

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* python<4

* <3.13

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
2024-06-11 20:45:15 +00:00
Andrei Radulescu
4581f6c368 compressed_vipc.py fixes (#32699)
* Restored VISION_STREAM_* to original index order

* Register exit handler
2024-06-11 07:57:56 -07:00
commaci-public
71063d66cd [bot] Update Python packages and pre-commit hooks (#32682)
* Update Python packages and pre-commit hooks

* fix linter

* poetry lock

---------

Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
2024-06-10 17:19:01 -07:00
Hoang Bui
1e3d62c88a tools/rerun: correct reset to defined default blueprint (#32692) 2024-06-10 16:58:51 -07:00
Harald Schäfer
1b2bd205b8 MSGQ refactor: cleanup outstanding issues (#32685)
* Rm sim dockerfile from bad merge

* Add watch back

* Fix watch3 compilation
2024-06-10 13:18:47 -07:00
Harald Schäfer
e70dc90a45 Restructure msgq (#32652)
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-06-09 17:44:34 -07:00
Harald Schäfer
b573a4cc48 Sim: don't need nvidia docker anymore (#32676)
Dont need nvidia docker anymore
2024-06-09 14:49:20 -07:00
Dean Lee
3f84fe3557 replay: add stop() function (#32673)
add stop() func
2024-06-09 11:04:21 -07:00
Dean Lee
6688d7b91c cabana: fix potential dangling pointer Issue (#32672)
Fix Potential Dangling Pointer Issue
2024-06-09 11:04:10 -07:00
Adeeb Shihadeh
541b5cbf13 tools/sim: remove special docker image (#32659) 2024-06-08 09:18:28 -07:00
Harald Schäfer
e71ec4e8d7 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
2024-06-06 14:31:56 -07:00
Dean Lee
1d61f320a8 cabana: stop stream thread before exiting main event loop (#32634)
stop stream thread before exiting main event loop
2024-06-05 08:49:58 -07:00
Adeeb Shihadeh
34e329649d boardd is pandad (#32628)
* boardd is pandad

* rename tests
2024-06-04 19:16:55 -07:00
Shane Smiskol
c7b3ece37e revert marking some files as unexecutable (#32613)
* this is not a test

* these are not tests!
2024-06-03 17:19:27 -07:00
Adeeb Shihadeh
c59887c810 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
2024-06-03 15:48:56 -07:00
Hoang Bui
f717e1e4e6 tools/rerun: streaming to one Viewer from multiple processes (#32595)
* one spawn only

* one blueprint

* comment
2024-06-02 21:05:15 -07:00
Hoang Bui
aa081f5748 Simulator: update MetaDrive to latest (#32576)
* bump metadrive

* comment
2024-05-30 11:25:21 -07:00
Dean Lee
6b3d2b5a80 cabana: fix panda stream issues (#32537)
fix segfault
2024-05-28 12:02:15 -07:00
Hoang Bui
d6a738bef7 tools/simulator: Remove superseded build script for sim docker (#32546)
* remove

* add those back
2024-05-27 09:22:41 -07:00
Adeeb Shihadeh
1eb938b8e8 Revert no pyenv (#32547)
* Revert "`ubuntu_setup`: fix `No module apt_pkg` error when setting up (#32526)"

This reverts commit f4322666c6.

* Revert "Removal of pyenv (#32512)"

This reverts commit f5752121f8.
2024-05-26 21:21:50 -07:00
Adeeb Shihadeh
accdade4cf manager: move to system/ (#32538)
* manager: move to system/

* one more
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
cd21d64058 speedup pj demo test 2024-05-25 11:40:10 -07:00
Hoang Bui
613f73c53f CI/simulator: metadrive test starts when OP engaged and world is initialized (#32523)
* fix metadrive start time

* fix
2024-05-25 10:37:07 -07:00
Mauricio Alvarez Leon
f4322666c6 ubuntu_setup: fix No module apt_pkg error when setting up (#32526)
* no apt_pkg fix

* check arch

* fix if

* cleanup

* reorder

* increase shm size for selfdrive tests

* add comment explaining reinstall

* refine
2024-05-24 21:38:23 -07:00
Mauricio Alvarez Leon
f5752121f8 Removal of pyenv (#32512)
* initial removal of pyenv

* remove .python-version copy in dockerfile

* successful image build with ppa

* update prompt

* pip install scons

* apt install scons

* finally fix dockerfile to work with venv

* cleanup userflow

* increase memory to 100m

* typos

* wrong variable

* lmao
2024-05-23 07:56:18 -07:00
Hoang Bui
fe9a091f11 CI: Drive a loop in MetaDrive (#32308)
* finish failure on crossing any line

* update

* standardize queue messages

* update control_command_gen

* fix

* fix logic

* update closing type

* update test

* update logic

* update test

* add out of lane to local

* ci arrive_dest

* pytest integration

* update ci_config

* fix ruff

* move test termination to time

* better

* better order

* curve_len

* add buffer

* cleanup

* cleanup

* cleanup

* cleanup

* out_of_lane

* cleanup

* merge tests

* run 90s

* change test name

* local out of lane detect

* out_of_lane

* static anal

* cleanup

* test_duration

* change setup_class -> setup_create_bridge

* no print state during test

* new out_of_lane detect

* cleanup print in common.py

* fix

* fix

* check distance vs time

* cleanup

* cleanup increase check time

* minimum bridge test time

* wording

* cleanup
2024-05-22 10:04:43 -07:00
Adeeb Shihadeh
406f30add4 more apt dependency cleanup (#32502)
rm
2024-05-21 15:40:00 -07:00
Mauricio Alvarez Leon
1203f5eeb3 minimize ubuntu deps. needed to run build openpilot (#32492)
* minimize common deps list

* fix

* fix endline error

* add portaudio3

* add build-essential

* upload old loggerd deps

* libqt5charts5-dev

* libncurses5-dev

* libbz2-dev

* libsqlite3-dev
2024-05-20 20:47:53 -07:00
Adeeb Shihadeh
b2e4c64cf8 ruff: enable UP 2024-05-20 17:43:54 -07:00
macdoos
e0fa26b1a4 split out dev apt dependencies (#32476)
* init

* add more extra packages

* update Dockerfile

* cleanup

* Update Dockerfile.openpilot_base

* needed to build

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-05-20 17:35:33 -07:00
Hoang Bui
f3f22a5698 CI/simulator: Fix metadrive test pyopencl.CompilerWarning (#32487)
* add pytest.mark.filterwarnings

* remove -W pyopencl.CompilerWarning

* add comment
2024-05-20 14:41:31 -07:00
Mauricio Alvarez Leon
bd6bea39bf deps: add rerun-sdk into pyproject.toml (#32472)
* add rerun-sdk into pyproject.toml

* install/wheel cleanup

* unpin version
2024-05-18 17:21:04 -07:00
Adeeb Shihadeh
c9531b463a Revert "ui: single-threaded CameraView (#32291)"
This reverts commit dd6e2a400b.
2024-05-18 16:34:03 -07:00
Adeeb Shihadeh
48e24321e8 remove libopencv-dev (#32469) 2024-05-18 14:29:49 -07:00
Hoang Bui
950aeae544 CI: fix metadrive test (#32457)
* fix test

* this?

* fix

* this?

* deprecation warning inside

* comment
2024-05-18 14:04:22 -07:00
Adeeb Shihadeh
3e023146d2 remove gcc from mac_setup.sh 2024-05-17 21:06:18 -07:00
Dean Lee
dd6e2a400b ui: single-threaded CameraView (#32291)
single thread cameraview
2024-05-17 20:18:41 -07:00
Adeeb Shihadeh
52acae5797 remove dead webcam dockerfile 2024-05-17 20:00:10 -07:00
Hoang Bui
630e152900 Simulator: standardize queue messages (#32313)
* standardize queue messages

* update control_command_gen

* fix

* fix logic

* update closing type

* qmessagetype -> enum

* update type hint

* old close() makes more sense

* cleanup

* fix

* revert that

* revert that

* better name

* actually this is better
2024-05-17 19:51:07 -07:00
Adeeb Shihadeh
e1a697fee5 remove old valgrind replay test 2024-05-17 19:43:47 -07:00
cl0cks4fe
dd9d5d4528 Unittest to pytest (#32366)
* add pytest-asyncio

* switch common

* switch selfdrive

* switch system

* switch tools

* small fixes

* fix setUp and valgrind pytest

* switch to setup

* fix random

* switch mock

* switch test_lateral_limits

* revert test_ui

* fix poetry.lock

* add unittest to banned-api

* add inline ignores to remaining unittest imports

* revert test_models

* revert check_can_parser_performance

* one more skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-05-17 11:01:44 -07:00
Greg Hogan
2a46d71fc8 logreader: skip internal source if connection refused (#32418)
* logreader: skip internal source if connection refused

* fix indentation

* fix spacing

* explicit ipv4 and tcp
2024-05-13 16:02:28 -07:00
Adeeb Shihadeh
1c481c5ad3 rerun.io proof of concept (#32416)
* Adding demo version for acceleration only

* Adding, plot any event

* Adding dynamic blueprint creation and menu to choose what to plot

* Adding, pool of processes for faster data visualization

* Adding, install rerun if not present

* Adding. thumbnail support

* Refactoring, minor cleanup

* -Use rerun pre-release
-Remove json as a middle format
-Replace recursion with stack-based approach

* Refactoring, using services from cereal instead of hardcoding them

* Use of lr.run_across_segments instead of pool,
Use of python dict instead of capnp objs - better performance
Use LogReader syntax

* Enable logging of liveTracks, pandaStates

* Use of plotjuggler user experience

* Fixing bug in log_msg function

* cleanup

---------

Co-authored-by: savojovic <jovo.savic00@gmail.com>
Co-authored-by: savojovic <74861870+savojovic@users.noreply.github.com>
2024-05-13 15:04:37 -07:00
Julio Salamanca
6aa17ab10a Remove qlog param from demo example (#32406)
Remove qlog param from demo instructions

qlog param was removed in this commit

d7e7659852
2024-05-12 17:00:17 -07:00
Shane Smiskol
b895095031 Cleanup auto_fingerprints.py (#32377)
* messyyy

* super clean car wash

* rm
2024-05-08 15:58:27 -07:00
Dean Lee
b551e7c1a2 cabana: Implement Remote Route Browsing Feature (#32332)
browse remote routes
2024-05-07 19:59:30 -07:00
Shane Smiskol
f597d63bf6 PlatformConfig: clean up and print all flags (#32369)
* script to print flags

* don't need

* SAL

* back

* fix
2024-05-07 15:00:02 -07:00
Adeeb Shihadeh
f93b139098 remove tools/zookeeper/ 2024-05-06 20:01:15 -07:00
Adeeb Shihadeh
1de6428896 remove foxglove, rerun is the future 2024-05-06 16:29:23 -07:00