Commit Graph

1564 Commits

Author SHA1 Message Date
Maxime Desroches
5658a6a9ea cabana: include optional (#32772)
optional
old-commit-hash: 3de6ee5ee3
2024-06-17 20:24:04 +00:00
Dean Lee
d1cd5f7ad6 cabana: improved error messaging (#32768)
* check user authenrication

* Update tools/cabana/streams/replaystream.cc

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 54da59c1fe
2024-06-17 12:44:31 -07:00
Dean Lee
06aed0617a cabana: avoid dead locks and improve responsiveness (#32740)
avoid dead locks and improve responsive
old-commit-hash: 865b98a5c4
2024-06-16 12:32:45 -07:00
Adeeb Shihadeh
c390a678e7 sim: remove docker script
old-commit-hash: 02ed9c584c
2024-06-16 12:20:15 -07:00
Shane Smiskol
9f50db15c0 LogReader: try zst on internal source (#32751)
* internal source list files like azure api

* messy but works

* no limit

* simpler

* clean up

* clean up

* clean up

* that's obvious

* better

* we need to unfortunately return a url, so best to take a naive approach for now

* todo

* fix

* clean up
old-commit-hash: b45caf4033
2024-06-14 01:12:19 -07:00
Shane Smiskol
644156420b LogReader: revert broken check
it returns files OR None

old-commit-hash: 68e22faa29
2024-06-14 00:30:14 -07:00
Harald Schäfer
47d5601d8a long control: new API (#32706)
* Simplify long control

* Seperate

* Rename

* Try new api for toyota

* rm v_pid everywhere

* No speed in reset

* 0 is better default

* unassigned variable

* Update other cars

* Update gm

* SIMPLIFY

* simplify more

* fix API boundry

* Fix stopping bug

* Small fixes

* Update ref
old-commit-hash: bc303df6a0
2024-06-14 00:08:58 -07:00
Dean Lee
a854878499 cabana: Fix visibility issue for a single data point in series (#32749)
Fix visibility issue for a single data point in series
old-commit-hash: 38529c5057
2024-06-13 23:38:02 -07:00
Shane Smiskol
8f402f29a3 SegmentRange: remove timestamp (#32750)
* add deprecation warning

* remove timestamp

* Update logreader.py
old-commit-hash: d5ce4b3085
2024-06-13 23:19:32 -07:00
Shane Smiskol
cd8d440c86 LogReader: support reading zst logs from Azure (#32745)
* staging api

* other stuff

* ugh this should really not be duplicated, we already check the max segnum in Route class

* better error message!!

* more better

* clean up

* clean up

* breaks again
old-commit-hash: a0bbc005b6
2024-06-13 22:43:24 -07:00
Shane Smiskol
ed80e9357a LogReader: improve error messages (#32747)
* better error messages

* clean up
old-commit-hash: 3ede1e2a7c
2024-06-13 22:37:00 -07:00
Shane Smiskol
e88cbb0162 add zstd Python library (#32731)
* add zstd

* fix

* uploader

* logreader: zst support

* caps

* only logreader
old-commit-hash: 04a93dd849
2024-06-12 21:14:23 -07:00
Dean Lee
450d012166 logreader.py: optimize event loading and sorting in _LogFileReader (#32729)
* improve logfilereader

* less changes
old-commit-hash: c64bca97ba
2024-06-12 14:20:06 -07:00
Adeeb Shihadeh
632060c0dc remove .python-version (#32714)
* remove .python-version

* no cp
old-commit-hash: ddfb31f1bf
2024-06-11 16:25:24 -07:00
Mauricio Alvarez Leon
008008b03a Update to Python 3.12 (#32548)
* 3.12

* pprofile is broken

* use modified metadrivepy3-12

* 0.3.0 metadrive

* add metadrive/commaai git dependency

* metadrive git set

* pin sounddevice 0.4.6

* datetime.utcnow() deprecation

* poetry lock

* make datetime not aware

* poetry lock

* pin pytools

* google_crc32c wheel

* unpin sounddevice

* clean metadrive

* use python crc

* mypy

* 3.12.4

* allow python3.11

* test

* no pip

* poetry

* better

* better

* merge

* remove

* try

* test

* try  this

* snok

* python

* simpler

* setuptools

* lower

* try

* try

* work?

* ubuntu deps

* ubuntu

* try

* remove

* move

* remove this

* names

* Update .github/workflows/tools_tests.yaml

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* python<4

* <3.13

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 148eaf8fa6
2024-06-11 20:45:15 +00:00
Andrei Radulescu
5ef789daf5 compressed_vipc.py fixes (#32699)
* Restored VISION_STREAM_* to original index order

* Register exit handler
old-commit-hash: 4581f6c368
2024-06-11 07:57:56 -07:00
commaci-public
0ee93c6a90 [bot] Update Python packages and pre-commit hooks (#32682)
* Update Python packages and pre-commit hooks

* fix linter

* poetry lock

---------

Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 71063d66cd
2024-06-10 17:19:01 -07:00
Hoang Bui
c34f76bc1a tools/rerun: correct reset to defined default blueprint (#32692)
old-commit-hash: 1e3d62c88a
2024-06-10 16:58:51 -07:00
Harald Schäfer
7e4edcc8d5 MSGQ refactor: cleanup outstanding issues (#32685)
* Rm sim dockerfile from bad merge

* Add watch back

* Fix watch3 compilation
old-commit-hash: 1b2bd205b8
2024-06-10 13:18:47 -07:00
Harald Schäfer
05ed3d8c15 Restructure msgq (#32652)
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a45
2024-06-09 17:44:34 -07:00
Harald Schäfer
eb2e5e335d Sim: don't need nvidia docker anymore (#32676)
Dont need nvidia docker anymore
old-commit-hash: b573a4cc48
2024-06-09 14:49:20 -07:00
Dean Lee
40de8d615f replay: add stop() function (#32673)
add stop() func
old-commit-hash: 3f84fe3557
2024-06-09 11:04:21 -07:00
Dean Lee
8bdeb04e72 cabana: fix potential dangling pointer Issue (#32672)
Fix Potential Dangling Pointer Issue
old-commit-hash: 6688d7b91c
2024-06-09 11:04:10 -07:00
Adeeb Shihadeh
8472df65ea tools/sim: remove special docker image (#32659)
old-commit-hash: 541b5cbf13
2024-06-08 09:18:28 -07:00
Harald Schäfer
f870a968e9 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
old-commit-hash: e71ec4e8d7
2024-06-06 14:31:56 -07:00
Dean Lee
958bdeda8a cabana: stop stream thread before exiting main event loop (#32634)
stop stream thread before exiting main event loop
old-commit-hash: 1d61f320a8
2024-06-05 08:49:58 -07:00
Adeeb Shihadeh
2c6829ed67 boardd is pandad (#32628)
* boardd is pandad

* rename tests
old-commit-hash: 34e329649d
2024-06-04 19:16:55 -07:00
Shane Smiskol
19d9e7ac6b revert marking some files as unexecutable (#32613)
* this is not a test

* these are not tests!
old-commit-hash: c7b3ece37e
2024-06-03 17:19:27 -07:00
Adeeb Shihadeh
86b6103657 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
old-commit-hash: c59887c810
2024-06-03 15:48:56 -07:00
Hoang Bui
10b536f73f tools/rerun: streaming to one Viewer from multiple processes (#32595)
* one spawn only

* one blueprint

* comment
old-commit-hash: f717e1e4e6
2024-06-02 21:05:15 -07:00
Hoang Bui
86e2641636 Simulator: update MetaDrive to latest (#32576)
* bump metadrive

* comment
old-commit-hash: aa081f5748
2024-05-30 11:25:21 -07:00
Dean Lee
cdea057d4b cabana: fix panda stream issues (#32537)
fix segfault
old-commit-hash: 6b3d2b5a80
2024-05-28 12:02:15 -07:00
Hoang Bui
8d51127ef7 tools/simulator: Remove superseded build script for sim docker (#32546)
* remove

* add those back
old-commit-hash: d6a738bef7
2024-05-27 09:22:41 -07:00
Adeeb Shihadeh
549bc535cd Revert no pyenv (#32547)
* Revert "`ubuntu_setup`: fix `No module apt_pkg` error when setting up (#32526)"

This reverts commit d850f07acb58e4fc6d530241a31c0917c2b6613e.

* Revert "Removal of pyenv (#32512)"

This reverts commit 41f72d5ca75aab9a9beb3181aca9f177e5a003f8.
old-commit-hash: 1eb938b8e8
2024-05-26 21:21:50 -07:00
Adeeb Shihadeh
cc4f53e6c6 manager: move to system/ (#32538)
* manager: move to system/

* one more
old-commit-hash: accdade4cf
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
f1c241361c speedup pj demo test
old-commit-hash: cd21d64058
2024-05-25 11:40:10 -07:00
Hoang Bui
60b476a5b6 CI/simulator: metadrive test starts when OP engaged and world is initialized (#32523)
* fix metadrive start time

* fix
old-commit-hash: 613f73c53f
2024-05-25 10:37:07 -07:00
Mauricio Alvarez Leon
f90655a1ff ubuntu_setup: fix No module apt_pkg error when setting up (#32526)
* no apt_pkg fix

* check arch

* fix if

* cleanup

* reorder

* increase shm size for selfdrive tests

* add comment explaining reinstall

* refine
old-commit-hash: f4322666c6
2024-05-24 21:38:23 -07:00
Mauricio Alvarez Leon
e665f05efe Removal of pyenv (#32512)
* initial removal of pyenv

* remove .python-version copy in dockerfile

* successful image build with ppa

* update prompt

* pip install scons

* apt install scons

* finally fix dockerfile to work with venv

* cleanup userflow

* increase memory to 100m

* typos

* wrong variable

* lmao
old-commit-hash: f5752121f8
2024-05-23 07:56:18 -07:00
Hoang Bui
b8fd64f3e7 CI: Drive a loop in MetaDrive (#32308)
* finish failure on crossing any line

* update

* standardize queue messages

* update control_command_gen

* fix

* fix logic

* update closing type

* update test

* update logic

* update test

* add out of lane to local

* ci arrive_dest

* pytest integration

* update ci_config

* fix ruff

* move test termination to time

* better

* better order

* curve_len

* add buffer

* cleanup

* cleanup

* cleanup

* cleanup

* out_of_lane

* cleanup

* merge tests

* run 90s

* change test name

* local out of lane detect

* out_of_lane

* static anal

* cleanup

* test_duration

* change setup_class -> setup_create_bridge

* no print state during test

* new out_of_lane detect

* cleanup print in common.py

* fix

* fix

* check distance vs time

* cleanup

* cleanup increase check time

* minimum bridge test time

* wording

* cleanup
old-commit-hash: fe9a091f11
2024-05-22 10:04:43 -07:00
Adeeb Shihadeh
64c444544f more apt dependency cleanup (#32502)
rm
old-commit-hash: 406f30add4
2024-05-21 15:40:00 -07:00
Mauricio Alvarez Leon
eca631af2d minimize ubuntu deps. needed to run build openpilot (#32492)
* minimize common deps list

* fix

* fix endline error

* add portaudio3

* add build-essential

* upload old loggerd deps

* libqt5charts5-dev

* libncurses5-dev

* libbz2-dev

* libsqlite3-dev
old-commit-hash: 1203f5eeb3
2024-05-20 20:47:53 -07:00
Adeeb Shihadeh
3358745103 ruff: enable UP
old-commit-hash: b2e4c64cf8
2024-05-20 17:43:54 -07:00
macdoos
52dbb6eae4 split out dev apt dependencies (#32476)
* init

* add more extra packages

* update Dockerfile

* cleanup

* Update Dockerfile.openpilot_base

* needed to build

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e0fa26b1a4
2024-05-20 17:35:33 -07:00
Hoang Bui
acd61af9fc CI/simulator: Fix metadrive test pyopencl.CompilerWarning (#32487)
* add pytest.mark.filterwarnings

* remove -W pyopencl.CompilerWarning

* add comment
old-commit-hash: f3f22a5698
2024-05-20 14:41:31 -07:00
Mauricio Alvarez Leon
1600939a38 deps: add rerun-sdk into pyproject.toml (#32472)
* add rerun-sdk into pyproject.toml

* install/wheel cleanup

* unpin version
old-commit-hash: bd6bea39bf
2024-05-18 17:21:04 -07:00
Adeeb Shihadeh
72b6504595 Revert "ui: single-threaded CameraView (#32291)"
This reverts commit 6adb53abf4d483e70bbe36725588a05cf75681fb.

old-commit-hash: c9531b463a
2024-05-18 16:34:03 -07:00
Adeeb Shihadeh
0585f670f1 remove libopencv-dev (#32469)
old-commit-hash: 48e24321e8
2024-05-18 14:29:49 -07:00
Hoang Bui
6c438b8902 CI: fix metadrive test (#32457)
* fix test

* this?

* fix

* this?

* deprecation warning inside

* comment
old-commit-hash: 950aeae544
2024-05-18 14:04:22 -07:00
Adeeb Shihadeh
a06c569595 remove gcc from mac_setup.sh
old-commit-hash: 3e023146d2
2024-05-17 21:06:18 -07:00