Commit Graph

1567 Commits

Author SHA1 Message Date
royjr
987b0d9e03 Ubuntu 24.04 fix setup (#32783)
* fix tk-dev

* fix missing pip

* Update tools/install_python_dependencies.sh

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-06-18 11:27:28 -07:00
Maxime Desroches
5c4ea14a3c Ubuntu 24.04 (#32624)
* noble build

* workflow

* symlink

* map only for noble

* sym

* add qt to cppcheck

* cppcheck noreturn in non void funct

* get kaitai header

* kaitai header

* syntax

* try new pyopencl

* try this version

* install lsb-core manually

* support old 20.04 lsb-core

* try arm

* try latest pyopencl

* revert

* use pocl icd

* no lock

* no arm pyopencl

* new intel opencl runtime

* pin filelock

* undo

* glsl version

* new version

* build test

* remove test

* new metadrive

* remove glsl restrictions

* <optional>

* Update .github/workflows/tools_tests.yaml

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* cache

* new cache

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-06-18 03:30:32 +00:00
Maxime Desroches
3de6ee5ee3 cabana: include optional (#32772)
optional
2024-06-17 20:24:04 +00:00
Dean Lee
54da59c1fe cabana: improved error messaging (#32768)
* check user authenrication

* Update tools/cabana/streams/replaystream.cc

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-06-17 12:44:31 -07:00
Dean Lee
865b98a5c4 cabana: avoid dead locks and improve responsiveness (#32740)
avoid dead locks and improve responsive
2024-06-16 12:32:45 -07:00
Adeeb Shihadeh
02ed9c584c sim: remove docker script 2024-06-16 12:20:15 -07:00
Shane Smiskol
b45caf4033 LogReader: try zst on internal source (#32751)
* internal source list files like azure api

* messy but works

* no limit

* simpler

* clean up

* clean up

* clean up

* that's obvious

* better

* we need to unfortunately return a url, so best to take a naive approach for now

* todo

* fix

* clean up
2024-06-14 01:12:19 -07:00
Shane Smiskol
68e22faa29 LogReader: revert broken check
it returns files OR None
2024-06-14 00:30:14 -07:00
Harald Schäfer
bc303df6a0 long control: new API (#32706)
* Simplify long control

* Seperate

* Rename

* Try new api for toyota

* rm v_pid everywhere

* No speed in reset

* 0 is better default

* unassigned variable

* Update other cars

* Update gm

* SIMPLIFY

* simplify more

* fix API boundry

* Fix stopping bug

* Small fixes

* Update ref
2024-06-14 00:08:58 -07:00
Dean Lee
38529c5057 cabana: Fix visibility issue for a single data point in series (#32749)
Fix visibility issue for a single data point in series
2024-06-13 23:38:02 -07:00
Shane Smiskol
d5ce4b3085 SegmentRange: remove timestamp (#32750)
* add deprecation warning

* remove timestamp

* Update logreader.py
2024-06-13 23:19:32 -07:00
Shane Smiskol
a0bbc005b6 LogReader: support reading zst logs from Azure (#32745)
* staging api

* other stuff

* ugh this should really not be duplicated, we already check the max segnum in Route class

* better error message!!

* more better

* clean up

* clean up

* breaks again
2024-06-13 22:43:24 -07:00
Shane Smiskol
3ede1e2a7c LogReader: improve error messages (#32747)
* better error messages

* clean up
2024-06-13 22:37:00 -07:00
Shane Smiskol
04a93dd849 add zstd Python library (#32731)
* add zstd

* fix

* uploader

* logreader: zst support

* caps

* only logreader
2024-06-12 21:14:23 -07:00
Dean Lee
c64bca97ba logreader.py: optimize event loading and sorting in _LogFileReader (#32729)
* improve logfilereader

* less changes
2024-06-12 14:20:06 -07:00
Adeeb Shihadeh
ddfb31f1bf remove .python-version (#32714)
* remove .python-version

* no cp
2024-06-11 16:25:24 -07:00
Mauricio Alvarez Leon
148eaf8fa6 Update to Python 3.12 (#32548)
* 3.12

* pprofile is broken

* use modified metadrivepy3-12

* 0.3.0 metadrive

* add metadrive/commaai git dependency

* metadrive git set

* pin sounddevice 0.4.6

* datetime.utcnow() deprecation

* poetry lock

* make datetime not aware

* poetry lock

* pin pytools

* google_crc32c wheel

* unpin sounddevice

* clean metadrive

* use python crc

* mypy

* 3.12.4

* allow python3.11

* test

* no pip

* poetry

* better

* better

* merge

* remove

* try

* test

* try  this

* snok

* python

* simpler

* setuptools

* lower

* try

* try

* work?

* ubuntu deps

* ubuntu

* try

* remove

* move

* remove this

* names

* Update .github/workflows/tools_tests.yaml

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* python<4

* <3.13

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
2024-06-11 20:45:15 +00:00
Andrei Radulescu
4581f6c368 compressed_vipc.py fixes (#32699)
* Restored VISION_STREAM_* to original index order

* Register exit handler
2024-06-11 07:57:56 -07:00
commaci-public
71063d66cd [bot] Update Python packages and pre-commit hooks (#32682)
* Update Python packages and pre-commit hooks

* fix linter

* poetry lock

---------

Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
2024-06-10 17:19:01 -07:00
Hoang Bui
1e3d62c88a tools/rerun: correct reset to defined default blueprint (#32692) 2024-06-10 16:58:51 -07:00
Harald Schäfer
1b2bd205b8 MSGQ refactor: cleanup outstanding issues (#32685)
* Rm sim dockerfile from bad merge

* Add watch back

* Fix watch3 compilation
2024-06-10 13:18:47 -07:00
Harald Schäfer
e70dc90a45 Restructure msgq (#32652)
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-06-09 17:44:34 -07:00
Harald Schäfer
b573a4cc48 Sim: don't need nvidia docker anymore (#32676)
Dont need nvidia docker anymore
2024-06-09 14:49:20 -07:00
Dean Lee
3f84fe3557 replay: add stop() function (#32673)
add stop() func
2024-06-09 11:04:21 -07:00
Dean Lee
6688d7b91c cabana: fix potential dangling pointer Issue (#32672)
Fix Potential Dangling Pointer Issue
2024-06-09 11:04:10 -07:00
Adeeb Shihadeh
541b5cbf13 tools/sim: remove special docker image (#32659) 2024-06-08 09:18:28 -07:00
Harald Schäfer
e71ec4e8d7 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
2024-06-06 14:31:56 -07:00
Dean Lee
1d61f320a8 cabana: stop stream thread before exiting main event loop (#32634)
stop stream thread before exiting main event loop
2024-06-05 08:49:58 -07:00
Adeeb Shihadeh
34e329649d boardd is pandad (#32628)
* boardd is pandad

* rename tests
2024-06-04 19:16:55 -07:00
Shane Smiskol
c7b3ece37e revert marking some files as unexecutable (#32613)
* this is not a test

* these are not tests!
2024-06-03 17:19:27 -07:00
Adeeb Shihadeh
c59887c810 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
2024-06-03 15:48:56 -07:00
Hoang Bui
f717e1e4e6 tools/rerun: streaming to one Viewer from multiple processes (#32595)
* one spawn only

* one blueprint

* comment
2024-06-02 21:05:15 -07:00
Hoang Bui
aa081f5748 Simulator: update MetaDrive to latest (#32576)
* bump metadrive

* comment
2024-05-30 11:25:21 -07:00
Dean Lee
6b3d2b5a80 cabana: fix panda stream issues (#32537)
fix segfault
2024-05-28 12:02:15 -07:00
Hoang Bui
d6a738bef7 tools/simulator: Remove superseded build script for sim docker (#32546)
* remove

* add those back
2024-05-27 09:22:41 -07:00
Adeeb Shihadeh
1eb938b8e8 Revert no pyenv (#32547)
* Revert "`ubuntu_setup`: fix `No module apt_pkg` error when setting up (#32526)"

This reverts commit f4322666c6.

* Revert "Removal of pyenv (#32512)"

This reverts commit f5752121f8.
2024-05-26 21:21:50 -07:00
Adeeb Shihadeh
accdade4cf manager: move to system/ (#32538)
* manager: move to system/

* one more
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh
cd21d64058 speedup pj demo test 2024-05-25 11:40:10 -07:00
Hoang Bui
613f73c53f CI/simulator: metadrive test starts when OP engaged and world is initialized (#32523)
* fix metadrive start time

* fix
2024-05-25 10:37:07 -07:00
Mauricio Alvarez Leon
f4322666c6 ubuntu_setup: fix No module apt_pkg error when setting up (#32526)
* no apt_pkg fix

* check arch

* fix if

* cleanup

* reorder

* increase shm size for selfdrive tests

* add comment explaining reinstall

* refine
2024-05-24 21:38:23 -07:00
Mauricio Alvarez Leon
f5752121f8 Removal of pyenv (#32512)
* initial removal of pyenv

* remove .python-version copy in dockerfile

* successful image build with ppa

* update prompt

* pip install scons

* apt install scons

* finally fix dockerfile to work with venv

* cleanup userflow

* increase memory to 100m

* typos

* wrong variable

* lmao
2024-05-23 07:56:18 -07:00
Hoang Bui
fe9a091f11 CI: Drive a loop in MetaDrive (#32308)
* finish failure on crossing any line

* update

* standardize queue messages

* update control_command_gen

* fix

* fix logic

* update closing type

* update test

* update logic

* update test

* add out of lane to local

* ci arrive_dest

* pytest integration

* update ci_config

* fix ruff

* move test termination to time

* better

* better order

* curve_len

* add buffer

* cleanup

* cleanup

* cleanup

* cleanup

* out_of_lane

* cleanup

* merge tests

* run 90s

* change test name

* local out of lane detect

* out_of_lane

* static anal

* cleanup

* test_duration

* change setup_class -> setup_create_bridge

* no print state during test

* new out_of_lane detect

* cleanup print in common.py

* fix

* fix

* check distance vs time

* cleanup

* cleanup increase check time

* minimum bridge test time

* wording

* cleanup
2024-05-22 10:04:43 -07:00
Adeeb Shihadeh
406f30add4 more apt dependency cleanup (#32502)
rm
2024-05-21 15:40:00 -07:00
Mauricio Alvarez Leon
1203f5eeb3 minimize ubuntu deps. needed to run build openpilot (#32492)
* minimize common deps list

* fix

* fix endline error

* add portaudio3

* add build-essential

* upload old loggerd deps

* libqt5charts5-dev

* libncurses5-dev

* libbz2-dev

* libsqlite3-dev
2024-05-20 20:47:53 -07:00
Adeeb Shihadeh
b2e4c64cf8 ruff: enable UP 2024-05-20 17:43:54 -07:00
macdoos
e0fa26b1a4 split out dev apt dependencies (#32476)
* init

* add more extra packages

* update Dockerfile

* cleanup

* Update Dockerfile.openpilot_base

* needed to build

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-05-20 17:35:33 -07:00
Hoang Bui
f3f22a5698 CI/simulator: Fix metadrive test pyopencl.CompilerWarning (#32487)
* add pytest.mark.filterwarnings

* remove -W pyopencl.CompilerWarning

* add comment
2024-05-20 14:41:31 -07:00
Mauricio Alvarez Leon
bd6bea39bf deps: add rerun-sdk into pyproject.toml (#32472)
* add rerun-sdk into pyproject.toml

* install/wheel cleanup

* unpin version
2024-05-18 17:21:04 -07:00
Adeeb Shihadeh
c9531b463a Revert "ui: single-threaded CameraView (#32291)"
This reverts commit dd6e2a400b.
2024-05-18 16:34:03 -07:00
Adeeb Shihadeh
48e24321e8 remove libopencv-dev (#32469) 2024-05-18 14:29:49 -07:00