Commit Graph

138 Commits

Author SHA1 Message Date
Justin Newberry
ab05bff07d CI: fix proc replay download cache permissions (#29636)
chmod that
2023-08-27 09:45:16 -07:00
Adeeb Shihadeh
d35beffbce CI: use buildjet for process replay (#29277)
* squash for pr

* backoff to 4vcpu

* review suggestions

* simplify

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
2023-08-25 18:50:21 -07:00
Dean Lee
2709cd6538 common/tests: combine multiple test binaries into one (#29623) 2023-08-25 10:35:39 -07:00
Justin Newberry
c0b9458a45 CI: move cache dir to workspace directory (#29622)
* comma dir

* mkdir

* fix issues

* test

* fix that

* fix

* do the other ones too

* missed that

* fix

* fix pr comments by moving into two different directories

* fix location

* fix that

* only change current

* fix
2023-08-25 01:41:04 -07:00
Adeeb Shihadeh
e863828051 CI: workaround syntax error in azure lib (#29618) 2023-08-24 17:18:11 -07:00
Justin Newberry
90cb417caa CI: use GITHUB_ENV for env variables (#29616)
export doesn't work across steps
2023-08-24 17:03:25 -07:00
Justin Newberry
ede9f2cda5 CI: fix docker push (#29614)
* fix those

* fix docker push too

* dont need that twice
2023-08-24 16:30:33 -07:00
Justin Newberry
3d9f238bf9 CI: use scripts for docker build (#29599)
* use scripts

* remove common

* do login in the workflow

* separate step

* cleanup

* one script is cleaner

* keep it consistent

* review suggestions

* move in ci too

* PR cleanup
2023-08-24 16:09:08 -07:00
Adeeb Shihadeh
4917e22615 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
2023-08-24 14:58:30 -07:00
Justin Newberry
da7504e1e7 CI: Normalize file permissions (#29584)
* normalize file permissions

* comment

* add comment

* remove that

* shell

* should be on the top
2023-08-23 23:50:51 -07:00
Justin Newberry
2fdde9b77d CI: switch to --cache-to type=inline for buildkit cache (#29575)
this is cleaner
2023-08-23 17:41:33 -07:00
Adeeb Shihadeh
91dc8457ae Revert Qt MOC hacks (#29528)
* Revert "CI: prevent moc from running in cache population step (#29401)"

This reverts commit d1aedccfbe.

* Revert "SCons: respect cache read only (#29437)"

This reverts commit 59abb469ea.

* don't change moc path
2023-08-22 11:16:58 -07:00
Kacper Rączy
d1aedccfbe CI: prevent moc from running in cache population step (#29401)
* Do not remove moc_files from cache

* Add cache cleanup script

* Use cache cleanup script

* Dry-run in cache population command

* Add newline

* Temporarly disable master only constraint for cache cleanup step

* Add test lines

* one more

* Fix shebang

* Remove debug lines

* Bring back master branch constraints
2023-08-22 10:47:56 -07:00
Justin Newberry
3492e80d19 CI: use xdist for car model tests (#29514)
* bump panda

* try multithreaded for car models

* need pytest-cov

* upgraded to poetry 1.5.1 and regenerated
2023-08-21 20:51:27 -07:00
Kacper Rączy
0f7be5b1e6 Setup cleanup vol. 2 (#29456)
* code from setup cleanup #29419

update ci

update ci

export variables for mac os

check env

what is in the profile script?

install pyenv the same everywhere

temporarily disable brew cache

temporarily disable brew cache

try fixing pyenv virtualenv-init

try this

inject shims path earlier

try alternate install method

switch back to brew install

try         eval "$(pyenv init --path)"

add eval "\$(pyenv init --path)"

* Add local .env file to the cache list

* Change .env paths

* debug line

* order?

* remove .env

* Add .venv to caches

---------

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
2023-08-21 13:30:48 -07:00
Dean Lee
3eef63af9b common: C++ RateKeeper (#29374)
* c++ RateKeeper

* add to files_common

* use util::random_int

* improve monotor_time

* remove ~ratekeeper
2023-08-20 21:27:02 -07:00
Adeeb Shihadeh
ff068dd722 move mypy config into pyproject.toml (#29501)
* move mypy config into pyproject.toml

* rm reference
2023-08-20 21:08:04 -07:00
Harald Schäfer
bc4b75822a update process replay timeout (#29478)
* Always dict differ

* Update selfdrive_tests.yaml

* bump up more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-08-20 17:24:33 -07:00
Justin Newberry
1944945d9d Revert "setup cleanup (#29419)" (#29451)
This reverts commit ad32816fd6.
2023-08-17 13:23:06 -07:00
Greg Hogan
ad32816fd6 setup cleanup (#29419)
* setup cleanup

* update ci

* update ci

* export variables for mac os

* check env

* what is in the profile script?

* install pyenv the same everywhere

* temporarily disable brew cache

* temporarily disable brew cache

* try fixing pyenv virtualenv-init

* try this

* inject shims path earlier

* try alternate install method

* switch back to brew install

* try         eval "$(pyenv init --path)"

* add eval "\$(pyenv init --path)"
2023-08-17 08:51:16 -07:00
Kacper Rączy
ae649ec68d macOS: fix GH actions cache (#29399)
Add lz4 and xz to dep cache exceptions
2023-08-14 16:13:35 -07:00
Adeeb Shihadeh
b11b14aff8 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
2023-08-12 17:15:16 -07:00
Adeeb Shihadeh
0ced56b2ea remove xx dependencies (#29263)
* rm xx deps

* mv that

* fix

* fix a path

* relock

* relock

* update

* update sentry

* update

* revert sentry

* Update lock

* Dummy pip package

* Not needed with poetry

* dont need dummy

---------

Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
2023-08-11 20:05:44 -07:00
Justin Newberry
2482b58968 CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
2023-08-11 17:41:23 -07:00
Justin Newberry
ace4d78e31 CI: move cache to home directory (#29347)
move cache to home dir
2023-08-11 15:45:38 -07:00
Justin Newberry
a0f399677e CI: use default caching action (#29339) 2023-08-11 14:03:10 -07:00
Adeeb Shihadeh
cd4bb412f5 CI: bump up model test timeout 2023-08-10 17:29:56 -07:00
Adeeb Shihadeh
e53f9597f3 remove rest of pylint (#29302)
* remove rest of pylint

* fix release build
2023-08-09 19:03:36 -07:00
Adeeb Shihadeh
ae8252c14a CI: move longitudinal tests into unit tests job (#29245)
* move long into unit test job

* try without these

* add that back
2023-08-07 06:48:06 -07:00
Adeeb Shihadeh
75ab960557 CI: add timeouts to selfdrive tests (#29239)
* CI: add timeouts to selfdrive tests

* ugh, so slow

* will have to come back to this one
2023-08-04 18:14:14 -07:00
Adeeb Shihadeh
f714e7cb24 CI: update cache action (#29241)
* update that

* update one more
2023-08-04 17:59:55 -07:00
Adeeb Shihadeh
0df2cd4fa8 CI: only run on master + PRs (#29242) 2023-08-04 17:56:30 -07:00
Shane Smiskol
6ad6191e6a car docs diff bot: don't ignore failures
we have a test for this, so if that fails, doesn't matter if this fails too
2023-08-02 17:18:43 -07:00
Adeeb Shihadeh
34389acbbf CI: run plotjuggler test on mac (#29102)
* CI: run plotjuggler test on mac

* source

* python path
2023-07-22 23:10:31 -07:00
Adeeb Shihadeh
a83dec9d94 CI: add docker images tagged with git commit (#29052)
* CI: add docker images tagged with git commit

* tag later

* debug

* fix tag

* test that

* cleanup
2023-07-19 23:35:33 -07:00
Adeeb Shihadeh
22882a0d22 CI: use locally built image as CL base (#29030) 2023-07-18 22:57:32 -07:00
Maxime Desroches
56a0f9e074 Force build of openpilot-base for OpenCL tests (#29022) 2023-07-18 16:25:05 -07:00
Adeeb Shihadeh
ae6f13fb50 CI: update codecov action (#28967) 2023-07-15 22:55:33 -07:00
Maxime Desroches
0ebec253d0 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit 7783dc602c.

* determinism

* fingerprint
2023-06-29 21:49:23 -07:00
Adeeb Shihadeh
7783dc602c Revert "simple fuzzing test for all processes (#28584)"
This reverts commit bac193bdd5.
2023-06-22 14:59:50 -07:00
Kacper Rączy
f7c520b0d9 macOS: re-order CI caching jobs (#28622)
Save scons cache before dependency cleanup
2023-06-21 14:01:33 -07:00
Kacper Rączy
45a6834a74 macOS: fix build issues & re-enable CI (#28258)
* Uncomment build_mac job

* Add PYCURL_CURL_CONFIG

* Acados universal binary

* Remove x86 macos references from sconscript

* Add missing include in cabana

* Update cereal

* Update workflow

* Remove unnecessary libpaths for darwin

* Add missing path to cached dirs

* Fix path in cache preparation step

* Add poetry caches to CI cache

* Compile acados with lower deployment target for CI

* Update cereal

* Pass -rpath in linker flags as scons doed not support RPATH on macos

* Use scons api instead of os

* @rpath in install name of acados dylibs

* SConstruct cleanup

* fix liblocationd tests by adding lib suffix based on platform

* Update cereal

* Update opendbc

* Update opendbc

* Add acados gitignore to release files

* Update cereal

* Update cereal

* Add scons_cache to build cache

* Add Caskroom to cache

* Fix typo

* Link all packages at once, instead of one by one

* Run cleanup stage using poetry

* Remove casks from cache

* Move scons cache to separate cache step

* Save scons cache only on master

* Remove restore-keys from save-scons-cache step

* Uncomment if conditions for scons save

* Add gcc-arm-embedded cask cache to cache

* Custom handling of gcc-arm-embedded toolchain cache

* Rename dep cache key

* Exclude .fseventsd from cache

* Fix glob pattern

* Remove .feventsd before caching

* Run mac_setup only if dependency cache-hit != true

* Update cereal to master

* Add overwrite flag to brew link

* Remove manual casadi build from mac_setup

* Remove restore-keys from dependency cache

* Remove linux requirement for casadi

* Restore restore-keys to dependency cache
2023-06-21 13:14:20 -07:00
Maxime Desroches
bac193bdd5 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
2023-06-20 10:57:02 -07:00
Adeeb Shihadeh
a1b6697629 logmessaged: handle big cloudlogs (#28553)
* logmessaged: handle big cloudlogs

* revert

* switch
2023-06-14 22:48:51 -07:00
Kacper Rączy
23de5f1bac pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh
5ec7da96a6 ci: always upload process replay ref logs 2023-03-30 12:43:08 -07:00
Adeeb Shihadeh
c97911dbad ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh
94eb215980 loggerd: move to system/ (#27534) 2023-03-08 11:20:49 -08:00
Shane Smiskol
b536b9c4c0 process replay: don't upload if diff doesn't exist (#27333)
* fail the replay, successfully print

* should still run

* debug

* outside?

* don't fail

* don't fail

* don't fail

* test

* test

* test

* try this now

* clean up, works!
2023-02-13 21:39:06 -08:00
Adeeb Shihadeh
01bdf382c4 CI: temporarily remove timeouts 2023-02-07 12:52:50 -08:00