Commit Graph

130 Commits

Author SHA1 Message Date
Adeeb Shihadeh
61cf541322 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
old-commit-hash: 4917e22615adbfcc9b3c3ec89b00d240e0b48883
2023-08-24 14:58:30 -07:00
Justin Newberry
de7257c22c CI: Normalize file permissions (#29584)
* normalize file permissions

* comment

* add comment

* remove that

* shell

* should be on the top
old-commit-hash: da7504e1e72ac09063901361377a64ec074efe8f
2023-08-23 23:50:51 -07:00
Justin Newberry
7a532e02f3 CI: switch to --cache-to type=inline for buildkit cache (#29575)
this is cleaner
old-commit-hash: 2fdde9b77d5d830277500d6841f32a356544718a
2023-08-23 17:41:33 -07:00
Adeeb Shihadeh
b38403f2ca Revert Qt MOC hacks (#29528)
* Revert "CI: prevent moc from running in cache population step (#29401)"

This reverts commit 34634b95aa15dc608315016c40857f3e16ca4ff9.

* Revert "SCons: respect cache read only (#29437)"

This reverts commit 77cb4da6381fdf94ea98c55d6fcc30db4d24dcf6.

* don't change moc path
old-commit-hash: 91dc8457ae8e9b188c8fe613be5b3aa2e86be276
2023-08-22 11:16:58 -07:00
Kacper Rączy
0c17a4f4d0 CI: prevent moc from running in cache population step (#29401)
* Do not remove moc_files from cache

* Add cache cleanup script

* Use cache cleanup script

* Dry-run in cache population command

* Add newline

* Temporarly disable master only constraint for cache cleanup step

* Add test lines

* one more

* Fix shebang

* Remove debug lines

* Bring back master branch constraints
old-commit-hash: d1aedccfbe3cb880ad54adea578f91c04857d81b
2023-08-22 10:47:56 -07:00
Justin Newberry
3e6ce7d6cd CI: use xdist for car model tests (#29514)
* bump panda

* try multithreaded for car models

* need pytest-cov

* upgraded to poetry 1.5.1 and regenerated
old-commit-hash: 3492e80d19a4395d9481076c916f9ab96a8fb004
2023-08-21 20:51:27 -07:00
Kacper Rączy
1d47429f8e Setup cleanup vol. 2 (#29456)
* code from setup cleanup #29419

update ci

update ci

export variables for mac os

check env

what is in the profile script?

install pyenv the same everywhere

temporarily disable brew cache

temporarily disable brew cache

try fixing pyenv virtualenv-init

try this

inject shims path earlier

try alternate install method

switch back to brew install

try         eval "$(pyenv init --path)"

add eval "\$(pyenv init --path)"

* Add local .env file to the cache list

* Change .env paths

* debug line

* order?

* remove .env

* Add .venv to caches

---------

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
old-commit-hash: 0f7be5b1e6efa04c59ce2a45afacd650b2e4d417
2023-08-21 13:30:48 -07:00
Dean Lee
97631ec362 common: C++ RateKeeper (#29374)
* c++ RateKeeper

* add to files_common

* use util::random_int

* improve monotor_time

* remove ~ratekeeper
old-commit-hash: 3eef63af9b4f4a25bc4c3a0d6ad450bba9f62205
2023-08-20 21:27:02 -07:00
Adeeb Shihadeh
bd27be2b78 move mypy config into pyproject.toml (#29501)
* move mypy config into pyproject.toml

* rm reference
old-commit-hash: ff068dd722b31078b9356d3f55e4898cf00a89cb
2023-08-20 21:08:04 -07:00
Harald Schäfer
3022f06e1e update process replay timeout (#29478)
* Always dict differ

* Update selfdrive_tests.yaml

* bump up more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: bc4b75822a609e6897058bc83688c84004f29093
2023-08-20 17:24:33 -07:00
Justin Newberry
1988b4805e Revert "setup cleanup (#29419)" (#29451)
This reverts commit bc9c60a3f955bb5b96dc41e6072cab47191f8896.
old-commit-hash: 1944945d9dfee6f42a875b119a5cf60daf8ade09
2023-08-17 13:23:06 -07:00
Greg Hogan
cce2c732c6 setup cleanup (#29419)
* setup cleanup

* update ci

* update ci

* export variables for mac os

* check env

* what is in the profile script?

* install pyenv the same everywhere

* temporarily disable brew cache

* temporarily disable brew cache

* try fixing pyenv virtualenv-init

* try this

* inject shims path earlier

* try alternate install method

* switch back to brew install

* try         eval "$(pyenv init --path)"

* add eval "\$(pyenv init --path)"
old-commit-hash: ad32816fd6bdd744e7f596209822707494d3ba5e
2023-08-17 08:51:16 -07:00
Kacper Rączy
4096be66e4 macOS: fix GH actions cache (#29399)
Add lz4 and xz to dep cache exceptions
old-commit-hash: ae649ec68d670cb2d90773906665695807e4dc2e
2023-08-14 16:13:35 -07:00
Adeeb Shihadeh
e76af64065 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
old-commit-hash: b11b14aff86a4c993bf5342ee37af169788c9026
2023-08-12 17:15:16 -07:00
Adeeb Shihadeh
b3f734283d remove xx dependencies (#29263)
* rm xx deps

* mv that

* fix

* fix a path

* relock

* relock

* update

* update sentry

* update

* revert sentry

* Update lock

* Dummy pip package

* Not needed with poetry

* dont need dummy

---------

Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
old-commit-hash: 0ced56b2ea7e0800f309c4e77d9a78bb90d89fb6
2023-08-11 20:05:44 -07:00
Justin Newberry
20f6a25a1c CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
old-commit-hash: 2482b58968df1faa509a9043b71d164353284146
2023-08-11 17:41:23 -07:00
Justin Newberry
afa33bee18 CI: move cache to home directory (#29347)
move cache to home dir
old-commit-hash: ace4d78e315f48655808e038c96c35b89096b654
2023-08-11 15:45:38 -07:00
Justin Newberry
f8cd844e7c CI: use default caching action (#29339)
old-commit-hash: a0f399677e365a2b7c9913c76ca72b1a22814825
2023-08-11 14:03:10 -07:00
Adeeb Shihadeh
2e818c2393 CI: bump up model test timeout
old-commit-hash: cd4bb412f5a6ecbf150b464ea2597943de12d208
2023-08-10 17:29:56 -07:00
Adeeb Shihadeh
442ec436dd remove rest of pylint (#29302)
* remove rest of pylint

* fix release build
old-commit-hash: e53f9597f3ee711ed21dcba7d2ba1a74c654cf81
2023-08-09 19:03:36 -07:00
Adeeb Shihadeh
d704b0318a CI: move longitudinal tests into unit tests job (#29245)
* move long into unit test job

* try without these

* add that back
old-commit-hash: ae8252c14a87181c9da10bab7e2df64a592987a6
2023-08-07 06:48:06 -07:00
Adeeb Shihadeh
de743e3ec4 CI: add timeouts to selfdrive tests (#29239)
* CI: add timeouts to selfdrive tests

* ugh, so slow

* will have to come back to this one
old-commit-hash: 75ab960557b772add9cf8f484ed330ad7774de0e
2023-08-04 18:14:14 -07:00
Adeeb Shihadeh
4b96635560 CI: update cache action (#29241)
* update that

* update one more
old-commit-hash: f714e7cb24517145b83bb01aa49da9b56ee8563a
2023-08-04 17:59:55 -07:00
Adeeb Shihadeh
ca5d92a1a1 CI: only run on master + PRs (#29242)
old-commit-hash: 0df2cd4fa873636b24407ebe5522fb3ba056e866
2023-08-04 17:56:30 -07:00
Shane Smiskol
ffd534fdc3 car docs diff bot: don't ignore failures
we have a test for this, so if that fails, doesn't matter if this fails too

old-commit-hash: 6ad6191e6a909445ea2ec2f5e192d6ca4e88ffd9
2023-08-02 17:18:43 -07:00
Adeeb Shihadeh
9f7fa18b7b CI: run plotjuggler test on mac (#29102)
* CI: run plotjuggler test on mac

* source

* python path
old-commit-hash: 34389acbbfdd5ab6e58e40c0819f986552f22a59
2023-07-22 23:10:31 -07:00
Adeeb Shihadeh
e56ac872e1 CI: add docker images tagged with git commit (#29052)
* CI: add docker images tagged with git commit

* tag later

* debug

* fix tag

* test that

* cleanup
old-commit-hash: a83dec9d9441a0ad768494d046b5782d04fdbfc1
2023-07-19 23:35:33 -07:00
Adeeb Shihadeh
e9648cf860 CI: use locally built image as CL base (#29030)
old-commit-hash: 22882a0d227d3b817da66ac1bbd08b4986ca42bd
2023-07-18 22:57:32 -07:00
Maxime Desroches
4aaceac124 Force build of openpilot-base for OpenCL tests (#29022)
old-commit-hash: 56a0f9e07414645ea54429a365a5557b1f143d7f
2023-07-18 16:25:05 -07:00
Adeeb Shihadeh
4dec8811e0 CI: update codecov action (#28967)
old-commit-hash: ae6f13fb503b4d8feece88df61378c282a6ea9a6
2023-07-15 22:55:33 -07:00
Maxime Desroches
1693786962 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit a5be0640a3780156fdd5c04c1e6204fa41b307a8.

* determinism

* fingerprint
old-commit-hash: 0ebec253d0443144f71f523118f6fadc93cf1eeb
2023-06-29 21:49:23 -07:00
Adeeb Shihadeh
ffcc2e4c61 Revert "simple fuzzing test for all processes (#28584)"
This reverts commit 0e98836e857583849aa4e960b097103a4aeb863d.

old-commit-hash: 7783dc602cc478d41918dd8fda2cd87ebf4069d1
2023-06-22 14:59:50 -07:00
Kacper Rączy
b82a7a8da8 macOS: re-order CI caching jobs (#28622)
Save scons cache before dependency cleanup
old-commit-hash: f7c520b0d92c25570b88424de58e9e05cf79d7ef
2023-06-21 14:01:33 -07:00
Kacper Rączy
b1eb066965 macOS: fix build issues & re-enable CI (#28258)
* Uncomment build_mac job

* Add PYCURL_CURL_CONFIG

* Acados universal binary

* Remove x86 macos references from sconscript

* Add missing include in cabana

* Update cereal

* Update workflow

* Remove unnecessary libpaths for darwin

* Add missing path to cached dirs

* Fix path in cache preparation step

* Add poetry caches to CI cache

* Compile acados with lower deployment target for CI

* Update cereal

* Pass -rpath in linker flags as scons doed not support RPATH on macos

* Use scons api instead of os

* @rpath in install name of acados dylibs

* SConstruct cleanup

* fix liblocationd tests by adding lib suffix based on platform

* Update cereal

* Update opendbc

* Update opendbc

* Add acados gitignore to release files

* Update cereal

* Update cereal

* Add scons_cache to build cache

* Add Caskroom to cache

* Fix typo

* Link all packages at once, instead of one by one

* Run cleanup stage using poetry

* Remove casks from cache

* Move scons cache to separate cache step

* Save scons cache only on master

* Remove restore-keys from save-scons-cache step

* Uncomment if conditions for scons save

* Add gcc-arm-embedded cask cache to cache

* Custom handling of gcc-arm-embedded toolchain cache

* Rename dep cache key

* Exclude .fseventsd from cache

* Fix glob pattern

* Remove .feventsd before caching

* Run mac_setup only if dependency cache-hit != true

* Update cereal to master

* Add overwrite flag to brew link

* Remove manual casadi build from mac_setup

* Remove restore-keys from dependency cache

* Remove linux requirement for casadi

* Restore restore-keys to dependency cache
old-commit-hash: 45a6834a744e13833e702ed6eb3c5483391cf899
2023-06-21 13:14:20 -07:00
Maxime Desroches
7be2b51229 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
old-commit-hash: bac193bdd518a260bfbbdb4893520c4263ab2be6
2023-06-20 10:57:02 -07:00
Adeeb Shihadeh
4aa12c2864 logmessaged: handle big cloudlogs (#28553)
* logmessaged: handle big cloudlogs

* revert

* switch
old-commit-hash: a1b6697629912ed4432a222f2cdb451f1dbc576a
2023-06-14 22:48:51 -07:00
Kacper Rączy
3ead794728 pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
old-commit-hash: 23de5f1bace7bae9bb89fc426df9f162ef598667
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh
c576ab8b97 ci: always upload process replay ref logs
old-commit-hash: 5ec7da96a60fd7712a9f7c8c5e53e0104204becc
2023-03-30 12:43:08 -07:00
Adeeb Shihadeh
de9a100719 ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
old-commit-hash: c97911dbad15c3cc7dc577b305ab9aed775e021f
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh
3a968c67e1 loggerd: move to system/ (#27534)
old-commit-hash: 94eb2159802d3dba99620db0b08731c68a7e4733
2023-03-08 11:20:49 -08:00
Shane Smiskol
eca32bd16d process replay: don't upload if diff doesn't exist (#27333)
* fail the replay, successfully print

* should still run

* debug

* outside?

* don't fail

* don't fail

* don't fail

* test

* test

* test

* try this now

* clean up, works!
old-commit-hash: b536b9c4c07742a035723c3a0e1aeb646db6555a
2023-02-13 21:39:06 -08:00
Adeeb Shihadeh
674f14615c CI: temporarily remove timeouts
old-commit-hash: 01bdf382c4bd8a30444c0bde3b737a95f5813f42
2023-02-07 12:52:50 -08:00
Kurt Nistelberger
0135d85a6d Ubloxd: glonass parsing tests (#27125)
* add glonass kaitai parsing

* add kaita generated files

* remove glonass from build

* add string non immediate type

* fix kaitai bug

* cleanUp

* add patch file

* fix scons order

* make lookup const

* remove comments

* rename

* add to release files

* remove printf

* add signs

* add glonass parsing test

* finish up glonass kaitai tests

* move cereal back to master

* ignore test_runner

* sign is not two complement

* address comments
---------

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
old-commit-hash: e2f5b164bd3dcffc5a11ef552f83296c34991949
2023-01-30 16:34:07 -08:00
Shane Smiskol
0ffdb9bda5 release pre-commit: test translations (#27017)
we should be able to run on the stripped dir now
old-commit-hash: 3efb22e82bb77601fc86db8ba02eafd9cc7ead51
2023-01-20 11:46:02 -08:00
Adeeb Shihadeh
01db07375c nav model replay (#26697)
* nav model replay

* set token

* fix gh actions

* update refs

* fix pc
old-commit-hash: 1da6f6a6e213280979dcf64b4d3e90f291bda4a3
2022-12-07 19:36:30 -08:00
Cameron Clough
fd73f0955f CI: use github.head_ref to group PR action runs (#26505)
* CI: use github.head_ref to group PR action runs

for push triggers, github.ref is set to the "branch or tag ref that was pushed"
for pull_request triggers, it is set to the "pull request merge branch" (master?)

github.head_ref is only set when the trigger is pull_request

https://docs.github.com/en/actions/learn-github-actions/contexts#github-context

* only check github.ref for push event
old-commit-hash: a662af57c7de750df4f1650ee4079c56665b817e
2022-11-15 13:07:46 -08:00
Dean Lee
520d0d1af0 Cabana: add save DBC dialog (#26282)
* export DBC to text edit

* added saveAs & Copy To Clipboard

* cleanup

* cleanup include

* add test case

* rename variable

* fix precision
old-commit-hash: 80b088c332808439ea9cfe23557fae5a86fb075c
2022-10-30 07:31:12 -07:00
Cameron Clough
eef468fd85 Revert "ci: run some jobs only on push (#26202)"
This reverts commit 8e0e99f77c4e7294df4c57e013c45a1e570cd5ef.

old-commit-hash: 335351123ab8a34d06bf164b5cf5be9046bf2c3c
2022-10-22 01:04:54 -07:00
Cameron Clough
cc8d86fa08 ci: run some jobs only on push (#26202)
* ci: run some jobs only on push

alternative to #25900

* tools too
old-commit-hash: 04b40aad92afaac555c3c7d814699c467d975627
2022-10-21 21:13:55 -07:00
Cameron Clough
3e7720538b Revert "ci: don't trigger on pull request sync event (#25900)"
This reverts commit d63442bd587b62ed26ba85dd5008951b06ae915c.

old-commit-hash: dba8e8ec0ee026f73b5a87d2c4b00556fdee58f7
2022-10-21 18:04:07 -07:00