Commit Graph

278 Commits

Author SHA1 Message Date
Justin Newberry
e022ffe528 CI: simulator disable pull to save local space (#29517)
we don't need to pull since the image is different most of the time
old-commit-hash: ec5e3bef95
2023-08-21 20:01:52 -07:00
Justin Newberry
fe844afac7 CI: remove old docs base image push (#29512)
remove that push
old-commit-hash: 9188c56069
2023-08-21 15:32:41 -07:00
Justin Newberry
7205b92bb6 CI: use scons cache mount for building simulator and docs (#29436)
* build docker image with scons cache

* use setup

* scons cache

* added the dockerfile

* add the shell

* docs use cache

* dont pull lfs for docs

* simulator too

* dont pull the cache image

* fix inputs

* inputs

* booleans aren't supported

* bool not supported

* bool isnt supported

* fix

* readonly cache

* fix sim cache too

* respect readonly

* gitignore and move to correct folder

* also copy old

* move to tools/ci

* move to selfdrive/test

* just make the cache writable, it's discarded anyway

* minimize diff in this pr
old-commit-hash: 197460e061
2023-08-21 15:11:31 -07:00
Kacper Rączy
1d47429f8e Setup cleanup vol. 2 (#29456)
* code from setup cleanup #29419

update ci

update ci

export variables for mac os

check env

what is in the profile script?

install pyenv the same everywhere

temporarily disable brew cache

temporarily disable brew cache

try fixing pyenv virtualenv-init

try this

inject shims path earlier

try alternate install method

switch back to brew install

try         eval "$(pyenv init --path)"

add eval "\$(pyenv init --path)"

* Add local .env file to the cache list

* Change .env paths

* debug line

* order?

* remove .env

* Add .venv to caches

---------

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
old-commit-hash: 0f7be5b1e6
2023-08-21 13:30:48 -07:00
Dean Lee
97631ec362 common: C++ RateKeeper (#29374)
* c++ RateKeeper

* add to files_common

* use util::random_int

* improve monotor_time

* remove ~ratekeeper
old-commit-hash: 3eef63af9b
2023-08-20 21:27:02 -07:00
Adeeb Shihadeh
bd27be2b78 move mypy config into pyproject.toml (#29501)
* move mypy config into pyproject.toml

* rm reference
old-commit-hash: ff068dd722
2023-08-20 21:08:04 -07:00
Harald Schäfer
3022f06e1e update process replay timeout (#29478)
* Always dict differ

* Update selfdrive_tests.yaml

* bump up more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: bc4b75822a
2023-08-20 17:24:33 -07:00
Justin Newberry
1988b4805e Revert "setup cleanup (#29419)" (#29451)
This reverts commit bc9c60a3f955bb5b96dc41e6072cab47191f8896.
old-commit-hash: 1944945d9d
2023-08-17 13:23:06 -07:00
Greg Hogan
cce2c732c6 setup cleanup (#29419)
* setup cleanup

* update ci

* update ci

* export variables for mac os

* check env

* what is in the profile script?

* install pyenv the same everywhere

* temporarily disable brew cache

* temporarily disable brew cache

* try fixing pyenv virtualenv-init

* try this

* inject shims path earlier

* try alternate install method

* switch back to brew install

* try         eval "$(pyenv init --path)"

* add eval "\$(pyenv init --path)"
old-commit-hash: ad32816fd6
2023-08-17 08:51:16 -07:00
Justin Newberry
edbd5d330e CI: use setup script for docs and simulator (#29434)
* use setup

* dont pull lfs for docs

* fix inputs

* bool not supported

* bool isnt supported
old-commit-hash: ad00595ba5
2023-08-16 17:59:42 -07:00
Kacper Rączy
4096be66e4 macOS: fix GH actions cache (#29399)
Add lz4 and xz to dep cache exceptions
old-commit-hash: ae649ec68d
2023-08-14 16:13:35 -07:00
Justin Newberry
1424636288 CI: docs speedup by caching first stage (#29397)
* docs speedup

* fix tags on docs build

* build docs without build-push-action
old-commit-hash: f8cbdcfa40
2023-08-14 14:36:17 -07:00
Adeeb Shihadeh
e76af64065 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
old-commit-hash: b11b14aff8
2023-08-12 17:15:16 -07:00
Adeeb Shihadeh
b3f734283d remove xx dependencies (#29263)
* rm xx deps

* mv that

* fix

* fix a path

* relock

* relock

* update

* update sentry

* update

* revert sentry

* Update lock

* Dummy pip package

* Not needed with poetry

* dont need dummy

---------

Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
old-commit-hash: 0ced56b2ea
2023-08-11 20:05:44 -07:00
Justin Newberry
20f6a25a1c CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
old-commit-hash: 2482b58968
2023-08-11 17:41:23 -07:00
Justin Newberry
afa33bee18 CI: move cache to home directory (#29347)
move cache to home dir
old-commit-hash: ace4d78e31
2023-08-11 15:45:38 -07:00
Justin Newberry
f8cd844e7c CI: use default caching action (#29339)
old-commit-hash: a0f399677e
2023-08-11 14:03:10 -07:00
Adeeb Shihadeh
2e818c2393 CI: bump up model test timeout
old-commit-hash: cd4bb412f5
2023-08-10 17:29:56 -07:00
Adeeb Shihadeh
442ec436dd remove rest of pylint (#29302)
* remove rest of pylint

* fix release build
old-commit-hash: e53f9597f3
2023-08-09 19:03:36 -07:00
Adeeb Shihadeh
d704b0318a CI: move longitudinal tests into unit tests job (#29245)
* move long into unit test job

* try without these

* add that back
old-commit-hash: ae8252c14a
2023-08-07 06:48:06 -07:00
Adeeb Shihadeh
de743e3ec4 CI: add timeouts to selfdrive tests (#29239)
* CI: add timeouts to selfdrive tests

* ugh, so slow

* will have to come back to this one
old-commit-hash: 75ab960557
2023-08-04 18:14:14 -07:00
Adeeb Shihadeh
4b96635560 CI: update cache action (#29241)
* update that

* update one more
old-commit-hash: f714e7cb24
2023-08-04 17:59:55 -07:00
Adeeb Shihadeh
ca5d92a1a1 CI: only run on master + PRs (#29242)
old-commit-hash: 0df2cd4fa8
2023-08-04 17:56:30 -07:00
Adeeb Shihadeh
5c0a7ef79e CI: add timeouts to tools jobs (#29238)
old-commit-hash: 8633e5f8ab
2023-08-04 15:35:21 -07:00
Shane Smiskol
ffd534fdc3 car docs diff bot: don't ignore failures
we have a test for this, so if that fails, doesn't matter if this fails too

old-commit-hash: 6ad6191e6a
2023-08-02 17:18:43 -07:00
Adeeb Shihadeh
0903b55fca CI: allow triggering fast release builds
old-commit-hash: e53ab3a18a
2023-07-26 15:22:23 -07:00
Adeeb Shihadeh
9f7fa18b7b CI: run plotjuggler test on mac (#29102)
* CI: run plotjuggler test on mac

* source

* python path
old-commit-hash: 34389acbbf
2023-07-22 23:10:31 -07:00
Adeeb Shihadeh
e56ac872e1 CI: add docker images tagged with git commit (#29052)
* CI: add docker images tagged with git commit

* tag later

* debug

* fix tag

* test that

* cleanup
old-commit-hash: a83dec9d94
2023-07-19 23:35:33 -07:00
Adeeb Shihadeh
e9648cf860 CI: use locally built image as CL base (#29030)
old-commit-hash: 22882a0d22
2023-07-18 22:57:32 -07:00
Maxime Desroches
4aaceac124 Force build of openpilot-base for OpenCL tests (#29022)
old-commit-hash: 56a0f9e074
2023-07-18 16:25:05 -07:00
Adeeb Shihadeh
4dec8811e0 CI: update codecov action (#28967)
old-commit-hash: ae6f13fb50
2023-07-15 22:55:33 -07:00
Maxime Desroches
1693786962 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit a5be0640a3780156fdd5c04c1e6204fa41b307a8.

* determinism

* fingerprint
old-commit-hash: 0ebec253d0
2023-06-29 21:49:23 -07:00
Adeeb Shihadeh
0d5fc13416 ci: fix master-ci build
old-commit-hash: e8e8b36142
2023-06-27 13:10:54 -07:00
Adeeb Shihadeh
52d1de0e79 jenkins: speedup build stage (#28687)
* jenkins: speedup build stage

* run in gh actions

* skip

* set that

* build

* python path

* cleanup
old-commit-hash: fdf1c328b9
2023-06-24 22:33:06 -07:00
Adeeb Shihadeh
ffcc2e4c61 Revert "simple fuzzing test for all processes (#28584)"
This reverts commit 0e98836e857583849aa4e960b097103a4aeb863d.

old-commit-hash: 7783dc602c
2023-06-22 14:59:50 -07:00
Kacper Rączy
b82a7a8da8 macOS: re-order CI caching jobs (#28622)
Save scons cache before dependency cleanup
old-commit-hash: f7c520b0d9
2023-06-21 14:01:33 -07:00
Kacper Rączy
b1eb066965 macOS: fix build issues & re-enable CI (#28258)
* Uncomment build_mac job

* Add PYCURL_CURL_CONFIG

* Acados universal binary

* Remove x86 macos references from sconscript

* Add missing include in cabana

* Update cereal

* Update workflow

* Remove unnecessary libpaths for darwin

* Add missing path to cached dirs

* Fix path in cache preparation step

* Add poetry caches to CI cache

* Compile acados with lower deployment target for CI

* Update cereal

* Pass -rpath in linker flags as scons doed not support RPATH on macos

* Use scons api instead of os

* @rpath in install name of acados dylibs

* SConstruct cleanup

* fix liblocationd tests by adding lib suffix based on platform

* Update cereal

* Update opendbc

* Update opendbc

* Add acados gitignore to release files

* Update cereal

* Update cereal

* Add scons_cache to build cache

* Add Caskroom to cache

* Fix typo

* Link all packages at once, instead of one by one

* Run cleanup stage using poetry

* Remove casks from cache

* Move scons cache to separate cache step

* Save scons cache only on master

* Remove restore-keys from save-scons-cache step

* Uncomment if conditions for scons save

* Add gcc-arm-embedded cask cache to cache

* Custom handling of gcc-arm-embedded toolchain cache

* Rename dep cache key

* Exclude .fseventsd from cache

* Fix glob pattern

* Remove .feventsd before caching

* Run mac_setup only if dependency cache-hit != true

* Update cereal to master

* Add overwrite flag to brew link

* Remove manual casadi build from mac_setup

* Remove restore-keys from dependency cache

* Remove linux requirement for casadi

* Restore restore-keys to dependency cache
old-commit-hash: 45a6834a74
2023-06-21 13:14:20 -07:00
Maxime Desroches
7be2b51229 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
old-commit-hash: bac193bdd5
2023-06-20 10:57:02 -07:00
Adeeb Shihadeh
4aa12c2864 logmessaged: handle big cloudlogs (#28553)
* logmessaged: handle big cloudlogs

* revert

* switch
old-commit-hash: a1b6697629
2023-06-14 22:48:51 -07:00
Kacper Rączy
3ead794728 pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
old-commit-hash: 23de5f1bac
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh
b7c0e56697 CI: add job to update pre-commit hooks (#27922)
* CI: add job to update pre-commit hooks

* rm push
old-commit-hash: fd50713c2d
2023-04-15 18:08:26 -07:00
Adeeb Shihadeh
c576ab8b97 ci: always upload process replay ref logs
old-commit-hash: 5ec7da96a6
2023-03-30 12:43:08 -07:00
Adeeb Shihadeh
de9a100719 ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
old-commit-hash: c97911dbad
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh
3a968c67e1 loggerd: move to system/ (#27534)
old-commit-hash: 94eb215980
2023-03-08 11:20:49 -08:00
Shane Smiskol
eca32bd16d process replay: don't upload if diff doesn't exist (#27333)
* fail the replay, successfully print

* should still run

* debug

* outside?

* don't fail

* don't fail

* don't fail

* test

* test

* test

* try this now

* clean up, works!
old-commit-hash: b536b9c4c0
2023-02-13 21:39:06 -08:00
Adeeb Shihadeh
674f14615c CI: temporarily remove timeouts
old-commit-hash: 01bdf382c4
2023-02-07 12:52:50 -08:00
Kurt Nistelberger
0135d85a6d Ubloxd: glonass parsing tests (#27125)
* add glonass kaitai parsing

* add kaita generated files

* remove glonass from build

* add string non immediate type

* fix kaitai bug

* cleanUp

* add patch file

* fix scons order

* make lookup const

* remove comments

* rename

* add to release files

* remove printf

* add signs

* add glonass parsing test

* finish up glonass kaitai tests

* move cereal back to master

* ignore test_runner

* sign is not two complement

* address comments
---------

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
old-commit-hash: e2f5b164bd
2023-01-30 16:34:07 -08:00
Shane Smiskol
0ffdb9bda5 release pre-commit: test translations (#27017)
we should be able to run on the stripped dir now
old-commit-hash: 3efb22e82b
2023-01-20 11:46:02 -08:00
Adeeb Shihadeh
1a7b2b6a2d revert timeout increase from #26850
old-commit-hash: 50f62a7adc
2023-01-13 13:46:01 -08:00
Kurt Nistelberger
9570336e6c Laikad: set active (#26850)
* laikad update, renaming

* update locationd

* fix naming

* address PR comments

* upsi

* .

* draft to fix replay

* fix process relay to allow no response for messages

* final fix for process replay

* .

* bump cereal

* update process replay ref commit

* reduce wait time

* .

* last ref change

* move laikad helpers to laika

* .

* fix ublox test

* update refs

* add proper qcom replay support

* fix gnss support if both is available

* update refs

* remove left over

* revert laikad msg

* move laika back to master

* init

* fix gps valid flag

* change time

* add gnss to ignore

* remove gps_valid flag

* .

* adopt orientation reset threshold

* .

* update laikad

* .

* fix stanstill KF resets

* test orienation reset count

* update laika

* bump cereal

* fix process replay

* update laika repo

* remove handle gps

* add extra logging for cache

* .

* add more log

* .

* .

* update laika

* dont remove gps code

* inc min satellite count

* update magic vals and add acc drop

* update laika

* upsi

* rem

* bump laika

* use nav and correct

* more fixes

* use sftp

* No more glonass

* Revert "No more glonass"

This reverts commit a76124da50a1e25f423ad1137c7a046e1d57811d.

* nump laika

* back support old ephemeris cache

* add health to ephemeris message

* bump laika

* remove print

* fix laikad tests

* clean

* remove extra log

* bump laika

* inc timeout for plotjuggler build

* rem cache clear

* .

* enable gps after checks

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 88423e25df
2023-01-13 11:37:38 -08:00