Commit Graph

250 Commits

Author SHA1 Message Date
Adeeb Shihadeh e76af64065 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
old-commit-hash: b11b14aff8
2023-08-12 17:15:16 -07:00
Adeeb Shihadeh b3f734283d remove xx dependencies (#29263)
* rm xx deps

* mv that

* fix

* fix a path

* relock

* relock

* update

* update sentry

* update

* revert sentry

* Update lock

* Dummy pip package

* Not needed with poetry

* dont need dummy

---------

Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
old-commit-hash: 0ced56b2ea
2023-08-11 20:05:44 -07:00
Justin Newberry 20f6a25a1c CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
old-commit-hash: 2482b58968
2023-08-11 17:41:23 -07:00
Justin Newberry afa33bee18 CI: move cache to home directory (#29347)
move cache to home dir
old-commit-hash: ace4d78e31
2023-08-11 15:45:38 -07:00
Justin Newberry f8cd844e7c CI: use default caching action (#29339)
old-commit-hash: a0f399677e
2023-08-11 14:03:10 -07:00
Adeeb Shihadeh 2e818c2393 CI: bump up model test timeout
old-commit-hash: cd4bb412f5
2023-08-10 17:29:56 -07:00
Adeeb Shihadeh 442ec436dd remove rest of pylint (#29302)
* remove rest of pylint

* fix release build
old-commit-hash: e53f9597f3
2023-08-09 19:03:36 -07:00
Adeeb Shihadeh d704b0318a CI: move longitudinal tests into unit tests job (#29245)
* move long into unit test job

* try without these

* add that back
old-commit-hash: ae8252c14a
2023-08-07 06:48:06 -07:00
Adeeb Shihadeh de743e3ec4 CI: add timeouts to selfdrive tests (#29239)
* CI: add timeouts to selfdrive tests

* ugh, so slow

* will have to come back to this one
old-commit-hash: 75ab960557
2023-08-04 18:14:14 -07:00
Adeeb Shihadeh 4b96635560 CI: update cache action (#29241)
* update that

* update one more
old-commit-hash: f714e7cb24
2023-08-04 17:59:55 -07:00
Adeeb Shihadeh ca5d92a1a1 CI: only run on master + PRs (#29242)
old-commit-hash: 0df2cd4fa8
2023-08-04 17:56:30 -07:00
Adeeb Shihadeh 5c0a7ef79e CI: add timeouts to tools jobs (#29238)
old-commit-hash: 8633e5f8ab
2023-08-04 15:35:21 -07:00
Shane Smiskol ffd534fdc3 car docs diff bot: don't ignore failures
we have a test for this, so if that fails, doesn't matter if this fails too

old-commit-hash: 6ad6191e6a
2023-08-02 17:18:43 -07:00
Adeeb Shihadeh 0903b55fca CI: allow triggering fast release builds
old-commit-hash: e53ab3a18a
2023-07-26 15:22:23 -07:00
Adeeb Shihadeh 9f7fa18b7b CI: run plotjuggler test on mac (#29102)
* CI: run plotjuggler test on mac

* source

* python path
old-commit-hash: 34389acbbf
2023-07-22 23:10:31 -07:00
Adeeb Shihadeh e56ac872e1 CI: add docker images tagged with git commit (#29052)
* CI: add docker images tagged with git commit

* tag later

* debug

* fix tag

* test that

* cleanup
old-commit-hash: a83dec9d94
2023-07-19 23:35:33 -07:00
Adeeb Shihadeh e9648cf860 CI: use locally built image as CL base (#29030)
old-commit-hash: 22882a0d22
2023-07-18 22:57:32 -07:00
Maxime Desroches 4aaceac124 Force build of openpilot-base for OpenCL tests (#29022)
old-commit-hash: 56a0f9e074
2023-07-18 16:25:05 -07:00
Adeeb Shihadeh 4dec8811e0 CI: update codecov action (#28967)
old-commit-hash: ae6f13fb50
2023-07-15 22:55:33 -07:00
Maxime Desroches 1693786962 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit a5be0640a3780156fdd5c04c1e6204fa41b307a8.

* determinism

* fingerprint
old-commit-hash: 0ebec253d0
2023-06-29 21:49:23 -07:00
Adeeb Shihadeh 0d5fc13416 ci: fix master-ci build
old-commit-hash: e8e8b36142
2023-06-27 13:10:54 -07:00
Adeeb Shihadeh 52d1de0e79 jenkins: speedup build stage (#28687)
* jenkins: speedup build stage

* run in gh actions

* skip

* set that

* build

* python path

* cleanup
old-commit-hash: fdf1c328b9
2023-06-24 22:33:06 -07:00
Adeeb Shihadeh ffcc2e4c61 Revert "simple fuzzing test for all processes (#28584)"
This reverts commit 0e98836e857583849aa4e960b097103a4aeb863d.

old-commit-hash: 7783dc602c
2023-06-22 14:59:50 -07:00
Kacper Rączy b82a7a8da8 macOS: re-order CI caching jobs (#28622)
Save scons cache before dependency cleanup
old-commit-hash: f7c520b0d9
2023-06-21 14:01:33 -07:00
Kacper Rączy b1eb066965 macOS: fix build issues & re-enable CI (#28258)
* Uncomment build_mac job

* Add PYCURL_CURL_CONFIG

* Acados universal binary

* Remove x86 macos references from sconscript

* Add missing include in cabana

* Update cereal

* Update workflow

* Remove unnecessary libpaths for darwin

* Add missing path to cached dirs

* Fix path in cache preparation step

* Add poetry caches to CI cache

* Compile acados with lower deployment target for CI

* Update cereal

* Pass -rpath in linker flags as scons doed not support RPATH on macos

* Use scons api instead of os

* @rpath in install name of acados dylibs

* SConstruct cleanup

* fix liblocationd tests by adding lib suffix based on platform

* Update cereal

* Update opendbc

* Update opendbc

* Add acados gitignore to release files

* Update cereal

* Update cereal

* Add scons_cache to build cache

* Add Caskroom to cache

* Fix typo

* Link all packages at once, instead of one by one

* Run cleanup stage using poetry

* Remove casks from cache

* Move scons cache to separate cache step

* Save scons cache only on master

* Remove restore-keys from save-scons-cache step

* Uncomment if conditions for scons save

* Add gcc-arm-embedded cask cache to cache

* Custom handling of gcc-arm-embedded toolchain cache

* Rename dep cache key

* Exclude .fseventsd from cache

* Fix glob pattern

* Remove .feventsd before caching

* Run mac_setup only if dependency cache-hit != true

* Update cereal to master

* Add overwrite flag to brew link

* Remove manual casadi build from mac_setup

* Remove restore-keys from dependency cache

* Remove linux requirement for casadi

* Restore restore-keys to dependency cache
old-commit-hash: 45a6834a74
2023-06-21 13:14:20 -07:00
Maxime Desroches 7be2b51229 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
old-commit-hash: bac193bdd5
2023-06-20 10:57:02 -07:00
Adeeb Shihadeh 4aa12c2864 logmessaged: handle big cloudlogs (#28553)
* logmessaged: handle big cloudlogs

* revert

* switch
old-commit-hash: a1b6697629
2023-06-14 22:48:51 -07:00
Kacper Rączy 3ead794728 pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
old-commit-hash: 23de5f1bac
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh b7c0e56697 CI: add job to update pre-commit hooks (#27922)
* CI: add job to update pre-commit hooks

* rm push
old-commit-hash: fd50713c2d
2023-04-15 18:08:26 -07:00
Adeeb Shihadeh c576ab8b97 ci: always upload process replay ref logs
old-commit-hash: 5ec7da96a6
2023-03-30 12:43:08 -07:00
Adeeb Shihadeh de9a100719 ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
old-commit-hash: c97911dbad
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh 3a968c67e1 loggerd: move to system/ (#27534)
old-commit-hash: 94eb215980
2023-03-08 11:20:49 -08:00
Shane Smiskol eca32bd16d process replay: don't upload if diff doesn't exist (#27333)
* fail the replay, successfully print

* should still run

* debug

* outside?

* don't fail

* don't fail

* don't fail

* test

* test

* test

* try this now

* clean up, works!
old-commit-hash: b536b9c4c0
2023-02-13 21:39:06 -08:00
Adeeb Shihadeh 674f14615c CI: temporarily remove timeouts
old-commit-hash: 01bdf382c4
2023-02-07 12:52:50 -08:00
Kurt Nistelberger 0135d85a6d Ubloxd: glonass parsing tests (#27125)
* add glonass kaitai parsing

* add kaita generated files

* remove glonass from build

* add string non immediate type

* fix kaitai bug

* cleanUp

* add patch file

* fix scons order

* make lookup const

* remove comments

* rename

* add to release files

* remove printf

* add signs

* add glonass parsing test

* finish up glonass kaitai tests

* move cereal back to master

* ignore test_runner

* sign is not two complement

* address comments
---------

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
old-commit-hash: e2f5b164bd
2023-01-30 16:34:07 -08:00
Shane Smiskol 0ffdb9bda5 release pre-commit: test translations (#27017)
we should be able to run on the stripped dir now
old-commit-hash: 3efb22e82b
2023-01-20 11:46:02 -08:00
Adeeb Shihadeh 1a7b2b6a2d revert timeout increase from #26850
old-commit-hash: 50f62a7adc
2023-01-13 13:46:01 -08:00
Kurt Nistelberger 9570336e6c Laikad: set active (#26850)
* laikad update, renaming

* update locationd

* fix naming

* address PR comments

* upsi

* .

* draft to fix replay

* fix process relay to allow no response for messages

* final fix for process replay

* .

* bump cereal

* update process replay ref commit

* reduce wait time

* .

* last ref change

* move laikad helpers to laika

* .

* fix ublox test

* update refs

* add proper qcom replay support

* fix gnss support if both is available

* update refs

* remove left over

* revert laikad msg

* move laika back to master

* init

* fix gps valid flag

* change time

* add gnss to ignore

* remove gps_valid flag

* .

* adopt orientation reset threshold

* .

* update laikad

* .

* fix stanstill KF resets

* test orienation reset count

* update laika

* bump cereal

* fix process replay

* update laika repo

* remove handle gps

* add extra logging for cache

* .

* add more log

* .

* .

* update laika

* dont remove gps code

* inc min satellite count

* update magic vals and add acc drop

* update laika

* upsi

* rem

* bump laika

* use nav and correct

* more fixes

* use sftp

* No more glonass

* Revert "No more glonass"

This reverts commit a76124da50.

* nump laika

* back support old ephemeris cache

* add health to ephemeris message

* bump laika

* remove print

* fix laikad tests

* clean

* remove extra log

* bump laika

* inc timeout for plotjuggler build

* rem cache clear

* .

* enable gps after checks

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 88423e25df
2023-01-13 11:37:38 -08:00
Adeeb Shihadeh 01db07375c nav model replay (#26697)
* nav model replay

* set token

* fix gh actions

* update refs

* fix pc
old-commit-hash: 1da6f6a6e2
2022-12-07 19:36:30 -08:00
Cameron Clough fd73f0955f CI: use github.head_ref to group PR action runs (#26505)
* CI: use github.head_ref to group PR action runs

for push triggers, github.ref is set to the "branch or tag ref that was pushed"
for pull_request triggers, it is set to the "pull request merge branch" (master?)

github.head_ref is only set when the trigger is pull_request

https://docs.github.com/en/actions/learn-github-actions/contexts#github-context

* only check github.ref for push event
old-commit-hash: a662af57c7
2022-11-15 13:07:46 -08:00
Dean Lee 520d0d1af0 Cabana: add save DBC dialog (#26282)
* export DBC to text edit

* added saveAs & Copy To Clipboard

* cleanup

* cleanup include

* add test case

* rename variable

* fix precision
old-commit-hash: 80b088c332
2022-10-30 07:31:12 -07:00
Cameron Clough eef468fd85 Revert "ci: run some jobs only on push (#26202)"
This reverts commit 8e0e99f77c4e7294df4c57e013c45a1e570cd5ef.

old-commit-hash: 335351123a
2022-10-22 01:04:54 -07:00
Cameron Clough cc8d86fa08 ci: run some jobs only on push (#26202)
* ci: run some jobs only on push

alternative to #25900

* tools too
old-commit-hash: 04b40aad92
2022-10-21 21:13:55 -07:00
Cameron Clough 3e7720538b Revert "ci: don't trigger on pull request sync event (#25900)"
This reverts commit d63442bd587b62ed26ba85dd5008951b06ae915c.

old-commit-hash: dba8e8ec0e
2022-10-21 18:04:07 -07:00
HaraldSchafer 3ca9b7f02e Pipenv -> poetry (#24858)
* Try poetry

* Remove casadi for now

* Update docker

* Copy pipfiles

* add casadi back

* Too many slashes

* New poetry api

* Install system

* Try again

* No more pipenv

* new dependencies

* updates

* poetry 1.2.1, install dev dependencies

* keep install pipenv for xx for now?

* add pre-commit checks for poetry

* poetry lock is too slow

* update pip

* migrate to poetry groups

* update lockfile

* don't need to specify dev group unless it is made optional

* always install poetry

* set POETRY_VIRTUALENVS_CREATE instead, and use pipenv for xx

* use env for docs docker image

* alphabetical

* poetry 1.2.2

* add dev dependencies for typing

added in aacf6ae3

* remove constraint

* fix PIPENV_SYSTEM

* remove constraint

* don't need this here

* bump

* bump pipenv

adds support for installing local pyprojects (can add openpilot as dependency of xx)

* README improvements

* probably not necessary

* bump pip

* maybe not necessary?

* revert

* don't install openpilot itself into the virtual env

* remove PySide2 and shiboken2

reverts 3e41c775cbf670740ac648a8614d2d6b433312fe

* remove Pipenv, add xx dependencies, sync system python

* add pipenv as xx dep

* semver package constraints, use old lockfile versions

* fix casadi

* remove whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* disable poetry cache

* cleanup

* prefer config file

Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: a98d105cb9
2022-10-21 16:23:56 -07:00
Cameron Clough 52319c1301 ci: don't trigger on pull request sync event (#25900)
old-commit-hash: 68530f18b4
2022-10-20 13:23:59 -07:00
Adeeb Shihadeh eec2ca1e8b CI speedup (#26096)
* CI speedup

* use the new stuff

* push

* no regressions

* try that

* don't let this slip

* fix modeld tests

* fix linter

* modernize prebuilt

* cleanup

* fix those

* increase a bit
old-commit-hash: 00494a44f4
2022-10-16 15:54:36 -07:00
Cameron Clough 813429531d ci: disable concurrency for master branch (#26052)
disable concurrency for master branch
old-commit-hash: 077f0e0a44
2022-10-12 15:11:03 -07:00
Cameron Clough d0cb619c7d ci: fix tools workflow
old-commit-hash: 23e78da6a4
2022-10-12 14:34:43 -07:00
Cameron Clough c4c087e145 ci: don't cancel concurrent workflows for master branch (#26047)
don't cancel for master branch
old-commit-hash: 03f06b0e32
2022-10-12 14:03:44 -07:00