Commit Graph

50 Commits

Author SHA1 Message Date
Adeeb Shihadeh
e69eeb7344 move remaining big files into LFS (#30053)
old-commit-hash: e185e5ffcd
2023-09-25 21:53:03 -07:00
Justin Newberry
fc69b28f7e Devcontainer: improve CI tests and support using local built image (#30012)
* improve devcontainer tests

* test full build with cache

* fix that

* fix the cache

* fix the cache
old-commit-hash: 003018fc46
2023-09-24 17:24:44 -07:00
Adeeb Shihadeh
ee0ddd7e26 Revert "CI: login to dockerhub on aarch64 runners (#29915)"
This reverts commit 28211fe8ada8997119c57c5619349332a406aa76.

old-commit-hash: 079a51cfdf
2023-09-17 15:16:07 -07:00
Kacper Rączy
9525da02b6 CI: login to dockerhub on aarch64 runners (#29915)
* DOCKER_HUB_LOGIN command

* Add docker creds

* checkout runner name

* test again

* Use runner.name to distinguish between buildjet and GH runners
old-commit-hash: c9ec7bc2a3
2023-09-14 17:08:49 -07:00
Justin Newberry
e468072f1f CI: retry setup on failure (#29785)
* try a setup action

* should be uses

* fix that formatting

* try conclusion

* continue on error

* try without hyphens

* only when failure

* make it optional

* continue on error

* those don't fail anymore

* what about 3 failures

* remove stuff for debugging

* cleanup

* review suggestions

* change that too

* fix pj
old-commit-hash: 917f71d446
2023-09-06 11:11:15 -07:00
Adeeb Shihadeh
53e0f5eb49 pytest: use a clean environment for all tests (#29788)
* pytest: use a clean environment for all tests

* rm that

* fix pj

* put build back

* fix params

* fix that

* handle no key

* that was removed

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 7b6afbc162
2023-09-05 18:52:40 -07:00
Justin Newberry
643a13f27e CI: use local scons cache instead of building a separate image (#29634)
* use local

* added ci_sim

* revert scons

* dont need these anymore

* same for sim

* fix dockerfiles
old-commit-hash: c46965fc27
2023-08-25 16:06:17 -07:00
Justin Newberry
e128aedc63 CI: move cache dir to workspace directory (#29622)
* comma dir

* mkdir

* fix issues

* test

* fix that

* fix

* do the other ones too

* missed that

* fix

* fix pr comments by moving into two different directories

* fix location

* fix that

* only change current

* fix
old-commit-hash: c0b9458a45
2023-08-25 01:41:04 -07:00
Adeeb Shihadeh
06aea7d935 CI: remove redundant apt installs (#29617)
* CI: remove redundant apt installs

* split build and test

* faster build
old-commit-hash: 36cc41f619
2023-08-24 17:32:15 -07:00
Justin Newberry
4063a92683 CI: use GITHUB_ENV for env variables (#29616)
export doesn't work across steps
old-commit-hash: 90cb417caa
2023-08-24 17:03:25 -07:00
Justin Newberry
630b440536 CI: fix docker push (#29614)
* fix those

* fix docker push too

* dont need that twice
old-commit-hash: ede9f2cda5
2023-08-24 16:30:33 -07:00
Justin Newberry
6847f819d1 CI: use scripts for docker build (#29599)
* use scripts

* remove common

* do login in the workflow

* separate step

* cleanup

* one script is cleaner

* keep it consistent

* review suggestions

* move in ci too

* PR cleanup
old-commit-hash: 3d9f238bf9
2023-08-24 16:09:08 -07:00
Adeeb Shihadeh
61cf541322 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
old-commit-hash: 4917e22615
2023-08-24 14:58:30 -07:00
Justin Newberry
7a532e02f3 CI: switch to --cache-to type=inline for buildkit cache (#29575)
this is cleaner
old-commit-hash: 2fdde9b77d
2023-08-23 17:41:33 -07:00
Justin Newberry
e54655626d CI: Docs rebuild base image (#29566)
* docs rebuild base image

* fix order
old-commit-hash: 2e4f8e6608
2023-08-23 15:33:23 -07:00
Kacper Rączy
3681c1d1b2 devcontainer: handle hosts without X11 (#29537)
* Setup xauthority link on host in initializeCommand

* Create a dummy xauthority if it does no exist on host machine

* Remove xauthority line from ci test
old-commit-hash: 659795b1db
2023-08-23 10:26:38 -07:00
Kacper Rączy
e250480db6 devcontainer: CI fix (#29534)
Export xauthority before running devcontainer
old-commit-hash: df9564e172
2023-08-22 14:14:14 -07:00
Robbe Derks
a04cbced36 Devcontainer (#29259)
* mvp devcontainer. builds, runs and UI works

* fix indentation

* enable color and fix openpilot_env path

* separate dockerfile for devcontainer

* use prebuilt image

* Fix openpilot_env setup

* Add dev container section in readme

* Fix typo

* Fix typo again

* Move dev dockerfile to .devcontainer dir

* Update README

* Add note about x11 forwarding on macos

* Update dev container json

* Fix typo

* Override DISPLAY on macOS

* Mention XAUTHORITY for macOS setup in README

* fix typo

* Add devcontainer CI test

* Rename to devcontainer

* Fix git issues

* ripgrep

* Link instead of vscode manual

* Replace raw path with containerWorkspaceFolder

* Fix typo

* Remove dev tools workflow

* Link away X11 forwarding setup isntructions for mac

* Remove fork consrtaint, add test run of scons

* Add submodules as safe.directories in postStartCommand

* Remove openpilot_env references

* Add scons cache volume

---------

Co-authored-by: Robbe Derks <robbe@localhost.localdomain>
Co-authored-by: Kacper Rączy <gfw.kra@gmail.com>
old-commit-hash: d71a7190f1
2023-08-22 11:47:09 -07:00
Justin Newberry
e022ffe528 CI: simulator disable pull to save local space (#29517)
we don't need to pull since the image is different most of the time
old-commit-hash: ec5e3bef95
2023-08-21 20:01:52 -07:00
Justin Newberry
fe844afac7 CI: remove old docs base image push (#29512)
remove that push
old-commit-hash: 9188c56069
2023-08-21 15:32:41 -07:00
Justin Newberry
7205b92bb6 CI: use scons cache mount for building simulator and docs (#29436)
* build docker image with scons cache

* use setup

* scons cache

* added the dockerfile

* add the shell

* docs use cache

* dont pull lfs for docs

* simulator too

* dont pull the cache image

* fix inputs

* inputs

* booleans aren't supported

* bool not supported

* bool isnt supported

* fix

* readonly cache

* fix sim cache too

* respect readonly

* gitignore and move to correct folder

* also copy old

* move to tools/ci

* move to selfdrive/test

* just make the cache writable, it's discarded anyway

* minimize diff in this pr
old-commit-hash: 197460e061
2023-08-21 15:11:31 -07:00
Justin Newberry
edbd5d330e CI: use setup script for docs and simulator (#29434)
* use setup

* dont pull lfs for docs

* fix inputs

* bool not supported

* bool isnt supported
old-commit-hash: ad00595ba5
2023-08-16 17:59:42 -07:00
Justin Newberry
1424636288 CI: docs speedup by caching first stage (#29397)
* docs speedup

* fix tags on docs build

* build docs without build-push-action
old-commit-hash: f8cbdcfa40
2023-08-14 14:36:17 -07:00
Justin Newberry
20f6a25a1c CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
old-commit-hash: 2482b58968
2023-08-11 17:41:23 -07:00
Justin Newberry
afa33bee18 CI: move cache to home directory (#29347)
move cache to home dir
old-commit-hash: ace4d78e31
2023-08-11 15:45:38 -07:00
Adeeb Shihadeh
ca5d92a1a1 CI: only run on master + PRs (#29242)
old-commit-hash: 0df2cd4fa8
2023-08-04 17:56:30 -07:00
Adeeb Shihadeh
5c0a7ef79e CI: add timeouts to tools jobs (#29238)
old-commit-hash: 8633e5f8ab
2023-08-04 15:35:21 -07:00
Adeeb Shihadeh
674f14615c CI: temporarily remove timeouts
old-commit-hash: 01bdf382c4
2023-02-07 12:52:50 -08:00
Adeeb Shihadeh
1a7b2b6a2d revert timeout increase from #26850
old-commit-hash: 50f62a7adc
2023-01-13 13:46:01 -08:00
Kurt Nistelberger
9570336e6c Laikad: set active (#26850)
* laikad update, renaming

* update locationd

* fix naming

* address PR comments

* upsi

* .

* draft to fix replay

* fix process relay to allow no response for messages

* final fix for process replay

* .

* bump cereal

* update process replay ref commit

* reduce wait time

* .

* last ref change

* move laikad helpers to laika

* .

* fix ublox test

* update refs

* add proper qcom replay support

* fix gnss support if both is available

* update refs

* remove left over

* revert laikad msg

* move laika back to master

* init

* fix gps valid flag

* change time

* add gnss to ignore

* remove gps_valid flag

* .

* adopt orientation reset threshold

* .

* update laikad

* .

* fix stanstill KF resets

* test orienation reset count

* update laika

* bump cereal

* fix process replay

* update laika repo

* remove handle gps

* add extra logging for cache

* .

* add more log

* .

* .

* update laika

* dont remove gps code

* inc min satellite count

* update magic vals and add acc drop

* update laika

* upsi

* rem

* bump laika

* use nav and correct

* more fixes

* use sftp

* No more glonass

* Revert "No more glonass"

This reverts commit a76124da50a1e25f423ad1137c7a046e1d57811d.

* nump laika

* back support old ephemeris cache

* add health to ephemeris message

* bump laika

* remove print

* fix laikad tests

* clean

* remove extra log

* bump laika

* inc timeout for plotjuggler build

* rem cache clear

* .

* enable gps after checks

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 88423e25df
2023-01-13 11:37:38 -08:00
Cameron Clough
fd73f0955f CI: use github.head_ref to group PR action runs (#26505)
* CI: use github.head_ref to group PR action runs

for push triggers, github.ref is set to the "branch or tag ref that was pushed"
for pull_request triggers, it is set to the "pull request merge branch" (master?)

github.head_ref is only set when the trigger is pull_request

https://docs.github.com/en/actions/learn-github-actions/contexts#github-context

* only check github.ref for push event
old-commit-hash: a662af57c7
2022-11-15 13:07:46 -08:00
Cameron Clough
eef468fd85 Revert "ci: run some jobs only on push (#26202)"
This reverts commit 8e0e99f77c4e7294df4c57e013c45a1e570cd5ef.

old-commit-hash: 335351123a
2022-10-22 01:04:54 -07:00
Cameron Clough
cc8d86fa08 ci: run some jobs only on push (#26202)
* ci: run some jobs only on push

alternative to #25900

* tools too
old-commit-hash: 04b40aad92
2022-10-21 21:13:55 -07:00
Cameron Clough
3e7720538b Revert "ci: don't trigger on pull request sync event (#25900)"
This reverts commit d63442bd587b62ed26ba85dd5008951b06ae915c.

old-commit-hash: dba8e8ec0e
2022-10-21 18:04:07 -07:00
Cameron Clough
52319c1301 ci: don't trigger on pull request sync event (#25900)
old-commit-hash: 68530f18b4
2022-10-20 13:23:59 -07:00
Adeeb Shihadeh
eec2ca1e8b CI speedup (#26096)
* CI speedup

* use the new stuff

* push

* no regressions

* try that

* don't let this slip

* fix modeld tests

* fix linter

* modernize prebuilt

* cleanup

* fix those

* increase a bit
old-commit-hash: 00494a44f4
2022-10-16 15:54:36 -07:00
Cameron Clough
813429531d ci: disable concurrency for master branch (#26052)
disable concurrency for master branch
old-commit-hash: 077f0e0a44
2022-10-12 15:11:03 -07:00
Cameron Clough
d0cb619c7d ci: fix tools workflow
old-commit-hash: 23e78da6a4
2022-10-12 14:34:43 -07:00
Cameron Clough
92fab023b3 ci: only run one instance of each workflow (#26036)
only allow one running workflow per event for each branch
old-commit-hash: 03a065160e
2022-10-12 13:51:09 -07:00
Adeeb Shihadeh
fca5728055 CI: Actions cleanup + speedup (#25514)
* actions cache cleanup

* release build cleanup

* fetch dpeth
old-commit-hash: 71e76c3d0f
2022-08-21 19:14:36 -07:00
HaraldSchafer
f7d1aad21e Update model replay commit for calib change (#25357)
* Update model replay commit for calib test

* more reliable baseline

* update docker login

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9fbbefbc94
2022-08-03 22:35:03 -07:00
Adeeb Shihadeh
396a20d9b3 CI: add build job for latest Ubuntu (#24637)
* CI: add build job for latest Ubuntu

* source

* source env

* scons cache

* cache pyenv

* fix key

* source
old-commit-hash: fbd98b0e54
2022-06-11 22:51:09 -07:00
HaraldSchafer
cf0564382a CL in docker (#24718)
* Move CL to base docker

* Different docker for cl

* add cl base docker

* add to tool

* cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dc4d4f875b
2022-06-02 18:26:12 -07:00
Adeeb Shihadeh
318b9cff4b CI: pull LFS after checkout (#24552)
old-commit-hash: 2c2c61fd77
2022-05-16 14:30:20 -07:00
Adeeb Shihadeh
8f0df45031 CI tuneup (#24541)
* little housekeeping

* all the commits

* one more cars
old-commit-hash: b2569d871f
2022-05-15 17:57:34 -07:00
Adeeb Shihadeh
f2457bb23c CI: cache LFS objects (#23345)
old-commit-hash: 760104068b
2022-01-03 14:34:31 -08:00
Adeeb Shihadeh
41d24acca9 disable simulator job until LFS is fixed
old-commit-hash: d85bb967e8
2021-12-31 16:53:54 -08:00
iejMac
926e0dfca6 Move simulator CI to tools workflow (#20285)
* sim CI

* simulator CI

* scons already in Dockerfile.sim

* faster

* fast

* testing
old-commit-hash: 539426033b
2021-03-08 21:33:15 -08:00
iejMac
36ecc144ff PlotJuggler CI with build from source (#20166)
* CI attempt

* fixing location

* fix

* fixes

* hardcode test_url for CI

* fixes

* cd fix

* Update tools/plotjuggler/juggle.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update tools/plotjuggler/test_plotjuggler.py

* fixes

* fixes

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9144dd7c2f
2021-02-26 17:14:37 -08:00
Adeeb Shihadeh
0823abceff tools: cleanup + setup CI (#20104)
* cleanup tools

* setup tools CI

* loggerd doesn't support this anymore

* cleanup

* builds with openpilot now
old-commit-hash: d1b44bbb34
2021-02-17 20:37:01 -08:00