Commit Graph

480 Commits

Author SHA1 Message Date
Justin Newberry 83975756ba fix cache permissions (#31084)
* fix cache permissions

* chown
old-commit-hash: 18467c8383
2024-01-19 13:57:10 -08:00
Justin Newberry 960f6d0a63 CI: fix post run cache (#31078)
* post cache only

* fix

* newline

* really github???
old-commit-hash: c907dd9e70
2024-01-19 13:25:41 -08:00
Adeeb Shihadeh 85b48a800e bump that up
old-commit-hash: 8a26b4383f
2024-01-19 13:19:41 -08:00
Hoang Bui 8aad664943 Enable cache for pre-commit (#31071)
* enable cache

* test cache

* commai cache

* remove id

* only save on master

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: f0f7e86dcc
2024-01-19 13:06:02 -08:00
Justin Newberry aba5ee6a44 CI: auto-cache add option to save cache (#31076)
* save cache option

* inputs
old-commit-hash: bbbe94bc3e
2024-01-19 12:43:47 -08:00
Justin Newberry 11b807cd32 CI: use namespace.io (#31064)
* namespace

* mkdir

* fix

* restore only

* restore

* v3

* disable provenance
old-commit-hash: 35ed8a0886
2024-01-18 22:13:19 -08:00
Justin Newberry d6922d3522 Revert "CI: use namespace.so" (#31060)
old-commit-hash: 23cbfe9eb3
2024-01-18 17:35:24 -08:00
Justin Newberry d792c3c5bb CI: use namespace.so (#31056)
* namespace

* mkdir

* fix

* restore only

* restore

* v3
old-commit-hash: 9ee0a8a2b1
2024-01-18 17:17:53 -08:00
Justin Newberry 934225a448 replace pytest-timeouts with pytest-timeout (#31053)
* one timeout

* timeout

* higher timeout for now

* bump
old-commit-hash: d98b33adc8
2024-01-18 16:19:49 -08:00
Justin Newberry 772e00ac63 Update PR templates + autogenerate (#31032)
* update templates

* same as before

* no tuning

* same as before

* move up
old-commit-hash: f6cd009c77
2024-01-17 10:36:47 -08:00
Justin Newberry 1b56fa2b56 CI: auto_pr_review fix error when label doesn't exist (#31030)
* bot template

* catch error
old-commit-hash: 49586fc30e
2024-01-16 18:23:33 -08:00
Justin Newberry 46dc9366e1 CI: only apply bot-review label when it doesn't pass (#31028)
bot template
old-commit-hash: 1bf8e04f54
2024-01-16 18:02:26 -08:00
Justin Newberry 055746bc1e fix typo
old-commit-hash: b933825231
2024-01-16 17:30:11 -08:00
Moritz Wörmann 00be1836a8 CI: Add GH Actions workflow Bot to check for a PR template (#30999)
* Add GH Actions workflow to check for a PR template

* switch to headings and checkboxes for template detection

* check for bold text in template too

* move template check over to auto_pr_review action and remove label only if check succeeded

* only run template check on external PRs

* wording

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 8a05d212ec
2024-01-16 13:40:38 -08:00
Adeeb Shihadeh 96e9a7d3ce CI: speedup unit test job (#30995)
* start

* mv to buildjet

* fix
old-commit-hash: e17e66180c
2024-01-13 21:16:35 -08:00
Adeeb Shihadeh 8277f37c4b camerad: move ae test to pytest/catch2 (#30994)
* mv ae gray test

* cleanup
old-commit-hash: 3e601b5e8f
2024-01-13 15:40:25 -08:00
Adeeb Shihadeh 04da45f5c3 speedup devcontainer ci job (#30993)
old-commit-hash: 66ddfece82
2024-01-13 15:01:35 -08:00
Justin Newberry 9e35f77f78 Revert "buildjet: pin location to de" (#30956)
Revert "buildjet: pin location to de (#30955)"

This reverts commit 5ce506c1ee95f7c6afe622430bc6d7eb3f167d5f.
old-commit-hash: af1b7e5c59
2024-01-10 15:11:20 -08:00
Justin Newberry d2d2190973 buildjet: pin location to de (#30955)
* pin location

* stringify

* Fix

* fromjson

* flip the parens

* and those
old-commit-hash: 576cba217d
2024-01-10 13:48:35 -08:00
Nelson Chen 26412386cb Add permissions to build_masterci in release workflow so it can push master-ci (#30949)
old-commit-hash: 4eba5fe68d
2024-01-09 16:46:09 -08:00
Nelson Chen 42c950010d Add more permissions for pushing in prebuilt workflow (#30948)
Continuing on from https://github.com/commaai/openpilot/pull/30947
old-commit-hash: 221f81bbd3
2024-01-09 11:35:14 -08:00
Nelson Chen 79e22e7ae4 Fix badges workflow blocking release/prebuilt workflows from permission and Git-LFS complications (#30947)
old-commit-hash: 2a074eefac
2024-01-09 10:40:45 -08:00
Nelson Chen 6f25eb5900 Add necessary permissions/tokens for "lewagon/wait-on-check-action" so it can run nightly (#30923)
old-commit-hash: 2a49f94872
2024-01-07 15:02:25 -08:00
Adeeb Shihadeh 14cbcf95c0 ignore "car port" for stale pr detection
old-commit-hash: e867aa40db
2024-01-07 14:34:04 -08:00
Shane Smiskol 2f2779fab9 CI: bump other lewagon/wait-on-check-action
old-commit-hash: 318d1204e5
2024-01-03 14:11:11 -08:00
Justin Newberry e1dd457277 CI: set CI=1 in docker image (#30889)
* ci=1

* wrong spot
old-commit-hash: 9b25bfc618
2024-01-02 13:48:16 -08:00
Adeeb Shihadeh 526f3edbb5 CI: bump lewagon/wait-on-check-action
old-commit-hash: 9cf57cc4e4
2024-01-02 13:34:35 -08:00
Justin Newberry 6c6f6ef45a CI: set CI=1 globally (#30888)
ci=1
old-commit-hash: 86bd337952
2024-01-02 13:17:19 -08:00
Justin Newberry 64fbb81860 CI: update labeler to 5.0.0 release (#30862)
* update labeler

* update labeler

* update labeler

* Update labeler (#63)

* update labeler

* update labeler

* update labeler

* fix that

* Update labeler (#65)

* update labeler

* update labeler

* update labeler

* fix that

* and that

* Update labeler (#66)

* update labeler

* update labeler

* update labeler

* fix that

* and that

* fix that
old-commit-hash: d33c5bccc6
2023-12-28 10:54:09 -08:00
Justin Newberry 82ff204bdd Docs: fix old docs still being populated (#30825)
* fix push

* also remove cached files

* fix readme

* add readme

* remove that wip submodule
old-commit-hash: abe4780fdb
2023-12-20 13:56:34 -08:00
Justin Newberry 723c346fc5 Docs: fix push and running locally (#30823)
fix push
old-commit-hash: 33e7baee40
2023-12-20 13:27:27 -08:00
Adeeb Shihadeh 9ae1b6473c run test_fuzzy.py with pytest
old-commit-hash: b0b4ae9c15
2023-12-18 14:38:57 -08:00
Justin Newberry ff12759e80 Move all fingerprints to fingerprints.py (#30790)
* move fingerpints

* fix circular imports

* fix circular imports

* fix auto fingerprint

* fix those tests

* and controlsd

* add labeler rule

* no defaultdict
old-commit-hash: 28eed156e0
2023-12-18 14:04:27 -08:00
Maxime Desroches aeba6b1592 CI: Close PRs not against master (#30768)
* check branch

* Update labeler.yaml

* Update labeler.yaml

* Update labeler.yaml

* rename

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 6239cf6780
2023-12-16 19:29:45 -08:00
Justin Newberry 0939b25bc4 CI: move test_maprenderer to GH actions (#30610)
maprenderer to ci
old-commit-hash: 5d668701cb
2023-12-14 16:59:28 -08:00
Justin Newberry 553a18c065 CI: add codecov token (#30716)
* add codecov token

* retrigger with token
old-commit-hash: a3c0e2bd25
2023-12-13 11:50:44 -08:00
Justin Newberry 059aa6ffd9 Revert "Process Replay: move to pytest (#30260)" (#30687)
This reverts commit eb8f3f7f568aa0e294b32226ae5c5ed5e1b75e9d.
old-commit-hash: 7b5d4d031a
2023-12-11 14:46:56 -08:00
Adeeb Shihadeh a9f5dcf4cf CI: speedup docs build (#30574)
old-commit-hash: 5dba9187e5
2023-12-01 19:55:27 -08:00
Adeeb Shihadeh d84af30348 bump model unit test timeout
old-commit-hash: afd5877be8
2023-11-30 21:48:11 -08:00
Justin Newberry 641ae08637 CI: automatically create PR for submodule bump (#30538)
* add job

* add job (#52)

* add body

* Bump submodules (#53)

* add job

* add body

* add .

* rm that

* need submodules too

* better message

* monday at 4am

* i thought i was still est lol
old-commit-hash: 7a387962c6
2023-11-27 17:09:32 -08:00
Adeeb Shihadeh 574a8fd901 Revert "CI: automatically create PR to bump submodules (#30523)"
This reverts commit e653b285251e45740bfde63fb798d33c3627ae41.

old-commit-hash: e0ab068273
2023-11-27 09:40:37 -08:00
Justin Newberry 15061adcdf CI: automatically create PR to bump submodules (#30523)
old-commit-hash: 6f073aed5f
2023-11-26 08:27:25 -08:00
Adeeb Shihadeh c544c3200d CI: manage stale PRs (#29367)
* CI: manage stale PRs

* before_close

* rename to ignore stale

* no push

* prod mode!

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 31ef352234
2023-11-18 23:31:33 -08:00
Justin Newberry 2a934cf3c8 CI: disable registry caching (#30474)
* Revert "CI: separate image for docker cache (#30413)"

This reverts commit ce7c4abe37343b78c3a0da66ec784fd71a46e53a.

* Revert "CI: enable buildx for registry cache (#30473)"

This reverts commit 528b1be03ac407184f19b8d4901cdc5a7c96e7eb.
old-commit-hash: 291c04163a
2023-11-15 18:21:57 -08:00
Justin Newberry 48ac234374 CI: enable buildx for registry cache (#30473)
* just registry cache

* enable buildx
old-commit-hash: edf90f3e76
2023-11-15 17:53:00 -08:00
Justin Newberry 6af8e72604 Process Replay: move to pytest (#30260)
* process replay pytest

* enable long diff

* readd job name

* make it executable

* cleanup imports

* retrigger
old-commit-hash: 90c873ab1d
2023-11-13 13:50:23 -08:00
Justin Newberry efaa3ea500 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
old-commit-hash: 2ad82cbfb0
2023-11-13 10:45:24 -08:00
Justin Newberry a0b0c1c4e7 CI: codecov for multiprocessing (#30432)
old-commit-hash: 2629417320
2023-11-10 10:02:05 -08:00
Justin Newberry 0a901ebe02 Revert "CI: codecov for multiprocessing" (#30431)
Revert "CI: codecov for multiprocessing (#30428)"

This reverts commit 3b07eefe35677ba9cd35680864b88d5eacd3a25e.
old-commit-hash: 863fdec50e
2023-11-09 15:52:28 -08:00
Justin Newberry 81e3076dc6 CI: codecov for multiprocessing (#30428)
* concurrencty codecov

* its a list

* retrigger ci

* increase delay
old-commit-hash: 1e91cf92a1
2023-11-09 15:19:10 -08:00
Justin Newberry d50bddf658 CI: label codecov uploads (#30426)
* label

* matrix
old-commit-hash: 5c2796a104
2023-11-09 11:12:19 -08:00
Justin Newberry e55c032ac0 CI: pytest for the rest for GHA (#30418)
* pytest car

* all pytest

* need more time

* keep release test short

* keep it short
old-commit-hash: 53b6ab9e18
2023-11-08 16:04:02 -08:00
Justin Newberry 621dae92c7 build_release: increase timeout again (#30417)
* inc timeout

* 3 minute timeout
old-commit-hash: 844cbd95e7
2023-11-08 14:32:16 -08:00
Justin Newberry d2fde3ab22 build_release: increase timeout (#30416)
inc timeout
old-commit-hash: fa9d3ec1f5
2023-11-08 14:15:15 -08:00
Justin Newberry b4992fefed Pytest: consistent codecov (#30408)
* seed only

* random seed

* ignore version.py

* increase max examples

* increase default max examples
old-commit-hash: d02dd50749
2023-11-08 13:43:32 -08:00
Shane Smiskol f22eeaa0be selfdrive_tests: allow manual run (#30307)
* allow manual run

* Apply suggestions from code review
old-commit-hash: 2acb22fada
2023-10-25 15:17:17 -07:00
Adeeb Shihadeh 7630012f4a add CNAME for docs.comma.ai
old-commit-hash: 54db997d80
2023-10-20 20:28:21 -07:00
Justin Newberry de9bc58c39 add fingerprinting template (#30257)
Add fingerprint template
old-commit-hash: db460762c2
2023-10-16 11:32:31 -07:00
Adeeb Shihadeh 79ad4feddb CI: update to checkout@v4 (#30248)
old-commit-hash: 0336219b6a
2023-10-14 23:25:41 -07:00
Adeeb Shihadeh 4866e8376b docs: move to gh pages (#30242)
* mv to pages

* cleanup

* push static

* mv that

* new name for the orphan

* only master

* build op
old-commit-hash: f8a7def515
2023-10-14 23:03:57 -07:00
Justin Newberry a0ccf2b577 Docker: add batman to sudo group (#30188)
add batman to sudo group
old-commit-hash: d731c85b2e
2023-10-05 15:53:07 -07:00
Kacper Rączy 2878a3a876 CI: add regen job (#30157)
* Ability to whitelist/blacklist cars in regen_all

* Add CI job for regen, running on 2 segments

* Run regen_all, not regen

* Use coverage run

* Add test_regen

* Use test_regen in ci test

* Add test case names

* ONNXCPU = 1

* Add mazda segment

* Use RUN_CL

* build cl image before running

* unset PYTHONWARNINGS

* Create regen cache

* Replace daemons with processes

* Skip ford

* Skip mazda

* Add comment about commented segments

* Update selfdrive/test/process_replay/test_regen.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Remove unset pythonwarnings

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3aa74c28fc
2023-10-05 13:59:00 -07:00
Justin Newberry a0f1a5207a CI: label for research and fix CI/testing label (#30152)
* research label

* add jenkinsfile
old-commit-hash: c6ad15e52f
2023-10-03 13:48:17 -07:00
Shane Smiskol f2863a0f15 CI: fix building prebuilt image (#30099)
* fix prebuilt and test it

* that does not work
old-commit-hash: 571ebf77fa
2023-09-29 02:19:10 -07:00
Justin Newberry f64c0e5462 Devcontainer: run setup as batman user (#30084)
old-commit-hash: fb89a2a6dd
2023-09-27 23:40:02 -07:00
Adeeb Shihadeh e0346cac83 CI: disable native mac build (#30082)
old-commit-hash: 4f72e87ab7
2023-09-27 21:15:53 -07:00
Adeeb Shihadeh a2c5b7c2a9 CI: reduce master-ci build frequency
old-commit-hash: 0e02d8b8d1
2023-09-26 16:18:41 -07:00
Justin Newberry ef75f0ab12 CI: use "slow" marker for pytest (#30063)
* skip to mark

* fix quotes
old-commit-hash: 0251742079
2023-09-26 13:44:18 -07:00
Adeeb Shihadeh 3512ac86eb pre-commit: always check all file sizes (#30050)
* pre-commit: always check all file sizes

* fix release
old-commit-hash: 425fa316d1
2023-09-25 22:22:48 -07:00
Adeeb Shihadeh e69eeb7344 move remaining big files into LFS (#30053)
old-commit-hash: e185e5ffcd
2023-09-25 21:53:03 -07:00
Justin Newberry fc69b28f7e Devcontainer: improve CI tests and support using local built image (#30012)
* improve devcontainer tests

* test full build with cache

* fix that

* fix the cache

* fix the cache
old-commit-hash: 003018fc46
2023-09-24 17:24:44 -07:00
Justin Newberry 52b437f6b6 CI: remove warning messages (#30013)
remove ci warnings
old-commit-hash: f223b66b7b
2023-09-22 19:59:38 -07:00
Justin Newberry 70a5d52887 CI: disable buildjet on PR's from forks (#29979)
* fix fork CI

* linter

* needed for docker build too

* slightly more clear

* you should have gone for the head
old-commit-hash: 6f0affbcd2
2023-09-20 13:15:23 -07:00
Adeeb Shihadeh e14996e079 CI: login to docker hub on BuildJet (#29961)
* CI: login to docker hub on BuildJet

* shell

* try quotes

* forward

* try this

* can't believe this is broken

* try

* fix process replay
old-commit-hash: 4b7b234b9e
2023-09-18 15:53:16 -07:00
Adeeb Shihadeh ee0ddd7e26 Revert "CI: login to dockerhub on aarch64 runners (#29915)"
This reverts commit 28211fe8ada8997119c57c5619349332a406aa76.

old-commit-hash: 079a51cfdf
2023-09-17 15:16:07 -07:00
Kacper Rączy 4fd9b553be macOS: add prompt about support in setup script (#29939)
* Add prompt about the state of macos support in mac_setup

* Change words

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: f0b8ecd14f
2023-09-15 19:05:32 -07:00
Justin Newberry 79feec2438 CI: reduce unittest timeout (#29937)
reduce timeout
old-commit-hash: c6f1f36789
2023-09-15 14:38:51 -07:00
Kacper Rączy 9525da02b6 CI: login to dockerhub on aarch64 runners (#29915)
* DOCKER_HUB_LOGIN command

* Add docker creds

* checkout runner name

* test again

* Use runner.name to distinguish between buildjet and GH runners
old-commit-hash: c9ec7bc2a3
2023-09-14 17:08:49 -07:00
Adeeb Shihadeh cc4cb7e078 don't run test twice
old-commit-hash: 7ef8898624
2023-09-14 14:08:24 -07:00
Vivek Aithal 244a2fc793 locationd: Unit tests for different scenarios (#29908)
* add different scenarios for locationd

* add locationd scenario tests to unit tests
old-commit-hash: e9edf1300a
2023-09-14 13:59:21 -07:00
Vivek Aithal 370d912053 liblocationd: No longer used (#29909)
remove liblocationd
old-commit-hash: 01011c6c1d
2023-09-13 18:59:32 -07:00
Justin Newberry 490613e5e4 CI: fix setup retry sleep time (#29877)
old-commit-hash: a87d62ffa6
2023-09-11 23:08:04 -07:00
Justin Newberry 58ea2bac72 CI: never remove existing labels (#29885)
old-commit-hash: f9a60072f7
2023-09-11 23:04:53 -07:00
Adeeb Shihadeh 1f8459d285 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f34
2023-09-11 14:01:50 -07:00
Justin Newberry d1fc58bf81 CI: fix pr labeler permissions (#29862)
* fix pr labeler

* fix that
old-commit-hash: 50b954d595
2023-09-09 01:02:49 -07:00
Justin Newberry 693183a946 CI: auto label PR's (#29842)
* auto label

* on pull request

* checkout

* yaml not yml

* recursive here too

* start with just car stuff and CI

* require all

* no fps

* add translations and fix CI
old-commit-hash: aa52cf3e81
2023-09-08 17:24:19 -07:00
Kacper Rączy fc4972539f docker: fix cl tag (#29858)
unset TARGET_ARCHITECTURE before running build
old-commit-hash: c417669cbd
2023-09-08 17:20:03 -07:00
Justin Newberry 5ac2ef0e3f CI: fix aarch64 cache (#29857)
was not passed in
old-commit-hash: d3e5f66fc1
2023-09-08 17:13:18 -07:00
Kacper Rączy 73c25cc743 docker: fix multiarch tag push (#29850)
Fix multiarch merge script
old-commit-hash: b09ec6bb5b
2023-09-08 15:03:40 -07:00
Kacper Rączy f8c6ebd3ad docker: multiarch images (amd64/aarch64) (#29691)
* arch specific tags

* merge multiarch script

* arm64 build and merge jobs

* update tag script

* casual ci test

* change image to 2204

* docker -v test

* arch specific naming

* Remove test_buildjet

* build -arch images only when CURRENT_ARCH_BUILD is set

* support new tags in tag_multiarch

* Toggle CURRENT_ARCH_BUILD on in ci

* Docker common

* Fix condition

* Fix path to docker_common

* Add more stuff to common

* Add build_arm job

* composite job for building

* Run checkout before build composite

* add shell arg

* move timeout to selfdrive_tests

* TARGET ARCHITECTURE var

* Support TARGET_ARCHITECTURE in workflow

* Rewrite to Single build job with matrix

* Remove shebang from docker_common

* Attempt for fix build matrix

* Remove setup arch

* build matrix for docker push

* Use 2vcpu for arm build

* 2vcpu for docker_push too

* temporarly unlock docker_push

* Remove requirement for target arch when pushing

* Unset target architecture in docker_push cl

* fix sha tags

* Rename action to compile-openpilot

* move push_image line to tag_multiarch step

* arch suffix for scons cache

* cache_key_prefix for setup-with-retry

* Re-disable docker_push on non-master

* Add newlines
old-commit-hash: 1344a93a35
2023-09-08 14:46:39 -07:00
Adeeb Shihadeh 13c3bf2cbd CI: increase model replay timeout
old-commit-hash: c96fe132e8
2023-09-08 10:41:54 -07:00
Justin Newberry 5b1e60f5da Pytest: enforce a default timeout (#29793)
* pytest: enforce default timeout

* disable that for now

* 30 second timeout on tests
old-commit-hash: b0a71d4553
2023-09-07 17:53:51 -07:00
Justin Newberry 37e4b2cba9 CI: run unittests in parallel with xdist (#29756)
* parallel tests

* review suggesions

* add to pyproject

* add a bit more buffer on that

* fix rare athena issue

* remove from pypoetry
old-commit-hash: dde225221e
2023-09-07 16:29:36 -07:00
Justin Newberry e468072f1f CI: retry setup on failure (#29785)
* try a setup action

* should be uses

* fix that formatting

* try conclusion

* continue on error

* try without hyphens

* only when failure

* make it optional

* continue on error

* those don't fail anymore

* what about 3 failures

* remove stuff for debugging

* cleanup

* review suggestions

* change that too

* fix pj
old-commit-hash: 917f71d446
2023-09-06 11:11:15 -07:00
Adeeb Shihadeh 53e0f5eb49 pytest: use a clean environment for all tests (#29788)
* pytest: use a clean environment for all tests

* rm that

* fix pj

* put build back

* fix params

* fix that

* handle no key

* that was removed

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 7b6afbc162
2023-09-05 18:52:40 -07:00
Justin Newberry 839e72de70 CI: use pytest for unittesting (#29709)
* switch to pytest

* static analysis

* fix the helpers

* static analysis

* remove that

* more parallel test

* cleanup

* static analysis

* durations min and tolerance

* reduce those iterations

* sleep time could be decreased too

* in case it's negative

* try using caching

* remove parallelization for first PR

* PR Cleanup

* reduce diff

* fix that

* bump panda
old-commit-hash: ca435d3447
2023-09-04 11:54:35 -07:00
Adeeb Shihadeh 0107dfb391 don't rerun those here
old-commit-hash: 75081b2e54
2023-08-31 18:34:20 -07:00
Adeeb Shihadeh fbfc0e460d CI: weekly poetry lock (#29738)
* CI: weekly poetry lock

* add that back

* title

* cleanup
old-commit-hash: afd35bf7ec
2023-08-31 14:27:59 -07:00
Justin Newberry 47eb055283 CI: fix proc replay download cache permissions (#29636)
chmod that
old-commit-hash: ab05bff07d
2023-08-27 09:45:16 -07:00
Adeeb Shihadeh 68dd600872 CI: use buildjet for process replay (#29277)
* squash for pr

* backoff to 4vcpu

* review suggestions

* simplify

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: d35beffbce
2023-08-25 18:50:21 -07:00
Justin Newberry 643a13f27e CI: use local scons cache instead of building a separate image (#29634)
* use local

* added ci_sim

* revert scons

* dont need these anymore

* same for sim

* fix dockerfiles
old-commit-hash: c46965fc27
2023-08-25 16:06:17 -07:00
Dean Lee 00f900e8c4 common/tests: combine multiple test binaries into one (#29623)
old-commit-hash: 2709cd6538
2023-08-25 10:35:39 -07:00
Justin Newberry e128aedc63 CI: move cache dir to workspace directory (#29622)
* comma dir

* mkdir

* fix issues

* test

* fix that

* fix

* do the other ones too

* missed that

* fix

* fix pr comments by moving into two different directories

* fix location

* fix that

* only change current

* fix
old-commit-hash: c0b9458a45
2023-08-25 01:41:04 -07:00
Adeeb Shihadeh 06aea7d935 CI: remove redundant apt installs (#29617)
* CI: remove redundant apt installs

* split build and test

* faster build
old-commit-hash: 36cc41f619
2023-08-24 17:32:15 -07:00
Adeeb Shihadeh 8f9dcca26a CI: workaround syntax error in azure lib (#29618)
old-commit-hash: e863828051
2023-08-24 17:18:11 -07:00
Justin Newberry 4063a92683 CI: use GITHUB_ENV for env variables (#29616)
export doesn't work across steps
old-commit-hash: 90cb417caa
2023-08-24 17:03:25 -07:00
Justin Newberry 630b440536 CI: fix docker push (#29614)
* fix those

* fix docker push too

* dont need that twice
old-commit-hash: ede9f2cda5
2023-08-24 16:30:33 -07:00
Justin Newberry 6847f819d1 CI: use scripts for docker build (#29599)
* use scripts

* remove common

* do login in the workflow

* separate step

* cleanup

* one script is cleaner

* keep it consistent

* review suggestions

* move in ci too

* PR cleanup
old-commit-hash: 3d9f238bf9
2023-08-24 16:09:08 -07:00
Adeeb Shihadeh 61cf541322 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
old-commit-hash: 4917e22615
2023-08-24 14:58:30 -07:00
Justin Newberry de7257c22c CI: Normalize file permissions (#29584)
* normalize file permissions

* comment

* add comment

* remove that

* shell

* should be on the top
old-commit-hash: da7504e1e7
2023-08-23 23:50:51 -07:00
Justin Newberry 7a532e02f3 CI: switch to --cache-to type=inline for buildkit cache (#29575)
this is cleaner
old-commit-hash: 2fdde9b77d
2023-08-23 17:41:33 -07:00
Justin Newberry e54655626d CI: Docs rebuild base image (#29566)
* docs rebuild base image

* fix order
old-commit-hash: 2e4f8e6608
2023-08-23 15:33:23 -07:00
Kacper Rączy 3681c1d1b2 devcontainer: handle hosts without X11 (#29537)
* Setup xauthority link on host in initializeCommand

* Create a dummy xauthority if it does no exist on host machine

* Remove xauthority line from ci test
old-commit-hash: 659795b1db
2023-08-23 10:26:38 -07:00
Kacper Rączy e250480db6 devcontainer: CI fix (#29534)
Export xauthority before running devcontainer
old-commit-hash: df9564e172
2023-08-22 14:14:14 -07:00
Robbe Derks a04cbced36 Devcontainer (#29259)
* mvp devcontainer. builds, runs and UI works

* fix indentation

* enable color and fix openpilot_env path

* separate dockerfile for devcontainer

* use prebuilt image

* Fix openpilot_env setup

* Add dev container section in readme

* Fix typo

* Fix typo again

* Move dev dockerfile to .devcontainer dir

* Update README

* Add note about x11 forwarding on macos

* Update dev container json

* Fix typo

* Override DISPLAY on macOS

* Mention XAUTHORITY for macOS setup in README

* fix typo

* Add devcontainer CI test

* Rename to devcontainer

* Fix git issues

* ripgrep

* Link instead of vscode manual

* Replace raw path with containerWorkspaceFolder

* Fix typo

* Remove dev tools workflow

* Link away X11 forwarding setup isntructions for mac

* Remove fork consrtaint, add test run of scons

* Add submodules as safe.directories in postStartCommand

* Remove openpilot_env references

* Add scons cache volume

---------

Co-authored-by: Robbe Derks <robbe@localhost.localdomain>
Co-authored-by: Kacper Rączy <gfw.kra@gmail.com>
old-commit-hash: d71a7190f1
2023-08-22 11:47:09 -07:00
Adeeb Shihadeh b38403f2ca Revert Qt MOC hacks (#29528)
* Revert "CI: prevent moc from running in cache population step (#29401)"

This reverts commit 34634b95aa15dc608315016c40857f3e16ca4ff9.

* Revert "SCons: respect cache read only (#29437)"

This reverts commit 77cb4da6381fdf94ea98c55d6fcc30db4d24dcf6.

* don't change moc path
old-commit-hash: 91dc8457ae
2023-08-22 11:16:58 -07:00
Kacper Rączy 0c17a4f4d0 CI: prevent moc from running in cache population step (#29401)
* Do not remove moc_files from cache

* Add cache cleanup script

* Use cache cleanup script

* Dry-run in cache population command

* Add newline

* Temporarly disable master only constraint for cache cleanup step

* Add test lines

* one more

* Fix shebang

* Remove debug lines

* Bring back master branch constraints
old-commit-hash: d1aedccfbe
2023-08-22 10:47:56 -07:00
Justin Newberry 3e6ce7d6cd CI: use xdist for car model tests (#29514)
* bump panda

* try multithreaded for car models

* need pytest-cov

* upgraded to poetry 1.5.1 and regenerated
old-commit-hash: 3492e80d19
2023-08-21 20:51:27 -07:00
Justin Newberry e022ffe528 CI: simulator disable pull to save local space (#29517)
we don't need to pull since the image is different most of the time
old-commit-hash: ec5e3bef95
2023-08-21 20:01:52 -07:00
Justin Newberry fe844afac7 CI: remove old docs base image push (#29512)
remove that push
old-commit-hash: 9188c56069
2023-08-21 15:32:41 -07:00
Justin Newberry 7205b92bb6 CI: use scons cache mount for building simulator and docs (#29436)
* build docker image with scons cache

* use setup

* scons cache

* added the dockerfile

* add the shell

* docs use cache

* dont pull lfs for docs

* simulator too

* dont pull the cache image

* fix inputs

* inputs

* booleans aren't supported

* bool not supported

* bool isnt supported

* fix

* readonly cache

* fix sim cache too

* respect readonly

* gitignore and move to correct folder

* also copy old

* move to tools/ci

* move to selfdrive/test

* just make the cache writable, it's discarded anyway

* minimize diff in this pr
old-commit-hash: 197460e061
2023-08-21 15:11:31 -07:00
Kacper Rączy 1d47429f8e Setup cleanup vol. 2 (#29456)
* code from setup cleanup #29419

update ci

update ci

export variables for mac os

check env

what is in the profile script?

install pyenv the same everywhere

temporarily disable brew cache

temporarily disable brew cache

try fixing pyenv virtualenv-init

try this

inject shims path earlier

try alternate install method

switch back to brew install

try         eval "$(pyenv init --path)"

add eval "\$(pyenv init --path)"

* Add local .env file to the cache list

* Change .env paths

* debug line

* order?

* remove .env

* Add .venv to caches

---------

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
old-commit-hash: 0f7be5b1e6
2023-08-21 13:30:48 -07:00
Dean Lee 97631ec362 common: C++ RateKeeper (#29374)
* c++ RateKeeper

* add to files_common

* use util::random_int

* improve monotor_time

* remove ~ratekeeper
old-commit-hash: 3eef63af9b
2023-08-20 21:27:02 -07:00
Adeeb Shihadeh bd27be2b78 move mypy config into pyproject.toml (#29501)
* move mypy config into pyproject.toml

* rm reference
old-commit-hash: ff068dd722
2023-08-20 21:08:04 -07:00
Harald Schäfer 3022f06e1e update process replay timeout (#29478)
* Always dict differ

* Update selfdrive_tests.yaml

* bump up more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: bc4b75822a
2023-08-20 17:24:33 -07:00
Justin Newberry 1988b4805e Revert "setup cleanup (#29419)" (#29451)
This reverts commit bc9c60a3f955bb5b96dc41e6072cab47191f8896.
old-commit-hash: 1944945d9d
2023-08-17 13:23:06 -07:00
Greg Hogan cce2c732c6 setup cleanup (#29419)
* setup cleanup

* update ci

* update ci

* export variables for mac os

* check env

* what is in the profile script?

* install pyenv the same everywhere

* temporarily disable brew cache

* temporarily disable brew cache

* try fixing pyenv virtualenv-init

* try this

* inject shims path earlier

* try alternate install method

* switch back to brew install

* try         eval "$(pyenv init --path)"

* add eval "\$(pyenv init --path)"
old-commit-hash: ad32816fd6
2023-08-17 08:51:16 -07:00
Justin Newberry edbd5d330e CI: use setup script for docs and simulator (#29434)
* use setup

* dont pull lfs for docs

* fix inputs

* bool not supported

* bool isnt supported
old-commit-hash: ad00595ba5
2023-08-16 17:59:42 -07:00
Kacper Rączy 4096be66e4 macOS: fix GH actions cache (#29399)
Add lz4 and xz to dep cache exceptions
old-commit-hash: ae649ec68d
2023-08-14 16:13:35 -07:00
Justin Newberry 1424636288 CI: docs speedup by caching first stage (#29397)
* docs speedup

* fix tags on docs build

* build docs without build-push-action
old-commit-hash: f8cbdcfa40
2023-08-14 14:36:17 -07:00
Adeeb Shihadeh e76af64065 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
old-commit-hash: b11b14aff8
2023-08-12 17:15:16 -07:00
Adeeb Shihadeh b3f734283d remove xx dependencies (#29263)
* rm xx deps

* mv that

* fix

* fix a path

* relock

* relock

* update

* update sentry

* update

* revert sentry

* Update lock

* Dummy pip package

* Not needed with poetry

* dont need dummy

---------

Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
old-commit-hash: 0ced56b2ea
2023-08-11 20:05:44 -07:00
Justin Newberry 20f6a25a1c CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
old-commit-hash: 2482b58968
2023-08-11 17:41:23 -07:00
Justin Newberry afa33bee18 CI: move cache to home directory (#29347)
move cache to home dir
old-commit-hash: ace4d78e31
2023-08-11 15:45:38 -07:00
Justin Newberry f8cd844e7c CI: use default caching action (#29339)
old-commit-hash: a0f399677e
2023-08-11 14:03:10 -07:00
Adeeb Shihadeh 2e818c2393 CI: bump up model test timeout
old-commit-hash: cd4bb412f5
2023-08-10 17:29:56 -07:00
Adeeb Shihadeh 442ec436dd remove rest of pylint (#29302)
* remove rest of pylint

* fix release build
old-commit-hash: e53f9597f3
2023-08-09 19:03:36 -07:00
Adeeb Shihadeh d704b0318a CI: move longitudinal tests into unit tests job (#29245)
* move long into unit test job

* try without these

* add that back
old-commit-hash: ae8252c14a
2023-08-07 06:48:06 -07:00
Adeeb Shihadeh de743e3ec4 CI: add timeouts to selfdrive tests (#29239)
* CI: add timeouts to selfdrive tests

* ugh, so slow

* will have to come back to this one
old-commit-hash: 75ab960557
2023-08-04 18:14:14 -07:00
Adeeb Shihadeh 4b96635560 CI: update cache action (#29241)
* update that

* update one more
old-commit-hash: f714e7cb24
2023-08-04 17:59:55 -07:00
Adeeb Shihadeh ca5d92a1a1 CI: only run on master + PRs (#29242)
old-commit-hash: 0df2cd4fa8
2023-08-04 17:56:30 -07:00
Adeeb Shihadeh 5c0a7ef79e CI: add timeouts to tools jobs (#29238)
old-commit-hash: 8633e5f8ab
2023-08-04 15:35:21 -07:00
Shane Smiskol ffd534fdc3 car docs diff bot: don't ignore failures
we have a test for this, so if that fails, doesn't matter if this fails too

old-commit-hash: 6ad6191e6a
2023-08-02 17:18:43 -07:00
Adeeb Shihadeh 0903b55fca CI: allow triggering fast release builds
old-commit-hash: e53ab3a18a
2023-07-26 15:22:23 -07:00
Adeeb Shihadeh 9f7fa18b7b CI: run plotjuggler test on mac (#29102)
* CI: run plotjuggler test on mac

* source

* python path
old-commit-hash: 34389acbbf
2023-07-22 23:10:31 -07:00
Adeeb Shihadeh e56ac872e1 CI: add docker images tagged with git commit (#29052)
* CI: add docker images tagged with git commit

* tag later

* debug

* fix tag

* test that

* cleanup
old-commit-hash: a83dec9d94
2023-07-19 23:35:33 -07:00
Adeeb Shihadeh e9648cf860 CI: use locally built image as CL base (#29030)
old-commit-hash: 22882a0d22
2023-07-18 22:57:32 -07:00
Maxime Desroches 4aaceac124 Force build of openpilot-base for OpenCL tests (#29022)
old-commit-hash: 56a0f9e074
2023-07-18 16:25:05 -07:00
Adeeb Shihadeh 4dec8811e0 CI: update codecov action (#28967)
old-commit-hash: ae6f13fb50
2023-07-15 22:55:33 -07:00
Maxime Desroches 1693786962 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit a5be0640a3780156fdd5c04c1e6204fa41b307a8.

* determinism

* fingerprint
old-commit-hash: 0ebec253d0
2023-06-29 21:49:23 -07:00