Commit Graph

337 Commits

Author SHA1 Message Date
Justin Newberry
2a934cf3c8 CI: disable registry caching (#30474)
* Revert "CI: separate image for docker cache (#30413)"

This reverts commit ce7c4abe37343b78c3a0da66ec784fd71a46e53a.

* Revert "CI: enable buildx for registry cache (#30473)"

This reverts commit 528b1be03ac407184f19b8d4901cdc5a7c96e7eb.
old-commit-hash: 291c04163a
2023-11-15 18:21:57 -08:00
Justin Newberry
48ac234374 CI: enable buildx for registry cache (#30473)
* just registry cache

* enable buildx
old-commit-hash: edf90f3e76
2023-11-15 17:53:00 -08:00
Justin Newberry
6af8e72604 Process Replay: move to pytest (#30260)
* process replay pytest

* enable long diff

* readd job name

* make it executable

* cleanup imports

* retrigger
old-commit-hash: 90c873ab1d
2023-11-13 13:50:23 -08:00
Justin Newberry
efaa3ea500 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
old-commit-hash: 2ad82cbfb0
2023-11-13 10:45:24 -08:00
Justin Newberry
a0b0c1c4e7 CI: codecov for multiprocessing (#30432)
old-commit-hash: 2629417320
2023-11-10 10:02:05 -08:00
Justin Newberry
0a901ebe02 Revert "CI: codecov for multiprocessing" (#30431)
Revert "CI: codecov for multiprocessing (#30428)"

This reverts commit 3b07eefe35677ba9cd35680864b88d5eacd3a25e.
old-commit-hash: 863fdec50e
2023-11-09 15:52:28 -08:00
Justin Newberry
81e3076dc6 CI: codecov for multiprocessing (#30428)
* concurrencty codecov

* its a list

* retrigger ci

* increase delay
old-commit-hash: 1e91cf92a1
2023-11-09 15:19:10 -08:00
Justin Newberry
d50bddf658 CI: label codecov uploads (#30426)
* label

* matrix
old-commit-hash: 5c2796a104
2023-11-09 11:12:19 -08:00
Justin Newberry
e55c032ac0 CI: pytest for the rest for GHA (#30418)
* pytest car

* all pytest

* need more time

* keep release test short

* keep it short
old-commit-hash: 53b6ab9e18
2023-11-08 16:04:02 -08:00
Justin Newberry
621dae92c7 build_release: increase timeout again (#30417)
* inc timeout

* 3 minute timeout
old-commit-hash: 844cbd95e7
2023-11-08 14:32:16 -08:00
Justin Newberry
d2fde3ab22 build_release: increase timeout (#30416)
inc timeout
old-commit-hash: fa9d3ec1f5
2023-11-08 14:15:15 -08:00
Justin Newberry
b4992fefed Pytest: consistent codecov (#30408)
* seed only

* random seed

* ignore version.py

* increase max examples

* increase default max examples
old-commit-hash: d02dd50749
2023-11-08 13:43:32 -08:00
Shane Smiskol
f22eeaa0be selfdrive_tests: allow manual run (#30307)
* allow manual run

* Apply suggestions from code review
old-commit-hash: 2acb22fada
2023-10-25 15:17:17 -07:00
Adeeb Shihadeh
7630012f4a add CNAME for docs.comma.ai
old-commit-hash: 54db997d80
2023-10-20 20:28:21 -07:00
Justin Newberry
de9bc58c39 add fingerprinting template (#30257)
Add fingerprint template
old-commit-hash: db460762c2
2023-10-16 11:32:31 -07:00
Adeeb Shihadeh
79ad4feddb CI: update to checkout@v4 (#30248)
old-commit-hash: 0336219b6a
2023-10-14 23:25:41 -07:00
Adeeb Shihadeh
4866e8376b docs: move to gh pages (#30242)
* mv to pages

* cleanup

* push static

* mv that

* new name for the orphan

* only master

* build op
old-commit-hash: f8a7def515
2023-10-14 23:03:57 -07:00
Justin Newberry
a0ccf2b577 Docker: add batman to sudo group (#30188)
add batman to sudo group
old-commit-hash: d731c85b2e
2023-10-05 15:53:07 -07:00
Kacper Rączy
2878a3a876 CI: add regen job (#30157)
* Ability to whitelist/blacklist cars in regen_all

* Add CI job for regen, running on 2 segments

* Run regen_all, not regen

* Use coverage run

* Add test_regen

* Use test_regen in ci test

* Add test case names

* ONNXCPU = 1

* Add mazda segment

* Use RUN_CL

* build cl image before running

* unset PYTHONWARNINGS

* Create regen cache

* Replace daemons with processes

* Skip ford

* Skip mazda

* Add comment about commented segments

* Update selfdrive/test/process_replay/test_regen.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Remove unset pythonwarnings

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3aa74c28fc
2023-10-05 13:59:00 -07:00
Justin Newberry
a0f1a5207a CI: label for research and fix CI/testing label (#30152)
* research label

* add jenkinsfile
old-commit-hash: c6ad15e52f
2023-10-03 13:48:17 -07:00
Shane Smiskol
f2863a0f15 CI: fix building prebuilt image (#30099)
* fix prebuilt and test it

* that does not work
old-commit-hash: 571ebf77fa
2023-09-29 02:19:10 -07:00
Justin Newberry
f64c0e5462 Devcontainer: run setup as batman user (#30084)
old-commit-hash: fb89a2a6dd
2023-09-27 23:40:02 -07:00
Adeeb Shihadeh
e0346cac83 CI: disable native mac build (#30082)
old-commit-hash: 4f72e87ab7
2023-09-27 21:15:53 -07:00
Adeeb Shihadeh
a2c5b7c2a9 CI: reduce master-ci build frequency
old-commit-hash: 0e02d8b8d1
2023-09-26 16:18:41 -07:00
Justin Newberry
ef75f0ab12 CI: use "slow" marker for pytest (#30063)
* skip to mark

* fix quotes
old-commit-hash: 0251742079
2023-09-26 13:44:18 -07:00
Adeeb Shihadeh
3512ac86eb pre-commit: always check all file sizes (#30050)
* pre-commit: always check all file sizes

* fix release
old-commit-hash: 425fa316d1
2023-09-25 22:22:48 -07:00
Adeeb Shihadeh
e69eeb7344 move remaining big files into LFS (#30053)
old-commit-hash: e185e5ffcd
2023-09-25 21:53:03 -07:00
Justin Newberry
fc69b28f7e Devcontainer: improve CI tests and support using local built image (#30012)
* improve devcontainer tests

* test full build with cache

* fix that

* fix the cache

* fix the cache
old-commit-hash: 003018fc46
2023-09-24 17:24:44 -07:00
Justin Newberry
52b437f6b6 CI: remove warning messages (#30013)
remove ci warnings
old-commit-hash: f223b66b7b
2023-09-22 19:59:38 -07:00
Justin Newberry
70a5d52887 CI: disable buildjet on PR's from forks (#29979)
* fix fork CI

* linter

* needed for docker build too

* slightly more clear

* you should have gone for the head
old-commit-hash: 6f0affbcd2
2023-09-20 13:15:23 -07:00
Adeeb Shihadeh
e14996e079 CI: login to docker hub on BuildJet (#29961)
* CI: login to docker hub on BuildJet

* shell

* try quotes

* forward

* try this

* can't believe this is broken

* try

* fix process replay
old-commit-hash: 4b7b234b9e
2023-09-18 15:53:16 -07:00
Adeeb Shihadeh
ee0ddd7e26 Revert "CI: login to dockerhub on aarch64 runners (#29915)"
This reverts commit 28211fe8ada8997119c57c5619349332a406aa76.

old-commit-hash: 079a51cfdf
2023-09-17 15:16:07 -07:00
Kacper Rączy
4fd9b553be macOS: add prompt about support in setup script (#29939)
* Add prompt about the state of macos support in mac_setup

* Change words

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: f0b8ecd14f
2023-09-15 19:05:32 -07:00
Justin Newberry
79feec2438 CI: reduce unittest timeout (#29937)
reduce timeout
old-commit-hash: c6f1f36789
2023-09-15 14:38:51 -07:00
Kacper Rączy
9525da02b6 CI: login to dockerhub on aarch64 runners (#29915)
* DOCKER_HUB_LOGIN command

* Add docker creds

* checkout runner name

* test again

* Use runner.name to distinguish between buildjet and GH runners
old-commit-hash: c9ec7bc2a3
2023-09-14 17:08:49 -07:00
Adeeb Shihadeh
cc4cb7e078 don't run test twice
old-commit-hash: 7ef8898624
2023-09-14 14:08:24 -07:00
Vivek Aithal
244a2fc793 locationd: Unit tests for different scenarios (#29908)
* add different scenarios for locationd

* add locationd scenario tests to unit tests
old-commit-hash: e9edf1300a
2023-09-14 13:59:21 -07:00
Vivek Aithal
370d912053 liblocationd: No longer used (#29909)
remove liblocationd
old-commit-hash: 01011c6c1d
2023-09-13 18:59:32 -07:00
Justin Newberry
490613e5e4 CI: fix setup retry sleep time (#29877)
old-commit-hash: a87d62ffa6
2023-09-11 23:08:04 -07:00
Justin Newberry
58ea2bac72 CI: never remove existing labels (#29885)
old-commit-hash: f9a60072f7
2023-09-11 23:04:53 -07:00
Adeeb Shihadeh
1f8459d285 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f34
2023-09-11 14:01:50 -07:00
Justin Newberry
d1fc58bf81 CI: fix pr labeler permissions (#29862)
* fix pr labeler

* fix that
old-commit-hash: 50b954d595
2023-09-09 01:02:49 -07:00
Justin Newberry
693183a946 CI: auto label PR's (#29842)
* auto label

* on pull request

* checkout

* yaml not yml

* recursive here too

* start with just car stuff and CI

* require all

* no fps

* add translations and fix CI
old-commit-hash: aa52cf3e81
2023-09-08 17:24:19 -07:00
Kacper Rączy
fc4972539f docker: fix cl tag (#29858)
unset TARGET_ARCHITECTURE before running build
old-commit-hash: c417669cbd
2023-09-08 17:20:03 -07:00
Justin Newberry
5ac2ef0e3f CI: fix aarch64 cache (#29857)
was not passed in
old-commit-hash: d3e5f66fc1
2023-09-08 17:13:18 -07:00
Kacper Rączy
73c25cc743 docker: fix multiarch tag push (#29850)
Fix multiarch merge script
old-commit-hash: b09ec6bb5b
2023-09-08 15:03:40 -07:00
Kacper Rączy
f8c6ebd3ad docker: multiarch images (amd64/aarch64) (#29691)
* arch specific tags

* merge multiarch script

* arm64 build and merge jobs

* update tag script

* casual ci test

* change image to 2204

* docker -v test

* arch specific naming

* Remove test_buildjet

* build -arch images only when CURRENT_ARCH_BUILD is set

* support new tags in tag_multiarch

* Toggle CURRENT_ARCH_BUILD on in ci

* Docker common

* Fix condition

* Fix path to docker_common

* Add more stuff to common

* Add build_arm job

* composite job for building

* Run checkout before build composite

* add shell arg

* move timeout to selfdrive_tests

* TARGET ARCHITECTURE var

* Support TARGET_ARCHITECTURE in workflow

* Rewrite to Single build job with matrix

* Remove shebang from docker_common

* Attempt for fix build matrix

* Remove setup arch

* build matrix for docker push

* Use 2vcpu for arm build

* 2vcpu for docker_push too

* temporarly unlock docker_push

* Remove requirement for target arch when pushing

* Unset target architecture in docker_push cl

* fix sha tags

* Rename action to compile-openpilot

* move push_image line to tag_multiarch step

* arch suffix for scons cache

* cache_key_prefix for setup-with-retry

* Re-disable docker_push on non-master

* Add newlines
old-commit-hash: 1344a93a35
2023-09-08 14:46:39 -07:00
Adeeb Shihadeh
13c3bf2cbd CI: increase model replay timeout
old-commit-hash: c96fe132e8
2023-09-08 10:41:54 -07:00
Justin Newberry
5b1e60f5da Pytest: enforce a default timeout (#29793)
* pytest: enforce default timeout

* disable that for now

* 30 second timeout on tests
old-commit-hash: b0a71d4553
2023-09-07 17:53:51 -07:00
Justin Newberry
37e4b2cba9 CI: run unittests in parallel with xdist (#29756)
* parallel tests

* review suggesions

* add to pyproject

* add a bit more buffer on that

* fix rare athena issue

* remove from pypoetry
old-commit-hash: dde225221e
2023-09-07 16:29:36 -07:00