Commit Graph

182 Commits

Author SHA1 Message Date
Adeeb Shihadeh
b0b4ae9c15 run test_fuzzy.py with pytest 2023-12-18 14:38:57 -08:00
Justin Newberry
5d668701cb CI: move test_maprenderer to GH actions (#30610)
maprenderer to ci
2023-12-14 16:59:28 -08:00
Justin Newberry
a3c0e2bd25 CI: add codecov token (#30716)
* add codecov token

* retrigger with token
2023-12-13 11:50:44 -08:00
Justin Newberry
7b5d4d031a Revert "Process Replay: move to pytest (#30260)" (#30687)
This reverts commit 90c873ab1d.
2023-12-11 14:46:56 -08:00
Adeeb Shihadeh
afd5877be8 bump model unit test timeout 2023-11-30 21:48:11 -08:00
Justin Newberry
90c873ab1d Process Replay: move to pytest (#30260)
* process replay pytest

* enable long diff

* readd job name

* make it executable

* cleanup imports

* retrigger
2023-11-13 13:50:23 -08:00
Justin Newberry
2ad82cbfb0 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
2023-11-13 10:45:24 -08:00
Justin Newberry
2629417320 CI: codecov for multiprocessing (#30432) 2023-11-10 10:02:05 -08:00
Justin Newberry
863fdec50e Revert "CI: codecov for multiprocessing" (#30431)
Revert "CI: codecov for multiprocessing (#30428)"

This reverts commit 1e91cf92a1.
2023-11-09 15:52:28 -08:00
Justin Newberry
1e91cf92a1 CI: codecov for multiprocessing (#30428)
* concurrencty codecov

* its a list

* retrigger ci

* increase delay
2023-11-09 15:19:10 -08:00
Justin Newberry
5c2796a104 CI: label codecov uploads (#30426)
* label

* matrix
2023-11-09 11:12:19 -08:00
Justin Newberry
53b6ab9e18 CI: pytest for the rest for GHA (#30418)
* pytest car

* all pytest

* need more time

* keep release test short

* keep it short
2023-11-08 16:04:02 -08:00
Justin Newberry
844cbd95e7 build_release: increase timeout again (#30417)
* inc timeout

* 3 minute timeout
2023-11-08 14:32:16 -08:00
Justin Newberry
fa9d3ec1f5 build_release: increase timeout (#30416)
inc timeout
2023-11-08 14:15:15 -08:00
Justin Newberry
d02dd50749 Pytest: consistent codecov (#30408)
* seed only

* random seed

* ignore version.py

* increase max examples

* increase default max examples
2023-11-08 13:43:32 -08:00
Shane Smiskol
2acb22fada selfdrive_tests: allow manual run (#30307)
* allow manual run

* Apply suggestions from code review
2023-10-25 15:17:17 -07:00
Adeeb Shihadeh
0336219b6a CI: update to checkout@v4 (#30248) 2023-10-14 23:25:41 -07:00
Kacper Rączy
3aa74c28fc CI: add regen job (#30157)
* Ability to whitelist/blacklist cars in regen_all

* Add CI job for regen, running on 2 segments

* Run regen_all, not regen

* Use coverage run

* Add test_regen

* Use test_regen in ci test

* Add test case names

* ONNXCPU = 1

* Add mazda segment

* Use RUN_CL

* build cl image before running

* unset PYTHONWARNINGS

* Create regen cache

* Replace daemons with processes

* Skip ford

* Skip mazda

* Add comment about commented segments

* Update selfdrive/test/process_replay/test_regen.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Remove unset pythonwarnings

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-10-05 13:59:00 -07:00
Adeeb Shihadeh
4f72e87ab7 CI: disable native mac build (#30082) 2023-09-27 21:15:53 -07:00
Justin Newberry
0251742079 CI: use "slow" marker for pytest (#30063)
* skip to mark

* fix quotes
2023-09-26 13:44:18 -07:00
Adeeb Shihadeh
425fa316d1 pre-commit: always check all file sizes (#30050)
* pre-commit: always check all file sizes

* fix release
2023-09-25 22:22:48 -07:00
Adeeb Shihadeh
e185e5ffcd move remaining big files into LFS (#30053) 2023-09-25 21:53:03 -07:00
Justin Newberry
f223b66b7b CI: remove warning messages (#30013)
remove ci warnings
2023-09-22 19:59:38 -07:00
Justin Newberry
6f0affbcd2 CI: disable buildjet on PR's from forks (#29979)
* fix fork CI

* linter

* needed for docker build too

* slightly more clear

* you should have gone for the head
2023-09-20 13:15:23 -07:00
Adeeb Shihadeh
4b7b234b9e CI: login to docker hub on BuildJet (#29961)
* CI: login to docker hub on BuildJet

* shell

* try quotes

* forward

* try this

* can't believe this is broken

* try

* fix process replay
2023-09-18 15:53:16 -07:00
Adeeb Shihadeh
079a51cfdf Revert "CI: login to dockerhub on aarch64 runners (#29915)"
This reverts commit c9ec7bc2a3.
2023-09-17 15:16:07 -07:00
Kacper Rączy
f0b8ecd14f macOS: add prompt about support in setup script (#29939)
* Add prompt about the state of macos support in mac_setup

* Change words

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-09-15 19:05:32 -07:00
Justin Newberry
c6f1f36789 CI: reduce unittest timeout (#29937)
reduce timeout
2023-09-15 14:38:51 -07:00
Kacper Rączy
c9ec7bc2a3 CI: login to dockerhub on aarch64 runners (#29915)
* DOCKER_HUB_LOGIN command

* Add docker creds

* checkout runner name

* test again

* Use runner.name to distinguish between buildjet and GH runners
2023-09-14 17:08:49 -07:00
Adeeb Shihadeh
7ef8898624 don't run test twice 2023-09-14 14:08:24 -07:00
Vivek Aithal
e9edf1300a locationd: Unit tests for different scenarios (#29908)
* add different scenarios for locationd

* add locationd scenario tests to unit tests
2023-09-14 13:59:21 -07:00
Vivek Aithal
01011c6c1d liblocationd: No longer used (#29909)
remove liblocationd
2023-09-13 18:59:32 -07:00
Adeeb Shihadeh
2c1dfc2f34 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
2023-09-11 14:01:50 -07:00
Kacper Rączy
c417669cbd docker: fix cl tag (#29858)
unset TARGET_ARCHITECTURE before running build
2023-09-08 17:20:03 -07:00
Justin Newberry
d3e5f66fc1 CI: fix aarch64 cache (#29857)
was not passed in
2023-09-08 17:13:18 -07:00
Kacper Rączy
b09ec6bb5b docker: fix multiarch tag push (#29850)
Fix multiarch merge script
2023-09-08 15:03:40 -07:00
Kacper Rączy
1344a93a35 docker: multiarch images (amd64/aarch64) (#29691)
* arch specific tags

* merge multiarch script

* arm64 build and merge jobs

* update tag script

* casual ci test

* change image to 2204

* docker -v test

* arch specific naming

* Remove test_buildjet

* build -arch images only when CURRENT_ARCH_BUILD is set

* support new tags in tag_multiarch

* Toggle CURRENT_ARCH_BUILD on in ci

* Docker common

* Fix condition

* Fix path to docker_common

* Add more stuff to common

* Add build_arm job

* composite job for building

* Run checkout before build composite

* add shell arg

* move timeout to selfdrive_tests

* TARGET ARCHITECTURE var

* Support TARGET_ARCHITECTURE in workflow

* Rewrite to Single build job with matrix

* Remove shebang from docker_common

* Attempt for fix build matrix

* Remove setup arch

* build matrix for docker push

* Use 2vcpu for arm build

* 2vcpu for docker_push too

* temporarly unlock docker_push

* Remove requirement for target arch when pushing

* Unset target architecture in docker_push cl

* fix sha tags

* Rename action to compile-openpilot

* move push_image line to tag_multiarch step

* arch suffix for scons cache

* cache_key_prefix for setup-with-retry

* Re-disable docker_push on non-master

* Add newlines
2023-09-08 14:46:39 -07:00
Adeeb Shihadeh
c96fe132e8 CI: increase model replay timeout 2023-09-08 10:41:54 -07:00
Justin Newberry
b0a71d4553 Pytest: enforce a default timeout (#29793)
* pytest: enforce default timeout

* disable that for now

* 30 second timeout on tests
2023-09-07 17:53:51 -07:00
Justin Newberry
dde225221e CI: run unittests in parallel with xdist (#29756)
* parallel tests

* review suggesions

* add to pyproject

* add a bit more buffer on that

* fix rare athena issue

* remove from pypoetry
2023-09-07 16:29:36 -07:00
Justin Newberry
917f71d446 CI: retry setup on failure (#29785)
* try a setup action

* should be uses

* fix that formatting

* try conclusion

* continue on error

* try without hyphens

* only when failure

* make it optional

* continue on error

* those don't fail anymore

* what about 3 failures

* remove stuff for debugging

* cleanup

* review suggestions

* change that too

* fix pj
2023-09-06 11:11:15 -07:00
Adeeb Shihadeh
7b6afbc162 pytest: use a clean environment for all tests (#29788)
* pytest: use a clean environment for all tests

* rm that

* fix pj

* put build back

* fix params

* fix that

* handle no key

* that was removed

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
2023-09-05 18:52:40 -07:00
Justin Newberry
ca435d3447 CI: use pytest for unittesting (#29709)
* switch to pytest

* static analysis

* fix the helpers

* static analysis

* remove that

* more parallel test

* cleanup

* static analysis

* durations min and tolerance

* reduce those iterations

* sleep time could be decreased too

* in case it's negative

* try using caching

* remove parallelization for first PR

* PR Cleanup

* reduce diff

* fix that

* bump panda
2023-09-04 11:54:35 -07:00
Adeeb Shihadeh
75081b2e54 don't rerun those here 2023-08-31 18:34:20 -07:00
Justin Newberry
ab05bff07d CI: fix proc replay download cache permissions (#29636)
chmod that
2023-08-27 09:45:16 -07:00
Adeeb Shihadeh
d35beffbce CI: use buildjet for process replay (#29277)
* squash for pr

* backoff to 4vcpu

* review suggestions

* simplify

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
2023-08-25 18:50:21 -07:00
Dean Lee
2709cd6538 common/tests: combine multiple test binaries into one (#29623) 2023-08-25 10:35:39 -07:00
Justin Newberry
c0b9458a45 CI: move cache dir to workspace directory (#29622)
* comma dir

* mkdir

* fix issues

* test

* fix that

* fix

* do the other ones too

* missed that

* fix

* fix pr comments by moving into two different directories

* fix location

* fix that

* only change current

* fix
2023-08-25 01:41:04 -07:00
Adeeb Shihadeh
e863828051 CI: workaround syntax error in azure lib (#29618) 2023-08-24 17:18:11 -07:00
Justin Newberry
90cb417caa CI: use GITHUB_ENV for env variables (#29616)
export doesn't work across steps
2023-08-24 17:03:25 -07:00