Commit Graph

195 Commits

Author SHA1 Message Date
Adeeb Shihadeh
147ccc7a58 move pigeond to system/ubloxd/ (#31848)
* move pigeond to system/ubloxd/

* update release

* more

* mv test
2024-03-12 17:13:13 -07:00
Justin Newberry
cccf28b9ca jenkins: reduce connection timeouts (#31431)
reduce jenkins timeouts
2024-02-13 11:02:21 -08:00
Justin Newberry
7010aae0a9 jenkins: kill subprocesses on exit (#31422)
* kill-on-exit

* kill all
2024-02-12 15:41:04 -08:00
Justin Newberry
e3028cbdca jenkins: no changeset (#31374)
no changeset

Co-authored-by: Comma Device <device@comma.ai>
2024-02-08 09:59:47 -08:00
Justin Newberry
8f67d3cab9 jenkins: remove pc / car tests (#31353)
* move to scripts

* clean first

* cant have test_*?

* move
2024-02-07 11:33:52 -08:00
Justin Newberry
6933d0560a Pytest: reenable gc in pytest fixture + re-combine jenkins car tests (#31351)
* Revert "jenkins: spilt car tests in two steps (#31346)"

This reverts commit 8a00b30029.

* enable gc

* codespell

* useless comment
2024-02-07 08:35:32 -08:00
Justin Newberry
8a00b30029 jenkins: spilt car tests in two steps (#31346)
fix
2024-02-07 00:04:27 -08:00
Justin Newberry
03c183cb05 jenkins: limit cpu and memory (#31329)
* limit that

* we can use 32g

* addopts

* half
2024-02-06 13:51:55 -08:00
Justin Newberry
052519570d jenkins: lock device resource first before making container (#31330)
lock first
2024-02-06 13:35:08 -08:00
Justin Newberry
88b635c4e1 jenkins: cleanup stage names for analysis (#31327)
fix names
2024-02-06 12:50:44 -08:00
Justin Newberry
0277fc5548 Pytest: consistent hardware state for tici tests (#31279)
* consistent hardware

* consistent hardware

* moved

* this too

* ruff

* s

* duplicated

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-02-02 14:18:01 -08:00
Justin Newberry
08d9681cf6 Jenkins: select devices randomly (#31274)
radnomly select devices
2024-02-01 17:24:28 -08:00
Justin Newberry
be33b00499 Jenkins: better timeout when disconnected from devices (#31256)
* timeout better

* timeoutes
2024-01-31 18:46:40 -08:00
Adeeb Shihadeh
332a21965d jenkins: cleanup /dev/shm (#31095) 2024-01-20 15:24:34 -08:00
Adeeb Shihadeh
7cd9568423 remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
2024-01-19 14:05:03 -08:00
Adeeb Shihadeh
b4ebba384b cleanup startup params (#31068) 2024-01-18 22:09:55 -08:00
Justin Newberry
4430944b29 jenkins: lock "pc" label to limit concurrent workers (#30902)
* lock pc label

* remove that
2024-01-03 16:55:16 -08:00
Mitchell Goff
7e71fd7bae new delhi model (#30822)
* 027a1efa-10fb-4291-ad58-90cf0ff150b5/700

* debug

* rm for now

* bump refs

* revert that

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-01-02 13:27:15 -08:00
Shane Smiskol
5052b55c44 test_models: fuzz test panda and CarState (#30443)
* pre-hypothesis

* some hypothesis junk

* this kinda works but is really slow due to counter check

* choose addrs from fingerprint

* stash

* honda nidec brake pressed mismatches fixed

* bump panda

* stash

* tesla: use DI_torque2 (panda msg)

* run

* run

* ah this honda mismatch too

* no more multi can msgs

* clean up, remove old file

* add todo

* prob can remove urandom

* stash, huge examples

* fix pq standstill mismatch

* yuge

* yup there's a leak somewhere

* try to find leak

* skip dashcam (pq and tesla)

* PR comments

* bump

* draft stash

* fix alt brake hondas

* bump

* bump

* bump

* some clean up

* minor clean up

* more clean up

* stash

* fix honda bug

* more

* 100 examples

* revert tesla

* no memory leak any more?

* bring back tests with skips

* parameterize max_examples

* skip interceptor

* is jenkins on my branch?

* ooh that's fast

* 50 is not bad for GH CI

* 300 might be better with rest of test_models

* no more detection

* bump

* need CS_prev to catch bugs where openpilot changes and panda doesn't (eg. not setting interceptor safety mode)

* need to simplify all this

* need a warm up first, since some signals are 1 by default (toyota's gas_released!=1)

* changes

* set honda safety param

* set toyota safety param

* bump panda

* clean up honda

* rm interceptor

* thought interleaving addrs might help, but we can fine tune later

* Revert "thought interleaving addrs might help, but we can fine tune later"

This reverts commit 153301384b48c9f33f9e2af3c224241eaeec41c1.

* get size from dict

* what

* add nocapture marker

* clean up

* try to raise logging level

* need to run last as pytest_runtest_call, since it starts capturing

* get capman conditionally

* mark

* type fingerprint

* should use gen_empty_fingerprint

* no longer needed

* draft

* no longer need gc

* clean that up

* test everything!

* more clean up

* more

* no point

* fix that

* fix errors

* bump

* nice even 300 examples for 300 segs

* final bump :fingers_crossed:

* better import order

* remove debugging prints

* warm up kinda works

* Revert "warm up kinda works"

This reverts commit 7fc77b07d592edb13eadca77deb49540954a7d69.

* random seed

* revert

* strat

strat

* add expl comment

* cmt

* check controls allowed

* Revert "check controls allowed"

This reverts commit e82a0e5396810dd4670e6847aa555194a709e10f.

* not unittests

* run tests!

* run tests 2!

* run tests 3!

* seed unused

* revert

* add shrink phase, and remove health check suppression

* hello

* oncemore

* Update selfdrive/car/tests/test_models.py
2023-12-19 03:18:54 -06:00
Adeeb Shihadeh
7aeefaad65 jenkins: only do replay when relevant files change 2023-12-16 23:35:43 -08:00
Adeeb Shihadeh
6f143f6c45 full clean for onroad device 2023-12-14 23:00:07 -08:00
Adeeb Shihadeh
0830f62b36 also run qcomgpsd on path update 2023-12-14 20:44:14 -08:00
Adeeb Shihadeh
2cad6dfa58 jenkins: only run pandad tests when paths change (#30741)
* jenkins: only run pandad when paths changed

* fix

* ugh shadow
2023-12-14 20:41:11 -08:00
Adeeb Shihadeh
303f1cf9cf jenkins: run test_onroad in the normal env (#30740) 2023-12-14 19:59:16 -08:00
Justin Newberry
5d668701cb CI: move test_maprenderer to GH actions (#30610)
maprenderer to ci
2023-12-14 16:59:28 -08:00
Justin Newberry
02373fcb05 jenkins: retry docker_build (#30629)
* retry docker build

* retry docker build

* retry docker build

* does this work nicely?

* docker fail!

* Revert "docker fail!"

This reverts commit ab227a1ea37fad3d6413081e4516211b474b0712.
2023-12-12 18:12:19 -08:00
Justin Newberry
93cd19e3a5 jenkins: retry pc setup (#30659)
* retry pc setup

* sleep and retry

* exception

* throw e

* remove force exit

* make a function for it

* remove force exit

* move to top

* separate exception
2023-12-12 17:54:17 -08:00
Justin Newberry
c066fdd7a3 jenkins: remove old root user permission fixes (#30684)
* Batman

* add debug stuff

* Revert that for now

* remove debug stuff
2023-12-12 17:48:03 -08:00
Shane Smiskol
e78b80c8fe jenkins: run all car tests with one command (#30661)
* run all jenkins car tests in one script, less down time?

* fix

* speed up

* u
2023-12-08 22:15:27 -08:00
Justin Newberry
36bebb1aa0 jenkins: retry build_devel (#30628)
* will it work

* retry build devel

* correct p[ath

* try a failure

* Revert "try a failure"

This reverts commit ba4e6a0a2096b94887fcfbf7d011e34aa2a16c41.
2023-12-06 17:22:32 -08:00
Justin Newberry
f16df8e4b7 pytest: group test_models by route instead of car name (#30625)
* group by route

* dont need those
2023-12-06 16:00:59 -08:00
Justin Newberry
3777bf7fb9 jenkins: disable xdist on tici (#30624)
to preserve it
2023-12-06 15:51:29 -08:00
Justin Newberry
31ab43ce41 jenkins: remove pytest tici conf (#30621)
* remove pytest conf

* remove that too
2023-12-06 11:13:22 -08:00
Justin Newberry
5030824572 jenkins auto cpu count (#30544)
* auto cpu

* build too

* need bash
2023-11-28 14:34:00 -08:00
Adeeb Shihadeh
4cae08e636 rename rawgpsd to qcomgpsd (#30493)
* rename rawgpsd to qcomgpsd

* fix more paths

* that moved

* forgot the d
2023-11-18 23:23:16 -08:00
Justin Newberry
2ad82cbfb0 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
2023-11-13 10:45:24 -08:00
Adeeb Shihadeh
5f7143df02 jenkins: use build.py to manage cache size (#30440)
* jenkins: use build.py to manage cache size

* label

* set pp

* double

* cleanup

* non mimimal build on PC

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
2023-11-10 16:55:25 -08:00
Adeeb Shihadeh
57c8304c25 jenkins: retry on failed git checkouts (#30345)
* jenkins: retry on failed git checkouts

* test

* Revert "test"

This reverts commit ea57ba025630eb3105a9ccdce3bdc17f72678c72.
2023-10-30 09:58:57 -07:00
Adeeb Shihadeh
13d780a5f2 test_onroad: log sizes check (#30265)
* test_onroad: check log sizes

* fix

* check logs

* rb

* len

* pytest

* mb

* corolla log is small

* adjust qlog
2023-10-18 19:44:46 -07:00
Adeeb Shihadeh
71a9b2c24c jenkins: clear commacache dir (#30290) 2023-10-18 19:37:29 -07:00
Justin Newberry
8b2b72499f CI: run jenkins as batman (#30184)
* I'm batman

* chown batman

* sudo

* add batman to sudo group

* try without cleanup

* Revert "try without cleanup"

This reverts commit f59554f2f373417f2c59fd250463eca2fda4d49e.

* comment
2023-10-06 11:12:41 -07:00
Adeeb Shihadeh
d036148550 jenkins speedup (#29869)
* jenkins speedup

* cleanup
2023-09-10 16:47:07 -07:00
Adeeb Shihadeh
a411af4f02 jenkins scripted pipeline (#29865)
* scripted

* exclude branches

* try that

* fix credentials

* fix

* tag with commit
2023-09-09 21:30:21 -07:00
Adeeb Shihadeh
947abbcba0 fixup power draw test output (#29844)
* fixup power draw test

* no pytest
2023-09-08 13:01:04 -07:00
Shane Smiskol
821cfff56d car interfaces: long running fuzzy test (#29592)
* draft

* draft 2

* increase deadline and run

* imports

* run -> use
2023-08-24 10:45:50 -07:00
Shane Smiskol
ac3f87bad5 internal test_models: run on more segments (#29443)
100 more
2023-08-17 00:25:14 -07:00
Shane Smiskol
fb235238ad jenkins: re-enable test_models (#29394)
* re-enable test_models

* now?

* Remove bad Volt segment

* Update Jenkinsfile

* use first n segments
2023-08-14 16:08:34 -07:00
Adeeb Shihadeh
de66ba0187 jenkins: remove test that's now run in Actions 2023-08-13 21:21:54 -07:00
Adeeb Shihadeh
09ffce8073 add small ui for jenkins runners (#29382) 2023-08-13 18:01:51 -07:00
Adeeb Shihadeh
b11b14aff8 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
2023-08-12 17:15:16 -07:00