Commit Graph

151 Commits

Author SHA1 Message Date
Shane Smiskol
821cfff56d car interfaces: long running fuzzy test (#29592)
* draft

* draft 2

* increase deadline and run

* imports

* run -> use
2023-08-24 10:45:50 -07:00
Shane Smiskol
ac3f87bad5 internal test_models: run on more segments (#29443)
100 more
2023-08-17 00:25:14 -07:00
Shane Smiskol
fb235238ad jenkins: re-enable test_models (#29394)
* re-enable test_models

* now?

* Remove bad Volt segment

* Update Jenkinsfile

* use first n segments
2023-08-14 16:08:34 -07:00
Adeeb Shihadeh
de66ba0187 jenkins: remove test that's now run in Actions 2023-08-13 21:21:54 -07:00
Adeeb Shihadeh
09ffce8073 add small ui for jenkins runners (#29382) 2023-08-13 18:01:51 -07:00
Adeeb Shihadeh
b11b14aff8 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
2023-08-12 17:15:16 -07:00
Shane Smiskol
70b1e9dd75 test_models: run on route list (#26226)
* move to openpilot

* draft

* support internal urls

* not used

* update seg list

* regen segment list

* regen seg list

* regen

* regen

* regen

* no dirty segments

* regen seg list with no fuzzy or fixed fp

* regen segments with hda2 exception

* regen with added filters

* regen without bad dongle

* regen

* regenerate!

* regenerate, only OP enabled

* regen

* regenerate!

* regenerate!

* stash

* use SegmentName

* new route list

* add temp comment

* remove comment

* let's see if this works

* comment out other tests to speed up

* fix agent

* ?

* hmm

* oh whoops...

* add matrix

* fix

* how many levels do we need?

* fix values

* matrix can't be in parallel

* how about this

* try this

* Revert matrix

Revert "try this"

This reverts commit 8d0d91fd70c467c1fbb4e4e9aed511d15b2a30ef.

Revert "how about this"

This reverts commit a8e4fc53234824e77cbfb1e471277bc033e9dea1.

Revert "matrix can't be in parallel"

This reverts commit daaa6fcc3c75c74cbb90e97c565099a94123994c.

Revert "fix values"

This reverts commit df554b6a3371d124a574eb8d26bc51ef5b5b8fde.

Revert "how many levels do we need?"

This reverts commit 1a17320fa1c5e7220ef60e29981bbb3bb7da16c6.

Revert "fix"

This reverts commit e7eb6e404358fbd2eac3fea1901a8d30ea92d729.

Revert "add matrix"

This reverts commit a1b57e5725417d3c2f639f8edfc0c889b84b6753.

* use pytest instead! (5 jobs is ~150 mins)

* split lines, uncomment

* This Sienna seg has a fault SDSU that stopped forwarding/sending msgs

* picked a route with no PSCMStatus and no panda errors, recent routes are working

* this cadillac was dashcammed (no radar)

* opened an issue for this, it's 'expected' right now

* small clean up

* small clean up

* i don't think that worked

* is this needed?

* add to new PC tests

* cache

* draft

* Revert "draft"

This reverts commit 3b7f740dd4883118747300bc3687074c2d3c2116.

* probably should be function

* draft

* clean up

* add todo

* 600 random segments

* debug

* does this fix pythonpath issues?

fix

* try this

* mount?

* pytest again!

* no need for PYTHONPATH now

* Update Jenkinsfile

* ?

* convention

* clean up

* would be even more complex (have to unset ci which is class level)

* track

* is lfs pulled at all?

* ah no it's not
2023-08-10 00:45:23 -07:00
Adeeb Shihadeh
7f02cb9faf jenkins: rm tools copy in release tests (#29273)
* jenkins: rm tools copy in release tests

* rm that too
2023-08-07 19:14:45 -07:00
Adeeb Shihadeh
036888ec15 jenkins: reset USB (#29155)
* jenkins: reset USB

* fix non aux
2023-07-26 15:11:20 -07:00
Adeeb Shihadeh
6b83724c50 jenkins: run tests with pytest (#29143)
* jenkins: run tests with pytest

* typo

* fix
2023-07-25 17:06:43 -07:00
Adeeb Shihadeh
5fb2f7072b rawgpsd: speedup tests (#29110)
* rawgpsd: speedup tests

* fix that one

* little more

* prevent subtle bugs

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-07-23 15:38:47 -07:00
Adeeb Shihadeh
d92c9aef23 tici: speedup power save setting (#29100)
* speedup

* update type

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-07-22 17:15:58 -07:00
Maxime Desroches
97eec45d42 Test scons multithreaded random build (#29082)
* random build

* name

* 2 pass

* clean after

* fail on this

* fix deps

* format

* var

* try without lfs
2023-07-21 21:57:27 -07:00
Adeeb Shihadeh
e8b20b7f81 CI: fix no DNS after tests killed (#29090)
* CI: fix no DNS after tests killed

* fix
2023-07-21 18:35:29 -07:00
Adeeb Shihadeh
e2b5d1e29a mapsd: rendering tests (#28981)
* mapsd: rendering tests

* run

* speedup
2023-07-16 14:39:34 -07:00
Adeeb Shihadeh
fdf1c328b9 jenkins: speedup build stage (#28687)
* jenkins: speedup build stage

* run in gh actions

* skip

* set that

* build

* python path

* cleanup
2023-06-24 22:33:06 -07:00
Adeeb Shihadeh
5992bf4acc rawgpsd tests (#28683)
* rawgpsd tests

* test xtra

* check freq

* fix

* restart lte

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-06-24 20:04:58 -07:00
Adeeb Shihadeh
16e3d4f69f jenkins: new replay devices (#28643)
* replay

* restart nm
2023-06-22 14:21:11 -07:00
Adeeb Shihadeh
6d91b7c341 jenkins: ensure panda is in good state (#28414) 2023-06-05 15:28:38 -07:00
Mitchell Goff
2d34083cd8 Test navmodel (#28272)
* Test navmodel

* removed comment

* Updated model_replay ref

* read tiles from azure bucket

* updated ref commit
2023-05-30 20:33:01 -07:00
Adeeb Shihadeh
2664dba52e jenkins: switch order of tests 2023-05-22 00:48:51 -07:00
Adeeb Shihadeh
39c5d492bf time to onroad test (#28242)
* time to onroad test

* run few times

* test on stripped builds

* manager

* cleanup

* split those out

* run first

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-05-20 17:59:41 -07:00
Adeeb Shihadeh
c4501e4bc1 controlsd: remove procs from ignore list (#26848)
* trim list

* check for file
2023-05-07 15:43:45 -07:00
Adeeb Shihadeh
d5a0a4b3e8 Jenkins tuneup (#28095)
* tuneup

* use service messages

* logmono

* not passive
2023-05-03 16:52:20 -07:00
Adeeb Shihadeh
b37b768f1e jenkins: source launch_env.sh (#28092)
* jenkins: source launch_env.sh

* cleanup

* cleanup
2023-05-03 14:26:38 -07:00
Adeeb Shihadeh
767ed4295f tizi: retry amp comms (#27735)
* tizi: retry amp comms

* ensure all config is written together

* simple test

* check errors

* test shutdown

* a tici exclusive

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-04-06 23:38:16 -07:00
Adeeb Shihadeh
39a1a917e7 tici: move tests to tests/ 2023-04-05 22:17:57 -07:00
Adeeb Shihadeh
ff89184823 tizi tests in jenkins (#27810)
* add

* mv there for now

* mv

* single panda

* move into parallel

* longer timeout for dfu

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-04-05 11:07:42 -07:00
Adeeb Shihadeh
94eb215980 loggerd: move to system/ (#27534) 2023-03-08 11:20:49 -08:00
Adeeb Shihadeh
6f40f0d442 sensord: move to system/ (#27531)
* sensord: move to system/

* add gitignore to releaes files
2023-03-08 10:56:54 -08:00
Adeeb Shihadeh
f7c15c1708 pandad unit tests (#27516)
* pandad unit tests

* only one

* in bootstub

* run in jenkins

* phone only
2023-03-07 11:05:20 -08:00
Adeeb Shihadeh
0374d4817d setup pre-built master-ci (#27205)
* try this

* add as release branch

* set the name

* build on master-ci
2023-02-05 15:45:01 -08:00
Adeeb Shihadeh
100fe10c7c jenkins: tmp disable sim test due to ZMQ bug (#27043) 2023-01-22 15:08:36 -08:00
Adeeb Shihadeh
ef42652368 fix typo AR0321 -> AR0231 (#26993) 2023-01-17 19:52:06 -08:00
Adeeb Shihadeh
8aac07bf86 model replay: disable nav for now 2023-01-12 15:20:37 -08:00
Adeeb Shihadeh
5f66a9a621 jenkins fixups 2023-01-10 16:20:27 -08:00
Adeeb Shihadeh
53023abd24 jenkins: don't clog up build queue (#26724)
* jenkins: don't clog up build queue

* not real
2022-12-07 22:21:05 -08:00
Adeeb Shihadeh
1da6f6a6e2 nav model replay (#26697)
* nav model replay

* set token

* fix gh actions

* update refs

* fix pc
2022-12-07 19:36:30 -08:00
Adeeb Shihadeh
753c3d5897 jenkins: move test_manager to common devices (#26663) 2022-12-01 15:32:59 -08:00
Adeeb Shihadeh
f2d97da9b4 jenkins: use tici-needs-can to build release 2022-11-15 20:14:35 -08:00
Kurt Nistelberger
5f094b8368 CI: regroup devices (#26436)
* regroup ci devices

* cleanup looopback test

* split loopback devices

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
2022-11-11 21:50:09 -08:00
Kurt Nistelberger
fa4a368005 CI: add OX0C310 camerad box (#26318)
* update jenkins file

* .

* revert

* Update Jenkinsfile

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-11-04 16:44:06 -07:00
Kurt Nistelberger
d58c19c576 CI: add LSM-C sensor device (#26303)
* add sensord tests to pipeline

* .

* cleanup

* redo

* .

* address comments

* Update Jenkinsfile

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-11-02 16:34:02 -07:00
Kurt Nistelberger
9e3e49a81f readd camerad tests 2022-10-26 15:11:45 -07:00
Adeeb Shihadeh
a22ce68699 jenkins: disable camerad while new box is built 2022-10-24 19:37:18 -07:00
Adeeb Shihadeh
9e6265ce21 CI: re-enable power draw test (#25988)
* CI: re-enable power draw test

* adjust for ngrl
2022-10-06 15:01:57 -07:00
Adeeb Shihadeh
4bb399ba3c pigeond tests (#25630)
* start pigeond tests

* sm checks

* add some types

* little more

Co-authored-by: Comma Device <device@comma.ai>
2022-08-31 23:12:26 -07:00
Adeeb Shihadeh
689d1970a7 jenkins: disable power draw test for now 2022-08-04 23:22:10 -07:00
Adeeb Shihadeh
9c9a0f0ef3 remove comma two branches 2022-07-20 14:27:10 -07:00
Adeeb Shihadeh
df251ef50e Fix master-ci dirty working tree + CI test (#25087)
* check

* test for dirty working tree

* swap order

* fix diff
2022-07-08 13:00:43 -07:00