Commit Graph

151 Commits

Author SHA1 Message Date
Shane Smiskol 821cfff56d
car interfaces: long running fuzzy test (#29592)
* draft

* draft 2

* increase deadline and run

* imports

* run -> use
2023-08-24 10:45:50 -07:00
Shane Smiskol ac3f87bad5
internal test_models: run on more segments (#29443)
100 more
2023-08-17 00:25:14 -07:00
Shane Smiskol fb235238ad
jenkins: re-enable test_models (#29394)
* re-enable test_models

* now?

* Remove bad Volt segment

* Update Jenkinsfile

* use first n segments
2023-08-14 16:08:34 -07:00
Adeeb Shihadeh de66ba0187
jenkins: remove test that's now run in Actions 2023-08-13 21:21:54 -07:00
Adeeb Shihadeh 09ffce8073
add small ui for jenkins runners (#29382) 2023-08-13 18:01:51 -07:00
Adeeb Shihadeh b11b14aff8
CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
2023-08-12 17:15:16 -07:00
Shane Smiskol 70b1e9dd75
test_models: run on route list (#26226)
* move to openpilot

* draft

* support internal urls

* not used

* update seg list

* regen segment list

* regen seg list

* regen

* regen

* regen

* no dirty segments

* regen seg list with no fuzzy or fixed fp

* regen segments with hda2 exception

* regen with added filters

* regen without bad dongle

* regen

* regenerate!

* regenerate, only OP enabled

* regen

* regenerate!

* regenerate!

* stash

* use SegmentName

* new route list

* add temp comment

* remove comment

* let's see if this works

* comment out other tests to speed up

* fix agent

* ?

* hmm

* oh whoops...

* add matrix

* fix

* how many levels do we need?

* fix values

* matrix can't be in parallel

* how about this

* try this

* Revert matrix

Revert "try this"

This reverts commit 8d0d91fd70.

Revert "how about this"

This reverts commit a8e4fc5323.

Revert "matrix can't be in parallel"

This reverts commit daaa6fcc3c.

Revert "fix values"

This reverts commit df554b6a33.

Revert "how many levels do we need?"

This reverts commit 1a17320fa1.

Revert "fix"

This reverts commit e7eb6e4043.

Revert "add matrix"

This reverts commit a1b57e5725.

* use pytest instead! (5 jobs is ~150 mins)

* split lines, uncomment

* This Sienna seg has a fault SDSU that stopped forwarding/sending msgs

* picked a route with no PSCMStatus and no panda errors, recent routes are working

* this cadillac was dashcammed (no radar)

* opened an issue for this, it's 'expected' right now

* small clean up

* small clean up

* i don't think that worked

* is this needed?

* add to new PC tests

* cache

* draft

* Revert "draft"

This reverts commit 3b7f740dd4.

* probably should be function

* draft

* clean up

* add todo

* 600 random segments

* debug

* does this fix pythonpath issues?

fix

* try this

* mount?

* pytest again!

* no need for PYTHONPATH now

* Update Jenkinsfile

* ?

* convention

* clean up

* would be even more complex (have to unset ci which is class level)

* track

* is lfs pulled at all?

* ah no it's not
2023-08-10 00:45:23 -07:00
Adeeb Shihadeh 7f02cb9faf
jenkins: rm tools copy in release tests (#29273)
* jenkins: rm tools copy in release tests

* rm that too
2023-08-07 19:14:45 -07:00
Adeeb Shihadeh 036888ec15
jenkins: reset USB (#29155)
* jenkins: reset USB

* fix non aux
2023-07-26 15:11:20 -07:00
Adeeb Shihadeh 6b83724c50
jenkins: run tests with pytest (#29143)
* jenkins: run tests with pytest

* typo

* fix
2023-07-25 17:06:43 -07:00
Adeeb Shihadeh 5fb2f7072b
rawgpsd: speedup tests (#29110)
* rawgpsd: speedup tests

* fix that one

* little more

* prevent subtle bugs

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-07-23 15:38:47 -07:00
Adeeb Shihadeh d92c9aef23
tici: speedup power save setting (#29100)
* speedup

* update type

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-07-22 17:15:58 -07:00
Maxime Desroches 97eec45d42
Test scons multithreaded random build (#29082)
* random build

* name

* 2 pass

* clean after

* fail on this

* fix deps

* format

* var

* try without lfs
2023-07-21 21:57:27 -07:00
Adeeb Shihadeh e8b20b7f81
CI: fix no DNS after tests killed (#29090)
* CI: fix no DNS after tests killed

* fix
2023-07-21 18:35:29 -07:00
Adeeb Shihadeh e2b5d1e29a
mapsd: rendering tests (#28981)
* mapsd: rendering tests

* run

* speedup
2023-07-16 14:39:34 -07:00
Adeeb Shihadeh fdf1c328b9
jenkins: speedup build stage (#28687)
* jenkins: speedup build stage

* run in gh actions

* skip

* set that

* build

* python path

* cleanup
2023-06-24 22:33:06 -07:00
Adeeb Shihadeh 5992bf4acc
rawgpsd tests (#28683)
* rawgpsd tests

* test xtra

* check freq

* fix

* restart lte

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-06-24 20:04:58 -07:00
Adeeb Shihadeh 16e3d4f69f
jenkins: new replay devices (#28643)
* replay

* restart nm
2023-06-22 14:21:11 -07:00
Adeeb Shihadeh 6d91b7c341
jenkins: ensure panda is in good state (#28414) 2023-06-05 15:28:38 -07:00
Mitchell Goff 2d34083cd8
Test navmodel (#28272)
* Test navmodel

* removed comment

* Updated model_replay ref

* read tiles from azure bucket

* updated ref commit
2023-05-30 20:33:01 -07:00
Adeeb Shihadeh 2664dba52e jenkins: switch order of tests 2023-05-22 00:48:51 -07:00
Adeeb Shihadeh 39c5d492bf
time to onroad test (#28242)
* time to onroad test

* run few times

* test on stripped builds

* manager

* cleanup

* split those out

* run first

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-05-20 17:59:41 -07:00
Adeeb Shihadeh c4501e4bc1
controlsd: remove procs from ignore list (#26848)
* trim list

* check for file
2023-05-07 15:43:45 -07:00
Adeeb Shihadeh d5a0a4b3e8
Jenkins tuneup (#28095)
* tuneup

* use service messages

* logmono

* not passive
2023-05-03 16:52:20 -07:00
Adeeb Shihadeh b37b768f1e
jenkins: source launch_env.sh (#28092)
* jenkins: source launch_env.sh

* cleanup

* cleanup
2023-05-03 14:26:38 -07:00
Adeeb Shihadeh 767ed4295f
tizi: retry amp comms (#27735)
* tizi: retry amp comms

* ensure all config is written together

* simple test

* check errors

* test shutdown

* a tici exclusive

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-04-06 23:38:16 -07:00
Adeeb Shihadeh 39a1a917e7 tici: move tests to tests/ 2023-04-05 22:17:57 -07:00
Adeeb Shihadeh ff89184823
tizi tests in jenkins (#27810)
* add

* mv there for now

* mv

* single panda

* move into parallel

* longer timeout for dfu

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-04-05 11:07:42 -07:00
Adeeb Shihadeh 94eb215980
loggerd: move to system/ (#27534) 2023-03-08 11:20:49 -08:00
Adeeb Shihadeh 6f40f0d442
sensord: move to system/ (#27531)
* sensord: move to system/

* add gitignore to releaes files
2023-03-08 10:56:54 -08:00
Adeeb Shihadeh f7c15c1708
pandad unit tests (#27516)
* pandad unit tests

* only one

* in bootstub

* run in jenkins

* phone only
2023-03-07 11:05:20 -08:00
Adeeb Shihadeh 0374d4817d
setup pre-built master-ci (#27205)
* try this

* add as release branch

* set the name

* build on master-ci
2023-02-05 15:45:01 -08:00
Adeeb Shihadeh 100fe10c7c
jenkins: tmp disable sim test due to ZMQ bug (#27043) 2023-01-22 15:08:36 -08:00
Adeeb Shihadeh ef42652368
fix typo AR0321 -> AR0231 (#26993) 2023-01-17 19:52:06 -08:00
Adeeb Shihadeh 8aac07bf86 model replay: disable nav for now 2023-01-12 15:20:37 -08:00
Adeeb Shihadeh 5f66a9a621 jenkins fixups 2023-01-10 16:20:27 -08:00
Adeeb Shihadeh 53023abd24
jenkins: don't clog up build queue (#26724)
* jenkins: don't clog up build queue

* not real
2022-12-07 22:21:05 -08:00
Adeeb Shihadeh 1da6f6a6e2
nav model replay (#26697)
* nav model replay

* set token

* fix gh actions

* update refs

* fix pc
2022-12-07 19:36:30 -08:00
Adeeb Shihadeh 753c3d5897
jenkins: move test_manager to common devices (#26663) 2022-12-01 15:32:59 -08:00
Adeeb Shihadeh f2d97da9b4 jenkins: use tici-needs-can to build release 2022-11-15 20:14:35 -08:00
Kurt Nistelberger 5f094b8368
CI: regroup devices (#26436)
* regroup ci devices

* cleanup looopback test

* split loopback devices

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
2022-11-11 21:50:09 -08:00
Kurt Nistelberger fa4a368005
CI: add OX0C310 camerad box (#26318)
* update jenkins file

* .

* revert

* Update Jenkinsfile

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-11-04 16:44:06 -07:00
Kurt Nistelberger d58c19c576
CI: add LSM-C sensor device (#26303)
* add sensord tests to pipeline

* .

* cleanup

* redo

* .

* address comments

* Update Jenkinsfile

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-11-02 16:34:02 -07:00
Kurt Nistelberger 9e3e49a81f readd camerad tests 2022-10-26 15:11:45 -07:00
Adeeb Shihadeh a22ce68699 jenkins: disable camerad while new box is built 2022-10-24 19:37:18 -07:00
Adeeb Shihadeh 9e6265ce21
CI: re-enable power draw test (#25988)
* CI: re-enable power draw test

* adjust for ngrl
2022-10-06 15:01:57 -07:00
Adeeb Shihadeh 4bb399ba3c
pigeond tests (#25630)
* start pigeond tests

* sm checks

* add some types

* little more

Co-authored-by: Comma Device <device@comma.ai>
2022-08-31 23:12:26 -07:00
Adeeb Shihadeh 689d1970a7 jenkins: disable power draw test for now 2022-08-04 23:22:10 -07:00
Adeeb Shihadeh 9c9a0f0ef3 remove comma two branches 2022-07-20 14:27:10 -07:00
Adeeb Shihadeh df251ef50e
Fix master-ci dirty working tree + CI test (#25087)
* check

* test for dirty working tree

* swap order

* fix diff
2022-07-08 13:00:43 -07:00