Commit Graph

169 Commits

Author SHA1 Message Date
Adeeb Shihadeh 6b1119274b disable tici camerad test while device is down for maintenance 2021-08-30 00:16:43 -07:00
Adeeb Shihadeh 7e3d002066 athena: hardcode jwt for tests 2021-08-19 14:19:14 -07:00
Adeeb Shihadeh 9ad935644b
build release3 in CI (#21772)
* ci pushes this now

* fix path

* cd

* push
2021-07-28 22:19:30 -07:00
Adeeb Shihadeh 12948e661a
soundd (#21619)
* refactor alerts

* doesn't go here anymore

* soudd

* handle controls unresponsive

* same check

* fix path

* update sound test

* nice

* fix c2

* add script

* update tests

Co-authored-by: Comma Device <device@comma.ai>
2021-07-16 17:30:00 -07:00
Adeeb Shihadeh 3a51a5c0f0
update release build (#21482)
* update master-ci

* move to /data

* fix tests

* fix source dir

* prune

* trailing slash

* compile
2021-07-04 20:26:38 -07:00
Adeeb Shihadeh 0bfd994f73
fast jenkins (#21472)
* speed up setup

* speedup onroad test

* .git doesn't like inplace

* tici2

* no inplace

* revert

* fix

* that one too
2021-07-02 16:29:57 -07:00
Adeeb Shihadeh cacdbea658 increase jenkins timeout 2021-06-03 19:20:42 -07:00
Adeeb Shihadeh a0dabd94e9
use scons cache by default (#21102)
* always use scons cache

* cleanup
2021-06-01 17:12:32 -07:00
Adeeb Shihadeh cf6d133638
fix up model tests + tools (#21071)
* unlogger: send yuv stream

* fix up model test tools

* fix unlogger

* rename model replay

* bump cereal

* test in actions

* no ci for now
2021-05-28 23:08:08 -07:00
Adeeb Shihadeh 4970e2fba3 no jenkins on hotfix branches 2021-05-27 15:03:23 -07:00
Adeeb Shihadeh b79ec74483 use build.py in jenkins 2021-05-24 19:52:54 -07:00
Adeeb Shihadeh e10007d2e8 reenable exposure tests 2021-05-18 12:07:48 -07:00
Willem Melching 5bfe51aeb1 increase Jenkins timeout 2021-05-18 15:38:23 +02:00
Willem Melching 39c6ea6d7c disable other exposure test 2021-05-18 14:16:37 +02:00
Willem Melching 5ab6ab3413 disable exposure test 2021-05-18 12:15:08 +02:00
Willem Melching b749ba4fe2 j16 -> j8 2021-05-17 16:13:53 +02:00
Adeeb Shihadeh 6075683474 raise jenkins timeout 2021-05-03 21:53:28 -07:00
robbederks 6a824d7651
Zookeeper support (#20000)
* zookeeper lib

* add ft4222 to dev pip packages and fix include error

* started on CI

* it's a file

* now it should be happy

* use docker for all on-device tests

* test scripts

* does this work?

* access to devices

* too broad. only usb enough?

* permissions for zookeeper usb

* as env var maybe?

* this?

* try this for now

* all devices

* move to correct location for impoerts

* right paths

* not running in the right agent?

* ofc not

* fix broken merge

* add ft4222 package again

* add timeout

* power monitor

* cleanup

Co-authored-by: Batman <batman@openpilot-ci.internal>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-04-13 15:08:00 -07:00
Adeeb Shihadeh 4e06665f55 fix master-ci typo 2021-04-11 20:29:46 -07:00
Adeeb Shihadeh 01dc011f9f
more tici CI coverage (#20639)
* run onroad test in tici

* run in jenkins

* no /data/media

* doesn't exists there yet

* more updates

Co-authored-by: Comma Device <device@comma.ai>
2021-04-11 15:56:17 -07:00
Adeeb Shihadeh 1858c696f2
wait for all jenkins tests before pushing master-ci (#20462)
* test on devel build

* fix athena test

* onroad test

* more of a unit test

* use scons cache

* script

* wait for all tests before pushing

* undo that

* add to release files

* onroad

* copy test files
2021-04-11 15:05:14 -07:00
ZwX1616 dd8f9a7263 Revert "jenkins device maintenance"
This reverts commit e8d0d48039.
2021-03-31 16:48:10 -07:00
ZwX1616 e8d0d48039 jenkins device maintenance 2021-03-30 18:41:32 -07:00
ZwX1616 97133a8fac
camerad jenkins box test (#20413)
* separate test

* send

* update test

* snapshot is rgb

* this does not belong here

* clean up

* tici

* no if

* no black frames

* flaky leds

* rename and cleanup

* should be stable and avoid lucky pass

* print

* logical and

* run in jenkins

* source profile on tici

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-03-26 13:23:18 -07:00
Adeeb Shihadeh e76c80ffa1
APK purge (#20446)
* purge begins

* release files

* remove those

* no more android

* only qt

* text and spinner

* neos update script

* update sounds

* update cpu usage

* all done

Co-authored-by: Comma Device <device@comma.ai>
2021-03-24 14:30:41 -07:00
Adeeb Shihadeh 7aade3db43
auotmatic jenkins setup (#20448)
* auotmatic jenkins setup

* fix quote

* ne wkey
2021-03-23 17:46:53 -07:00
Willem Melching 5a3b511306
Manager cleanup (#20231)
* move manager in folder

* inital refactor

* call start

* small cleanup

* add comments

* use self.signal()

* order shouldnt matter

* newlines

* add helpers

* newlines

* add process config

* split out build part of manager

* this should fix most tests

* no sensord on pc

* dont start athena

* remove comment

* fix old athena test

* fix inject model

* fix test car models

* should be not none

* fix helpers exitcode

* ignore manage_athenad

* Use time.monotonic()

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* combine init, remove spinner

* move manager test

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-03-05 11:03:23 +01:00
Adeeb Shihadeh c33a0d54ac disable release3 build for now 2021-02-09 17:32:16 -08:00
Adeeb Shihadeh 46c0e0e6f3 fix failing CI jobs 2021-02-09 13:59:34 -08:00
Comma Device 8f84f19062 split the build and test running 2021-02-01 20:35:37 -08:00
Adeeb Shihadeh 49d4d58201
logcatd bugfix + tests (#19689)
* hack to exit cleanly

* move the hack

* add test

* run in ci

* unused

Co-authored-by: Comma Device <device@comma.ai>
2021-02-01 15:15:29 -08:00
Adeeb Shihadeh a712a4bd9c
build release3 (#19984)
* build release3

* copy agnos manifest

* build in jenkins

* nproc doesn't work

* no pandaextra

* revert that

* don't modify version from source

* build after tests

* restore the symlink

* only master

* remove apk

* revert that

Co-authored-by: Comma Device <device@comma.ai>
2021-01-31 18:49:34 -08:00
ZwX1616 1a95127b0e
camerad frame lag/drop jenkins tests (#19945)
* clean up test

* not needed for now

* this be enough

* comment this out

* clean up

* adjust tolerance

* use sof on tici

Co-authored-by: Comma Device <device@comma.ai>
2021-01-28 14:21:59 -08:00
Adeeb Shihadeh 810ed30cab
more tici tests in jenkins (#19908)
* run loggerd tests on tici

* boardd loopback

* fix up seg length

* this doesn't add more coverage
2021-01-24 17:54:03 -08:00
Adeeb Shihadeh 8b1e51bbdd
tici jenkins build (#19505)
* tici jenkins

* /usr/bin/bash

* source all

* fix model replay

* onroad tests
2021-01-23 18:34:18 -08:00
Adeeb Shihadeh 5a9769020d
On-device onroad CI test (#19792)
* start onroad test

* cpu usage test works

* nice print

* run in jenkins

* pretty reliable

* bump loggerd cpu usgae

Co-authored-by: Comma Device <device@comma.ai>
2021-01-16 18:11:53 -08:00
Adeeb Shihadeh def24ae27a reenable cpu usage test 2021-01-15 14:22:25 -08:00
Adeeb Shihadeh cc2490bb12 build master-ci with the relase2 build device 2021-01-12 16:24:34 -08:00
Adeeb Shihadeh 10268b6669 use scons cache for QCOM replay build in CI 2021-01-12 16:10:18 -08:00
Adeeb Shihadeh 24ce55c2c2 disable again for now, replay hw is down 2021-01-10 21:58:09 -08:00
Adeeb Shihadeh fa2d2a7162 reenable cpu usage test 2021-01-08 16:32:58 -08:00
Willem Melching fb496c692a
VisionIPC 2.0 (#19641)
* Squashed vipc

* Update release files

* Remove else

* add visionipc to release files

* use poller in vipc receive

* opencl framework instead of lib on macos

* Fix camera webcam

* Fix opencl on mac in ui

* more webcam fixes

* typo in ui sconsfile

* Use cur_yuv_buf

* visionbuf c++ class

* Camera qcom was still using visionbuf_allocate

* Turn loggerd back on

* fix snapshot

* No build needed

* update test camerad

* no more release callback

* make encoder c++

* Revert "no more release callback"

This reverts commit e5707b07002fee665d0483d90713154efc2d70d4.

* fix exit handlers

* No need to check errno

* move release callback call

* s/VIPCBufExtra/VisionIpcBufExtra/g

* use non blocking connect

* ui use non blocking connect

* Lower condition variable wait time

* Snapshot cleanup

* bump cereal

* bump cereal
2021-01-08 14:54:25 +01:00
Adeeb Shihadeh af81190cfc
loggerd tests (#19671) 2021-01-06 19:18:35 -08:00
Adeeb Shihadeh a01a2ecc24 disable cpu usage test until CAN replay hw is fixed 2020-12-31 15:01:38 -08:00
Adeeb Shihadeh ffa7e0cbdb
manager tests + make all processes exit cleanly (#19595)
* manager tests

* logcatd exits cleanly

* sigint

* boardd

* multiple dbus connections hangs for some reason

* clocksd proclogd

* network type from thermal

* fix tests

* fix android logcatd

* fix mac

* fix mac proclogd

* move on device athena tests

* build first

* build first

Co-authored-by: Comma Device <device@comma.ai>
2020-12-29 22:32:03 -08:00
Adeeb Shihadeh 220853730d
manager cleanup (#2634)
* start cleanup

* add uninstall to hw abstraction layer

* cleanup

* litte more

* don't build at import time

* fix tests

* don't build by default

* sync
2020-12-17 11:45:41 -08:00
Willem Melching 9e919fb5e0 Jenkins: 1 hour pipeline timeout 2020-10-15 19:16:28 +02:00
ZwX1616 cb58e79ee8
Test camerad in CI (#2297)
* remove unused junk

* check frame pkts

* from magic

* self

* cleanup

* add todo

* no opencv

* run in J

* fix conv

* make 250x faster

* abs

* should be +1

* depends on starting phase

* block on furniture refactor

* fixed

* restart test

* check ex

* need scaling
2020-10-09 16:31:25 -07:00
Adeeb Shihadeh 4422d0c8a8 don't run jenkins on testing closet branches 2020-10-07 15:51:59 -07:00
Adeeb Shihadeh 427d4a5a9e
run loggerd tests in CI (#2241)
* run loggerd tests in jenkins

* fast

* check segs on the fly

* missing import

* wait for dir

* no thread

* relax FILE_SIZE_TOLERANCE

* cleanup

* unused

* set ci flag

* wait longer for first seg

* fix race condition with setting RecordFront

Co-authored-by: ZwX1616 <zwx1616@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-10-01 18:42:43 -07:00
Adeeb Shihadeh 846b56831f
jenkins: clean workspace (#2248) 2020-09-29 22:14:54 -07:00
Adeeb Shihadeh a3f5643019
split dockerfile into base image and CI image (#2066)
* split dockerfile into base image and CI

* doesn't exist yet

* fix path

* cache on this branch

* latest

* use cache

* don't double pull
2020-08-23 18:18:19 -07:00
Adeeb Shihadeh 100f2958fc add missing agent for jenkins job 2020-08-12 12:47:32 -07:00
Adeeb Shihadeh cb5a2996e7
NEOS background updater (#1892) 2020-08-12 11:39:21 -07:00
Adeeb Shihadeh 1f4714ba98
Test standalone binary builds in CI (#2008)
* test updater, spinner, and text window build in CI

* we dont ship the libs for updater in release branches
2020-08-10 21:52:26 -07:00
Adeeb Shihadeh ecf0a8c8d4
Improve CPU usage test reliability (#2002)
* run phone tests in parallel

* better cpu test

* re-enable test

* no root

* terms version

* not one

* yes

* debug

* that's coverd by min cpu percent
2020-08-08 20:59:32 -07:00
Adeeb Shihadeh 90d5383354
Setup PC testing in Jenkins (#1984)
* build openpilot docker container in jenkins

* use cache

* run all stages in parallel

* move device tests

* wrap in stages

* it's docker

* doesn't work, but jenkins should cache the image

* steps

* disable phone tests for now

* we're root

* enable everything

* clean up our mess

* skip checkout

* need a plugin for that

* remove that

* parallel

* Revert "parallel"

This reverts commit e3e5af9dc9db692d1b5552012d62393a5b8520dd.

* this is ugly

* Revert "this is ugly"

This reverts commit e83995935294584e264a8fcb3d08bcf7d9305434.
2020-08-05 20:21:04 -07:00
Adeeb Shihadeh 90fc1c6028
Improve on-device CI reliability (#1922) 2020-07-25 02:12:19 -07:00
Adeeb Shihadeh 63ab7930de increase Jenkins timeout, clean builds take a long time 2020-07-09 10:43:19 -07:00
Adeeb Shihadeh 3ab0b49656
Boardd loopback test (#1840)
* start boardd loopback test

* let's try this in CI

* fix jenkinsfile

* remove old

* rename

* check msgs

* should be reliable now

* send more
2020-07-08 19:42:03 -07:00
Adeeb Shihadeh 65d800c4f5 use special 'eon-build' device for release build 2020-07-07 16:41:04 -07:00
Adeeb Shihadeh c715661656
Build release2 and dashcam in CI (#1834)
* start building release2 in CI

* build script

* bring over changes from test branch

* fix build release test

* remove references to test branches

* ucnomment push

* fix duplicate remove

* two commits for dashcam

* need the key
2020-07-07 14:17:09 -07:00
Adeeb Shihadeh f1afb3e3ae
Sound test (#1820)
* WIP sound test

* it does something

* refactor

* phone only

* update release files

* test sound card init

* add to CI

* check writes

* increase time

* unused

* only build cereal

* small tolerance

Co-authored-by: Comma Device <device@comma.ai>
2020-07-05 17:56:24 -07:00
Adeeb Shihadeh 32f03ec8a5
On-device CI framework (#1784)
* let's see if this works

* fix build_release actions job

* does jenkins like this config

* separate jenkinsfile for release build

* fix devel build

* devel build should work

* always pass that for now

* run modeld replay

* release2 build will be a separate PR

* pass env to phone shell

* force checkout

* run on real jenkins eons

* add timeout

* rsync

* more timeout

* trailing slash

* fix branch detection

* debug

* not sure why paramiko doesn't pass it through

* newline

* CI_PUSH

* still not passing it

* test branch

* should be good now
2020-07-03 19:12:05 -07:00
Willem Melching 63c8e8439b
Model + camerad test (#1622)
* kind of works

* move that

* hack to get camerad to reliably terminate

* not sure why SIGTERM wasn't working before

* compare bytes

* clean up some hacks

* gitignore

* fix that

* WIP

* no reboot

* comparison works

* pretty print

* fix build

* run in jenkins

* python path

* space

* raise timeout

* new eon

* skip the copy

* spinner

* spin less

* update model ref commit

* reenable that

* clean up

* fix jenkinsfile

* parallel

* wrap it in a stage

* fix linter

* better progress

* lower timeout

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-06-04 18:57:25 -07:00
Willem Melching 960b42c523
Re enable athenad test (#1058)
* Renable athena test

* debug

* Revert "debug"

This reverts commit 30f68055f8ea047ba4e2989d63a5020e0468487f.

* Specify correct pythonpath for tests

Co-authored-by: Andy <andyh2@me.com>
2020-02-11 19:26:34 -08:00
Willem Melching 0319861700
Jenkins pipeline to create master-ci (#1019)
* Added Jenkinsfile

* Added Jenkinsfile

* Added Jenkinsfile

* change order

* sudo

* whoami?

* Added Jenkinsfile

* install git

* Untested build scripts

* Add lockable resource

* Fix syntax

* Only one stage

* fix target dir

* Use deploy key

* noqa on test_openpilot

* Fix version.h path

* Cleanup release files

* Add linter scripts to release

* Update jenkinsfile

* Fix path

* this should work

* Use python3 docker container

* Run in correct directory

* Setup /data/pythonpath

Co-authored-by: commaci-public <60409688+commaci-public@users.noreply.github.com>
2020-01-30 13:06:45 -08:00
Willem Melching 7f813d23ce cleanup and make linting part of ci work 2020-01-17 13:03:44 -08:00
George Hotz 012535a84e root directory non hidden files 2020-01-17 10:22:00 -08:00