Files
dragonpilot/selfdrive/test/process_replay
Willem Melching 63c8e8439b Model + camerad test (#1622)
* kind of works

* move that

* hack to get camerad to reliably terminate

* not sure why SIGTERM wasn't working before

* compare bytes

* clean up some hacks

* gitignore

* fix that

* WIP

* no reboot

* comparison works

* pretty print

* fix build

* run in jenkins

* python path

* space

* raise timeout

* new eon

* skip the copy

* spinner

* spin less

* update model ref commit

* reenable that

* clean up

* fix jenkinsfile

* parallel

* wrap it in a stage

* fix linter

* better progress

* lower timeout

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-06-04 18:57:25 -07:00
..
2020-01-17 11:16:14 -08:00
2020-06-04 18:57:25 -07:00
2020-01-17 11:16:14 -08:00
2020-06-02 17:31:59 -07:00
2020-06-04 18:57:25 -07:00
2020-06-04 18:57:25 -07:00

process replay

Process replay is a regression test designed to identify any changes in the output of a process. This test replays a segment through individual processes and compares the output to a known good replay. Each make is represented in the test with a segment.

If the test fails, make sure that you didn't unintentionally change anything. If there are intentional changes, the reference logs will be updated.

Use test_processes.py to run the test locally.

Currently the following processes are tested:

  • controlsd
  • radard
  • plannerd
  • calibrationd

Forks

openpilot forks can use this test with their own reference logs

To generate new logs:

./update-refs.py --no-upload

Then, check in the new logs using git-lfs. Make sure to also include the updated ref_commit file.