Commit Graph

159 Commits

Author SHA1 Message Date
Shane Smiskol
f918ab7967 process replay CI: print diff after test (#24513)
* make sure we print the diff before updating refs

* cause fail

* when only uploading no need to print success status or update diff

don't print succeed/fail when only uploading

* Revert "cause fail"

This reverts commit 6e5db1a0ac6ccd0e6a0885d72d79d75c610bdc1f.

* Revert "when only uploading no need to print success status or update diff"

This reverts commit d6727f30a109fd7330746005aa7b228c9eca3e79.
2022-05-12 14:55:43 -07:00
Shane Smiskol
d2d3b7b823 process replay: automatically push refs on fail (#24414)
* test failure()

* let's just change a tune here

* debug

revert

* debug

* use current commit, not ref_commit

fix

* need to figure out better place for this

* quick test

* test without upload

* temp

* use azure token

* fixes

* shouldn't need this

* debug

* debug

* not getting anything?

* does this mean nothing gets envvars?

* add azure token to docker environment variables

* quote

* move back

* clean up a bit

* more clean up

* like this sorting better

* replace flags with CI and clean up

* test FULL_TEST and minimalize diff a bit

* now test all

* revert tests comments

* remove flags

* revert this

revert this

* now make it fail

* now update ref_commit to last commit (make sure we can re-start this test if we commit before last one finishes uploading)

* fix

fix

fix

fix

* bad commit

* why is it not throwing an exception?

* debug

* URLFile returns empty bytes if using cache and remote file doesn't exist

* we always need to download anyway

* debug...

* duh, wrong file. but neither should have it

* add that back and just check explicitly

* check both

* clean up and make a diff

* stylize

* see if this is a better diff on files changed

* update refs

* revert changes

* only for owners or members

* if we have token access

* if we have token access

* if we have token access

* move up

* clean up

* revert

* move update refs to test_processes

* clean up

* update messages

* update msg

* update README and delete update_refs

* this isn't possible to reach anymore

* fix readme

* better help message

better help message

better help message

* only show basename when uploading, only if failed to find

* test diff

* fix printing old ref commit

* change to using

* update refs

* Revert "update refs"

This reverts commit 2e352a736a6de68e2c7064daa4e2e9409ce77686.

* revert

* ref refers to reference commit/logs, cur refers to current logs/commit (future ref)

* like for better

* Apply suggestions from code review

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/test_processes.py

* every time lol

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-05-11 15:03:05 -07:00
Adeeb Shihadeh
f1bae8ca88 remove from car bug too 2022-05-06 13:21:38 -07:00
Adeeb Shihadeh
43912eb252 update issue template 2022-05-06 13:21:08 -07:00
Adeeb Shihadeh
674a2061fd CI: allow triggering prebuilt workflow manually 2022-05-04 15:08:08 -07:00
Adeeb Shihadeh
462a1079a2 CI: add job for complete build (#24283)
* CI: add job for complete build

* add --test
2022-04-21 11:34:49 -07:00
Adeeb Shihadeh
27b067446a modeld tests (#24263) 2022-04-19 15:50:04 -07:00
Adeeb Shihadeh
a55e25d9d2 test models: skip with flag 2022-03-23 16:42:04 -07:00
Shane Smiskol
99c02bdd29 Car ports: update PR template (#23996)
* update text for docs generator

* use docs.py

* Update .github/pull_request_template.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-03-18 17:47:43 -07:00
Adeeb Shihadeh
b9c48f12ad update references to CARS.md and routes.py (#23993) 2022-03-18 13:30:06 -07:00
Adeeb Shihadeh
8718a59330 cleanup selfdrive/test (#23967)
* move test routes and test_models

* move fingerprints

* little more

* remove that
2022-03-14 15:46:16 -07:00
Adeeb Shihadeh
5d34c4c66b disable macos CI for now 2022-02-10 12:57:18 -08:00
Willem Melching
a62e914090 Revert "collect C++ code coverage (#23619)"
This reverts commit 698ab6ac97.
2022-01-26 10:59:21 +01:00
Willem Melching
698ab6ac97 collect C++ code coverage (#23619)
* collect cpp coverage

* install llvm

* compile with coverage

* cd to root

* remove broken gcda files

* remove newline

* delete more stuff

* script to collect coverage

* Update tools/collect_coverage.sh

* actually delete
2022-01-25 23:15:24 +01:00
Willem Melching
ea2da86e81 use codecov action (#23618)
* use codecov action

* convert to xml

* also coverage in longitudinal test

* fix typo
2022-01-25 14:57:47 +01:00
Dean Lee
feae37541f swaglog.cc: add test case. fixed the ctx of the first message is empty (#23226)
* test case

* add to selfdrive_tests.yaml

* fix ctx_j is empty

* check return value too
2022-01-13 20:03:07 -08:00
Andrew
6664421710 mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
2022-01-07 15:15:18 -08:00
Willem Melching
526448563c disable pytest concurrency for test_models 2022-01-04 14:29:58 +01:00
Adeeb Shihadeh
cd42be7777 CI: run car unit tests in parallel (#23379)
* CI: run car unit tests in parallel

* move that
2022-01-03 16:30:14 -08:00
Adeeb Shihadeh
760104068b CI: cache LFS objects (#23345) 2022-01-03 14:34:31 -08:00
Adeeb Shihadeh
d85bb967e8 disable simulator job until LFS is fixed 2021-12-31 16:53:54 -08:00
Adeeb Shihadeh
e4caaeb2d3 tests for agnos manifest (#23176) 2021-12-08 16:21:12 -08:00
Dean Lee
c77354009c panda: add unit tests for usb protocol (pack/unpack) (#22955)
* prepare for unit tests

* add to selfdrive_tests.yaml

* test header

* test chunk count

* rename test function

* continue

* don't check chunks count

* test recv_can

* continue

* small cleanup

* merge master

* cleanup

* rename functions

* test different packet size

* fix operator precedence problem

* refactor unpack_can_buffer

* cleanup test

* cleanup unpack_can_buffer

* add test for multiple pandas

* rename to test_panda

* restore test_boardd

* rename to test_boardd_usbprotocol

* fix typo

* bus_offset = [0,4]

* change src

* use USBPACKET_MAX_SIZE
2021-11-23 20:15:22 -08:00
Willem Melching
ba0c844ad9 ci: move timestamp step into correct job 2021-11-17 14:21:59 +01:00
qadmus
65d1b51476 PlotJuggler: Tuning layout (#22902)
* PlotJuggler layout for lateral and longitudinal tuning

* update README and tuning PR template
2021-11-13 23:16:42 -08:00
Willem Melching
6bbcecb41c ci: scons cache should be pushed by a stage that actually builds 2021-11-12 19:54:04 +01:00
Willem Melching
264c5f4e61 ci: run test car models in matrix (#22884)
* Run test car models in matrix

* cache key per job

* actually cache files

* ci

* make files readable

* actually expose variables

* fix quote

* get cache unstuck

* ro cache can use more prefixes

* ci
2021-11-12 19:50:15 +01:00
Willem Melching
579994ced9 ci: scons save condition was flipped 2021-11-12 19:30:55 +01:00
Willem Melching
d98c73adb4 ci: fix timestamp in cache key (#22886) 2021-11-12 18:13:21 +01:00
Willem Melching
4462d4c31f ci: new name for scons cache to switch to new timestamp 2021-11-12 17:25:31 +01:00
Willem Melching
b213e225a6 ci: use scons cache (#22885)
* ci: populate scons cache

* release build can use the regular cache

* no volume for docker run

* no need to load the cache then

* upload cache on master
2021-11-12 17:19:25 +01:00
Willem Melching
0e78502181 remove broken athena test 2021-11-11 17:32:26 +01:00
Willem Melching
b816b5b644 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
2021-10-28 15:14:37 +02:00
Willem Melching
8cd195d030 fix test_models.py (#22694) 2021-10-26 14:46:31 +02:00
Adeeb Shihadeh
aad8d709c9 suggest car bug report in the bug report form 2021-10-10 20:27:16 -07:00
Adeeb Shihadeh
d32c11cbcb issue templates improvements 2021-10-10 14:37:04 -07:00
Adeeb Shihadeh
5428dee4d2 use forms for car and pc bugs (#22502) 2021-10-09 14:32:10 -07:00
Adeeb Shihadeh
bd36f2ec8d try out new github issue forms (#22501)
* try new issue templates

* Update new_bug_report.yml

* replace old one
2021-10-09 14:19:26 -07:00
Adeeb Shihadeh
5b641379ae phonelibs -> third_party (#22477)
* git mv to third_party

* find and replace

* fix release tests

* update pre-commit

* update tici bins

* update eon bins

Co-authored-by: Comma Device <device@comma.ai>
2021-10-07 16:32:44 -07:00
Adeeb Shihadeh
de7a9e0116 move athena tests to github actions (#22475)
* move athena tests to actions

* run

* fix timeout
2021-10-07 13:22:14 -07:00
Dean Lee
f3683dd4cb test_replay.cc: temporarily comment out the rand seek test (#22192)
* Temporarily comment out the rand seek test

* enable ci

* trigger ci

* trigger ci

* trigger ci

* trigger ci

* trigger ci
2021-09-10 21:53:46 -07:00
Adeeb Shihadeh
95ee5daec5 disable replay tests for now 2021-09-10 17:33:20 -07:00
HaraldSchafer
1b4e780025 Create tuning.md 2021-09-09 14:13:32 -07:00
Dean Lee
81a128cd76 FrameReader: do not depend on Qtunit tests (#21379)
* add timeout and test case

* remove useless comment

* reduce to 1s

* fix gotframe fail when Duplicate POC in a sequence

* cleanup

* remove space

* fix
2021-09-09 13:40:12 -07:00
Adeeb Shihadeh
81006b03c2 handle missing routes better in test car models 2021-09-06 19:21:06 -07:00
Dean Lee
935cbd3139 LoggerState: test cases (#21855)
* test multiple threads writing to log

* fix typo

* use util::getenv

* check INIT_DATA and SENTINEL

* test END_OF_SEGMENT

* add comment

* test multiple threads logging and rotation

* cleanup

* update

* LoggerHandle:quick fix

* cleanup

* revert test_loggerd.py

* refactor test case

* check lock file

* check refcnt after close

* test_runner.cc

d

* int eixt_signal
2021-08-30 17:12:09 -07:00
Dean Lee
d0fa98931b proclogd: reduce the size of the procLog message by nearly half (#21800)
* cp msg to remove the space

* no orphans

* cleanup

* parse using istringstream

* add test

* split files

* cleanup

* add parser.cc to files_common

* add test for build message

* use > 0

* cleanup

* test proc/self/stat

* more test

* dd

* fix bug

* update test

* refactor pidStat

* cleanup

* test exe

* check procs size in message

* rename pidStat->ProcStat

* don't use util::format_string

* robust pids()

* catch conversion exception

* fix softirq

* udpate test

* use istringstream

* use REQUIRE_THAT&cleanup

* reserve vector of procStats

* use istream to parse cmdline

* cleanup
2021-08-05 11:27:02 +02:00
Adeeb Shihadeh
7a5f30f16b remove nav sconscript hack (#21768)
* remove nav sconscript hack

* pc files
2021-07-28 17:44:01 -07:00
Adeeb Shihadeh
6d4307e9f7 issue templates: add note about uploading logs and remove redundant field 2021-07-07 19:02:44 -07:00
Adeeb Shihadeh
ccf2780456 check submodule commits on master (#21446) 2021-07-01 23:12:39 -07:00