Commit Graph

51 Commits

Author SHA1 Message Date
Adeeb Shihadeh
f4675fc260 Merge common/ and selfdrive/common (#24556)
* Merge common/ and selfdrive/common

* fix that

* fix version

* fix unit tests
old-commit-hash: cb8885cffb
2022-05-18 14:11:57 -07:00
Adeeb Shihadeh
8f0df45031 CI tuneup (#24541)
* little housekeeping

* all the commits

* one more cars
old-commit-hash: b2569d871f
2022-05-15 17:57:34 -07:00
Shane Smiskol
768f36979a process replay CI: print diff after test (#24513)
* make sure we print the diff before updating refs

* cause fail

* when only uploading no need to print success status or update diff

don't print succeed/fail when only uploading

* Revert "cause fail"

This reverts commit 6e5db1a0ac6ccd0e6a0885d72d79d75c610bdc1f.

* Revert "when only uploading no need to print success status or update diff"

This reverts commit d6727f30a109fd7330746005aa7b228c9eca3e79.
old-commit-hash: f918ab7967
2022-05-12 14:55:43 -07:00
Shane Smiskol
024f42bae5 process replay: automatically push refs on fail (#24414)
* test failure()

* let's just change a tune here

* debug

revert

* debug

* use current commit, not ref_commit

fix

* need to figure out better place for this

* quick test

* test without upload

* temp

* use azure token

* fixes

* shouldn't need this

* debug

* debug

* not getting anything?

* does this mean nothing gets envvars?

* add azure token to docker environment variables

* quote

* move back

* clean up a bit

* more clean up

* like this sorting better

* replace flags with CI and clean up

* test FULL_TEST and minimalize diff a bit

* now test all

* revert tests comments

* remove flags

* revert this

revert this

* now make it fail

* now update ref_commit to last commit (make sure we can re-start this test if we commit before last one finishes uploading)

* fix

fix

fix

fix

* bad commit

* why is it not throwing an exception?

* debug

* URLFile returns empty bytes if using cache and remote file doesn't exist

* we always need to download anyway

* debug...

* duh, wrong file. but neither should have it

* add that back and just check explicitly

* check both

* clean up and make a diff

* stylize

* see if this is a better diff on files changed

* update refs

* revert changes

* only for owners or members

* if we have token access

* if we have token access

* if we have token access

* move up

* clean up

* revert

* move update refs to test_processes

* clean up

* update messages

* update msg

* update README and delete update_refs

* this isn't possible to reach anymore

* fix readme

* better help message

better help message

better help message

* only show basename when uploading, only if failed to find

* test diff

* fix printing old ref commit

* change to using

* update refs

* Revert "update refs"

This reverts commit 2e352a736a6de68e2c7064daa4e2e9409ce77686.

* revert

* ref refers to reference commit/logs, cur refers to current logs/commit (future ref)

* like for better

* Apply suggestions from code review

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/test_processes.py

* every time lol

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: d2d3b7b823
2022-05-11 15:03:05 -07:00
Adeeb Shihadeh
09cb3ad3ee CI: add job for complete build (#24283)
* CI: add job for complete build

* add --test
old-commit-hash: 462a1079a2
2022-04-21 11:34:49 -07:00
Adeeb Shihadeh
074603c1b9 modeld tests (#24263)
old-commit-hash: 27b067446a
2022-04-19 15:50:04 -07:00
Adeeb Shihadeh
3679d88b80 test models: skip with flag
old-commit-hash: a55e25d9d2
2022-03-23 16:42:04 -07:00
Adeeb Shihadeh
5fe40091bf update references to CARS.md and routes.py (#23993)
old-commit-hash: b9c48f12ad
2022-03-18 13:30:06 -07:00
Adeeb Shihadeh
805a00b5f3 cleanup selfdrive/test (#23967)
* move test routes and test_models

* move fingerprints

* little more

* remove that
old-commit-hash: 8718a59330
2022-03-14 15:46:16 -07:00
Adeeb Shihadeh
1ccf50fb3f disable macos CI for now
old-commit-hash: 5d34c4c66b
2022-02-10 12:57:18 -08:00
Willem Melching
772f394423 Revert "collect C++ code coverage (#23619)"
This reverts commit a97b2e613b275f407576ddb3d7a3bd52b05f612a.

old-commit-hash: a62e914090
2022-01-26 10:59:21 +01:00
Willem Melching
6c89b62dd9 collect C++ code coverage (#23619)
* collect cpp coverage

* install llvm

* compile with coverage

* cd to root

* remove broken gcda files

* remove newline

* delete more stuff

* script to collect coverage

* Update tools/collect_coverage.sh

* actually delete
old-commit-hash: 698ab6ac97
2022-01-25 23:15:24 +01:00
Willem Melching
b8c3aab0d8 use codecov action (#23618)
* use codecov action

* convert to xml

* also coverage in longitudinal test

* fix typo
old-commit-hash: ea2da86e81
2022-01-25 14:57:47 +01:00
Dean Lee
12c511b1e0 swaglog.cc: add test case. fixed the ctx of the first message is empty (#23226)
* test case

* add to selfdrive_tests.yaml

* fix ctx_j is empty

* check return value too
old-commit-hash: feae37541f
2022-01-13 20:03:07 -08:00
Andrew
192978753d mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
old-commit-hash: 6664421710
2022-01-07 15:15:18 -08:00
Willem Melching
879033f1ff disable pytest concurrency for test_models
old-commit-hash: 526448563c
2022-01-04 14:29:58 +01:00
Adeeb Shihadeh
5e490d86c3 CI: run car unit tests in parallel (#23379)
* CI: run car unit tests in parallel

* move that
old-commit-hash: cd42be7777
2022-01-03 16:30:14 -08:00
Adeeb Shihadeh
83a0271f2c tests for agnos manifest (#23176)
old-commit-hash: e4caaeb2d3
2021-12-08 16:21:12 -08:00
Dean Lee
a919e5721e panda: add unit tests for usb protocol (pack/unpack) (#22955)
* prepare for unit tests

* add to selfdrive_tests.yaml

* test header

* test chunk count

* rename test function

* continue

* don't check chunks count

* test recv_can

* continue

* small cleanup

* merge master

* cleanup

* rename functions

* test different packet size

* fix operator precedence problem

* refactor unpack_can_buffer

* cleanup test

* cleanup unpack_can_buffer

* add test for multiple pandas

* rename to test_panda

* restore test_boardd

* rename to test_boardd_usbprotocol

* fix typo

* bus_offset = [0,4]

* change src

* use USBPACKET_MAX_SIZE
old-commit-hash: c77354009c
2021-11-23 20:15:22 -08:00
Willem Melching
b03a21a8d5 ci: move timestamp step into correct job
old-commit-hash: ba0c844ad9
2021-11-17 14:21:59 +01:00
Willem Melching
387d4fc961 ci: scons cache should be pushed by a stage that actually builds
old-commit-hash: 6bbcecb41c
2021-11-12 19:54:04 +01:00
Willem Melching
0b8d611b10 ci: run test car models in matrix (#22884)
* Run test car models in matrix

* cache key per job

* actually cache files

* ci

* make files readable

* actually expose variables

* fix quote

* get cache unstuck

* ro cache can use more prefixes

* ci
old-commit-hash: 264c5f4e61
2021-11-12 19:50:15 +01:00
Willem Melching
b42be232d6 ci: scons save condition was flipped
old-commit-hash: 579994ced9
2021-11-12 19:30:55 +01:00
Willem Melching
71906f45fb ci: fix timestamp in cache key (#22886)
old-commit-hash: d98c73adb4
2021-11-12 18:13:21 +01:00
Willem Melching
bf03231af5 ci: new name for scons cache to switch to new timestamp
old-commit-hash: 4462d4c31f
2021-11-12 17:25:31 +01:00
Willem Melching
d3ca4af4a6 ci: use scons cache (#22885)
* ci: populate scons cache

* release build can use the regular cache

* no volume for docker run

* no need to load the cache then

* upload cache on master
old-commit-hash: b213e225a6
2021-11-12 17:19:25 +01:00
Willem Melching
e8b1e69ac1 remove broken athena test
old-commit-hash: 0e78502181
2021-11-11 17:32:26 +01:00
Willem Melching
67f41f32f1 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
old-commit-hash: b816b5b644
2021-10-28 15:14:37 +02:00
Willem Melching
a15e1b2de0 fix test_models.py (#22694)
old-commit-hash: 8cd195d030
2021-10-26 14:46:31 +02:00
Adeeb Shihadeh
782d7023d2 phonelibs -> third_party (#22477)
* git mv to third_party

* find and replace

* fix release tests

* update pre-commit

* update tici bins

* update eon bins

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 5b641379ae
2021-10-07 16:32:44 -07:00
Adeeb Shihadeh
ad96d0d130 move athena tests to github actions (#22475)
* move athena tests to actions

* run

* fix timeout
old-commit-hash: de7a9e0116
2021-10-07 13:22:14 -07:00
Dean Lee
0d226299e7 test_replay.cc: temporarily comment out the rand seek test (#22192)
* Temporarily comment out the rand seek test

* enable ci

* trigger ci

* trigger ci

* trigger ci

* trigger ci

* trigger ci
old-commit-hash: f3683dd4cb
2021-09-10 21:53:46 -07:00
Adeeb Shihadeh
75b50fc128 disable replay tests for now
old-commit-hash: 95ee5daec5
2021-09-10 17:33:20 -07:00
Dean Lee
1d5ca75029 FrameReader: do not depend on Qtunit tests (#21379)
* add timeout and test case

* remove useless comment

* reduce to 1s

* fix gotframe fail when Duplicate POC in a sequence

* cleanup

* remove space

* fix
old-commit-hash: 81a128cd76
2021-09-09 13:40:12 -07:00
Adeeb Shihadeh
984fc2008d handle missing routes better in test car models
old-commit-hash: 81006b03c2
2021-09-06 19:21:06 -07:00
Dean Lee
0fac38e34f LoggerState: test cases (#21855)
* test multiple threads writing to log

* fix typo

* use util::getenv

* check INIT_DATA and SENTINEL

* test END_OF_SEGMENT

* add comment

* test multiple threads logging and rotation

* cleanup

* update

* LoggerHandle:quick fix

* cleanup

* revert test_loggerd.py

* refactor test case

* check lock file

* check refcnt after close

* test_runner.cc

d

* int eixt_signal
old-commit-hash: 935cbd3139
2021-08-30 17:12:09 -07:00
Dean Lee
ee8b53a7e8 proclogd: reduce the size of the procLog message by nearly half (#21800)
* cp msg to remove the space

* no orphans

* cleanup

* parse using istringstream

* add test

* split files

* cleanup

* add parser.cc to files_common

* add test for build message

* use > 0

* cleanup

* test proc/self/stat

* more test

* dd

* fix bug

* update test

* refactor pidStat

* cleanup

* test exe

* check procs size in message

* rename pidStat->ProcStat

* don't use util::format_string

* robust pids()

* catch conversion exception

* fix softirq

* udpate test

* use istringstream

* use REQUIRE_THAT&cleanup

* reserve vector of procStats

* use istream to parse cmdline

* cleanup
old-commit-hash: d0fa98931b
2021-08-05 11:27:02 +02:00
Adeeb Shihadeh
28ddda3011 remove nav sconscript hack (#21768)
* remove nav sconscript hack

* pc files
old-commit-hash: 7a5f30f16b
2021-07-28 17:44:01 -07:00
Adeeb Shihadeh
88eab8b0a8 check submodule commits on master (#21446)
old-commit-hash: ccf2780456
2021-07-01 23:12:39 -07:00
Adeeb Shihadeh
add0d2d65e CI: fix hanging if build failed
old-commit-hash: 7d04be39cb
2021-06-30 17:58:28 -07:00
Dean Lee
6bfc7f4ca5 common/util.cc: add unit test, fix bug in util::read_file (#21251)
* add test case for util

* fix bug in read_file

* gitignore test_util

* better test

* referer

* more

* more test

* REQUIRE size

* apply reviews

* only test binary

* simplify the test

* read  non-permission

* debug print

* remove /etc/shadow

* test read directory

* Update selfdrive/common/tests/test_util.cc

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: a873a23e0d
2021-06-16 11:01:13 +02:00
Adeeb Shihadeh
d1068dc263 increase test car moddels timeout
old-commit-hash: 164e018d38
2021-06-04 04:38:43 -07:00
Adeeb Shihadeh
fb62002e92 use scons cache by default (#21102)
* always use scons cache

* cleanup
old-commit-hash: a0dabd94e9
2021-06-01 17:12:32 -07:00
Adeeb Shihadeh
c7c49e8e35 fix up model tests + tools (#21071)
* unlogger: send yuv stream

* fix up model test tools

* fix unlogger

* rename model replay

* bump cereal

* test in actions

* no ci for now
old-commit-hash: cf6d133638
2021-05-28 23:08:08 -07:00
Adeeb Shihadeh
89105c46ac disable mac for now
old-commit-hash: 5488793a60
2021-05-20 03:14:43 -07:00
Adeeb Shihadeh
df17f65c61 cleanup car tests (#20562)
* cleanup test_car_models

* don't fail on that
old-commit-hash: 7e632900e5
2021-04-01 16:46:08 -07:00
Adeeb Shihadeh
85ab6b1c79 test build script in CI (#20482)
old-commit-hash: cfe4cea2c9
2021-03-25 20:22:59 -07:00
ZwX1616
d8c1e9a16e set_exposure_target test (#20318)
* build

* remove junk

* clean up

* clean up rebase

* new patterns

* add gts

* add to jenkis

* this more useful

* typo

* test only

* Update Jenkinsfile

* test flag

* remove from jenkins

* these should all just be common:wq

* oops

* unigt

* add to unit tests?

* build all is fine

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 65bb979c34
2021-03-12 17:40:50 -08:00
Adeeb Shihadeh
233c41bc60 scons cache in CI (#20197)
* scons cache in ci

* clean up cache

* fix cleanup step

* non fixed key

* quote
old-commit-hash: 7921759bbe
2021-02-28 15:50:20 -08:00
Adeeb Shihadeh
b93cc8417a CI: fix webcam cache
old-commit-hash: 9288031e6f
2021-02-27 21:54:34 -08:00