Commit Graph

421 Commits

Author SHA1 Message Date
Adeeb Shihadeh
fbd98b0e54 CI: add build job for latest Ubuntu (#24637)
* CI: add build job for latest Ubuntu

* source

* source env

* scons cache

* cache pyenv

* fix key

* source
2022-06-11 22:51:09 -07:00
Adeeb Shihadeh
a029245a78 CI: fix docker push for base image 2022-06-11 12:21:12 -07:00
Shane Smiskol
5bb1554ec4 build checks do not rely on each other (#24783) 2022-06-09 10:55:05 -07:00
HaraldSchafer
a2c6b30c98 Fix onnx model replay (#24702)
* No more C2

* Add test

* Various fixups

* Use ONNXCPU

* rm prints

* LFS pull

* Use sim docker

* Try sim docker again

* Print counter

* Make sure it can fail

* Fails correctly

* comments

* Add more install to opencl base docker

* vim not needed in base
2022-06-03 10:43:09 -07:00
HaraldSchafer
dc4d4f875b CL in docker (#24718)
* Move CL to base docker

* Different docker for cl

* add cl base docker

* add to tool

* cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-06-02 18:26:12 -07:00
Adeeb Shihadeh
afd16b2ade Create system/ for generic services (#24717)
* Create system/ for generic services

* logcatd joins the party

* fix those up
2022-06-02 17:02:25 -07:00
Lukas Petersson
28dd1a9124 CI: run process replay in parallel (#24646)
* CI in parallel

* cache key
2022-05-24 12:47:29 -07:00
Adeeb Shihadeh
cb8885cffb Merge common/ and selfdrive/common (#24556)
* Merge common/ and selfdrive/common

* fix that

* fix version

* fix unit tests
2022-05-18 14:11:57 -07:00
Adeeb Shihadeh
2c2c61fd77 CI: pull LFS after checkout (#24552) 2022-05-16 14:30:20 -07:00
Adeeb Shihadeh
b2569d871f CI tuneup (#24541)
* little housekeeping

* all the commits

* one more cars
2022-05-15 17:57:34 -07:00
Adeeb Shihadeh
08cb0edb53 push to real master-ci 2022-05-14 00:43:40 -07:00
Adeeb Shihadeh
531f4483b2 CI: build master-ci in Actions (#24533)
* jenkins: build master-ci on pc

* make target configurable

* build on actions

* no wait

* more fetch

* v3 has push?

* example

* remove that

* wait

* v1.1.1

* this one works

* schedule

* clear out target first

* no lfs
2022-05-14 00:18:30 -07:00
Shane Smiskol
f918ab7967 process replay CI: print diff after test (#24513)
* make sure we print the diff before updating refs

* cause fail

* when only uploading no need to print success status or update diff

don't print succeed/fail when only uploading

* Revert "cause fail"

This reverts commit 6e5db1a0ac6ccd0e6a0885d72d79d75c610bdc1f.

* Revert "when only uploading no need to print success status or update diff"

This reverts commit d6727f30a109fd7330746005aa7b228c9eca3e79.
2022-05-12 14:55:43 -07:00
Shane Smiskol
d2d3b7b823 process replay: automatically push refs on fail (#24414)
* test failure()

* let's just change a tune here

* debug

revert

* debug

* use current commit, not ref_commit

fix

* need to figure out better place for this

* quick test

* test without upload

* temp

* use azure token

* fixes

* shouldn't need this

* debug

* debug

* not getting anything?

* does this mean nothing gets envvars?

* add azure token to docker environment variables

* quote

* move back

* clean up a bit

* more clean up

* like this sorting better

* replace flags with CI and clean up

* test FULL_TEST and minimalize diff a bit

* now test all

* revert tests comments

* remove flags

* revert this

revert this

* now make it fail

* now update ref_commit to last commit (make sure we can re-start this test if we commit before last one finishes uploading)

* fix

fix

fix

fix

* bad commit

* why is it not throwing an exception?

* debug

* URLFile returns empty bytes if using cache and remote file doesn't exist

* we always need to download anyway

* debug...

* duh, wrong file. but neither should have it

* add that back and just check explicitly

* check both

* clean up and make a diff

* stylize

* see if this is a better diff on files changed

* update refs

* revert changes

* only for owners or members

* if we have token access

* if we have token access

* if we have token access

* move up

* clean up

* revert

* move update refs to test_processes

* clean up

* update messages

* update msg

* update README and delete update_refs

* this isn't possible to reach anymore

* fix readme

* better help message

better help message

better help message

* only show basename when uploading, only if failed to find

* test diff

* fix printing old ref commit

* change to using

* update refs

* Revert "update refs"

This reverts commit 2e352a736a6de68e2c7064daa4e2e9409ce77686.

* revert

* ref refers to reference commit/logs, cur refers to current logs/commit (future ref)

* like for better

* Apply suggestions from code review

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/test_processes.py

* every time lol

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-05-11 15:03:05 -07:00
Adeeb Shihadeh
f1bae8ca88 remove from car bug too 2022-05-06 13:21:38 -07:00
Adeeb Shihadeh
43912eb252 update issue template 2022-05-06 13:21:08 -07:00
Adeeb Shihadeh
674a2061fd CI: allow triggering prebuilt workflow manually 2022-05-04 15:08:08 -07:00
Adeeb Shihadeh
462a1079a2 CI: add job for complete build (#24283)
* CI: add job for complete build

* add --test
2022-04-21 11:34:49 -07:00
Adeeb Shihadeh
27b067446a modeld tests (#24263) 2022-04-19 15:50:04 -07:00
Adeeb Shihadeh
a55e25d9d2 test models: skip with flag 2022-03-23 16:42:04 -07:00
Shane Smiskol
99c02bdd29 Car ports: update PR template (#23996)
* update text for docs generator

* use docs.py

* Update .github/pull_request_template.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-03-18 17:47:43 -07:00
Adeeb Shihadeh
b9c48f12ad update references to CARS.md and routes.py (#23993) 2022-03-18 13:30:06 -07:00
Adeeb Shihadeh
8718a59330 cleanup selfdrive/test (#23967)
* move test routes and test_models

* move fingerprints

* little more

* remove that
2022-03-14 15:46:16 -07:00
Adeeb Shihadeh
5d34c4c66b disable macos CI for now 2022-02-10 12:57:18 -08:00
Willem Melching
a62e914090 Revert "collect C++ code coverage (#23619)"
This reverts commit 698ab6ac97.
2022-01-26 10:59:21 +01:00
Willem Melching
698ab6ac97 collect C++ code coverage (#23619)
* collect cpp coverage

* install llvm

* compile with coverage

* cd to root

* remove broken gcda files

* remove newline

* delete more stuff

* script to collect coverage

* Update tools/collect_coverage.sh

* actually delete
2022-01-25 23:15:24 +01:00
Willem Melching
ea2da86e81 use codecov action (#23618)
* use codecov action

* convert to xml

* also coverage in longitudinal test

* fix typo
2022-01-25 14:57:47 +01:00
Dean Lee
feae37541f swaglog.cc: add test case. fixed the ctx of the first message is empty (#23226)
* test case

* add to selfdrive_tests.yaml

* fix ctx_j is empty

* check return value too
2022-01-13 20:03:07 -08:00
Andrew
6664421710 mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
2022-01-07 15:15:18 -08:00
Willem Melching
526448563c disable pytest concurrency for test_models 2022-01-04 14:29:58 +01:00
Adeeb Shihadeh
cd42be7777 CI: run car unit tests in parallel (#23379)
* CI: run car unit tests in parallel

* move that
2022-01-03 16:30:14 -08:00
Adeeb Shihadeh
760104068b CI: cache LFS objects (#23345) 2022-01-03 14:34:31 -08:00
Adeeb Shihadeh
d85bb967e8 disable simulator job until LFS is fixed 2021-12-31 16:53:54 -08:00
Adeeb Shihadeh
e4caaeb2d3 tests for agnos manifest (#23176) 2021-12-08 16:21:12 -08:00
Dean Lee
c77354009c panda: add unit tests for usb protocol (pack/unpack) (#22955)
* prepare for unit tests

* add to selfdrive_tests.yaml

* test header

* test chunk count

* rename test function

* continue

* don't check chunks count

* test recv_can

* continue

* small cleanup

* merge master

* cleanup

* rename functions

* test different packet size

* fix operator precedence problem

* refactor unpack_can_buffer

* cleanup test

* cleanup unpack_can_buffer

* add test for multiple pandas

* rename to test_panda

* restore test_boardd

* rename to test_boardd_usbprotocol

* fix typo

* bus_offset = [0,4]

* change src

* use USBPACKET_MAX_SIZE
2021-11-23 20:15:22 -08:00
Willem Melching
ba0c844ad9 ci: move timestamp step into correct job 2021-11-17 14:21:59 +01:00
qadmus
65d1b51476 PlotJuggler: Tuning layout (#22902)
* PlotJuggler layout for lateral and longitudinal tuning

* update README and tuning PR template
2021-11-13 23:16:42 -08:00
Willem Melching
6bbcecb41c ci: scons cache should be pushed by a stage that actually builds 2021-11-12 19:54:04 +01:00
Willem Melching
264c5f4e61 ci: run test car models in matrix (#22884)
* Run test car models in matrix

* cache key per job

* actually cache files

* ci

* make files readable

* actually expose variables

* fix quote

* get cache unstuck

* ro cache can use more prefixes

* ci
2021-11-12 19:50:15 +01:00
Willem Melching
579994ced9 ci: scons save condition was flipped 2021-11-12 19:30:55 +01:00
Willem Melching
d98c73adb4 ci: fix timestamp in cache key (#22886) 2021-11-12 18:13:21 +01:00
Willem Melching
4462d4c31f ci: new name for scons cache to switch to new timestamp 2021-11-12 17:25:31 +01:00
Willem Melching
b213e225a6 ci: use scons cache (#22885)
* ci: populate scons cache

* release build can use the regular cache

* no volume for docker run

* no need to load the cache then

* upload cache on master
2021-11-12 17:19:25 +01:00
Willem Melching
0e78502181 remove broken athena test 2021-11-11 17:32:26 +01:00
Willem Melching
b816b5b644 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
2021-10-28 15:14:37 +02:00
Willem Melching
8cd195d030 fix test_models.py (#22694) 2021-10-26 14:46:31 +02:00
Adeeb Shihadeh
aad8d709c9 suggest car bug report in the bug report form 2021-10-10 20:27:16 -07:00
Adeeb Shihadeh
d32c11cbcb issue templates improvements 2021-10-10 14:37:04 -07:00
Adeeb Shihadeh
5428dee4d2 use forms for car and pc bugs (#22502) 2021-10-09 14:32:10 -07:00
Adeeb Shihadeh
bd36f2ec8d try out new github issue forms (#22501)
* try new issue templates

* Update new_bug_report.yml

* replace old one
2021-10-09 14:19:26 -07:00