Commit Graph

94 Commits

Author SHA1 Message Date
Kacper Rączy
23de5f1bac pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh
5ec7da96a6 ci: always upload process replay ref logs 2023-03-30 12:43:08 -07:00
Adeeb Shihadeh
c97911dbad ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh
94eb215980 loggerd: move to system/ (#27534) 2023-03-08 11:20:49 -08:00
Shane Smiskol
b536b9c4c0 process replay: don't upload if diff doesn't exist (#27333)
* fail the replay, successfully print

* should still run

* debug

* outside?

* don't fail

* don't fail

* don't fail

* test

* test

* test

* try this now

* clean up, works!
2023-02-13 21:39:06 -08:00
Adeeb Shihadeh
01bdf382c4 CI: temporarily remove timeouts 2023-02-07 12:52:50 -08:00
Kurt Nistelberger
e2f5b164bd Ubloxd: glonass parsing tests (#27125)
* add glonass kaitai parsing

* add kaita generated files

* remove glonass from build

* add string non immediate type

* fix kaitai bug

* cleanUp

* add patch file

* fix scons order

* make lookup const

* remove comments

* rename

* add to release files

* remove printf

* add signs

* add glonass parsing test

* finish up glonass kaitai tests

* move cereal back to master

* ignore test_runner

* sign is not two complement

* address comments
---------

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
2023-01-30 16:34:07 -08:00
Shane Smiskol
3efb22e82b release pre-commit: test translations (#27017)
we should be able to run on the stripped dir now
2023-01-20 11:46:02 -08:00
Adeeb Shihadeh
1da6f6a6e2 nav model replay (#26697)
* nav model replay

* set token

* fix gh actions

* update refs

* fix pc
2022-12-07 19:36:30 -08:00
Cameron Clough
a662af57c7 CI: use github.head_ref to group PR action runs (#26505)
* CI: use github.head_ref to group PR action runs

for push triggers, github.ref is set to the "branch or tag ref that was pushed"
for pull_request triggers, it is set to the "pull request merge branch" (master?)

github.head_ref is only set when the trigger is pull_request

https://docs.github.com/en/actions/learn-github-actions/contexts#github-context

* only check github.ref for push event
2022-11-15 13:07:46 -08:00
Dean Lee
80b088c332 Cabana: add save DBC dialog (#26282)
* export DBC to text edit

* added saveAs & Copy To Clipboard

* cleanup

* cleanup include

* add test case

* rename variable

* fix precision
2022-10-30 07:31:12 -07:00
Cameron Clough
335351123a Revert "ci: run some jobs only on push (#26202)"
This reverts commit 04b40aad92.
2022-10-22 01:04:54 -07:00
Cameron Clough
04b40aad92 ci: run some jobs only on push (#26202)
* ci: run some jobs only on push

alternative to #25900

* tools too
2022-10-21 21:13:55 -07:00
Cameron Clough
dba8e8ec0e Revert "ci: don't trigger on pull request sync event (#25900)"
This reverts commit 68530f18b4.
2022-10-21 18:04:07 -07:00
HaraldSchafer
a98d105cb9 Pipenv -> poetry (#24858)
* Try poetry

* Remove casadi for now

* Update docker

* Copy pipfiles

* add casadi back

* Too many slashes

* New poetry api

* Install system

* Try again

* No more pipenv

* new dependencies

* updates

* poetry 1.2.1, install dev dependencies

* keep install pipenv for xx for now?

* add pre-commit checks for poetry

* poetry lock is too slow

* update pip

* migrate to poetry groups

* update lockfile

* don't need to specify dev group unless it is made optional

* always install poetry

* set POETRY_VIRTUALENVS_CREATE instead, and use pipenv for xx

* use env for docs docker image

* alphabetical

* poetry 1.2.2

* add dev dependencies for typing

added in 4e310b80

* remove constraint

* fix PIPENV_SYSTEM

* remove constraint

* don't need this here

* bump

* bump pipenv

adds support for installing local pyprojects (can add openpilot as dependency of xx)

* README improvements

* probably not necessary

* bump pip

* maybe not necessary?

* revert

* don't install openpilot itself into the virtual env

* remove PySide2 and shiboken2

reverts c6b749fb96

* remove Pipenv, add xx dependencies, sync system python

* add pipenv as xx dep

* semver package constraints, use old lockfile versions

* fix casadi

* remove whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* disable poetry cache

* cleanup

* prefer config file

Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-10-21 16:23:56 -07:00
Cameron Clough
68530f18b4 ci: don't trigger on pull request sync event (#25900) 2022-10-20 13:23:59 -07:00
Adeeb Shihadeh
00494a44f4 CI speedup (#26096)
* CI speedup

* use the new stuff

* push

* no regressions

* try that

* don't let this slip

* fix modeld tests

* fix linter

* modernize prebuilt

* cleanup

* fix those

* increase a bit
2022-10-16 15:54:36 -07:00
Cameron Clough
077f0e0a44 ci: disable concurrency for master branch (#26052)
disable concurrency for master branch
2022-10-12 15:11:03 -07:00
Cameron Clough
03f06b0e32 ci: don't cancel concurrent workflows for master branch (#26047)
don't cancel for master branch
2022-10-12 14:03:44 -07:00
Cameron Clough
03a065160e ci: only run one instance of each workflow (#26036)
only allow one running workflow per event for each branch
2022-10-12 13:51:09 -07:00
Shane Smiskol
6393d29b04 pre-commit: test translations (#25695)
* add test translations to precommit

* fix test translations pre-commit hook

* revert

* fix that

* add to release files

add to release files

* fix

* don't run test on stripped dir

* fix
2022-10-03 12:26:12 -07:00
Adeeb Shihadeh
c626198575 webcam isn't a special build anymore 2022-08-26 20:44:29 -07:00
Adeeb Shihadeh
c2fee2d45e build test files by default (#25515)
* build test files by default

* only on master based
2022-08-25 16:22:52 -07:00
Adeeb Shihadeh
71e76c3d0f CI: Actions cleanup + speedup (#25514)
* actions cache cleanup

* release build cleanup

* fetch dpeth
2022-08-21 19:14:36 -07:00
Adeeb Shihadeh
ce1e40285b build_devel: check file sizes against GH limit (#25391)
* build_devel: check file sizes against GH limit

* pull lfs
2022-08-08 14:16:47 -07:00
HaraldSchafer
9fbbefbc94 Update model replay commit for calib change (#25357)
* Update model replay commit for calib test

* more reliable baseline

* update docker login

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-08-03 22:35:03 -07:00
Shane Smiskol
b5e3678245 Car info diff comment: don't fail if car info structure changes (#25193)
Don't fail if car info structure changes
2022-07-18 23:17:29 -07:00
Willem Melching
a006cd168e run pre-commit in release CI (#25158)
* run pre-commit in release

* add pylintrc and init files

* build first

* add mypy ini

* limit amount of debug scripts shipped in release

* add python version?

* add more missing __init__.py

* excluded rednose for cppcheck

* remove files before dirty check
2022-07-13 17:55:05 +02:00
Shane Smiskol
e710ba549a Car docs diff bot: skip PRs from forks (#25151)
* check permissions explicitly

* fix syntax

* Fix

* Diff

* fix

* revert
2022-07-13 00:20:35 -07:00
Shane Smiskol
aadaaabd54 compatibility docs: print diff from PR (#24941)
* print docs diff

* revert car changes

* cause a diff

* temp so it works

* text diff

* tier inline is a bit too much

* comments

* fix

* use paths

* fix

* temp

* temp

* diff

* fix

* remove something

* more text diff

* Delete comment if outdated

* Smaller diff

* remove

* no diff

* Don't try to run on fork PRs

* cause some errors

* Fix

* Fix

* Doesn't support env in job if, only step if

* in case file was moved, don't throw error

* See if this does what I think it does

* See if this does what I think it does

* should work

* change something

* revert

* uncomment

* no comment

* this shouldn't fail

* rename to base

* Remove true

* Remove other true
2022-07-12 18:58:46 -07:00
Adeeb Shihadeh
df251ef50e Fix master-ci dirty working tree + CI test (#25087)
* check

* test for dirty working tree

* swap order

* fix diff
2022-07-08 13:00:43 -07:00
martinl
0bf1462ad0 Update path for github workflow hardware unit tests (#25035)
* Update hardware path for github workflow unit tests

* Update release/files_common

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-07-05 10:33:20 -07:00
Shane Smiskol
7178800d84 Multilang prerequisites (#24999)
* some supporting code for multilang

* for now just english

* test for missing language files

* test for checking if ts file is up to date

* Skip test if causes exception, other test catches this

Test test

Should also work

should now fail

revert

rmn

* add to files_common

* fix files_common

* newlines

* no need to not update

* comment

* only english

* double quotes

* switch around
2022-06-30 11:02:53 +02:00
Shane Smiskol
879a7c3201 UI: wrap all text for translation (#24961)
* rough multiple language demo

* more wrappings

* stash

* add some bad translations

* updates

* map from french to spanish still has same problem of needing to call setText on everything

* add files

* restart UI

* use return code

* relative path

* more translations

* don't loop restart

* Toggle and prime translations

* try on device

* try QComboBox with readable style

* stash

* not yet scrollable

* stash

* dynamic translations (doesn't work for dynamic widget strings yet)

* clean up multiple option selector

* store languages in json

* try transparent

* Try transparent popup

* see how this looks

* tweaks

* clean up

* clean up

* clean up 2 and missing tr

* wrap more strings

* missing updater

* fixes

* add basic test to ensure all strings wrapped

* try in CI

* clean up

* test name

* fix test

* always install qt dev tools

* fix deps

* fast test

* add section so it prints multiple errors

* debug

* debug

get rid of those

* make any difference?

* comment

* oh...

* run with offscreen platform

* try out section

* clean up

* fix missing wrappings (it works!)

* move down

* space

* clear relevant params, set TICI=1
2022-06-29 14:47:46 -07:00
Dean Lee
fd5b3d7603 move replay from selfdrive/ui/replay to tools/replay (#24971)
* mv to tools/replay

* change folder

* add .gitignore

* fix build doc

* disable warning

* enable warning after build

* build qt/util.cc qt/api.cc to library

* cleanup
2022-06-28 16:12:42 +02:00
Willem Melching
b95e687782 split locationd and liblocationd tests (#24977)
* laikad: use cython version of gnss kf

* fix import error

* test liblocationd separate

* Revert "laikad: use cython version of gnss kf"

This reverts commit bdd769b9554e7e45e976dabd6595403943e864bb.
2022-06-27 21:31:54 +02:00
Adeeb Shihadeh
6123ab3d1c Move camerad to system/ (#24836)
* mv camerad

* add hardware symlink

* fix unit tests
2022-06-19 14:43:49 -07:00
Adeeb Shihadeh
fbd98b0e54 CI: add build job for latest Ubuntu (#24637)
* CI: add build job for latest Ubuntu

* source

* source env

* scons cache

* cache pyenv

* fix key

* source
2022-06-11 22:51:09 -07:00
Adeeb Shihadeh
a029245a78 CI: fix docker push for base image 2022-06-11 12:21:12 -07:00
HaraldSchafer
a2c6b30c98 Fix onnx model replay (#24702)
* No more C2

* Add test

* Various fixups

* Use ONNXCPU

* rm prints

* LFS pull

* Use sim docker

* Try sim docker again

* Print counter

* Make sure it can fail

* Fails correctly

* comments

* Add more install to opencl base docker

* vim not needed in base
2022-06-03 10:43:09 -07:00
HaraldSchafer
dc4d4f875b CL in docker (#24718)
* Move CL to base docker

* Different docker for cl

* add cl base docker

* add to tool

* cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-06-02 18:26:12 -07:00
Adeeb Shihadeh
afd16b2ade Create system/ for generic services (#24717)
* Create system/ for generic services

* logcatd joins the party

* fix those up
2022-06-02 17:02:25 -07:00
Lukas Petersson
28dd1a9124 CI: run process replay in parallel (#24646)
* CI in parallel

* cache key
2022-05-24 12:47:29 -07:00
Adeeb Shihadeh
cb8885cffb Merge common/ and selfdrive/common (#24556)
* Merge common/ and selfdrive/common

* fix that

* fix version

* fix unit tests
2022-05-18 14:11:57 -07:00
Adeeb Shihadeh
b2569d871f CI tuneup (#24541)
* little housekeeping

* all the commits

* one more cars
2022-05-15 17:57:34 -07:00
Shane Smiskol
f918ab7967 process replay CI: print diff after test (#24513)
* make sure we print the diff before updating refs

* cause fail

* when only uploading no need to print success status or update diff

don't print succeed/fail when only uploading

* Revert "cause fail"

This reverts commit 6e5db1a0ac6ccd0e6a0885d72d79d75c610bdc1f.

* Revert "when only uploading no need to print success status or update diff"

This reverts commit d6727f30a109fd7330746005aa7b228c9eca3e79.
2022-05-12 14:55:43 -07:00
Shane Smiskol
d2d3b7b823 process replay: automatically push refs on fail (#24414)
* test failure()

* let's just change a tune here

* debug

revert

* debug

* use current commit, not ref_commit

fix

* need to figure out better place for this

* quick test

* test without upload

* temp

* use azure token

* fixes

* shouldn't need this

* debug

* debug

* not getting anything?

* does this mean nothing gets envvars?

* add azure token to docker environment variables

* quote

* move back

* clean up a bit

* more clean up

* like this sorting better

* replace flags with CI and clean up

* test FULL_TEST and minimalize diff a bit

* now test all

* revert tests comments

* remove flags

* revert this

revert this

* now make it fail

* now update ref_commit to last commit (make sure we can re-start this test if we commit before last one finishes uploading)

* fix

fix

fix

fix

* bad commit

* why is it not throwing an exception?

* debug

* URLFile returns empty bytes if using cache and remote file doesn't exist

* we always need to download anyway

* debug...

* duh, wrong file. but neither should have it

* add that back and just check explicitly

* check both

* clean up and make a diff

* stylize

* see if this is a better diff on files changed

* update refs

* revert changes

* only for owners or members

* if we have token access

* if we have token access

* if we have token access

* move up

* clean up

* revert

* move update refs to test_processes

* clean up

* update messages

* update msg

* update README and delete update_refs

* this isn't possible to reach anymore

* fix readme

* better help message

better help message

better help message

* only show basename when uploading, only if failed to find

* test diff

* fix printing old ref commit

* change to using

* update refs

* Revert "update refs"

This reverts commit 2e352a736a6de68e2c7064daa4e2e9409ce77686.

* revert

* ref refers to reference commit/logs, cur refers to current logs/commit (future ref)

* like for better

* Apply suggestions from code review

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/test_processes.py

* every time lol

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-05-11 15:03:05 -07:00
Adeeb Shihadeh
462a1079a2 CI: add job for complete build (#24283)
* CI: add job for complete build

* add --test
2022-04-21 11:34:49 -07:00
Adeeb Shihadeh
27b067446a modeld tests (#24263) 2022-04-19 15:50:04 -07:00
Adeeb Shihadeh
a55e25d9d2 test models: skip with flag 2022-03-23 16:42:04 -07:00