Commit Graph

1420 Commits

Author SHA1 Message Date
Adeeb Shihadeh
99d51bf02c Revert "Simplify passive mode handling (#30593)" 2023-12-04 15:05:05 -08:00
Adeeb Shihadeh
5ccff25d88 Simplify passive mode handling (#30593)
* simplify passive handling

* makes more sense
2023-12-03 13:59:59 -08:00
Adeeb Shihadeh
a1d36961cf new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
2023-12-03 10:50:17 -08:00
Adeeb Shihadeh
a2b48efa20 process replay: check valid flag (#30588) 2023-12-02 10:47:08 -08:00
Adeeb Shihadeh
8971e2c177 longitudinal tests: cleanup old hacks (#30585) 2023-12-02 10:01:28 -08:00
Adeeb Shihadeh
c028688a65 bump cereal (#30582)
* bump cereal

* fix dmonitoringd

* update refs

* update refs
2023-12-02 01:16:07 -08:00
Adeeb Shihadeh
b97e5b0e03 rename carEvents -> onroadEvents (#30577)
* rename carEvents -> onroadEvents

* bump cereal

* bump cereal
2023-12-01 22:48:29 -08:00
Justin Newberry
4086795c29 Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
2023-11-30 09:55:48 -08:00
Justin Newberry
8d3bf1f41a Pytest: add cpp harness (#30471)
cpp harness
2023-11-22 13:45:49 -08:00
Adeeb Shihadeh
4cae08e636 rename rawgpsd to qcomgpsd (#30493)
* rename rawgpsd to qcomgpsd

* fix more paths

* that moved

* forgot the d
2023-11-18 23:23:16 -08:00
Shane Smiskol
c2af245b85 CI: use azure-storage-blob for uploading (#30478)
* use azure-storage-blob

* fix pattern

* nsp
2023-11-15 21:22:14 -08:00
Shane Smiskol
0addee2b4b openpilot CI: fix azure bucket names (#30477)
fix azure bucket names
2023-11-15 21:15:10 -08:00
Justin Newberry
291c04163a CI: disable registry caching (#30474)
* Revert "CI: separate image for docker cache (#30413)"

This reverts commit 361ffb5e54.

* Revert "CI: enable buildx for registry cache (#30473)"

This reverts commit edf90f3e76.
2023-11-15 18:21:57 -08:00
Justin Newberry
361ffb5e54 CI: separate image for docker cache (#30413)
just registry cache
2023-11-15 17:48:43 -08:00
Justin Newberry
31c682d407 Pytest: load by group by default (#30466)
* wip

* use a class marker

* this one should be grouped too
2023-11-14 17:33:47 -08:00
Justin Newberry
90c873ab1d Process Replay: move to pytest (#30260)
* process replay pytest

* enable long diff

* readd job name

* make it executable

* cleanup imports

* retrigger
2023-11-13 13:50:23 -08:00
Justin Newberry
2ad82cbfb0 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
2023-11-13 10:45:24 -08:00
Vivek Aithal
2eb487c9a5 params: Remove separate CarParams from each daemon (#30405)
* remove separate previous route carparams from each daemon and add centrally to controlsd

* extract out sigint handler

* make process replay work for torqued

* don't write param if None
2023-11-08 15:25:41 -08:00
Justin Newberry
aec7cea30d Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh
d2edc239fd jenkins: disable ciui for now 2023-11-07 11:27:56 -08:00
Harald Schäfer
9118973ed0 Farmville model (#30392)
* slightly different

* Revert "slightly different"

This reverts commit 8a470ecab40c295f3b8c777b82cb7a22890d116e.

* d09c9c88-1797-4ed5-ab2d-9dca5b12340b/700

* Update power draw

* Revert "Update power draw"

This reverts commit 1c95b663ec9c507604dd8580ff6386497b5391a8.

* Update ref
2023-11-07 11:17:37 -08:00
Harald Schäfer
c9fae805bc Tinygrad: use compile2 (#30400)
* Tinygrad: use compile2

* unused

* compile2 file

* slightly different

* Revert "slightly different"

This reverts commit 8a470ecab40c295f3b8c777b82cb7a22890d116e.

* slightly different ref

* add release file

* rm default args
2023-11-07 09:54:48 -08:00
Justin Newberry
bdf2fa0f83 Mapsd: move on the CPU (#30349)
* mapsd -> cpu

* link directly to mesa

* Fix gitignore

* without launcher script

* dont change that

* dont need that

* add to files_common

* rename to configure cpu rendering

* without a symlink!

* update time refs

* update ref

* update ref

* remove duplicate include

* bump up again

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-06 09:04:53 -08:00
Justin Newberry
c52f2ec19b model_replay: allow skipping modeld/dmodeld (#30365)
* skip model

* sa

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-02 18:10:11 -07:00
YassineYousfi
4c2bd853e4 (New) Lemon Pie Model 🍋 (#30209)
* 6f6e3749-1b7c-42e8-a33b-03929b7fc476/700

* oops deleted too much

* 1b4308b7-a659-4ebd-b4c6-c81c1c3890f8/700

* 1be192f3-f407-4217-9757-78b9ad92750a/700

* remove some todos

* more cleanup in lat planner

* vego > min_speed

* regen and update process replay refs

* update model replay ref

* update model replay ref commit again

* Revert "update model replay ref commit again"

This reverts commit 922cb796b8dfe264b0cce7a18206bb898b18bcb3.

* update again

* bump cereal
2023-11-02 14:01:00 -07:00
Justin Newberry
ddbdaf3cf9 test_onroad: assert the procs that use the GPU (#30359)
* test gpu

* keep it localiized

* has to be later

* reduce diff

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-11-01 17:31:54 -07:00
Kacper Rączy
e5eea7276f regen: update refs with dummy dcamera (#30347)
Update refs
2023-10-30 15:33:17 -07:00
Kacper Rączy
7a5d85232f regen: dummy dcamera support (#30323)
* DummyFrameReader

* dummy_dcam_if_missing flag

* Blank dcamera for all neo segments, as dmonitoringd does not support neo camera feeds

* Remove trailing whitespace

* zero_dcamera staticmethod

* enable dmonitoring in test_regen

* Simplify. User decides wether to use dummy or not

* Moving some stuff

* rename to dummy_driver_cam
2023-10-30 15:17:32 -07:00
Adeeb Shihadeh
91380f085b fix up docker script 2023-10-29 07:05:13 -10:00
Kacper Rączy
4094d584f3 process_replay: use frame dimensions from FrameReader (#30332)
Use dimensions from FrameReader to setup vipc server
2023-10-25 15:46:16 -07:00
Kacper Rączy
21715d7f81 process_replay: migrate cameraStates of segments without driverEncodeIdx (#30331)
Migrate camera states of segments without driverEncodeIdx
2023-10-25 15:42:06 -07:00
Harald Schäfer
56dea7b0b4 Rm laikad (#30299)
* rm laika

* Rm laika

* Needed this

* More rm

* More rm
2023-10-23 00:15:39 -07:00
Adeeb Shihadeh
67f2321060 delete clocksd (#30252) 2023-10-22 14:47:38 -07:00
YassineYousfi
cad17b1255 modeld: parsing and publishing in python (#30273)
* WIP try modeld all in python

* fix plan

* add lane lines stds

* fix lane lines prob

* add lead prob

* add meta

* simplify plan parsing

* add hard brake pred

* add confidence

* fix desire state and desire pred

* check this file for now

* rm prints

* rm debug

* add todos

* add plan_t_idxs

* same as cpp

* removed cython

* add wfd width - rm cpp code

* add new files rm old files

* get metadata at compile time

* forgot this file

* now uses more CPU

* not used

* update readme

* lint

* copy this too

* simplify disengage probs

* update model replay ref commit

* update again

* confidence: remove if statemens

* use publish_state.enqueue

* Revert "use publish_state.enqueue"

This reverts commit d8807c8348338a1f773a8de00fd796abb8181404.

* confidence: better shape defs

* use ModelConstants class

* fix confidence

* Parser

* slightly more power too

* no inline ifs :(

* confidence: just use if statements
2023-10-19 14:23:51 -07:00
Adeeb Shihadeh
09c8866d17 Update test_onroad.py 2023-10-19 10:36:18 -07:00
Adeeb Shihadeh
13d780a5f2 test_onroad: log sizes check (#30265)
* test_onroad: check log sizes

* fix

* check logs

* rb

* len

* pytest

* mb

* corolla log is small

* adjust qlog
2023-10-18 19:44:46 -07:00
Justin Newberry
b86567d330 compare_logs: separate format_process_diff into a new function (#30284)
support separate
2023-10-18 15:12:43 -07:00
Yassine
52b5a33d35 Revert "update model replay ref commit"
This reverts commit 40817b6810.
2023-10-17 19:49:42 -07:00
Yassine
40817b6810 update model replay ref commit 2023-10-17 19:49:13 -07:00
Justin Newberry
1820b5f259 Proc Replay: cleanup iterable log typing (#30261)
* cleanup log typing

* use iterable

* fix those

* Cleanup

* cleanup

* missed that one
2023-10-17 12:58:28 -07:00
George Hotz
50d720fc2e Bump tinygrad to master (0.7) (#30254)
* bump tinygrad to master

* ops_cpu is required now

* and that one too

* tinygrad is getting out of hand with all the files

* bump tinygrad

* update ref commit

* tinygrad master

* Revert "update ref commit"

This reverts commit e7284152899d6dd8a986d9570e6021addfbc6b0f.

* bump tinygrad repo

* bump master

* update ref commit
2023-10-17 10:05:28 -07:00
Justin Newberry
def2b93895 compare_logs: better names for short/long diffs (#30263)
* better names

* dont need that

* those too
2023-10-16 17:04:14 -07:00
Justin Newberry
d23f5d2ec5 test_processes: assert that mazda is tested (#30258)
mazda left dashcam mode
2023-10-16 12:18:25 -07:00
Adeeb Shihadeh
f8a7def515 docs: move to gh pages (#30242)
* mv to pages

* cleanup

* push static

* mv that

* new name for the orphan

* only master

* build op
2023-10-14 23:03:57 -07:00
Adeeb Shihadeh
f0aa631818 cleanup up old lib64 references (#30246)
* cleanup sensord

* rm rest

* fix that

* update that
2023-10-14 20:39:15 -07:00
Shane Smiskol
3cd0e392eb Toyota: combine similar TSS2 hybrid platforms (#30194)
* combine corolla

* corolla tss2: remove duplicates

* remove gas pedal hybrid signal

* combine RX TSS2

* we only split for static DSU msgs, or sng differences

* Combine NX TSS2

* remove nb

* Combine ES TSS2

* Combine RAV4 TSS2 (torque params for each EPS variant are similar enough, and eps and fwdcamera all are identical)

* Merge TSS-P Lexus NX

* TSS-P Lexus NX: remove duplicates

* TSS-P C-HR: merge

* TSS-P C-HR: remove duplicates

* fix routes

* re-did everything: no diff 🎉

* update test models seg list

* Update ref_commit
2023-10-07 01:26:49 -07:00
Kacper Rączy
3aa74c28fc CI: add regen job (#30157)
* Ability to whitelist/blacklist cars in regen_all

* Add CI job for regen, running on 2 segments

* Run regen_all, not regen

* Use coverage run

* Add test_regen

* Use test_regen in ci test

* Add test case names

* ONNXCPU = 1

* Add mazda segment

* Use RUN_CL

* build cl image before running

* unset PYTHONWARNINGS

* Create regen cache

* Replace daemons with processes

* Skip ford

* Skip mazda

* Add comment about commented segments

* Update selfdrive/test/process_replay/test_regen.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Remove unset pythonwarnings

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-10-05 13:59:00 -07:00
Shane Smiskol
a1ca5dc484 scripts: format diff when comparing logs (#30174)
* move format diff to compare_logs to pretty print

* smaller
2023-10-04 22:59:03 -07:00
Kacper Rączy
18f41d1910 regen: skip fetching camera files when not needed (#30169)
* Fetch only camera files which are needed in current setup

* Refactor daemons to processes
2023-10-04 15:00:50 -07:00
Kacper Rączy
898acb13f2 process_replay: migrate panda/peripheral/manager states (#30141)
* Migrate pandaStates

* Fix import

* Make pandaStates migration optional, so process_replay still works on logs without carParams

* peripheralState migration if its not available

* Do nothing if log file has peripheralStates

* Add migrate_managerState

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-10-04 13:41:50 -07:00