Commit Graph

1300 Commits

Author SHA1 Message Date
Kacper Rączy
1774b4fc61 Revert "radard: tie radard frequency to modelV2 (#29063)" (#29243)
This reverts commit 255f5c13f2.
2023-08-04 20:25:40 -07:00
Kacper Rączy
255f5c13f2 radard: tie radard frequency to modelV2 (#29063) 2023-08-03 22:10:21 -07:00
Kacper Rączy
547a033a3c process_replay: capture process output (#29027)
* Add ProcessOutputProxy

* Move launcher to its own field

* Move ProcessOutputCapture to its own file

* Return itself from __enter__ of OpenpilotPrefix

* Integrate ProcessOutputCapture into process_replay

* Add note about capture_output_store to README

* ipykernel import is optional

* Disable type checking for link_with_current_proc

* Remove assertion

* Decode outputs to utf-8

* read(self): return empty buf if its none

* Fix type annotations

* Replace fifo with regular file, to avoid hitting fifo size limit
2023-07-31 16:30:58 -07:00
Adeeb Shihadeh
3476205569 increase min duration of steer saturated alert (#29191)
* increase min duration of steer saturated alert

* update refs
2023-07-31 12:48:11 -07:00
Shane Smiskol
12ed894362 dmonitoringmodeld: initialize model first (#29080)
* hacky fix

* even better

* ordering

* clean up

* fix model replay

* add comment

* catch sigint
2023-07-23 09:28:22 -07:00
Kacper Rączy
4793772c47 test_fuzzy: fix keyword argument (#29083)
Fix fuzzy test
2023-07-21 14:58:14 -07:00
Adeeb Shihadeh
1945c356c2 agnos 8 (#28843)
* agnos 8

* update to python 3.11.4 (#27452)

* rebase

* optional

* lower cython

* TEMP don't pull cl to use python3.11

* Revert "lower cython"

This reverts commit c5132f8a2727c212bdfc01e77aa53e50a17ead9d.

* fix cython

* remove tensorrt

* carla + opencv

* macos

* update timm and smp

* pynvc

* https

* downgrade numpy

* pin scipy

---------

Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
Co-authored-by: Yassine <yassine.y10@gmail.com>

* revert that

* fix linter

---------

Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
Co-authored-by: Yassine <yassine.y10@gmail.com>
2023-07-20 21:56:57 -07:00
Adeeb Shihadeh
716d0d5918 process replay: remove sorting before comparison (#29072)
* process replay: remove sorting before comparison

* keep ignore msgs
2023-07-20 19:22:59 -07:00
Kacper Rączy
81e8cf414e process_replay: ability to permanently unlock some sockets (#29070)
Add unlocked_pubs for keeping some sockets permanently unlocked
2023-07-20 16:03:58 -07:00
Harald Schäfer
ca699e3989 radard: no clustering (#29010)
* First commit

* cleanup

* Update ref

* Doesnt deserve two files

* cleanup radard
2023-07-19 20:31:40 -07:00
Kacper Rączy
f74f1def29 process_replay: API docs (#29041)
* Update process_replay README

* Expose get_custom_params_from_lr in top-level module
2023-07-19 17:50:26 -07:00
Kacper Rączy
1235110983 regen: blacklist-procs option (#29024)
* Add blacklist-procs option to regen

* Keep the original process order
2023-07-18 17:13:23 -07:00
Kacper Rączy
b2d0f74ec3 process_replay: support for replaying multiple processes simultaneously (#28829)
* first working ProcessContainer and _replay_multi_process implementation

* Setup controlsd config_callback

* Add vision ipc support

* Remove old code

* add todo

* Update estimated processing times

* Use deepcopy when getting configs

* Rework the API to support passing multiple names or configs

* Add get_custom_params_from_lr

* Add more typing

* Enable simulation for controlsd

* Fix typing issues

* Regen refactor

* Fix linter issues

* Make wideRoadCameraState optional

* Move DummySocket to helpers

* Improve typing in regen

* Minor improvements

* Maintain sort order of internal_pub_queue using heapq

* Move ProcessContainer elsewhere

* Fix internal heap

* Change comment

* Remove subtest_name from ProcessConfig

* Update cereal

* Add newline
2023-07-18 14:56:24 -07:00
Harald Schäfer
7613f6918b Laikad cpu usage: enable test onroad (#28926)
* enable test onroad

* Better

* specify range

* fix printing

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-07-15 23:06:42 -07:00
Shane Smiskol
f495c21805 FuzzyGenerator: typing (#28934)
* bump

* should be bytes

* draft fuzzy car params

* stash

* bump

* bump

* this is explored!

* some clean up

* more clean up

* clean up

* do we need draw??

* draft

* this was confusing

* revert

* draft

* Revert "draft"

This reverts commit c593a03474b04d4df2648d8149798196c991a108.

* draft

* more typing!

* complete typing

* fix that

* cleanup

* better
2023-07-14 21:41:30 -07:00
Shane Smiskol
c541074669 test_onroad: lower ui CPU usage (#28927)
lower from multiple runs
2023-07-13 23:47:12 -07:00
Shane Smiskol
77339af1c0 FuzzyGenerator: return bytes for data (#28932)
generate bytes
2023-07-13 23:43:08 -07:00
Kacper Rączy
72579a0e10 controlsd: support for SIMULATION mode for process replay (#28895)
* Support for simulation flag while replay

* Update cereal

* Enable simulation for controlsd

* Update ref commit

* Update cereal
2023-07-12 10:32:02 -07:00
Harald Schäfer
47ee0932db Qcom rawgps: Timestamp svpolys (#28738)
* Timestamp svpolys

* leap seconds handled fine

* Fix error

* bump laika

* Update test route

* update ref
2023-07-11 13:22:09 -07:00
Adeeb Shihadeh
69e7f386a7 revert accidental enable 2023-07-10 17:22:09 -07:00
Adeeb Shihadeh
24de4a6204 Update test_onroad.py 2023-07-10 16:40:09 -07:00
Mitchell Goff
e346839c68 nav model: fix flicker in nav enabled state (#28815)
* Fix flicker in nav enabled state

* Move all relevant information for validity checks into navModel packet

* Ignore locationMonoTime in replay tests

* Check route valid in navmodeld

* sm update

* check that

* update refs

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-07-09 15:10:02 -07:00
Adeeb Shihadeh
740380bf05 test onroad: stricter ui timings check (#28853) 2023-07-08 22:26:53 -07:00
Mitchell Goff
531c13f2ac Moonrise Model (#28761)
* New model: 889463fc-5e5d-497d-9111-c8567a13cabf

* Updated model replay ref
2023-06-30 18:52:20 -07:00
Maxime Desroches
0ebec253d0 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit 7783dc602c.

* determinism

* fingerprint
2023-06-29 21:49:23 -07:00
Adeeb Shihadeh
336b5f7324 reduce startup alert duration (#28749)
* reduce startup alert duration

* update refs
2023-06-29 17:57:25 -07:00
Harald Schäfer
5c6efd2aab Laikad: more sensible ephemeris management (#28721)
* Laikad: more sensible ephemeris management

* Tow

* fix test

* Also publish qcom

* Update

* Update laikad.py
2023-06-28 21:08:18 -07:00
Jason Young
0c223b4814 VW PQ: Extended standstill for FtS with EPB (#28248)
* VW PQ: Extended standstill for FtS with EPB

* update refs

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-06-24 21:28:10 -07:00
Vivek Aithal
c9f02ae905 [SUBARU OUTBACK 6TH GEN] Modify offline torque parameters (#28663)
* add new valkues for subaru, to try

* update refs

* update refs
2023-06-23 17:06:57 -07:00
ZwX1616
ce2dffe566 Modeld: send confidence class (#28625)
* 0.7

* magic

* faster magic

* more simple

* up

* empty

* more mid bits

* naive

* flatten

* dz

* that can stay

* this is fine

* what the

* what the

* giRevert "what the"

This reverts commit 1619ba68e6098dc581fe9b82e7ecb74562b619cc.

* Revert "what the"

This reverts commit 0037dd368290497a6d0009ca34adb2184b584d2e.

* 1x fine

* that was fine

* combined

* independent cum

* 0 is fine

* use metrics

* up cereal

* process and publish from modeld

* cleanup

* use s.output

* bg

* a greener approach

* dns

* serial

* update ref commit

* rebase

* ref

* cereal master

---------

Co-authored-by: Comma Device <device@comma.ai>
2023-06-23 16:49:14 -07:00
Adeeb Shihadeh
a50c191f8d bump cereal (#28650)
* bump cereal

* fix pigeond test

* bump cereal

* bump cereal

* bump cereal

* bump cereal

* update refs
2023-06-23 16:01:21 -07:00
Kacper Rączy
2c617e0c7a process_replay: modeld and dmonitoringmodeld support (#28463)
* vipc support. modeld and dmonitoringmodeld configs

* Update cereal

* Add vision meta

* Use vision meta in process replay

* Exclude modeld and dmonitoringmodeld from test_processes

* Refactor other pieces of code to use vision meta

* remove unnecessary imports

* Add MAX_FRAMES_PER_SEGMENT

* cameraState migration

* Move camera state migration to migration module

* model_replay refactor

* Fix lint issues

* Reduce number of vipc buffers to 2

* Update spinner message

* Update model replay ref

* Support the new log order

* Replace CameraFrameSizes with dict. Add encode_index field

* Migrate camera states based on encode indices

* Refactor process replay

* Refactor model replay

* Remove unnecessary print

* Update model replay ref

* Make camera state migration optional

* Remove unused import

* Add ignore_alive_pubs field

* Add assertion for carParams inside fingerprinting callback

* Remove WideCameraOnly param setup

* Refactor ModeldCameraSyncRcvCallback

* Update model replay ref commit

* Fix camera state migration

* Only migrate camera states when process has vision pubs

* Refactor model replay again

* Fix linter issues

* One more linter fix

* Update model replay ref commit
2023-06-22 17:36:25 -07:00
Adeeb Shihadeh
7783dc602c Revert "simple fuzzing test for all processes (#28584)"
This reverts commit bac193bdd5.
2023-06-22 14:59:50 -07:00
Adeeb Shihadeh
16e3d4f69f jenkins: new replay devices (#28643)
* replay

* restart nm
2023-06-22 14:21:11 -07:00
Kacper Rączy
3cae32a85f process_replay: custom params (#28624)
* Add custom params argument

* Fix default arguments

* Fix typing issues
2023-06-21 20:16:14 -07:00
Maxime Desroches
bac193bdd5 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
2023-06-20 10:57:02 -07:00
Mitchell Goff
aadd9ae269 Enable nav features in modeld (#28448)
* Enable nav features in modeld

* Enable mapsd/navmodeld

* Updated model_replay_ref_commit and added mapsd/navmodeld to test_onroad

* fixed process name

* always publish from mapsd
2023-06-16 21:27:35 -07:00
Mitchell Goff
a9cb255017 New map model: 917a2539-5e7a-4374-878a-9b356f0f1922/500 (#28579) 2023-06-16 19:31:57 -07:00
Yassine
fc61209f74 update model replay ref commit 2023-06-16 15:04:06 -07:00
Maxime Desroches
3fc104fb6d test: car interface fuzzy testing + generating capnp structs (#28530)
* random car control

* format

* struct generation

* math

* staying real

* really staying real

* move

* split this

* format

* Revert "format"

This reverts commit a70a73952ee3833c4ae839d7b2729ee2a1e1a85b.

* Revert "split this"

This reverts commit ae96be63cbfbee230101e69a0f84c874f321fafa.

* space
2023-06-15 17:01:13 -07:00
Harald Schäfer
155cab9ec4 Disable internet in laikad.py, even in CI (#28535)
* Limit OPENBLAS to 1 thread in manager

* Restrict openblas threads when running openpilot

* print in CI

* Disable internet for laika, even in CI

* update ref
2023-06-13 23:39:11 -07:00
Kacper Rączy
15fcd0d9d4 regen: remove support for fake extra vision client (#28520)
* Remove extra client from camera replay

* Fix another device type check
2023-06-13 16:13:20 -07:00
Shane Smiskol
bce19bf187 Subaru: use latActive for steer request bit (#28453)
* subaru: use latactive

* Update ref_commit
2023-06-12 23:03:04 -07:00
Dean Lee
4ae0378f63 automatically detect available camera streams (#27640)
* remove WideCameraOnly

* check in set_initial_state

* no block

* remove try block

* apply reviews
2023-06-12 13:40:43 -07:00
Adeeb Shihadeh
2f117e88b7 test onroad: explicit memory leak check (#28502) 2023-06-11 14:43:25 -07:00
Kacper Rączy
838346d8a3 process_replay: deprecated message migration (#28456)
* Move migration code to new file

* Migrate messages in process replay. Remove old code

* Fix old_logtime

* Keep old logtimes on migrated messages

* Update ref commit
2023-06-09 19:17:50 -07:00
Kacper Rączy
a2e75fdea6 process_replay: progress bar support (#28447)
* Add support for tqdm progress bar

* Fix argument name
2023-06-07 16:23:40 -07:00
Kacper Rączy
d932aae327 process_replay: improved support for drained pubs (#28452)
Stop triggering empty update if there're no drained messages in the queue
2023-06-07 16:23:02 -07:00
Kacper Rączy
02841cede3 process_replay: remove get_car_params_callback when it's not needed (#28451)
* Add assertion for can msgs in get_car_params_callback

* Remove get_car_params_callback from processes that don't need it
2023-06-07 16:22:48 -07:00
Kacper Rączy
64377a88f9 process_replay: helpers (#28367)
* process_replay helper

* Refactor

* refactor check_enabled uses

* fix __init__

* noqa in __init__ imports

* Move compare_logs outside of process_replay

* Move save_logs to tools.lib.helpers

* Remove save_log from compare_logs

* fix lint issues
2023-06-06 10:31:13 -07:00