Commit Graph

457 Commits

Author SHA1 Message Date
YassineYousfi
4c2bd853e4 (New) Lemon Pie Model 🍋 (#30209)
* 6f6e3749-1b7c-42e8-a33b-03929b7fc476/700

* oops deleted too much

* 1b4308b7-a659-4ebd-b4c6-c81c1c3890f8/700

* 1be192f3-f407-4217-9757-78b9ad92750a/700

* remove some todos

* more cleanup in lat planner

* vego > min_speed

* regen and update process replay refs

* update model replay ref

* update model replay ref commit again

* Revert "update model replay ref commit again"

This reverts commit 922cb796b8dfe264b0cce7a18206bb898b18bcb3.

* update again

* bump cereal
2023-11-02 14:01:00 -07:00
mitchellgoffpc
eecdaf9950 Added sentry hooks for modeld 2023-10-25 21:37:54 -07:00
YassineYousfi
1802de3f01 modeld: fix prev brake probs shapes (#30309) 2023-10-23 15:22:32 -07:00
YassineYousfi
b7cc6983c3 modeld: send_raw_pred under a flag (#30298)
* modeld: SEND_RAW_PRED under a flag

* not twice
2023-10-20 13:53:22 -07:00
YassineYousfi
cad17b1255 modeld: parsing and publishing in python (#30273)
* WIP try modeld all in python

* fix plan

* add lane lines stds

* fix lane lines prob

* add lead prob

* add meta

* simplify plan parsing

* add hard brake pred

* add confidence

* fix desire state and desire pred

* check this file for now

* rm prints

* rm debug

* add todos

* add plan_t_idxs

* same as cpp

* removed cython

* add wfd width - rm cpp code

* add new files rm old files

* get metadata at compile time

* forgot this file

* now uses more CPU

* not used

* update readme

* lint

* copy this too

* simplify disengage probs

* update model replay ref commit

* update again

* confidence: remove if statemens

* use publish_state.enqueue

* Revert "use publish_state.enqueue"

This reverts commit d8807c8348338a1f773a8de00fd796abb8181404.

* confidence: better shape defs

* use ModelConstants class

* fix confidence

* Parser

* slightly more power too

* no inline ifs :(

* confidence: just use if statements
2023-10-19 14:23:51 -07:00
George Hotz
50d720fc2e Bump tinygrad to master (0.7) (#30254)
* bump tinygrad to master

* ops_cpu is required now

* and that one too

* tinygrad is getting out of hand with all the files

* bump tinygrad

* update ref commit

* tinygrad master

* Revert "update ref commit"

This reverts commit e7284152899d6dd8a986d9570e6021addfbc6b0f.

* bump tinygrad repo

* bump master

* update ref commit
2023-10-17 10:05:28 -07:00
Kacper Rączy
5cb9291de8 modeld: don't attempt to connect extra vipc client if its not available (#30154)
Do not connect extra client if it's not available
2023-10-03 15:54:21 -07:00
Harald Schäfer
3c0a7d6986 Night Strike Model (#30148)
* baab2a46-f0c3-46eb-8756-00c55354945b/700

* Update model replay ref
2023-10-03 14:25:30 -07:00
YassineYousfi
04e239f7ed onnxmodel: fp16_to_fp32 (#30080)
* onnxmodel: force fp32

* rename

* rename this too
2023-09-27 22:37:03 -07:00
Adeeb Shihadeh
362c0bf2ca Revert "modeld: remove extra cloudlog.bind, manager does this"
This reverts commit 754af893e9.
2023-09-21 20:13:13 -07:00
Adeeb Shihadeh
754af893e9 modeld: remove extra cloudlog.bind, manager does this 2023-09-21 20:06:46 -07:00
Harald Schäfer
3799fe46b3 Optimus Prime Model 🤖 (#29752)
* b449f295-7e40-4f97-96a6-d858815955e5/700

* make it compile b449f295-7e40-4f97-96a6-d858815955e5/700

* simpler - b449f295-7e40-4f97-96a6-d858815955e5/700

* feature_len changed

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700

* Revert "0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700"

This reverts commit 41708b88447cfcf302b16f21f0caa69450bbd3df.

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700 again

* Update ref

* update ref

---------

Co-authored-by: Yassine <yassine.y10@gmail.com>
2023-09-21 13:51:12 -07:00
Harald Schäfer
ef50b4fdac Test modeld: 3s enough for modeld startup (#29936)
* Test modeld: 3s enough for modeld startup

* Always fails when you send frames before modeld is ready

* Wait for modeld to read
2023-09-15 14:59:46 -07:00
Mitchell Goff
9cc00c2101 Converted onnx runner to python (#29856) 2023-09-08 16:45:38 -07:00
Mitchell Goff
2d69f3d63e Update model input names to match onnx inputs (#29855)
Updated model input names to match onnx inputs
2023-09-08 16:06:16 -07:00
Mitchell Goff
503fa121ee Rewrite dmonitoringmodeld in python (#29740)
* Added dmonitoringmodeld.py

* Removed dmonitoringmodeld.cc

* Use ModelRunner helpers from runners/__init__.py

* Fixed DriverStateResult field ordering

* Some bug fixes

* Set calib input

* Look ma, no loop!

* Bump dmonitoringmodeld cpu usage in test_onroad

* Fixed memory leak caused by np.ctypes.data_as

* Formatting fixes

* chmod +x

* remove USE_ONNX_MODEL

* Realtime priority 1, formatting fixes
2023-09-07 19:46:43 -07:00
Mitchell Goff
0c0af682a1 Rewrite navmodeld in python (#29579)
* Added navmodeld.py

* Deleted navmodeld.cc

* Write SConscript config flags to config.py

* Remove deleted files from release/files_common

* Some more bug fixes

* Added config.py to gitignore

* Get rid of config.py

* Use set_realtime_priority

* A tiny bit more cleanup

* set realtime priority 1

* Use ModelRunner helper class from runners/__init__.py

* Formatting fixes

* mama mia that's a SPICY memory leak
2023-09-07 14:39:37 -07:00
mitchellgoffpc
05993f50df Added cython bindings for commonmodel sigmoid 2023-08-31 19:40:53 -07:00
Mitchell Goff
d5a55136a1 Added ModelRunner helpers in modeld/runners/__init__.py (#29737)
* Added ModelRunner helper class

* import Runtime in __init__.py
2023-08-31 14:19:20 -07:00
mitchellgoffpc
f91e955a86 Move Runtime into runmodel_pyx 2023-08-31 13:51:50 -07:00
mitchellgoffpc
857f747467 Remove unnecessary hardware check in modeld 2023-08-31 13:51:49 -07:00
mitchellgoffpc
18526c58b6 Set ADSP_LIBRARY_PATH in snpemodel_pyx 2023-08-31 13:11:39 -07:00
mitchellgoffpc
aebff37593 Set RPATH for snpemodel 2023-08-31 11:33:42 -07:00
Mitchell Goff
88a36f4464 Cleaned up modeld SConscript (#29646) 2023-08-30 15:29:33 -07:00
Mitchell Goff
151ac4bf76 Combine update_calibration/get_warp_matrix (#29719) 2023-08-30 15:16:29 -07:00
Mitchell Goff
1eb60516cb Move update_calibration to modeld.py (#29688)
* Move update_calibration to modeld.py

* Updated ref commit
2023-08-30 14:12:52 -07:00
mitchellgoffpc
12d1020239 -DUSE_THNEED is dead 2023-08-30 12:58:31 -07:00
Mitchell Goff
d998fd88a8 Added USE_THNEED environment variable and removed build flag (#29645) 2023-08-29 14:07:57 -07:00
mitchellgoffpc
807410e0ac Remove no-thneed build flag 2023-08-25 19:09:25 -07:00
mitchellgoffpc
e0287fa93e Remove USE_THNEED check from run.h 2023-08-25 19:05:49 -07:00
Kacper Rączy
a4a0429fca modeld: fix bash scripts (#29643)
Fix shebang. Fix LD_PRELOAD
2023-08-25 18:56:06 -07:00
mitchellgoffpc
ef8e0fef55 Remove thneed logic from snpemodel 2023-08-25 14:37:08 -07:00
Mitchell Goff
72a3c987c0 Rewrite modeld in python (#29230)
* Added modeld.py (WIP)

* No more VisionIpcBufExtra

* Started work on cython bindings for runmodel

* Got ONNXModel cython bindings mostly working, added ModelFrame bindings

* Got modeld main loop running without model eval

* Move everything into ModelState

* Doesn't crash!

* Moved ModelState into modeld.py

* Added driving_pyx

* Added cython bindings for message generation

* Moved CLContext definition to visionipc.pxd

* *facepalm*

* Move cl_pyx into commonmodel_pyx

* Split out ONNXModel into a subclass of RunModel

* Added snpemodel/thneedmodel bindings

* Removed modeld.cc

* Fixed scons for macOS

* Fixed sconscript

* Added flag for thneedmodel

* paths are now relative to openpilot root dir

* Set cl kernel paths in SConscript

* Set LD_PRELOAD=libthneed.so to fix ioctl interception

* Run from root dir

* A few more fixes

* A few more minor fixes

* Use C update_calibration for now to exactly match refs

* Add nav_instructions input

* Link driving_pyx.pyx with transformations

* Checked python FirstOrderFilter against C++ FirstOrderFilter

* Set process name to fix test_onroad

* Revert changes to onnxmodel.cc

* Fixed bad onnx_runner.py path in onnxmodel.cc

* Import all constants from driving.h

* logging -> cloudlog

* pylint import-error suppressions no longer needed?

* Loop in SConscript

* Added parens

* Bump modeld cpu usage in test_onroad

* Get rid of use_nav

* use config_realtime_process

* error message from ioctl sniffer was messing up pyenv

* cast distance_idx to int

* Removed cloudlog.infos in model.run

* Fixed rebase conflicts

* Clean up driving.pxd/pyx

* Fixed linter error
2023-08-25 14:36:26 -07:00
Mitchell Goff
e2e39d100b Added cython bindings for model runners and commonmodel (#29607)
* Added cython bindings for model runners and commonmodel

* Removed cython language_level=3

* loop to set CXXFLAGS for both envs
2023-08-24 17:00:26 -07:00
Justin Newberry
1ee6ed4b16 Linter: remove pylint (#29611)
remove pylint
2023-08-24 16:30:54 -07:00
mitchellgoffpc
7dae580441 Moved thneed src to top of modeld sconscript 2023-08-24 15:12:01 -07:00
mitchellgoffpc
fc8c97e7a9 Some cleanup in modeld sconscript 2023-08-24 14:41:04 -07:00
mitchellgoffpc
a184d40b7a Disable error message in thneed ioctl interceptor to fix pyenv issues 2023-08-24 14:41:04 -07:00
Dean Lee
7bfd3dac81 cpplint: add filter whitespace/comma (#29595) 2023-08-24 10:42:06 -07:00
Dean Lee
9c7bf50703 cpplint: add filter whitespace/tab (#29588) 2023-08-24 08:06:58 -07:00
Dean Lee
21da5a216f cpplint: add filter build/include_subdir (#29585) 2023-08-24 15:42:17 +01:00
Dean Lee
f203648de0 cpplint: add filter whitespace/semicolon (#29568) 2023-08-23 15:00:30 -07:00
Dean Lee
5480d32bb5 cpplint: add filter whitespace/parens (#29565) 2023-08-23 14:25:05 -07:00
Dean Lee
2d99521e75 cpplint: build/include_what_you_use (#29556)
* include_what_you_use

* remove comments

* include <memory>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-08-23 13:25:17 -07:00
mitchellgoffpc
7699444816 Set paths for cl kernels and onnx_runner.py in modeld SConscript 2023-08-21 19:38:40 -07:00
mitchellgoffpc
24090d2121 Move USE_RUNTIME flags into runmodel.h 2023-08-21 19:26:48 -07:00
mitchellgoffpc
8c478708ee exit if onnxmodel exec fails 2023-08-21 19:23:23 -07:00
Adeeb Shihadeh
a9626f95b6 add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
2023-08-20 20:49:55 -07:00
Justin Newberry
e4ead4f183 Ruff: b905 (strict zip) (#29336)
* added mutable default args

* most of the Bs

* add comment about lrucache

* b905
2023-08-11 16:13:51 -07:00
Justin Newberry
62c1e65924 Ruff: enable most of bugbear (#29320)
* added mutable default args

* most of the Bs

* add comment about lrucache
2023-08-11 15:33:49 -07:00