Commit Graph

464 Commits

Author SHA1 Message Date
YassineYousfi
dd54ec9aa8 blue diamond model 💎 (#30504)
* c53b1113-ca16-434f-a3e7-457a36ba98cc/700

* 672ee0a5-0466-420d-be18-0610c5d71b6d/700

* update model replay ref commit
2023-12-12 11:24:04 -08:00
Adeeb Shihadeh
35f819c823 swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
2023-12-06 17:27:51 -08:00
Adeeb Shihadeh
a1d36961cf new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
2023-12-03 10:50:17 -08:00
YassineYousfi
84d2fa68f7 modeld: handle division by zero (#30411)
* modeld: avoid division by zero

* undefined at 0
2023-11-08 10:06:30 -08:00
Justin Newberry
aec7cea30d Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
2023-11-07 17:35:44 -08:00
Harald Schäfer
9118973ed0 Farmville model (#30392)
* slightly different

* Revert "slightly different"

This reverts commit 8a470ecab40c295f3b8c777b82cb7a22890d116e.

* d09c9c88-1797-4ed5-ab2d-9dca5b12340b/700

* Update power draw

* Revert "Update power draw"

This reverts commit 1c95b663ec9c507604dd8580ff6386497b5391a8.

* Update ref
2023-11-07 11:17:37 -08:00
Harald Schäfer
c9fae805bc Tinygrad: use compile2 (#30400)
* Tinygrad: use compile2

* unused

* compile2 file

* slightly different

* Revert "slightly different"

This reverts commit 8a470ecab40c295f3b8c777b82cb7a22890d116e.

* slightly different ref

* add release file

* rm default args
2023-11-07 09:54:48 -08:00
YassineYousfi
4c2bd853e4 (New) Lemon Pie Model 🍋 (#30209)
* 6f6e3749-1b7c-42e8-a33b-03929b7fc476/700

* oops deleted too much

* 1b4308b7-a659-4ebd-b4c6-c81c1c3890f8/700

* 1be192f3-f407-4217-9757-78b9ad92750a/700

* remove some todos

* more cleanup in lat planner

* vego > min_speed

* regen and update process replay refs

* update model replay ref

* update model replay ref commit again

* Revert "update model replay ref commit again"

This reverts commit 922cb796b8dfe264b0cce7a18206bb898b18bcb3.

* update again

* bump cereal
2023-11-02 14:01:00 -07:00
mitchellgoffpc
eecdaf9950 Added sentry hooks for modeld 2023-10-25 21:37:54 -07:00
YassineYousfi
1802de3f01 modeld: fix prev brake probs shapes (#30309) 2023-10-23 15:22:32 -07:00
YassineYousfi
b7cc6983c3 modeld: send_raw_pred under a flag (#30298)
* modeld: SEND_RAW_PRED under a flag

* not twice
2023-10-20 13:53:22 -07:00
YassineYousfi
cad17b1255 modeld: parsing and publishing in python (#30273)
* WIP try modeld all in python

* fix plan

* add lane lines stds

* fix lane lines prob

* add lead prob

* add meta

* simplify plan parsing

* add hard brake pred

* add confidence

* fix desire state and desire pred

* check this file for now

* rm prints

* rm debug

* add todos

* add plan_t_idxs

* same as cpp

* removed cython

* add wfd width - rm cpp code

* add new files rm old files

* get metadata at compile time

* forgot this file

* now uses more CPU

* not used

* update readme

* lint

* copy this too

* simplify disengage probs

* update model replay ref commit

* update again

* confidence: remove if statemens

* use publish_state.enqueue

* Revert "use publish_state.enqueue"

This reverts commit d8807c8348338a1f773a8de00fd796abb8181404.

* confidence: better shape defs

* use ModelConstants class

* fix confidence

* Parser

* slightly more power too

* no inline ifs :(

* confidence: just use if statements
2023-10-19 14:23:51 -07:00
George Hotz
50d720fc2e Bump tinygrad to master (0.7) (#30254)
* bump tinygrad to master

* ops_cpu is required now

* and that one too

* tinygrad is getting out of hand with all the files

* bump tinygrad

* update ref commit

* tinygrad master

* Revert "update ref commit"

This reverts commit e7284152899d6dd8a986d9570e6021addfbc6b0f.

* bump tinygrad repo

* bump master

* update ref commit
2023-10-17 10:05:28 -07:00
Kacper Rączy
5cb9291de8 modeld: don't attempt to connect extra vipc client if its not available (#30154)
Do not connect extra client if it's not available
2023-10-03 15:54:21 -07:00
Harald Schäfer
3c0a7d6986 Night Strike Model (#30148)
* baab2a46-f0c3-46eb-8756-00c55354945b/700

* Update model replay ref
2023-10-03 14:25:30 -07:00
YassineYousfi
04e239f7ed onnxmodel: fp16_to_fp32 (#30080)
* onnxmodel: force fp32

* rename

* rename this too
2023-09-27 22:37:03 -07:00
Adeeb Shihadeh
362c0bf2ca Revert "modeld: remove extra cloudlog.bind, manager does this"
This reverts commit 754af893e9.
2023-09-21 20:13:13 -07:00
Adeeb Shihadeh
754af893e9 modeld: remove extra cloudlog.bind, manager does this 2023-09-21 20:06:46 -07:00
Harald Schäfer
3799fe46b3 Optimus Prime Model 🤖 (#29752)
* b449f295-7e40-4f97-96a6-d858815955e5/700

* make it compile b449f295-7e40-4f97-96a6-d858815955e5/700

* simpler - b449f295-7e40-4f97-96a6-d858815955e5/700

* feature_len changed

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700

* Revert "0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700"

This reverts commit 41708b88447cfcf302b16f21f0caa69450bbd3df.

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700 again

* Update ref

* update ref

---------

Co-authored-by: Yassine <yassine.y10@gmail.com>
2023-09-21 13:51:12 -07:00
Harald Schäfer
ef50b4fdac Test modeld: 3s enough for modeld startup (#29936)
* Test modeld: 3s enough for modeld startup

* Always fails when you send frames before modeld is ready

* Wait for modeld to read
2023-09-15 14:59:46 -07:00
Mitchell Goff
9cc00c2101 Converted onnx runner to python (#29856) 2023-09-08 16:45:38 -07:00
Mitchell Goff
2d69f3d63e Update model input names to match onnx inputs (#29855)
Updated model input names to match onnx inputs
2023-09-08 16:06:16 -07:00
Mitchell Goff
503fa121ee Rewrite dmonitoringmodeld in python (#29740)
* Added dmonitoringmodeld.py

* Removed dmonitoringmodeld.cc

* Use ModelRunner helpers from runners/__init__.py

* Fixed DriverStateResult field ordering

* Some bug fixes

* Set calib input

* Look ma, no loop!

* Bump dmonitoringmodeld cpu usage in test_onroad

* Fixed memory leak caused by np.ctypes.data_as

* Formatting fixes

* chmod +x

* remove USE_ONNX_MODEL

* Realtime priority 1, formatting fixes
2023-09-07 19:46:43 -07:00
Mitchell Goff
0c0af682a1 Rewrite navmodeld in python (#29579)
* Added navmodeld.py

* Deleted navmodeld.cc

* Write SConscript config flags to config.py

* Remove deleted files from release/files_common

* Some more bug fixes

* Added config.py to gitignore

* Get rid of config.py

* Use set_realtime_priority

* A tiny bit more cleanup

* set realtime priority 1

* Use ModelRunner helper class from runners/__init__.py

* Formatting fixes

* mama mia that's a SPICY memory leak
2023-09-07 14:39:37 -07:00
mitchellgoffpc
05993f50df Added cython bindings for commonmodel sigmoid 2023-08-31 19:40:53 -07:00
Mitchell Goff
d5a55136a1 Added ModelRunner helpers in modeld/runners/__init__.py (#29737)
* Added ModelRunner helper class

* import Runtime in __init__.py
2023-08-31 14:19:20 -07:00
mitchellgoffpc
f91e955a86 Move Runtime into runmodel_pyx 2023-08-31 13:51:50 -07:00
mitchellgoffpc
857f747467 Remove unnecessary hardware check in modeld 2023-08-31 13:51:49 -07:00
mitchellgoffpc
18526c58b6 Set ADSP_LIBRARY_PATH in snpemodel_pyx 2023-08-31 13:11:39 -07:00
mitchellgoffpc
aebff37593 Set RPATH for snpemodel 2023-08-31 11:33:42 -07:00
Mitchell Goff
88a36f4464 Cleaned up modeld SConscript (#29646) 2023-08-30 15:29:33 -07:00
Mitchell Goff
151ac4bf76 Combine update_calibration/get_warp_matrix (#29719) 2023-08-30 15:16:29 -07:00
Mitchell Goff
1eb60516cb Move update_calibration to modeld.py (#29688)
* Move update_calibration to modeld.py

* Updated ref commit
2023-08-30 14:12:52 -07:00
mitchellgoffpc
12d1020239 -DUSE_THNEED is dead 2023-08-30 12:58:31 -07:00
Mitchell Goff
d998fd88a8 Added USE_THNEED environment variable and removed build flag (#29645) 2023-08-29 14:07:57 -07:00
mitchellgoffpc
807410e0ac Remove no-thneed build flag 2023-08-25 19:09:25 -07:00
mitchellgoffpc
e0287fa93e Remove USE_THNEED check from run.h 2023-08-25 19:05:49 -07:00
Kacper Rączy
a4a0429fca modeld: fix bash scripts (#29643)
Fix shebang. Fix LD_PRELOAD
2023-08-25 18:56:06 -07:00
mitchellgoffpc
ef8e0fef55 Remove thneed logic from snpemodel 2023-08-25 14:37:08 -07:00
Mitchell Goff
72a3c987c0 Rewrite modeld in python (#29230)
* Added modeld.py (WIP)

* No more VisionIpcBufExtra

* Started work on cython bindings for runmodel

* Got ONNXModel cython bindings mostly working, added ModelFrame bindings

* Got modeld main loop running without model eval

* Move everything into ModelState

* Doesn't crash!

* Moved ModelState into modeld.py

* Added driving_pyx

* Added cython bindings for message generation

* Moved CLContext definition to visionipc.pxd

* *facepalm*

* Move cl_pyx into commonmodel_pyx

* Split out ONNXModel into a subclass of RunModel

* Added snpemodel/thneedmodel bindings

* Removed modeld.cc

* Fixed scons for macOS

* Fixed sconscript

* Added flag for thneedmodel

* paths are now relative to openpilot root dir

* Set cl kernel paths in SConscript

* Set LD_PRELOAD=libthneed.so to fix ioctl interception

* Run from root dir

* A few more fixes

* A few more minor fixes

* Use C update_calibration for now to exactly match refs

* Add nav_instructions input

* Link driving_pyx.pyx with transformations

* Checked python FirstOrderFilter against C++ FirstOrderFilter

* Set process name to fix test_onroad

* Revert changes to onnxmodel.cc

* Fixed bad onnx_runner.py path in onnxmodel.cc

* Import all constants from driving.h

* logging -> cloudlog

* pylint import-error suppressions no longer needed?

* Loop in SConscript

* Added parens

* Bump modeld cpu usage in test_onroad

* Get rid of use_nav

* use config_realtime_process

* error message from ioctl sniffer was messing up pyenv

* cast distance_idx to int

* Removed cloudlog.infos in model.run

* Fixed rebase conflicts

* Clean up driving.pxd/pyx

* Fixed linter error
2023-08-25 14:36:26 -07:00
Mitchell Goff
e2e39d100b Added cython bindings for model runners and commonmodel (#29607)
* Added cython bindings for model runners and commonmodel

* Removed cython language_level=3

* loop to set CXXFLAGS for both envs
2023-08-24 17:00:26 -07:00
Justin Newberry
1ee6ed4b16 Linter: remove pylint (#29611)
remove pylint
2023-08-24 16:30:54 -07:00
mitchellgoffpc
7dae580441 Moved thneed src to top of modeld sconscript 2023-08-24 15:12:01 -07:00
mitchellgoffpc
fc8c97e7a9 Some cleanup in modeld sconscript 2023-08-24 14:41:04 -07:00
mitchellgoffpc
a184d40b7a Disable error message in thneed ioctl interceptor to fix pyenv issues 2023-08-24 14:41:04 -07:00
Dean Lee
7bfd3dac81 cpplint: add filter whitespace/comma (#29595) 2023-08-24 10:42:06 -07:00
Dean Lee
9c7bf50703 cpplint: add filter whitespace/tab (#29588) 2023-08-24 08:06:58 -07:00
Dean Lee
21da5a216f cpplint: add filter build/include_subdir (#29585) 2023-08-24 15:42:17 +01:00
Dean Lee
f203648de0 cpplint: add filter whitespace/semicolon (#29568) 2023-08-23 15:00:30 -07:00
Dean Lee
5480d32bb5 cpplint: add filter whitespace/parens (#29565) 2023-08-23 14:25:05 -07:00