Harald Schäfer
d41311ca20
Switch PC running to tinygrad with LLVM ( #34660 )
...
* try llvm on cpu
* update lock
* Make sure test fails
* With BEAM=3 its fast
* small fixes
* more fixes
* Fix macos
* do dm too
* rm ort
2025-02-24 14:51:10 -08:00
Harald Schäfer
17ca6389e1
Tinygrad runner ( #34261 )
...
* squash
* dmonitoringmodeld: use cl transform (#34235 )
* needs cleanup
* only if tici
* bump tinygrad
* check width
* base modelframe
* .
* need to be args
* more cleanup
* no _frame in base
* tici only
* its DrivingModelFrame
* .6 is fair
---------
Co-authored-by: Comma Device <device@comma.ai >
* Update tinygrad
* tg upstream
* bump tg
* bump tg
* debug
* attr
* misc cleanup
* whitespace
* remove
* Add TODOs to make python proc for modelrunners
* whitespace
---------
Co-authored-by: ZwX1616 <zwx1616@gmail.com >
Co-authored-by: Comma Device <device@comma.ai >
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
2024-12-18 11:58:59 -08:00
Harald Schäfer
a98210aeec
modeld: ort helpers ( #34258 )
...
* ort helpers
* import from ort helpers
* import that too
* linter
* linter
* linter
2024-12-16 13:10:00 -08:00
Harald Schäfer
f6885dcbec
Revert Tinygrad ( #34243 )
...
* Revert "dmonitoringmodeld: use cl transform (#34235 )"
This reverts commit 684b0b9d4d31606a7d1544f58ff758#34171 )"
This reverts commit 7b5a4fbb03
2024-12-14 12:15:36 -08:00
mitchellgoffpc
31606a7d15
load model before calling convert_fp16_to_fp32
2024-12-12 15:04:54 -08:00
Harald Schäfer
7b5a4fbb03
Tinygrad runner ( #34171 )
...
* squash
* bump tg
* bump tg
* debump tinygrad
* bump tinygrad
* bump tg
* Skip init iteration
* fixes
* cleanups
* skip first test sample
* typos
* linter unhappy
* update cpu usage
* OPENCL just zeros for now
* imports
* Try printing
* Runs again, but slower
* unused import
* Allow more buffer with tg and all on gpu
* bump tinygrad
* seems ok
* stricter timings for driving looser for dm
* try llvm
* check nvidia
* More timeout for now
* make test pass
* Revert "try llvm"
This reverts commit ef136e478320101fea262bae3579e558da991902.
* small fixes
* whitespace
* revert test timeout
* No model runners
* Always CPU always fast
* No onnx runtime GPU
* more cores
* cleanup
* Is this faster
* Is this faster
* at least runs
* FP32 is faster than 16
* fix deps
* whitespace
* comment
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
2024-12-11 23:15:20 -08:00
Maxime Desroches
216ebcaa50
Fix model runtime on PC ( #34210 )
...
exhaustive
2024-12-11 13:27:39 -08:00
Adeeb Shihadeh
d9d57e5d6f
Revert ISP image processing + tinygrad bump ( #34020 )
...
* Revert "Replace ThneedModel with TinygradModel (#33532 )"
This reverts commit da952e9b64#33959 )"
This reverts commit f2a1cce42b
2024-11-13 19:27:11 -08:00
Mitchell Goff
da952e9b64
Replace ThneedModel with TinygradModel ( #33532 )
...
* squash
* bump tg
* bump tg
* debump tinygrad
* bump tinygrad
* bump tg
* Skip init iteration
* fixes
* cleanups
* skip first test sample
* typos
* linter unhappy
* update cpu usage
* OPENCL just zeros for now
* imports
* Try printing
* Runs again, but slower
* unused import
* Allow more buffer with tg and all on gpu
* bump tinygrad
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com >
2024-11-11 13:32:21 -08:00
ZwX1616
876f192112
exec DM model with gpu ( #33609 )
...
* half
old-commit-hash: 9f72eca003d4637ca7fe847ebaf925c694fc2e84
* optimed
old-commit-hash: 6e36e2a12e09275ec21d1590012a92b05ca52ff5
* thneed
old-commit-hash: 419a06c09c0c767d828bcd1e118bc575898c343a
* exec
old-commit-hash: 0059c27ec11b076a37f65d604ed135ea6541b1a6
* runner
old-commit-hash: 34232ada94450ce541eaef546197fa219810a891
* runs but
old-commit-hash: 3db37c00b6a64908293b4de8d8b56e80308cd8f2
* it is 01
old-commit-hash: a160d81eb1a7e77abbef959b44f602610f68f665
* np
old-commit-hash: c1caff6ba648cc2c0094c71b2ea074f01c3c2dc8
* module url
old-commit-hash: 6f4902c4d384263a53e2c1d14d93b5ff864b6a5f
* new
old-commit-hash: 779ae79b1bc3df6374fb6663ac8592e107a6e504
* ds fast
* is this work
* corcention
* real timing
* no reg
* interim gather
* 0e4a9c7b
* fa69be01, and halve
* list
* cleanup
* slighly faster
* setprotlt
* expected
* replay ref
* more powar
* reluctantly
* bump tg
* 8
* less
* less
* bump tg
* better than exp
* closer
* cc
* see diff
* commits
* was right
* to 32 cast
* remove dlc file
* support both
* dspExecutionTime -> gpuExecutionTime
* ignore
* time ref
* ref commit
* last
---------
Co-authored-by: Comma Device <device@comma.ai >
2024-09-26 16:40:44 -07:00
ZwX1616
b2976631d2
onnxmodel fp16_to_fp32: misc improvements ( #33615 )
2024-09-20 15:00:34 -07:00
ZwX1616
ffb6e11f96
Revert "exec DM model with gpu" ( #33604 )
...
Revert "exec DM model with gpu (#33397 )"
This reverts commit f79aca8e1e
2024-09-19 20:55:11 -07:00
ZwX1616
f79aca8e1e
exec DM model with gpu ( #33397 )
...
* half
old-commit-hash: 9f72eca003d4637ca7fe847ebaf925c694fc2e84
* optimed
old-commit-hash: 6e36e2a12e09275ec21d1590012a92b05ca52ff5
* thneed
old-commit-hash: 419a06c09c0c767d828bcd1e118bc575898c343a
* exec
old-commit-hash: 0059c27ec11b076a37f65d604ed135ea6541b1a6
* runner
old-commit-hash: 34232ada94450ce541eaef546197fa219810a891
* runs but
old-commit-hash: 3db37c00b6a64908293b4de8d8b56e80308cd8f2
* it is 01
old-commit-hash: a160d81eb1a7e77abbef959b44f602610f68f665
* np
old-commit-hash: c1caff6ba648cc2c0094c71b2ea074f01c3c2dc8
* module url
old-commit-hash: 6f4902c4d384263a53e2c1d14d93b5ff864b6a5f
* new
old-commit-hash: 779ae79b1bc3df6374fb6663ac8592e107a6e504
* ds fast
* is this work
* corcention
* real timing
* no reg
* interim gather
* 0e4a9c7b
* fa69be01, and halve
* list
* cleanup
* slighly faster
* setprotlt
* expected
* replay ref
* more powar
* reluctantly
* bump tg
* 8
* less
* less
* bump tg
* better than exp
* closer
* cc
* see diff
* commits
* was right
* to 32 cast
* remove dlc file
* support both
---------
Co-authored-by: Comma Device <device@comma.ai >
2024-09-19 17:42:44 -07:00
Dean Lee
29dda3b232
Fix FutureWarning "Cython directive 'language_level' not set" ( #33046 )
...
fix FutureWarning
old-commit-hash: fb33366144
2024-07-23 09:27:10 -07:00
Harald Schäfer
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7
2024-06-06 14:31:56 -07:00
Cameron Clough
9bd90112d0
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae49
2024-02-24 16:41:23 -08:00
Milan Medić
284450400e
add Cython static analysis ( #31491 )
...
* Adding pre-commit hook for cython static analysis
* Adding changes to cython files to pass static analysis
* Revert "Adding changes to cython files to pass static analysis"
This reverts commit 9a0eb733199abd9eef1eac3d024ef2760348d67c.
* Adding ignore rule for indentation of 4 spaces (E111)
* Fixes for cython-lint static analysis
* Revert "Fixes for cython-lint static analysis"
This reverts commit 972741735b2bdc73460d65a4d7ea167dfc0f4644.
* Adding two new rules into ignore list (2 new lines after difinition of class)
* Adding fixes for cython static analysis
old-commit-hash: 69fb3c2ed5
2024-02-19 12:11:56 -08:00
YassineYousfi
a3f3e0c122
onnxmodel: fp16_to_fp32 ( #30080 )
...
* onnxmodel: force fp32
* rename
* rename this too
old-commit-hash: 04e239f7ed
2023-09-27 22:37:03 -07:00
Mitchell Goff
3e1903a6cb
Converted onnx runner to python ( #29856 )
...
old-commit-hash: 9cc00c2101
2023-09-08 16:45:38 -07:00
Mitchell Goff
5732002296
Rewrite dmonitoringmodeld in python ( #29740 )
...
* Added dmonitoringmodeld.py
* Removed dmonitoringmodeld.cc
* Use ModelRunner helpers from runners/__init__.py
* Fixed DriverStateResult field ordering
* Some bug fixes
* Set calib input
* Look ma, no loop!
* Bump dmonitoringmodeld cpu usage in test_onroad
* Fixed memory leak caused by np.ctypes.data_as
* Formatting fixes
* chmod +x
* remove USE_ONNX_MODEL
* Realtime priority 1, formatting fixes
old-commit-hash: 503fa121ee
2023-09-07 19:46:43 -07:00
Mitchell Goff
cd7d73eaf8
Added ModelRunner helpers in modeld/runners/__init__.py ( #29737 )
...
* Added ModelRunner helper class
* import Runtime in __init__.py
old-commit-hash: d5a55136a1
2023-08-31 14:19:20 -07:00
mitchellgoffpc
aca5580900
Move Runtime into runmodel_pyx
...
old-commit-hash: f91e955a86
2023-08-31 13:51:50 -07:00
mitchellgoffpc
51066175f5
Set ADSP_LIBRARY_PATH in snpemodel_pyx
...
old-commit-hash: 18526c58b6
2023-08-31 13:11:39 -07:00
mitchellgoffpc
e9e98abe89
Remove USE_THNEED check from run.h
...
old-commit-hash: e0287fa93e
2023-08-25 19:05:49 -07:00
mitchellgoffpc
68e2c74cd3
Remove thneed logic from snpemodel
...
old-commit-hash: ef8e0fef55
2023-08-25 14:37:08 -07:00
Mitchell Goff
5033da5e27
Added cython bindings for model runners and commonmodel ( #29607 )
...
* Added cython bindings for model runners and commonmodel
* Removed cython language_level=3
* loop to set CXXFLAGS for both envs
old-commit-hash: e2e39d100b
2023-08-24 17:00:26 -07:00
Dean Lee
228d30d5a9
cpplint: add filter whitespace/tab ( #29588 )
...
old-commit-hash: 9c7bf50703
2023-08-24 08:06:58 -07:00
Dean Lee
0984736972
cpplint: add filter build/include_subdir ( #29585 )
...
old-commit-hash: 21da5a216f
2023-08-24 15:42:17 +01:00
Dean Lee
97e9d55588
cpplint: build/include_what_you_use ( #29556 )
...
* include_what_you_use
* remove comments
* include <memory>
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: 2d99521e75
2023-08-23 13:25:17 -07:00
mitchellgoffpc
8a1e4d8575
Set paths for cl kernels and onnx_runner.py in modeld SConscript
...
old-commit-hash: 7699444816
2023-08-21 19:38:40 -07:00
mitchellgoffpc
b1a10e45d1
Move USE_RUNTIME flags into runmodel.h
...
old-commit-hash: 24090d2121
2023-08-21 19:26:48 -07:00
mitchellgoffpc
b69de80962
exit if onnxmodel exec fails
...
old-commit-hash: 8c478708ee
2023-08-21 19:23:23 -07:00
Justin Newberry
f33b4de80b
Ruff: b905 (strict zip) ( #29336 )
...
* added mutable default args
* most of the Bs
* add comment about lrucache
* b905
old-commit-hash: e4ead4f183
2023-08-11 16:13:51 -07:00
Justin Newberry
3ee0786de3
CI: Pylint to ruff ( #29294 )
...
* pylint to riff
* pylint to riff
* pylint to riff
* revert more
* undo exclude removal
* exclude tinygrad
* set line length
* pylint exclusions to ruff
* same excludes as old linter
* fix tools QA
* remove unrequired check
* revert linting third_party
* ignore e402
old-commit-hash: 7fdd9fc37c
2023-08-09 13:26:54 -07:00
Justin Newberry
ff96892511
Revert "CI: pylint to ruff ( #29276 )" ( #29284 )
...
This reverts commit ffad7279cbad3c4f2ea786287b4624d3a3aa18d7.
old-commit-hash: a91764954b
2023-08-08 14:24:04 -07:00
Justin Newberry
99006365a3
CI: pylint to ruff ( #29276 )
...
* pylint to riff
* pylint to riff
* pylint to riff
* revert more
* undo exclude removal
* exclude tinygrad
old-commit-hash: cb31a53d8a
2023-08-08 13:41:30 -07:00
Dean Lee
b80325aa04
swaglog: enable type-checked against format string ( #29096 )
...
* check&fix fmt
* bump rednose
* correct format string
* bump rednose
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: 940954c13e
2023-07-31 17:49:50 -07:00
Kacper Rączy
fe2fc9dd11
onnx_runner: force determinism ( #29000 )
...
old-commit-hash: 8ce72760e7
2023-07-18 05:52:07 +02:00
Adeeb Shihadeh
e83ec32c7b
dmonitoringmodeld: add more logging around the init ( #28920 )
...
old-commit-hash: 8d13ddb943
2023-07-13 11:58:51 -07:00
Mitchell Goff
95051090a1
Refactor model runners ( #28598 )
...
* Started work on model runner refactor
* Fixed some compile errors
* everything compiles
* Fixed bug in SNPEModel
* updateInput -> setInputBuffer
* I understand nothing
* whoops lol
* use std::string instead of char*
* Move common logic into RunModel
* formatting fix
old-commit-hash: c9f00678af
2023-07-06 22:26:11 -07:00
YassineYousfi
52e1cf2e64
fix input order in onnxmodel ( #28274 )
...
old-commit-hash: d0a8b3780c
2023-05-23 16:11:51 -07:00
Mitchell Goff
22c5053bbc
Nicki Minaj Model ( #28218 )
...
* New model: 2ff7490f-8a2f-4c0d-87a8-b0fa3a4a6a71
* Updated model_replay_ref_commit
old-commit-hash: 328b5d9d47
2023-05-22 15:11:04 -07:00
Harald Schäfer
f315819d47
Navmodel and driving style: update runner ( #26762 )
...
* Navmodel and driving style: update runner
* No driving style yet
* thneedrunner without extra inputs
* nav feature ref
old-commit-hash: 160c9ba1d2
2022-12-11 15:25:36 -08:00
HaraldSchafer
a8ec6f4cfd
Rocket Launcher Model ( #25963 )
...
* 1456d261-d232-4654-8885-4d9fde883894/440 6b7d7cec-ead8-40f3-86cc-86d52c9b03fe/300
* compute only 9 tokens: 1456d261-d232-4654-8885-4d9fde883894/440 6b7d7cec-ead8-40f3-86cc-86d52c9b03fe/300
* tinygrad: cleanup gather
* 1456d261-d232-4654-8885-4d9fde883894/440 6b7d7cec-ead8-40f3-86cc-86d52c9b03fe/700
* empty commit for tests
* bump tinygrad
* dont use tinygrad matmul for now
* bump tinygrad
* 1456d261-d232-4654-8885-4d9fde883894/440 e63ab895-2222-4abd-a9a5-af86bb70e260/700
* float16 1456d261-d232-4654-8885-4d9fde883894/440 e63ab895-2222-4abd-a9a5-af86bb70e260/700
* increase steer rate cost
* Revert "increase steer rate cost"
This reverts commit 74ce9ab9be7ef17ecfec931f96851b12f37f2336.
* fork tinygrad
* empty commit for tests
* basics
* Kinda works
* new lat
* new tuning
* Move LATMPCN so scons compiles
* Update long weights
* Add tinygrad optim
* Update model ref
* update weights
* Update ref
* Try
* Error message for field ignore
* update model regf
* ref commit
* Fix onnx test
Co-authored-by: Yassine Yousfi <yyousfi1@binghamton.edu >
old-commit-hash: cb0b7375b7
2022-10-05 21:43:38 -07:00
George Hotz
273fab518b
modeld: delete unused SNPE stuff after move to tinygrad ( #25635 )
...
* delete unused stuff
* remove CL interceptor from thneed since we don't use SNPE anymore
* remove dead files from release
* that's removed
* oops, didn't save
old-commit-hash: 6c39382d71
2022-09-01 18:28:20 -07:00
George Hotz
58f2a941da
modeld: PC Thneed prereqs ( #25615 )
...
* pc thneed prereqs
* ugh, out of date
* that can stay private
* memcpy here is fine in SNPE variant
* release files
* thneed docs don't work anymore. they didn't look too useful
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: b6e355a933
2022-08-30 17:57:14 -07:00
ZwX1616
cd2a98aa11
fullframe DM model ( #24860 )
...
* Revert "put cereal on master"
This reverts commit 4646c132bae7358079c9b2867725f8382906c1e5.
* Revert "Revert fullframe DM model (#24812 )"
This reverts commit 59e8af4c3101785cead69a9880cc03e0a18081e1.
* revert revert cereal
* clip6
* 0.8 is fair
* Fiction compensation should be based on error
* Update refs
* Add deadzone
* not that
* good mg
* ref
* ref
* ee8f
* minor tweak
* ref
* recompile
* ref
* cereal
* match driverstatus
* new ref
* new ref
* pass token through jenkins credentials
* quote
* fix snpe dead weights
* final ref
Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com >
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: 1f2f9ea9c9
2022-06-20 16:24:51 -07:00
ZwX1616
c73d4e5fc6
Revert fullframe DM model ( #24812 )
...
* Revert "fullframe DM: flip RHD yaw to use matching thresholds"
This reverts commit ce7daabc8847d18ba46e5d1879f5a6958d04ccc7.
* Revert "fullframe DM model (#24762 )"
This reverts commit 817be81fb19004f4873881f6b29dcdfffbe7e3a8.
* revert cereal
old-commit-hash: c646eeee0a
2022-06-10 16:16:46 -07:00
ZwX1616
02f0f39b52
fullframe DM model ( #24762 )
...
* get log
* simplify two nonsense
* not needed
* libyuv is a joke
* clean up
* try small
* fast but not bad
* working
* clean up driverview
* simplified
* thats mirrored
* smol
* tweak
* ref is screen
* w/ ee
* update camera model
* no if TICI
* start
* update pose thresh
* less cpu more dsp
* new libyuv
* new snpe
* add files
* test
* should be fast
* update out len
* trigger test
* use master snpe
* add cereal
* update cereal
* refactor parsing
* missing ;
* get
* wrong type
* test model
* use driver data
* 10829278-72fe-4283-a118-2cef959ce174/1550
* no pf
* adapt driverview
* ;
* rhd learner
* update libyuv buildi x64
* ad4337ea
* remove blink slack
* test
* no
* use toggle
* b16
* fix for nv12
* 5b02cff5 both
* update test
* update cereal
* update cereal
* update cereal
* v2 packets
* revert libyuv
* no /
* update snpemodel
* ;
* memcpy
* fix test
* use toggle in driverview
* update power
* update replay
* Revert "update replay"
This reverts commit 1d0979ca59dbc89bc5890656e9501e83f0556d50.
* update model ref
* halve cpu
* fake 8bit onnx runner
* same thresh as report
* cereal master
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: d6c07a6b15
2022-06-08 20:13:46 -07:00
Adeeb Shihadeh
3df7552b7b
modeld: cleaner exit from onnx runner
...
old-commit-hash: 921a411da5
2022-06-02 20:16:21 -07:00
