Commit Graph

71 Commits

Author SHA1 Message Date
ZwX1616
e8a8e37185 DM: more precision running on DSP + e2e outputs (#23900)
* update cereal

* run but not use

* log distraction type

* regression scaling

* clean up naming

* add calib buf

* add to header

* fake model

* no calib model

* adjust threshs

* 018a305f

* fix bn

* tweak1

* tweak2

* 0ff2/666

* tweak3

* t4

* t5

* fix out of bound

* skip when replaying old segments

* update ref

* fix onnxmodel

* get calib

* update model replay refs

* up ref
old-commit-hash: de4031c98e
2022-03-15 19:02:21 -07:00
Adeeb Shihadeh
2e91f016bb modeld: remove support for small model (#23803)
* modeld: remove support for small model

* use extra
old-commit-hash: 8a19d9892e
2022-02-28 10:32:39 -08:00
Willem Melching
ad5ccabce3 bigmodel (#23684)
* Added wide cam vipc client and bigmodel transform logic

* Added wide_frame to ModelState, should still work normally

* Refactored image input into addImage method, should still work normally

* Updated thneed/compile.cc

* Bigmodel, untested: 44f83118-b375-4d4c-ae12-2017124f0cf4/200

* Have to initialize extra buffer in SNPEModel

* Default paramater value in the wrong place I think

* Move USE_EXTRA to SConscript

* New model: 6c34d59a-acc3-4877-84bd-904c10745ba6/250

* move use extra check to runtime, not on C2

* this is always true

* more C2 checks

* log if frames are out of sync

* more logging on no frame

* store in pointer

* print sof

* add sync logic

* log based on sof difference as well

* keep both models

* less assumptions

* define above thneed

* typo

* simplify

* no need for second client is main is already wide

* more comments update

* no optional reference

* more logging to debug lags

* add to release files

* both defines

* New model: 6831a77f-2574-4bfb-8077-79b0972a2771/950

* Path offset no longer relevant

* Remove duplicate execute

* Moved bigmodel back to big_supercombo.dlc

* add wide vipc stream

* Tici must be tici

* Needs state too

* add wide cam support to model replay

* handle syncing better

* ugh, c2

* print that

* handle ecam lag

* skip first one

* so close

* update refs

Co-authored-by: mitchellgoffpc <mitchellgoffpc@gmail.com>
Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 85efde269d
2022-02-19 16:06:31 -08:00
Mitchell Goff
42591a19a7 New model: 224877e7-dfcf-4b28-9482-371655918fe1/950 (#23170)
* New model: 224877e7-dfcf-4b28-9482-371655918fe1/950

* Updated model replay ref
old-commit-hash: 1d119999c2
2021-12-08 13:55:30 -08:00
Mitchell Goff
104ad1d833 New model: d2053554-6094-43ce-943a-7bee3f43458d/950 (#23097)
* New model: d2053554-6094-43ce-943a-7bee3f43458d/950

* Updated model replay ref

* Revert "Updated model replay ref"

This reverts commit e83e0a1adc79dd20232b74932de202d858ebb485.

* New refs (again)

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: be89044c51
2021-12-01 22:43:13 -08:00
ZwX1616
0aa7404922 Add DM model readme (#22801)
* add dm model

* link to parsing
old-commit-hash: eaaccaa3d8
2021-11-08 15:15:55 -08:00
Willem Melching
67f41f32f1 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
old-commit-hash: b816b5b644
2021-10-28 15:14:37 +02:00
ZwX1616
d4cbef299b wider FOV DM on comma three (#22286)
* c3 is straightforward

* c2 transform

* c3 preview

* alpha model

* Revert "alpha model": wrong quantization data

This reverts commit b50e5739735b30d960aca22bcf3cbe23b0121e13.

* yuv looks good

* a55b

* const int

* block top deadzone

* new box alpha curve

* update k

* fix debug

* rhd use same offset

* box shift for rhd

* 7e3e

* set new thresh

* update ref

* explain

* remove e2e

* same metric thresh

* process isocc

* model

* cancel extra policy

* update numbers

* new model

* update cereal

* up cereal

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 8574e79fec
2021-10-13 17:00:46 -07:00
Ewout ter Hoeven
961ece7ae2 [Docs] Models: README: Fix channel number (#22530)
Fix the channel number for the V-channel of the supercombo input image stream
old-commit-hash: 3ad3e46d81
2021-10-12 10:34:53 -07:00
HaraldSchafer
02afe84c53 Update README.md
old-commit-hash: 2e74bc769d
2021-10-11 15:12:18 -07:00
HaraldSchafer
0ca698bcf7 Update README.md
old-commit-hash: 25c2304760
2021-10-11 15:05:05 -07:00
HaraldSchafer
8a7f3c7dbf Models README (#22523)
* first commit

* Update README.md
old-commit-hash: 14baedc9f5
2021-10-11 14:52:24 -07:00
HaraldSchafer
db0c802df0 Improved lead model: 6be443f2-ed70-4580-9c31-61b94d068e24/950 (#22290)
* 6be443f2-ed70-4580-9c31-61b94d068e24/950

* meta changed too

* new ref

* new ref from CI

* unused

* Revert "new ref from CI"

This reverts commit 28b6bdc81055c39973d0bf9cc964647838b73a73.

* new ref from CI again
old-commit-hash: 72a736f90e
2021-09-21 17:36:05 -07:00
ZwX1616
7c2a076d0e DM 0.8.8 (#21897)
* update threshs

* e392

* 40% less

* ref
old-commit-hash: 00ea7c1c82
2021-08-16 12:44:45 -07:00
Mitchell Goff
b7b87efed9 Retuned desire model (#21919)
* New model: d8e7f76f-7bec-4a83-af00-c0fae792527f/950

* Updated process replay refs

* Updated model replay ref
old-commit-hash: 05b37552f3
2021-08-12 21:06:26 -07:00
ZwX1616
fd0839c85d DM model with better noise performance (#21733)
* smooth 3d4f

* update thresholds

* update ref commt

* update
old-commit-hash: 0066523b88
2021-08-05 16:29:37 -07:00
Mitchell Goff
2d0512b8a1 Revert "New desire model (#21729)" (#21805)
* Revert "New desire model (#21729)"

This reverts commit 709932b3bfb4c3b4f33711b8d07615469e762832.

* Updated process replay ref and reverted release notes
old-commit-hash: 15d6bbb47c
2021-07-30 14:34:29 -07:00
Mitchell Goff
3fb1a1c746 New desire model (#21729)
* New model: b822ee32-917c-4639-99f8-25be3e6aabad/900

* Enable keeps

* use new packet

* Send keep pulses once per second

* Updated model_replay_ref_commit

* New model: 0f160bf9-1bce-43e6-9785-564b2453eeac

* Bump model_replay_ref_commit

* Bump submodules

* New model: fd904bf9-5dd8-4619-8997-c5668400e078/550

* New model: fd904bf9-5dd8-4619-8997-c5668400e078/950

* No keeps

* Bumped model replay ref

Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com>
old-commit-hash: e83973b9b3
2021-07-26 21:11:09 -07:00
Adeeb Shihadeh
477e2e22d3 Revert model (#21571)
* Revert "New desire model (#21458)"

This reverts commit 9db03d2a3fefff50b738d288beadc2c2e7c3165e.

* revert rel notes
old-commit-hash: 88424ede2c
2021-07-12 19:26:50 -07:00
HaraldSchafer
7fcdd04541 New desire model (#21458)
* New model: b822ee32-917c-4639-99f8-25be3e6aabad/900

* Enable keeps

* use new packet

* Send keep pulses once per second

* Updated model_replay_ref_commit

* New model: 0f160bf9-1bce-43e6-9785-564b2453eeac

* Bump model_replay_ref_commit

Co-authored-by: mitchell <mitchellgoffpc@gmail.com>
old-commit-hash: 4230d5d212
2021-07-07 19:44:17 -07:00
HaraldSchafer
d529ce9f5b Revert DM model change (#21442)
* Revert "tici patch"

This reverts commit 99c27ca8c5942c009fe5b74ac9ea4911c20c596c.

* Revert "dm e2e outputs added (#21210)"

This reverts commit eb26cd0e0ca5a82fb1e8b0e787497193b40fa5c2.

* Revert "improved dm model (#21113)"

This reverts commit 66818291b1813420801b601137ffa3b323aa7cbd.
old-commit-hash: 70f0059be4
2021-06-29 21:29:06 -07:00
ZwX1616
3768536076 tici patch
old-commit-hash: 09de331f18
2021-06-21 20:18:16 -07:00
ZwX1616
4b72ef3da3 dm e2e outputs added (#21210)
* try this

* use e2e only

* add new outputs

* Revert "use e2e only"

This reverts commit 423dd8e29b88d892074f6f6a0e103681147ff6cc.

* send new

* fix batchnorm
old-commit-hash: 46e3f4528f
2021-06-09 16:18:14 -07:00
ZwX1616
6d26873654 improved dm model (#21113)
* d0b8bec4

* 6272770f
old-commit-hash: 0f48fddf41
2021-06-04 15:04:25 -07:00
Mitchell Goff
78927e4ebb New model outputs (#20933)
* New model: 51a237cd-9c43-4281-9072-802325e6744d/950

* Added new meta outputs and proper interp for plan_t_arr

* Added meta-based trigger for FCW

* No nans in planner, separate alert for model FCW

* Cleaned up plan_t interp logic

* Added empty cameraError alert to fix unit tests

* Use the normal FCW event

* Updated filter logic

* Updated model replay ref

* Moved disengage predictions into their own cereal struct

* Updated model replay ref for new cereal structs

* Apparently this breaks stuff?

* Bumped cereal commit and model replay ref
old-commit-hash: 29cc3500a5
2021-05-19 22:30:23 -07:00
HaraldSchafer
eae1fa481c New KL model + laneless toggle (#20454)
* New model: 0bf38240-6b55-42b0-bcfb-da08ff5cd0b9/650

* laneless baby

* hardcode model difference for now

* kale toggle

* kale emoji

* sensible description

* make clear it is not just for ui

* emojis dont work yet

* 9671a8fe-539f-4a04-a163-54571df21139/650

* new model

* only read param on rising edge of ignition

* update toggle text

* fix that

* update refs

Co-authored-by: mitchell <mitchellgoffpc@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7ee79c9923
2021-03-24 01:10:31 -07:00
ZwX1616
e961d9b64c pyTorch DM (#19760)
* new model files

* no more rot

* no rot no diag switch

* should be correct and cache aware

* 405d7aeb

* parse new outputs

* change uncertain policy accordingly

* 1bdbd9ed

* adjust

* 0.5 is fine

* 3d4f9cab

* no face prob no loss

* clean up

* clean up test

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 8605ba8ab9
2021-01-28 14:02:58 -08:00
HaraldSchafer
074aef5349 0b6e45f8-21c1-408a-b61d-3dce02a69d23/500 (#19528)
old-commit-hash: 78176c79ad
2020-12-16 19:26:46 -08:00
HaraldSchafer
ed5f1fe79c Early model 081 (#19510)
* c91b82af-c0b0-4378-8431-3e6efc26b084/325

* 0b6e45f8-21c1-408a-b61d-3dce02a69d23/200

* update model ref
old-commit-hash: c89ec883cc
2020-12-15 22:21:30 -08:00
HaraldSchafer
faad598e29 Minor fixes 08 (#2565)
* correct indexes

* best metrics yet 30231f46-08af-477e-9d30-776593913c24/700

* sometimes x decreases

* update model refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7b216e7cbb
2020-11-17 20:04:32 -08:00
George Hotz
eb38dae9e9 ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 b5e5c420-7042-4d0c-92e5-770eb09936a5/800 with skip connection in temporal summarizer
old-commit-hash: 0d2c500f6c
2020-11-14 17:40:09 -08:00
HaraldSchafer
008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0e
2020-11-11 20:31:46 -08:00
ZwX1616
a55099ac2a EfficientNet driver monitoring (#1907)
* e96f9be6

* bump cereal

* filter sunglasses

* fix unittest

* update refs

* udpate refs

* update refs

* add tolerance for dmonitoringd

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2cfa0edb4c
2020-07-27 20:22:06 -07:00
ZwX1616
556752a77b Revert "EfficientNet driver monitoring (#1866)"
This reverts commit 0bc9d737dde1a50937d421f7a417260732f90480.

Need to fix test

old-commit-hash: c2be31c10b
2020-07-17 18:20:04 -07:00
ZwX1616
7a8bf9d7de EfficientNet driver monitoring (#1866)
* e96f9be6

* bump cereal

* filter sunglasses

* fix unittest

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2d0e994674
2020-07-17 15:34:02 -07:00
Harald Schafer
24fa28d053 83112b47-3b23-48e4-b65b-8c058766f4c1/100
old-commit-hash: a420d4bcbb
2020-05-11 09:49:41 -07:00
Harald Schafer
9e24129eb9 83112b47-3b23-48e4-b65b-8c058766f4c1/40
old-commit-hash: b61e318377
2020-05-10 22:14:12 -07:00
HaraldSchafer
f3747d2fe5 Better poly (#1437)
- better polyfitting
- no mpc cost change during lane change
- model trained with better ll gt, sim noise and guaranteed memories
old-commit-hash: 65fcc7c45f
2020-05-08 17:14:43 -07:00
ZwX1616
08e4f3b0f1 fix DLC for new SNPE
old-commit-hash: 90c9073250
2020-04-29 20:01:38 -07:00
Harald Schafer
f6c96a59ee newest
old-commit-hash: 2a2d27b6fd
2020-04-29 12:03:00 -07:00
HaraldSchafer
ed76f95dc1 Sim noise model (#1433)
* 62cb2c3a-7c18-4b09-91ea-c69a1496a839/30

* epoch 90

* looks pretty good

* newest model

* 12570fba-bfe4-43f6-aed0-2078c4ae6dba/40
old-commit-hash: 03b6b2e9ed
2020-04-28 20:05:15 -07:00
HaraldSchafer
5d72509104 Faster lane change (#1381)
* final B2 for 0.75

* more aggression in lane changes
old-commit-hash: d39595cf10
2020-04-16 18:13:37 -07:00
ZwX1616
f90b956f47 RHD support for driver monitoring (#1299)
old-commit-hash: 133b1a20b4
2020-04-15 16:48:44 -07:00
HaraldSchafer
cd44a6b07f Traffic b2 (#1345)
* add traffic convention

* hope this work

* no comment

* latest and gratest

* big gru model

* 1af55c7d-ee15-414a-9e98-a0cb08c3441f/75

* much later in training

* wrong temporal size

* converged

* fix lane changes
old-commit-hash: d3edc594ce
2020-04-13 13:27:06 -07:00
Harald Schafer
ab9cb21440 doesnt belong here
old-commit-hash: 6f7320a046
2020-03-19 14:28:21 -07:00
Harald Schafer
fe0dbbf424 doesnt work yet
old-commit-hash: fddb18ca32
2020-03-19 14:03:38 -07:00
Harald Schafer
1335be2843 update keras
old-commit-hash: e0e92dd141
2020-03-16 13:40:25 -07:00
Harald Schafer
097a16eb96 6f9039be-5ae6-484d-8c01-b0bf3164f15d/270 keras still outdated, will fix
old-commit-hash: 6e7bb9cdde
2020-03-13 11:15:09 -07:00
ZwX1616
fb2a2d98b8 dmonitoring model 2ad118ee
old-commit-hash: 68e35a6a98
2020-03-11 15:45:27 -07:00
HaraldSchafer
544d198bed Pulse desire (#1172)
* initial

* compilation fixes

* add desire

* pulse desire

* 0d5728f6-a918-40a6-bce3-a9d0f1238180/20

* cleaner

* inject model

* inject model

* test runs

* ah already done I see

* remove useless

* update

* updates, doesnt work

* fix generating new references

Co-authored-by: Willem Melching <willem.melching@gmail.com>

old-commit-hash: 63d3bb517f
2020-03-04 18:51:45 -08:00