Commit Graph

463 Commits

Author SHA1 Message Date
Justin Newberry
6a395a599b jenkins: publish casync agnos alongside builds (#32177)
* publish agnos

* test it

* more logging and fix

* remove this for a quick test

* time logging

* revert that

* space

* Revert "test it"

This reverts commit 3b80d97f7d436bc5b2cc29caf6bff1671f7f3f71.

* bump timeout
old-commit-hash: 1f37de1870f127cd8c1c9943b026fe952fd34b8d
2024-04-11 17:51:26 -07:00
Justin Newberry
933dd500c4 agnos casync script improvements (#32156)
* build agnos

* include path

* cleanup

* rm this

* test it

* all agnos partitions are AB

* fix that

* correct

* build agnos first

* better temp dir

* revert the order

* try it on pc

* test it

* upload and fix

* build

* pass in environemnt variable

* not in jenkins
old-commit-hash: ecb648a68ab86e053faff450f5bf0d2bfc221333
2024-04-11 09:46:27 -07:00
Justin Newberry
2074f46fbe jenkins: use token for pushing to openpilot-releases (#32146)
use token

Co-authored-by: tester <tester@comma.ai>
old-commit-hash: 91713bed2627bef431af0fbcca485e054112d875
2024-04-09 15:42:30 -07:00
Justin Newberry
6cc3c1ee0f jenkins: publish casync releases from device (#32142)
* publish in ci

* overwrite

* publish in ci

* fix

* test it

* Revert "test it"

This reverts commit b3de51dc693df79b980d7dffc18bcc3c88d83375.

* use right token

* cleanup after uploading

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 8364cd2f2cc4f4b753fc417333df4c707c11eb86
2024-04-09 11:38:18 -07:00
YassineYousfi
75a69e12b3 disable navigate on openpilot (#32106)
* 2eedcd90-b7db-46cb-86be-740f48ded7ab/700

* noop ciao

* here too

* mapsd too

* update translations

* disable mapsd test from test onroad

* disable mapRenderState test from timings

* lint

* fix exp mode toggle panel

* update tr

* french done

* dont build mapd

* only no nav

* just comment

* deprecate nav fields

* rm not comment

* dont deprecate too much

* remove from services

* merge cereal
old-commit-hash: 754dd45ffa82bf3d7f2d3413c4132eb65551ebd5
2024-04-09 10:40:38 -07:00
Justin Newberry
deb8ff1865 make manifest script executable (#32140)
old-commit-hash: 97db26b6a94a21e0dbe223f91ec8762347d493c2
2024-04-09 10:15:28 -07:00
Justin Newberry
15cc195882 jenkins: set pythonpath for casync build (#32139)
* set pythonpath

* quotes
old-commit-hash: e18ec9bbd7860166d9a74da90566c9e98e1b74e7
2024-04-09 09:19:05 -07:00
Justin Newberry
b982781570 tool to create casync manifest (#32131)
* manifest tool

* newline

* add to jenkins
old-commit-hash: b331e4a15b4d720bba59adbda51e8f78ab127382
2024-04-08 16:54:14 -07:00
Justin Newberry
327a4f2769 unsparsify the agnos casync images (#32126)
unsparse
old-commit-hash: 1788ecf7b1281e6b3d4325226860a513a0f6eab8
2024-04-08 12:25:33 -07:00
Justin Newberry
40d1e69efd add tool to create casync agnos updates from existing manifest (#32124)
* wip

* wip

* add agnos prefix

* add mkdir

* tool to create agnos updates
old-commit-hash: 44bb4eb521b3d0fcb00e9df5eb7c74741946ebe4
2024-04-08 11:34:05 -07:00
Justin Newberry
d3f41f84bb fix nightly casync build (#32111)
fix casync build
old-commit-hash: bbb31184ab869619944fbd4ad5667f8bc4ca6d3d
2024-04-05 14:11:38 -07:00
Justin Newberry
b33aef01b8 move casync release creation to use a tarball of files (#32089)
* tar archive instead

* fix

* move this here

* migrate these

* fix this

* update readme

* fix that

* try to build nightly

* Revert "try to build nightly"

This reverts commit 4ea680cb6a1f985c0490168724c99bcb45af9899.

* caexclude is no longer required

* finish up

* sorted

* need this

* and that

* context mnager

* path based
old-commit-hash: 69982d43cd61e9b085fbd19f1e3ac6c747a51793
2024-04-05 11:00:45 -07:00
Justin Newberry
1762d1d319 add system/updated to release (#31966)
* add updated

* all
old-commit-hash: 0cca1bb91a214ea2005d3e22b98df9714450770b
2024-03-21 17:21:36 -07:00
Justin Newberry
f2baf77e02 casync build: caidx filename is canonical representation of build (#31964)
* canonical

* short commit

* channel

* cleanup

* let's do 9 characters

* fixes

* set the build style during release creation

* as a property
old-commit-hash: 33f9193c94d3afb9120369e6557ddcd71133c5ee
2024-03-21 16:41:40 -07:00
Justin Newberry
ad3ae98a19 build nightly casync build in jenkins (#31880)
* casync in jenkins

* rename some stuff, add a readme

* slightly better names

* clean

* more cleanup

* cleaner

* release3 staging too

* always rm the signed version

* cleanups

* in build dir

* better name

* simpler

* more

* divider

* built

* build

* and contains

* add channel description

* and git branches

* and build required

* move this up

* these are terms

* updates

* 3/3x

* bullets

* wording

* version metadata

* git type

* more channel -> release

* more build

* just release

* more channel to release

* also fix jenkins

* use build_metadata

* fix normailzed

* also normalized

* and here

* use build_metadata

* dont commit that

* don't touch the git stuff

* branch

* don't need that

* or that

* improved names

* build_metadata

* use this instead

* fix

* build

* test nightly build again

* fix

* fixes

* Revert "test nightly build again"

This reverts commit be5e7aa7089bfc0947c9b2b484d0277c109ee089.
old-commit-hash: c3bbc58a85f515c834e6f4eb92c2d0ec45c9317e
2024-03-21 11:55:54 -07:00
Adeeb Shihadeh
dd1bdc9a09 won't need this
old-commit-hash: 4c424eb4b05836b379469d17aabd7cbef47edf2b
2024-03-18 22:13:47 -07:00
Adeeb Shihadeh
5733c516c3 move pigeond to system/ubloxd/ (#31848)
* move pigeond to system/ubloxd/

* update release

* more

* mv test
old-commit-hash: 147ccc7a582518e565755262e36799b540b5ddf7
2024-03-12 17:13:13 -07:00
Adeeb Shihadeh
b26565d793 remove RTC time pull (#31829)
* remove RTC time pull

* and syncing

* bump panda

* bump panda
old-commit-hash: 78d72d7dc390984496dd6633fd588bfd06ae1939
2024-03-11 18:23:10 -07:00
Adeeb Shihadeh
4399424e89 disable that one for now
old-commit-hash: 6a7a99805839a7e2012b55c2282d545ee21bdff4
2024-03-10 16:44:21 -07:00
Adeeb Shihadeh
777d37b619 much commit
old-commit-hash: 33d1b127c9e7a3d563014a13f174939be202238d
2024-03-08 13:18:55 -08:00
Robbe Derks
8a2766a86b Tesla Raven (#29947)
* fingerprinting

* wip

* bug

* fix another bug

* fix rebase

* clean up raven

* forgot to save

* one more rename

* one more rename

* radar fixes

* AP1 also has bosch radar

* put back dashcamOnly

* small fixes

* raven flag

* fix bug

* fix raven flag

* bump opendbc

* fix radar trigger for non-raven

* fix tests?

* bump panda

* more test fixes

* tesla fingerprinting is a bit slower now

* fix tests

* bump opendbc

* bump submodules to master

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 7177ec06312c574aeb21dd261004be44bda5ba29
2024-03-06 21:14:48 +01:00
Justin Newberry
2cdb550d12 updated -> move to selfdrive/updated/updated (#31696)
* move updated

* for release
old-commit-hash: be2b48183f81c09f7bc5d1e77d880ce40abacb20
2024-03-04 14:33:52 -08:00
Justin Newberry
88467a0669 move card to selfdrive/car/card (#31693)
* more obivous dif

* release
old-commit-hash: bc2407abeb68bce9c0fa94e3c7df1b1d0799e660
2024-03-04 10:45:32 -08:00
Justin Newberry
0f1f246bc0 scons: fix race condition with opendbc (#31621)
* fix race condition

* add to release

* fix for now

* bump
old-commit-hash: 7cf2b28b7883fdc3e68ad9e0974879103fa3a6ba
2024-02-28 11:41:42 -08:00
Justin Newberry
c57f5bfb1d add common/mock to release (#31596)
* add mock

* fix

* fix2
old-commit-hash: 86090a1e150f6d6df5283725ff1fb03605ecfef5
2024-02-26 11:20:51 -08:00
Justin Newberry
d11aac152e cars: introduce "Platform" union type for all car enums (#31558)
* Hmm

* release

* hmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm

* unrelated

* forgot

* cleaner

* Platform

* new syntax

* Fix

* clean

* Fix
old-commit-hash: e6009d80e9323f0cbb41f058164b63eef4a9c55c
2024-02-24 22:18:13 -08:00
Adeeb Shihadeh
a5de704798 add neural ff weights to release
old-commit-hash: 83fc734b8f6bbb75698fc575ddab1d63cb706067
2024-02-02 11:28:42 -08:00
Hoang Bui
4c05358aad map: Transfer to MapLibre (#31185)
* change codebase

* compile

* add mapboxprovider

* works with map_renderer in c

* remove maplibre temp

* maplibre works

* cleanup build.sh

* x86 stuff

* add lib

* update release files

* don't need that

* tici build

* tici build

* add tici lib

* update refs

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08037594e27292ca755a211628f4141469347f82
2024-02-01 13:37:22 -08:00
Adeeb Shihadeh
12d2d861f2 Revert "Switch from json11 to nlohmann/json (#31093)"
This reverts commit 8fa1e8aa53defca264272a66531d639b3d569418.

old-commit-hash: 88757c12b3371a1ba5b3ebabc9e85faad0a19d56
2024-01-22 22:41:59 -08:00
mtribiere
cb3a834067 Switch from json11 to nlohmann/json (#31093)
* Initial commit

* fix release/file_common

* Update common/swaglog.cc

* Swtiched serialize cc

* move to lfs

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: ee036482b8152f0e7650895c6f4bac5d4f00e00f
2024-01-22 22:35:47 -08:00
Adeeb Shihadeh
b8fbf60097 timed: always pull time and timezone from GPS (#31112)
* timed

* rm timezoned

* just gps

* ok

* little more

* fix

* datetime

* sleep a little

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 827aa2e4fad3334e594f8a259444f9461579fa2d
2024-01-22 18:35:11 -08:00
Harald Schäfer
66dbadb029 Delete lat planner (#31089)
* Initial commit

* Fixup

* typo

* ignore lateral plan

* Update cereal

* Remove lateralPlan

* Fix release build

* Fix release build

* give car params

* Add carParams to include_all_types

* Write car param in powerdraw test

* add demo mode

* Update model regf

* proc replay ref commit

* Try

* Move enum definition

* Update cereal

* typo

* Write car param for modeld test

* Update ref

* Update model ref again

---------

Co-authored-by: Kacper Rączy <gfw.kra@gmail.com>
old-commit-hash: e6c97c384671b448f307a7ed91416886f2186d80
2024-01-21 12:09:48 -08:00
Adeeb Shihadeh
972650f0eb remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
old-commit-hash: 7cd9568423a2e78187d16018b70a78f56c02027d
2024-01-19 14:05:03 -08:00
Adeeb Shihadeh
1d1514449c OS04C10 support (#30658)
* getting frames

* ok

* support both output

* cleanup

* fix unused

* undo

* fix release files

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: cd1d7eb4d2e590c56a570e6f45189eb10401401c
2024-01-09 14:19:10 -08:00
Justin Newberry
611e3fe8e7 add script to automatically format fingerprints file (#30792)
* Add script

* fix script

* fix script

* fix for subaddr

* run the script

* old style can fingerprints

* cleanup

* sort imports, make executable, fix path

* newline w/o newline

* match og can formatting

* match og formatting

* generate template once

* standard name

* less nested

* can fingerprints comments

* fix spacing

* no need for PLATFORM_TO_ENUM_NAME!

* prep for PRs

* comments for all, add honda comments

* Auto-generated fingerprint PR from fuzzy fingerprinting cars

* Revert "Auto-generated fingerprint PR from fuzzy fingerprinting cars"

This reverts commit 97bc9e3bdb9d819dcbe684ceba92ea702d40eaf0.

* even closer to original

* readd this comment

* and run script

* add to precommit

* add comments

* add comments

* add to release

* use for auto fingerprint

* disable precommit for now

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 3713e4d5eaed783738ea8ecdbd3b7e6abaa974c0
2023-12-20 11:18:29 -08:00
Adeeb Shihadeh
63b374bd89 Cython KF1D to Python (#30773)
* Cython KF1D to Python

* cleanup

* set x

* less nesting

* fix release

* Revert "fix release"

This reverts commit 97e5d0f80405660efb861c7b9df7fbfd5dda5dd9.
old-commit-hash: 1421551297396cf16e3d041506f156c1626ded50
2023-12-16 23:45:28 -08:00
Adeeb Shihadeh
887cd1855c common: remove statlog (#30774)
* common: remove statlog

* fix release
old-commit-hash: a07060b24bf9bc0963dad5fa94dc9881d6e3cc06
2023-12-16 23:33:55 -08:00
Adeeb Shihadeh
ab31860658 remove PyYAML package (#30770)
* remove PyYAML package

* remove those

* add comments back

* fix lock

* fix those
old-commit-hash: bc54ed794b2cd9dcb9522cdeb241ad78ac30d998
2023-12-16 20:48:57 -08:00
Adeeb Shihadeh
2526dcf30c remove Qt wrapper scripts (#30454)
* remove Qt wrapper scripts

* revert those
old-commit-hash: 3831bf19e47ed1ee09b2f4eb0341f8e879194880
2023-12-10 11:45:35 -08:00
Dean Lee
27284c4049 camerad: move sensor related code to /sensors (#30647)
old-commit-hash: ef262ff9eb5e52a58838479510947552a88ae3bd
2023-12-08 11:19:10 -08:00
Dean Lee
164644e6b4 camerad: split sensor_ic2.h (#30641)
* split sensor_ic2.h

* move start_reg,stop_reg
old-commit-hash: bdf868ddc276e2cf8a644376afe1a9634bdf06fe
2023-12-07 15:45:49 -08:00
Dean Lee
3c4d6de5d1 camerad: move AR0231 functions to camera_ar0231.cc (#30635)
* move AR0231 functions to camera_ar0231.cc

* move to sensors/aro231.cc
old-commit-hash: ecfe201a57431e5dc1e4def58519f6493d489bab
2023-12-07 11:48:17 -08:00
Adeeb Shihadeh
59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
Justin Newberry
12da944f1c jenkins: retry build_devel (#30628)
* will it work

* retry build devel

* correct p[ath

* try a failure

* Revert "try a failure"

This reverts commit ba4e6a0a2096b94887fcfbf7d011e34aa2a16c41.
old-commit-hash: 36bebb1aa064b4b40580aa48d35b21bd9ebe14c2
2023-12-06 17:22:32 -08:00
Justin Newberry
f945b8ebaa jenkins: remove pytest tici conf (#30621)
* remove pytest conf

* remove that too
old-commit-hash: 31ab43ce41d6d0f88cb8a9b6df8e79f23b6309fe
2023-12-06 11:13:22 -08:00
Justin Newberry
817161f3ac Soundd: move to python (#30567)
soundd python
old-commit-hash: abe39e50766c418818bf72d2567db78978dbd466
2023-12-05 18:10:01 -08:00
Kacper Rączy
d331250b7e webrtcd: endpoint for message schema retrieval vol. 2 (#30607)
* webrtcd: endpoint for message schema retrieval (#30578)

* Capnp json schema conversion

* Schema get endpoint

* Type annotation for generate_field

* Filter empty services

* Add schema.py to release
old-commit-hash: f46f00b373fac85a9b0c673feb4e809b57802216
2023-12-04 23:51:52 -08:00
Kacper Rączy
d062a97a26 webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
old-commit-hash: f058b5d64eed31878533a85f25eb53386ff9e330
2023-12-01 21:13:37 -08:00
Adeeb Shihadeh
5acd765c1e camerad cleanup (#30573)
* misc cleanup

* rm those

* rm utils

* fix build

* rm pool

* little more

* goodbye imgproc
old-commit-hash: e34ee43eeae000d080cb923b722afaf4c06fbc59
2023-12-01 20:10:07 -08:00
Kacper Rączy
9cd71f897a locationd: remove models unused in openpilot (#30481)
* Remove filters used exclusively by xx

* Update SConstruct

* Remove from release

* Accomodate rednose build changes

* Update rednose ref

* rednose/helpers in rpath

* Add rednose_filters to files_common

* Change rednose_root

* Copy rednose site_scons to docker images

* Remove rednose from rpath

* Bump rednose

* Bump rednose

* Bump rednose
old-commit-hash: f65e6bc30e7a3cce8b073f9ae0155facfe6c7646
2023-11-22 13:25:29 -08:00