Commit Graph

88 Commits

Author SHA1 Message Date
Jeroen
75a30612b0 Updated CARLA to v0.9.13 (#24575)
* Updated CARLA to v0.9.13

* pipenv lock

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 1c29b20e72
2022-06-12 09:32:18 -07:00
Adeeb Shihadeh
6f249733e1 add PyQt (#24811)
old-commit-hash: aeb2c67c90
2022-06-10 15:39:18 -07:00
Adeeb Shihadeh
00f7f96308 little tools fix ups (#24629)
old-commit-hash: b8a32bbc46
2022-05-23 16:10:36 -07:00
YassineYousfi
20f0e865d6 hatanaka 2.4 (#24508)
* hatanaka 2.4

* wrong hashes
old-commit-hash: 7ad44b7d53
2022-05-12 13:28:04 -07:00
Willem Melching
d98cd3a9e7 Pipfile: remove carla for MacOS installs (#24502)
* no carla for mac

* lock
old-commit-hash: fab611c2ce
2022-05-12 12:43:20 +02:00
Adeeb Shihadeh
78a577d6af update python packages (#24478)
old-commit-hash: b8dad70f70
2022-05-09 15:44:02 -07:00
Gijs Koning
c082f26d63 Laikad: the basics for ublox msg processing (#24359)
* Add laikad that receives ublox messages and publishes corrected measurements and position fix

* types

* cleanup

* laikad version 1 with uncorrected measurements

* push

* Fix glonass frequency and delete redundant test

* Update after cereal and cleanup

* Add test, fix laikad and remove process replay for now

* update laika

* add hatanaka to packages. Used to decompress orbit data

* Fix pip
old-commit-hash: b64fe6e339
2022-05-06 04:41:14 -07:00
Shane Smiskol
3960317d60 Add azure-storage-blob to dev packages (#24426)
* add azure-storage-blob

* same
old-commit-hash: e3fd6a7c50
2022-05-04 15:00:47 -07:00
Gijs Koning
7b4b8d3f58 Carla pip dependency and fix for git init (#24258)
* Add carla pip dependency for dev

* Revert other packages in pipfile

* Remove redundant carla install in docker

* Fix CI
Remove broken openpilot_build

* New run command
old-commit-hash: e95a250bca
2022-04-20 05:23:27 -07:00
Adeeb Shihadeh
60c3bb2da3 add mpld3 python pacakge (#24138)
* add mpld3 python pacakge

* move to dev

* fix for new pylint
old-commit-hash: 6013d733a3
2022-04-05 15:00:35 -07:00
Shane Smiskol
0910ad09f9 CARS.md: sort cars in lowercase (#24086)
* sort cars in lowercase

* nicer name

* skoda deserves better

* lock
old-commit-hash: 9d44f790b3
2022-04-01 15:43:54 -07:00
Adeeb Shihadeh
fe6f6ef4ff update python packages (#23864)
old-commit-hash: 8344f3c087
2022-02-25 14:34:46 -08:00
Andrew
192978753d mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
old-commit-hash: 6664421710
2022-01-07 15:15:18 -08:00
Andrew
830b8692c0 docs: setup docs for C code (#23262)
* add breathe and doxygen

* add sphinx-breathe c docs generation
* add c docs to site

* built in docker

* build base image first

* namespace cleanup

* Revert "build base image first"

This reverts commit 4c44c02ffb93b3f0bc3968f2ee1fdc64faa25608.

* its in the dockerfile

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 9f70bea964
2022-01-04 17:26:07 +01:00
Adeeb Shihadeh
5e490d86c3 CI: run car unit tests in parallel (#23379)
* CI: run car unit tests in parallel

* move that
old-commit-hash: cd42be7777
2022-01-03 16:30:14 -08:00
Andrew
06c80e264c docs.comma.ai add sitemap and robots.txt (#23259)
* add sitemap generator

* update conf for seo

* remove cmake var

* relock

* fix html_baseurl

* more fixes

* newline

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: c95202bd1c
2021-12-28 18:07:32 +01:00
jimw
ce83b94fa6 PC: fix onnxruntime excessive CPU (#23051)
* onnxruntime-gpu two threads

* relock pipfile

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: db9ea45cd5
2021-12-06 16:51:45 +01:00
jimw
cf29eacca4 CARLA: send YUV and RGB over visionipc from bridge.py (#23012)
* CARLA: send YUV and RGB over visionipc

* CARLA: send YUV and RGB over visionipc-fix pipfile

* CARLA: send YUV and RGB over visionipc-Camerad class

* relock pipfile

* small bridge cleanup

* use tici camera resolution

* update vof

* HUD_SETTING has no counter

* no loggerd

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: a58d272ae4
2021-11-26 16:58:25 +01:00
Willem Melching
fd3140fd6f cleanup unused pip packages (#22947)
* cleanup unused pip packages

* fix linter
old-commit-hash: f1c77f97b9
2021-11-17 16:23:03 +01:00
Jason Young
d422f39d19 Fix pygame and knack dependencies (#22818)
* fix pygame and knack

* lock again

* latest pygame, headless opencv

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 739bd37003
2021-11-08 19:21:24 +01:00
Mayfield
72c892e014 ui: render markdown in release notes (#22754)
* convert release notes from markdown to html

* fall back to previous behavior if utf8 decoding or markdown parsing throws

* make simple markdown parser to avoid needing a library

* add unit test

* move markdown parser to common. add unit test

use `markdown-it-py` instead of `markdown` dependency for test comparison since it's already in Pipfile.lock

* test (almost) all release notes and add some extra html encoding

* update lock

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1aebe6ff6e
2021-11-04 16:12:39 +01:00
Willem Melching
9e64a5a70f docker: update pip/pipenv versiosn (#22793)
old-commit-hash: 3f8991a261
2021-11-04 15:40:36 +01:00
Willem Melching
0cdb1d5bab Add sphinx dependencies to Pipfile (#22720)
old-commit-hash: aa8952d0b1
2021-10-28 17:32:29 +02:00
Willem Melching
cd7c85ec6d remove cysignals from pipfile (#22630)
old-commit-hash: cf42e71c16
2021-10-20 12:26:12 +02:00
Adeeb Shihadeh
16736a0186 update pre-commit version (#22560)
old-commit-hash: ad32a2d27b
2021-10-14 14:02:48 -07:00
Willem Melching
ef3020eb3b add jupyterlab to dev packages (#22453)
* add jupyterlab to dev packages

* add prebuilt vim extension
old-commit-hash: 227e12a477
2021-10-06 17:23:29 +02:00
Willem Melching
8aa225b3f9 move acados deps out of devpackages (#22376)
* move acados deps out of devpackages

* fix new pylint errors
old-commit-hash: a60f3c6a35
2021-09-29 23:20:33 +02:00
Adeeb Shihadeh
333d07563e update pycapnp to v1.1.0 (#21371)
old-commit-hash: 42f9d1b46f
2021-06-22 14:57:13 -07:00
Adeeb Shihadeh
03405b81fd acados support (#21319)
* acados support

* add pyextra to python path

* x86 libs
old-commit-hash: 6e4c2aa4d2
2021-06-17 16:40:00 -07:00
Adeeb Shihadeh
801db6f615 add inputs package to Pipfile (#21122)
old-commit-hash: 73ea28f7ef
2021-06-03 14:57:56 -07:00
Willem Melching
b3838fb91e hypothesis fuzz testing (#20818)
* add hypothesis testing

* cleanup

* some cleanup

* check for infinity too

* one-liner

* add more fields that are used

* no print

* add locationd testing

* sensor timestamp is signed

* recursive finite checking

* keep locationd inputs finite for now

* specify proces name on command line

* increase timeout and add raw speed

* abstract runner in function

* add unittest class
old-commit-hash: 33edb62967
2021-05-05 13:25:29 +02:00
Willem Melching
305043def8 remove raven from pip packages
old-commit-hash: 7dcda0e461
2021-04-22 15:29:43 +02:00
robbederks
5cd4a9ba36 Zookeeper support (#20000)
* zookeeper lib

* add ft4222 to dev pip packages and fix include error

* started on CI

* it's a file

* now it should be happy

* use docker for all on-device tests

* test scripts

* does this work?

* access to devices

* too broad. only usb enough?

* permissions for zookeeper usb

* as env var maybe?

* this?

* try this for now

* all devices

* move to correct location for impoerts

* right paths

* not running in the right agent?

* ofc not

* fix broken merge

* add ft4222 package again

* add timeout

* power monitor

* cleanup

Co-authored-by: Batman <batman@openpilot-ci.internal>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 6a824d7651
2021-04-13 15:08:00 -07:00
Greg Hogan
183d9f98a1 log to file and send through athena (#20250)
* log to file and send through athena

* rename logging level

* pass thru log formatter

* logMessage is TEXT

* send queue always strings

* switch to xattr and lower priority queue

* enable cloud logging for devices

* time or size based log rotation

* basename -> dirname

* remove HARDWARE.get_cloudlog_enabled

* fix errors

* fix another exception

* xattrs need to be bytes

* sending works

* cleanup files at start

* add id and adjust formatting

* do not send active log file

* better names

* separate log formatters

* fix formatter super init

* fix log file order

* ensure file always has file formatter

* i see why there was no formatter

* apply same formatting to cpp log msgs

* apply same formatting to cpp log msgs

* update queue names in tests

* strip deprecated keys in STATUS_PACKET

* strip DEPRECATED from dict recursively

* athena log queue test

* instanceof instead of type

* isinstance instead of type

* use super

* remove logentries

* last_scan param unused

* comment about special log msg attr names

* add dict_helpers.py to release files

* use monotonic time and counter for log rotation

* update for adjusted log file naming

* use monotonic clock for tracking last log file scan
old-commit-hash: 3d48bd934d
2021-03-25 13:30:09 -07:00
Adeeb Shihadeh
c4aa4ef5c7 bump pycapnp version (#20326)
* bump pycapnp version

* bump cereal
old-commit-hash: 20e6f6bd79
2021-03-11 20:18:38 -08:00
Adeeb Shihadeh
bc7a57cbd6 add new sentry client package (#20178)
old-commit-hash: 3e70395e82
2021-02-26 22:03:19 -08:00
Greg Hogan
8ab54a4be7 remove some pip packages
old-commit-hash: 5fbfaaef52
2021-02-23 11:38:05 -08:00
Greg Hogan
501dc3e2ae eliminate python-logstash-async
old-commit-hash: a796294474
2021-02-20 10:16:46 -08:00
Willem Melching
17d5446650 Timezoned (#19960)
* untested code

* add to manager

* whitespace

* only save on fix

* cleanup

* fix typo

* add to ignored processes

* import tici

* fix param name

* cleanup

* only run offroad

* use itertools

* wait for thermald

* simpler

* fall back to api call

* add param to override timezone

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 4c04e220a1
2021-02-06 11:07:37 +01:00
George Hotz
3b1d87e506 pyopencl pipenv
old-commit-hash: bd9388c933
2021-01-08 10:47:19 -08:00
George Hotz
5322863366 smp_pipenv (#19687)
old-commit-hash: cc4c34cc0b
2021-01-07 08:52:51 -08:00
George Hotz
65d1793bff Revert "add two dev packages for training"
This reverts commit 5d3dc7c4ecc69e593efa5a32a2e06708ad814cf4.

old-commit-hash: bbe868d312
2020-12-09 21:48:38 -08:00
George Hotz
2c106a1a9a add two dev packages for training
old-commit-hash: 3da368247a
2020-12-09 11:07:18 -08:00
George Hotz
9789e816c1 add onnx and bump versions in Pipfile.lock
old-commit-hash: 2df0f9ffb1
2020-11-14 17:20:20 -08:00
HaraldSchafer
008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0e
2020-11-11 20:31:46 -08:00
Greg Hogan
8b208a580d Revert "pytorch cuda 11.0 (#2496)" (didn't work!)
This reverts commit f1c6ef23219228ff283778c1d0b43011ced2bfb6.

old-commit-hash: 789a94932b
2020-11-06 19:38:23 -08:00
Greg Hogan
01e7e4ef04 pytorch cuda 11.0 (#2496)
old-commit-hash: 14c6de9094
2020-11-06 19:02:25 -08:00
George Hotz
afa6b535dc pin blosc (#2492)
old-commit-hash: e63f434d5c
2020-11-05 21:06:08 -08:00
Greg Hogan
d9185fd436 add blosc to pipfile (#2464)
old-commit-hash: 06f63d37fa
2020-10-31 08:19:54 -07:00
Adeeb Shihadeh
2e5247056a ubuntu 16.04 -> 20.04 (#2378)
old-commit-hash: 719c5e3598
2020-10-29 16:51:09 -07:00