openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system in 275+ supported cars.
Go to file
George Hotz 29cd51b876 modeld: Move from SNPE to tinygrad (#25207)
* compiling, won't work yet

* running with inputs and outputs

* there's some magic chance this works

* no more dlc, include onnx

* yolo tests plz

* bump tinygrad

* files_common + delete dlc

* tinygrad_repo -> tinygrad

* pre commit config

* llops needed

* extra in files_common

* bump tinygrad

* fix indent

* tinygrad/nn/__init__

* tinygrad_repo

* bump tinygrad repo

* bump tinygrad

* bump with native_exp, match maybe

* native_explog is argument

* pyopencl no cache

* 5% chance this matches

* work in float32?

* bump tinygrad

* fix build

* no __init__

* fix recip

* dumb hack

* adding thneed PC support

* fix pc segfault

* pc thneed is working

* to_image

* prints stuff with debug=2

* it sort of works

* copy host ptr is simpler

* bug fix

* build on c3

* this correct?

* reenable float16

* fix private, fixup copy_inputs internal

* bump tinygrad and update ref commit

* fix OPTWG on PC

* maybe fix non determinism

* revert model replay ref commit

* comments, init zeroed out buffers

* upd ref commit

* bump tinygrad to fix initial image

* try this ref

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 40d6f4b65c
2022-09-01 10:31:14 -07:00
.github pre-commit: add codespell (#25571) 2022-08-30 11:20:55 -07:00
body@04aeb30ce0 body: add fw repo as submodule (#25420) 2022-08-12 16:46:33 -07:00
cereal@d3a943ef66 USB power mode cleanup (#25619) 2022-08-31 21:13:53 -07:00
common modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
docs modeld: PC Thneed prereqs (#25615) 2022-08-30 17:57:14 -07:00
laika_repo@c8bc1fa01b Qcom use laika timestamp (#25344) 2022-08-02 15:53:55 -07:00
opendbc@8c634615c5 pre-commit: add codespell (#25571) 2022-08-30 11:20:55 -07:00
panda@13d64d4cc3 USB power mode cleanup (#25619) 2022-08-31 21:13:53 -07:00
pyextra longitudinal MPC: use reset() function instead of recreating the solver in (#24091) 2022-04-01 15:39:41 -07:00
rednose_repo@3b6bd703b7 Fix master-ci dirty working tree + CI test (#25087) 2022-07-08 13:00:43 -07:00
release modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
scripts Move selfdrive/hardware/ to system/ (#24725) 2022-06-11 16:38:24 -07:00
selfdrive modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
site_scons/site_tools Add scanner for Cython dependencies (#19722) 2021-01-11 14:36:30 +01:00
system USB power mode cleanup (#25619) 2022-08-31 21:13:53 -07:00
third_party multilanguage: compile QM in scons (#25217) 2022-07-20 18:44:47 -07:00
tinygrad_repo@2e9b7637b3 modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
tools add pyside2 package (#25602) 2022-08-30 15:10:52 -07:00
.clang-tidy setup clang tidy (#19533) 2021-01-05 12:50:23 -08:00
.dir-locals.el
.dockerignore sim: update CARLA to 0.9.12 (#22497) 2021-10-10 15:54:47 -07:00
.editorconfig
.gitattributes cleanup .gitattributes (#23503) 2022-01-12 23:07:06 -08:00
.gitignore modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
.gitmodules modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
.lfsconfig lfs: easier to use config (#23490) 2022-01-10 23:14:30 -08:00
.pre-commit-config.yaml modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
.pylintrc Move a bunch of stuff to system/ part 3 (#24829) 2022-06-11 23:19:27 -07:00
.python-version update to python 3.8.10 (#22551) 2021-10-13 21:36:10 -07:00
Dockerfile.openpilot misc jenkins fixups (#24840) 2022-06-12 18:00:00 -07:00
Dockerfile.openpilot_base CI: add SSH for pushing branches 2022-05-13 16:47:55 -07:00
Dockerfile.openpilot_base_cl Fix onnx model replay (#24702) 2022-06-03 10:43:09 -07:00
Jenkinsfile pigeond tests (#25630) 2022-08-31 23:12:26 -07:00
LICENSE
Pipfile add pyside2 package (#25602) 2022-08-30 15:10:52 -07:00
Pipfile.lock add pyside2 package (#25602) 2022-08-30 15:10:52 -07:00
README.md pre-commit: add codespell (#25571) 2022-08-30 11:20:55 -07:00
RELEASES.md pre-commit: add codespell (#25571) 2022-08-30 11:20:55 -07:00
SConstruct modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
SECURITY.md Create SECURITY.md 2022-08-13 23:28:44 -07:00
codecov.yml
laika
launch_chffrplus.sh Move selfdrive/hardware/ to system/ (#24725) 2022-06-11 16:38:24 -07:00
launch_env.sh AGNOS 5.2 (#25011) 2022-07-08 00:23:46 -07:00
launch_openpilot.sh
lgtm.yml phonelibs -> third_party (#22477) 2021-10-07 16:32:44 -07:00
mypy.ini enable numpy mypy typing (#24387) 2022-05-02 16:48:04 -07:00
rednose
tinygrad modeld: Move from SNPE to tinygrad (#25207) 2022-09-01 10:31:14 -07:00
update_requirements.sh add pyside2 package (#25602) 2022-08-30 15:10:52 -07:00

README.md

Table of Contents


What is openpilot?

openpilot is an open source driver assistance system. Currently, openpilot performs the functions of Adaptive Cruise Control (ACC), Automated Lane Centering (ALC), Forward Collision Warning (FCW), and Lane Departure Warning (LDW) for a growing variety of supported car makes, models, and model years. In addition, while openpilot is engaged, a camera-based Driver Monitoring (DM) feature alerts distracted and asleep drivers. See more about the vehicle integration and limitations.

Running on a dedicated device in a car

To use openpilot in a car, you need four things

  • A supported device to run this software: a comma three.
  • This software. The setup procedure of the comma three allows the user to enter a URL for custom software. The URL, openpilot.comma.ai will install the release version of openpilot. To install openpilot master, you can use installer.comma.ai/commaai/master, and replacing commaai with another GitHub username can install a fork.
  • One of the 200+ supported cars. We support Honda, Toyota, Hyundai, Nissan, Kia, Chrysler, Lexus, Acura, Audi, VW, and more. If your car is not supported but has adaptive cruise control and lane-keeping assist, it's likely able to run openpilot.
  • A car harness to connect to your car.

We have detailed instructions for how to mount the device in a car.

Running on PC

All openpilot services can run as usual on a PC without requiring special hardware or a car. You can also run openpilot on recorded or simulated data to develop or experiment with openpilot.

With openpilot's tools, you can plot logs, replay drives, and watch the full-res camera streams. See the tools README for more information.

You can also run openpilot in simulation with the CARLA simulator. This allows openpilot to drive around a virtual car on your Ubuntu machine. The whole setup should only take a few minutes but does require a decent GPU.

A PC running openpilot can also control your vehicle if it is connected to a webcam, a black panda, and a harness.

Community and Contributing

openpilot is developed by comma and by users like you. We welcome both pull requests and issues on GitHub. Bug fixes and new car ports are encouraged. Check out the contributing docs.

Documentation related to openpilot development can be found on docs.comma.ai. Information about running openpilot (e.g. FAQ, fingerprinting, troubleshooting, custom forks, community hardware) should go on the wiki.

You can add support for your car by following guides we have written for Brand and Model ports. Generally, a car with adaptive cruise control and lane keep assist is a good candidate. Join our Discord to discuss car ports: most car makes have a dedicated channel.

Want to get paid to work on openpilot? comma is hiring.

And follow us on Twitter.

User Data and comma Account

By default, openpilot uploads the driving data to our servers. You can also access your data through comma connect. We use your data to train better models and improve openpilot for everyone.

openpilot is open source software: the user is free to disable data collection if they wish to do so.

openpilot logs the road-facing cameras, CAN, GPS, IMU, magnetometer, thermal sensors, crashes, and operating system logs. The driver-facing camera is only logged if you explicitly opt-in in settings. The microphone is not recorded.

By using openpilot, you agree to our Privacy Policy. You understand that use of this software or its related services will generate certain types of user data, which may be logged and stored at the sole discretion of comma. By accepting this agreement, you grant an irrevocable, perpetual, worldwide right to comma for the use of this data.

Safety and Testing

  • openpilot observes ISO26262 guidelines, see SAFETY.md for more details.
  • openpilot has software-in-the-loop tests that run on every commit.
  • The code enforcing the safety model lives in panda and is written in C, see code rigor for more details.
  • panda has software-in-the-loop safety tests.
  • Internally, we have a hardware-in-the-loop Jenkins test suite that builds and unit tests the various processes.
  • panda has additional hardware-in-the-loop tests.
  • We run the latest openpilot in a testing closet containing 10 comma devices continuously replaying routes.

Directory Structure

.
├── cereal              # The messaging spec and libs used for all logs
├── common              # Library like functionality we've developed here
├── docs                # Documentation
├── opendbc             # Files showing how to interpret data from cars
├── panda               # Code used to communicate on CAN
├── third_party         # External libraries
├── pyextra             # Extra python packages
└── system              # Generic services
    ├── camerad         # Driver to capture images from the camera sensors
    ├── clocksd         # Broadcasts current time
    ├── hardware        # Hardware abstraction classes
    ├── logcatd         # systemd journal as a service
    └── proclogd        # Logs information from /proc
└── selfdrive           # Code needed to drive the car
    ├── assets          # Fonts, images, and sounds for UI
    ├── athena          # Allows communication with the app
    ├── boardd          # Daemon to talk to the board
    ├── car             # Car specific code to read states and control actuators
    ├── controls        # Planning and controls
    ├── debug           # Tools to help you debug and do car ports
    ├── locationd       # Precise localization and vehicle parameter estimation
    ├── loggerd         # Logger and uploader of car data
    ├── manager         # Daemon that starts/stops all other daemons as needed
    ├── modeld          # Driving and monitoring model runners
    ├── monitoring      # Daemon to determine driver attention
    ├── navd            # Turn-by-turn navigation
    ├── sensord         # IMU interface code
    ├── test            # Unit tests, system tests, and a car simulator
    └── ui              # The UI

Licensing

openpilot is released under the MIT license. Some parts of the software are released under other licenses as specified.

Any user of this software shall indemnify and hold harmless Comma.ai, Inc. and its directors, officers, employees, agents, stockholders, affiliates, subcontractors and customers from and against all allegations, claims, actions, suits, demands, damages, liabilities, obligations, losses, settlements, judgments, costs and expenses (including without limitation attorneys fees and costs) which arise out of, relate to or result from any use of this software by user.

THIS IS ALPHA QUALITY SOFTWARE FOR RESEARCH PURPOSES ONLY. THIS IS NOT A PRODUCT. YOU ARE RESPONSIBLE FOR COMPLYING WITH LOCAL LAWS AND REGULATIONS. NO WARRANTY EXPRESSED OR IMPLIED.


openpilot tests Total alerts Language grade: Python Language grade: C/C++ codecov