gm/tools/webcam
FrogAi 7705efaa34 Add openpilot tools 2024-03-02 22:34:41 -07:00
..
Dockerfile Add openpilot tools 2024-03-02 22:34:41 -07:00
README.md Add openpilot tools 2024-03-02 22:34:41 -07:00
front_mount_helper.py Add openpilot tools 2024-03-02 22:34:41 -07:00
warp_vis.py Add openpilot tools 2024-03-02 22:34:41 -07:00

README.md

NOTE: this README is outdated. #24590 tracks adding back webcam support

Run openpilot with webcam on PC

What's needed:

  • Ubuntu 20.04
  • GPU (recommended)
  • Two USB webcams, at least 720p and 78 degrees FOV (e.g. Logitech C920/C615)
  • Car harness with black panda to connect to your car
  • Panda paw or USB-A to USB-A cable to connect panda to your computer That's it!

Setup openpilot

cd ~
git clone https://github.com/commaai/openpilot.git
  • Follow this readme to install the requirements
  • Add line "export PYTHONPATH=$HOME/openpilot" to your ~/.bashrc
  • Install tensorflow 2.2 and nvidia drivers: nvidia-xxx/cuda10.0/cudnn7.6.5
  • Install OpenCL Driver
  • Install OpenCV4 (ignore the Python part)

Build openpilot for webcam

cd ~/openpilot
  • check out system/camerad/cameras/camera_webcam.cc lines 72 and 146 before building if any camera is upside down
USE_WEBCAM=1 scons -j$(nproc)

Connect the hardware

  • Connect the road facing camera first, then the driver facing camera
  • (default indexes are 1 and 2; can be modified in system/camerad/cameras/camera_webcam.cc)
  • Connect your computer to panda

GO

cd ~/openpilot/selfdrive/manager
NOSENSOR=1 USE_WEBCAM=1 ./manager.py
  • Start the car, then the UI should show the road webcam's view
  • Adjust and secure the webcams (you can run tools/webcam/front_mount_helper.py to help mount the driver camera)
  • Finish calibration and engage!