mawei
/
openpilot0
mirror of https://github.com/commaai/openpilot.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
openpilot0/selfdrive/loggerd
History
Robbe Derks 323febbf37 Statsd (#23413) 
* device side of statsd

* need to start it

* enable in manager

* add sleep

* cleanup

* remove aggregates for now and standardize on industry terms

* manager needs main

* need to have a try/except

* atomic_write_on_fs_tmp does not work

* cleaner

* use dump

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* one file at a time

* limit amount of files

* move to influx line protocol and cleanup

* needs to be a list

* fix timezone bug

* actually rate limit

* add to release

* normalized origin

* also log deviceType

* more stats

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1b49ce6ec4
 		2022-01-10 15:21:48 +01:00
..
include
…
tests Pyupgrade 3.6: Update syntax with Python 3.6+ features (#23305) 2021-12-24 11:18:39 -08:00
tools Convert format strings strings to f-strings (#23241) 2021-12-16 14:58:17 +01:00
.gitignore LoggerState: test cases (#21855) 2021-08-30 17:12:09 -07:00
README.md small typo 2021-09-24 10:23:41 +02:00
SConscript loggerd: add test case for sync_encoders (#23020) 2021-11-24 13:34:16 -08:00
__init__.py
…
bootlog.cc put logcat in bootlog (#23217) 2021-12-14 11:54:54 -08:00
config.py Statsd (#23413) 2022-01-10 15:21:48 +01:00
deleter.py Convert format strings strings to f-strings (#23241) 2021-12-16 14:58:17 +01:00
encoder.h
…
logger.cc Clear loggerd locks once on boot (#23060) 2021-11-29 12:30:28 +01:00
logger.h Clear loggerd locks once on boot (#23060) 2021-11-29 12:30:28 +01:00
loggerd.cc Use std::unique_ptr to manage memory (#23168) 2021-12-13 14:16:53 +01:00
loggerd.h Use std::unique_ptr to manage memory (#23168) 2021-12-13 14:16:53 +01:00
main.cc util: move all functions into util namespace (#23203) 2021-12-12 14:42:23 -08:00
omx_encoder.cc wshadow: fix comma three build 2021-11-02 17:27:34 +01:00
omx_encoder.h loggerd: always run encoders (#22649) 2021-10-21 16:37:03 -07:00
raw_logger.cc RawLogger: fix wrong pts (#23205) 2021-12-13 11:46:52 +01:00
raw_logger.h loggerd: always run encoders (#22649) 2021-10-21 16:37:03 -07:00
uploader.py Convert format strings strings to f-strings (#23241) 2021-12-16 14:58:17 +01:00
xattr_cache.py
…

README.md

loggerd

openpilot records routes in one minute chunks called segments. A route starts on the rising edge of ignition and ends on the falling edge.

Check out our python library for reading openpilot logs. Also checkout our tools to replay and view your data. These are the same tools we use to debug and develop openpilot.

log types

For each segment, openpilot records the following log types:

rlog.bz2

rlogs contain all the messages passed amongst openpilot's processes. See cereal/services.py for a list of all the logged services. They're a bzip2 archive of the serialized capnproto messages.

{f,e,d}camera.hevc

Each camera stream is H.265 encoded and written to its respective file.

  • fcamera.hevc is the road camera
  • ecamera.hevc is the wide road camera
  • dcamera.hevc is the driver camera

qlog.bz2 & qcamera.ts

qlogs are a decimated subset of the rlogs. Check out cereal/services.py for the decimation.

qcameras are H.264 encoded, lower res versions of the fcamera.hevc. The video shown in comma connect is from the qcameras.

qlogs and qcameras are designed to be small enough to upload instantly on slow internet and store forever, yet useful enough for most analysis and debugging.