Commit Graph

207 Commits

Author SHA1 Message Date
Adeeb Shihadeh
5b331fd6f5 don't set core affinity on PC (#22706) 2021-10-26 21:51:46 -07:00
Willem Melching
89f311714c loggerd: set encodeIdx.valid if frame id is correct (#22634)
* loggerd: set encodeIdx.valid if frame id is correct

* check valid flag in test

* test cleanup

* bump cereal
2021-10-26 16:00:43 +02:00
Adeeb Shihadeh
76bd932cf5 loggerd: always run encoders (#22649)
* loggerd: always run encoders

* fix raw logger

* bump loggerd cpu usage
2021-10-21 16:37:03 -07:00
Adeeb Shihadeh
84de248fa7 tici: affine loggerd to efficiency cores (#22581) 2021-10-18 13:21:24 -07:00
Dean Lee
d28b98c602 replay : move utility functions into separate file (#22414)
* move functions into util

* read bz2 into stream

* pre-decompress log in the download thread

* cleanup logreader

* cache sha256 path

* use readBZ2file in test_logger

* Revert "cache sha256 path"

This reverts commit 60459d3ea09a2c80f4560cf95b1ce7d6af59f06d.

* use macro

* use ostringstream

* cleanup readBZ2File

* move precise_nano_sleep into util
2021-10-04 15:39:59 +02:00
Robbe Derks
3ccf712ac9 small typo 2021-09-24 10:23:41 +02:00
Adeeb Shihadeh
0f8c6f130b add log docs 2021-09-23 14:41:35 -07:00
ntegan1
54b5972cf6 Upload when on ethernet (#22188)
in addition to when on wifi

Co-authored-by: ntegan <nick@egan.gg>
2021-09-10 12:05:12 -07:00
Willem Melching
377fe84948 remove loggerd todo about encodeIdx decimation 2021-09-08 12:16:16 -07:00
Dean Lee
8bca70878f loggerd: remove obsolete ethernetsniffer.py (#22139) 2021-09-06 12:11:19 -07:00
Dean Lee
5a8ca8b449 loggerd: remove obsolete testraw.cc (#22138) 2021-09-06 12:10:12 -07:00
Willem Melching
48035e9535 Disable encoder sync logic if only one rotate camera present (#22107)
* disable sync logic if only one rotate camera

* consistent brackets
2021-09-01 23:08:06 -07:00
Willem Melching
a93271a518 Ensure that first segment starts with all cameras on the same frameId (#22096)
* test that segment starts with the same frame id

* improve test

* add sync logic

* atomic max

* review comments
2021-09-01 14:28:50 -07:00
Dean Lee
f02c8d0e2c Handle EINTR for all syscalls that can return it (#21948) 2021-08-31 16:22:56 -07:00
Dean Lee
d9baaf7eb9 loggerd: create encoder threads from cameras_logged (#21875) 2021-08-30 19:33:00 -07:00
Dean Lee
935cbd3139 LoggerState: test cases (#21855)
* test multiple threads writing to log

* fix typo

* use util::getenv

* check INIT_DATA and SENTINEL

* test END_OF_SEGMENT

* add comment

* test multiple threads logging and rotation

* cleanup

* update

* LoggerHandle:quick fix

* cleanup

* revert test_loggerd.py

* refactor test case

* check lock file

* check refcnt after close

* test_runner.cc

d

* int eixt_signal
2021-08-30 17:12:09 -07:00
Willem Melching
dddab597bc Less open file permissions (#21922)
* Less open file permissions

* add test back

* remove params test for permissions

* remove umask

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-08-28 18:25:05 -07:00
Adeeb Shihadeh
54a4eeb0fc Revert "tici: give loggerd rt priority (#21503)"
This reverts commit 7e2752c878.
2021-08-22 16:57:53 -07:00
Adeeb Shihadeh
7e2752c878 tici: give loggerd rt priority (#21503)
* give loggerd rt priority

* assert

* little more

Co-authored-by: Comma Device <device@comma.ai>
2021-08-20 21:27:31 -07:00
Dean Lee
c6a34dd9f7 capnp:Text::Reader: use implicit conversion from string (#21980) 2021-08-19 13:49:08 -07:00
Dean Lee
b66e8adbef BZFile: handle EINTR on BZ2_bzWrite (#21949) 2021-08-18 12:08:07 +02:00
Dean Lee
4625098a79 enclose macro arguments in parentheses (#21947)
* macro argument should be enclosed in parentheses

* CL_CHECK
2021-08-18 10:56:37 +02:00
Adeeb Shihadeh
1d4b19f739 use same env variable for loggerd, deleter, and uploader 2021-08-07 18:58:11 -07:00
Willem Melching
a39873872d refactor loggerd: trigger rotate in encoder thread (#21860)
* trigger rotate in eoncode thread

* rotate in time

* lgtm

* dcam trigger rotate on C3

* check trigger rotate field

* Use >=

* add rotator thread

* set cnt to 0

* test encodeIdx is increasing across segments

* test both segmentId and encodeId

* fix encodeIdx

* no thread needed

* add log for failed to encode

* stricter C3 test, dont check start encodeId on C2 dcam

* only update last_camera_seen_tms when considered for rotate

Co-authored-by: deanlee <deanlee3@gmail.com>
2021-08-06 11:10:33 +02:00
Dean Lee
fefc70b4ca hw.h: move Hardware-related paths to namespace Path (#21826)
* refactor getenv and path

* apply review
2021-08-04 13:29:03 +02:00
George Hotz
8354cfc53c loggerd: implement DONT_LOG flag (#21832)
* implement DONT_LOG flag

* better typing
2021-08-02 20:16:38 -07:00
Adeeb Shihadeh
d748b44f48 fix loggerd test failure when camerad is slow to start 2021-08-02 09:10:29 -07:00
Dean Lee
fecdf16f6b logger.cc/logger_build_init_data(): reuse params_map (#21811)
* faster log params

* Update selfdrive/loggerd/logger.cc

* fix build

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-08-02 11:21:12 +02:00
Dean Lee
11ffbc6936 util/read_files_in_dir: return map by value (#21815) 2021-08-02 10:59:54 +02:00
Adeeb Shihadeh
48652db706 debug msg for loggerd tests 2021-07-28 14:01:27 -07:00
Adeeb Shihadeh
6b69032807 publish uploader state (#21580)
* uploader state

* add time

* bump

* populate whole packet

* bump cereal

* revert

Co-authored-by: Comma Device <device@comma.ai>
2021-07-13 17:18:10 -07:00
Willem Melching
dd128f5916 loggerd: power failure print sync done 2021-07-12 12:28:07 +02:00
Adeeb Shihadeh
d8411e7a62 fix qlog decimation calculation in loggerd tests 2021-07-10 23:20:15 -07:00
Greg Hogan
d066b8f7e8 upload can only create (#21513) 2021-07-07 18:28:06 -07:00
Adeeb Shihadeh
0bfd994f73 fast jenkins (#21472)
* speed up setup

* speedup onroad test

* .git doesn't like inplace

* tici2

* no inplace

* revert

* fix

* that one too
2021-07-02 16:29:57 -07:00
Adeeb Shihadeh
4a1aec27ef segment regen (#21148)
* start seg regen

* send vipc

* fix up some paths

* set fp

* fix no entries

* engages

* seperate camera procs

* send real frames

* regen test routes

* nice argparser

* fix valgrind test

* move that

* fix that
2021-06-28 21:44:40 -07:00
Dean Lee
e4e669bb0f add space after function name and if statement (#21225) 2021-06-11 10:17:52 +02:00
Dean Lee
c53cb5d570 Use C++ header files instead of C header files. (#21192)
* use cstring instead of string.h

* use cstdio instead of stdio.h

* remove inttypes.h

* use cstdlib instead of stdlib.h

* use cstdint instead of stdint.h

* #include <cstddef>

* cstdlib

* use cmath

* remove stddef.h

* use cassert

* use csignal

* use ctime

* use cerror

* rebase master
2021-06-08 13:46:22 -07:00
Adeeb Shihadeh
c76c30fa2d disable uploading raw by default (#21128) 2021-06-03 15:24:30 -07:00
Willem Melching
129c760e4f deleter.py: delete boot and crash folders last (#21028) 2021-06-01 14:08:08 -07:00
Dean Lee
65e0b1e699 Cleanup util.h (#20849)
* cleanup util.h

* fix build error:omx_encoder.cc:408: undefined reference to do_exit

* fix build error

* rebase master

* move helper functions back to util

* ExitHandleHelper->ExitHandlerHelper

* std::clamp

* struct ExitHandlerHelper to class

* rebase master

* cleanup

* restore ExitHandler

* prefer cassert
2021-06-01 16:53:12 +02:00
Willem Melching
6e22f16ddb loggerd: put signal in end of route sentinel (#21025) 2021-05-25 17:34:40 +02:00
Adeeb Shihadeh
ec976b3b44 log OS version in initData (#20979) 2021-05-20 13:00:34 -07:00
Dean Lee
0495426535 Cleanup includes (#20925)
* remove #include <pthread.h>

* remove #include<stdbool.h> for cc files

* remove #include<iostream>
2021-05-17 10:31:31 +02:00
Adeeb Shihadeh
2bc9b97aba bootlog: setup cloudlog on keywords (#20898)
* bootlog: setup cloudlog on keywords

* just log
2021-05-13 23:02:08 -07:00
Willem Melching
4742f55749 store all files in /sys/fs/pstore in bootlog (#20875)
* store all files in /sys/fs/pstore in bootlog

* whitespace

* fix bootlog test
2021-05-12 11:15:54 +02:00
Dean Lee
7222d0f20d Cleanup selfdrive/ includes (#20822)
* cleanup include path

* continue

* format includes

* fix testraw.cc

* remove include path from SConstruct

* regroup

* rebase master

* almost done

* apply review

* rename FileReader.xx to filereader.xx

* rename Unlogger.x->unlogger.x

* rename FrameReader.xx -> framereader.xx

* apply reviews

* ui.h

* continue

* fix framebuffer.cc build error:mv util.h up

* full path to msm_media_info

* fix qcom2 camerad

Co-authored-by: Comma Device <device@comma.ai>
2021-05-08 22:15:17 -07:00
Willem Melching
ab319d4f54 Replace ifdef with hw abstraction layer (#20843)
* Replace ifdefs with hardware abstraction layer (#20801)

* add type to class hadwareXXX

* replace ifdefs with hardware layer

* continue

* continue

* new function get_driver_view_transform

* full path to hw.h

* fix build error setup.cc

* apply review

* fix typo

* fix deprecated error:replace deprecated fromPath with new

* fix build error

* Fixes after ifdef clenaup (#20842)

* inheritance doesnt work with static

* fix debayer

* small cleanup

* Update selfdrive/camerad/cameras/camera_common.cc

* Update selfdrive/ui/qt/offroad/settings.cc

* Update selfdrive/common/modeldata.h

* flip conditions

* fix comment

Co-authored-by: Dean Lee <deanlee3@gmail.com>
2021-05-06 14:39:05 +02:00
Willem Melching
3a95d3ccaa Revert "Replace ifdefs with hardware abstraction layer (#20801)"
This reverts commit 757d2923d2.
2021-05-06 12:29:30 +02:00
Dean Lee
757d2923d2 Replace ifdefs with hardware abstraction layer (#20801)
* add type to class hadwareXXX

* replace ifdefs with hardware layer

* continue

* continue

* new function get_driver_view_transform

* full path to hw.h

* fix build error setup.cc

* apply review

* fix typo

* fix deprecated error:replace deprecated fromPath with new

* fix build error
2021-05-06 11:41:46 +02:00