mawei/sunnypilot
1
0
Fork 0
mirror of https://github.com/sunnypilot/sunnypilot.git synced 2026-02-19 20:33:53 +08:00
Code Issues Packages Projects Releases Wiki Activity
12,859 Commits 186 Branches 165 Tags
75b07c042f09f39275452df84c5dfd46e2f4e7f0
Commit Graph

68 Commits

Author SHA1 Message Date
Shane Smiskol
3e41b1b287 LogReader: show total segment count in missing rlog prompt 2024-07-01 22:43:48 -07:00
StefanLekanic-SYRMIA
504dd4543d LogReader: print number of missing rlogs (#32830) 
* count rlogs

* minimization changes

* cache to avoid duplicate checks

* no real point in checking qlogs to just show the warning

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
 2024-06-26 22:15:13 -07:00
Shane Smiskol
b45caf4033 LogReader: try zst on internal source (#32751) 
* internal source list files like azure api

* messy but works

* no limit

* simpler

* clean up

* clean up

* clean up

* that's obvious

* better

* we need to unfortunately return a url, so best to take a naive approach for now

* todo

* fix

* clean up
 2024-06-14 01:12:19 -07:00
Shane Smiskol
68e22faa29 LogReader: revert broken check 
it returns files OR None
 2024-06-14 00:30:14 -07:00
Shane Smiskol
d5ce4b3085 SegmentRange: remove timestamp (#32750) 
* add deprecation warning

* remove timestamp

* Update logreader.py
 2024-06-13 23:19:32 -07:00
Shane Smiskol
3ede1e2a7c LogReader: improve error messages (#32747) 
* better error messages

* clean up
 2024-06-13 22:37:00 -07:00
Shane Smiskol
04a93dd849 add zstd Python library (#32731) 
* add zstd

* fix

* uploader

* logreader: zst support

* caps

* only logreader
 2024-06-12 21:14:23 -07:00
Dean Lee
c64bca97ba logreader.py: optimize event loading and sorting in _LogFileReader (#32729) 
* improve logfilereader

* less changes
 2024-06-12 14:20:06 -07:00
Justin Newberry
a819292073 logreader: fix auto source + interactive modes (#31847) 
* interactive modes

* these exceptions don't matter
 2024-03-12 20:04:17 -07:00
Shane Smiskol
e964c5944d LogReader: fix sort by time and union types (#31565) 
* fix :(

* test_sort_by_time

* this isn't required

* not slow, and just compare sorted

* messy

* works

* clean up

* clean up

* not here

* clean up

* clean up

* clean up

* makes network call

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
 2024-03-08 02:49:24 -08:00
Cameron Clough
995250ae49 use pyupgrade to update to new typing syntax (#31580) 
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
 2024-02-24 16:41:23 -08:00
Justin Newberry
16d1339553 test_logreader: test internal scenarios (#31484) 
* test source scenario

* test source scenario

* fix
 2024-02-15 12:10:56 -08:00
Justin Newberry
8aee0d2af2 test_logreader: test interactive mode + fix typo in AUTO_INTERACTIVE (#31481) 
* fix spelling

* test interactive

* remove that

* test taht

* move that
 2024-02-15 11:24:27 -08:00
Justin Newberry
33cf6bda9e LogReader: add typing hints (#31464) 
logreader typing
 2024-02-14 10:34:17 -08:00
Justin Newberry
1436f576df LogReader: retain old behavior for direct parsing of files (#31419) 
* maintain exception

* test that head is not called

* annoying mock

* test with cache
 2024-02-14 10:05:25 -08:00
Shane Smiskol
8fe9bc7a69 SegmentRange: simplify slice (#31455) 
* simplify slicing

* rm
 2024-02-14 04:17:03 -08:00
Shane Smiskol
0846175f44 tools/lib: format code (#31454) 
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
 2024-02-14 01:56:17 -08:00
Justin Newberry
d6762c3035 live_logreader to its own file (#31436) 
own file
 2024-02-13 13:29:52 -08:00
Justin Newberry
0a92c5bf96 LogReader: live_logreader helpers (#31416) 
live helper
 2024-02-12 12:58:25 -08:00
Greg Hogan
667693b8c2 logreader: skip internal source if not available (#31400) 
* logreader: skip internal source if not available

* raise exception

* but only when appropriate
 2024-02-10 00:20:43 -08:00
Justin Newberry
6010a39bf8 LogReader: skip file_exists check for comma_api (#31251) 
* valid file

* missed this one
 2024-01-31 16:43:58 -08:00
Justin Newberry
c782fbc34e LogReader: add ``.filter`` (#31222) 
add filter
 2024-01-29 17:33:47 -08:00
Justin Newberry
7835f9cce0 LogReader: add tqdm back to run_across_segments (#31216) 
tqdm
 2024-01-29 13:18:49 -08:00
Justin Newberry
824ddffec8 CommaCarSegments: BIG Database! (#31169) 
* sanetized selector

* god damn

* add to re

* slog branch

* slog

* source

* big

* not slog

* cleanup

* no space

* works!

* trigger

* main!
 2024-01-27 01:07:29 -08:00
Justin Newberry
edd2428b60 LogReader: fail-fast on invalid segments (#31152) 
* don't check all

* is
 2024-01-25 11:09:09 -08:00
Justin Newberry
dd0c474e6c LogReader: replace get_first_message with LogReader.first (#31146) 
* first

* str
 2024-01-24 10:21:57 -08:00
Justin Newberry
88dcaa51c4 LogReader: no redownloading on multiple iterations (#31141) 
* no redownload

* sort
 2024-01-23 23:54:11 -08:00
Justin Newberry
ac71c30ad5 auto_source: add commaCarSegments source (#31137) 
add source
 2024-01-23 21:40:04 -08:00
Justin Newberry
3d9b483e10 comma_api_source: fix qlogs (#31136) 
fix qlogs
 2024-01-23 20:51:15 -08:00
Justin Newberry
d574013d7b LogReader: don't use route for max_segment (#31129) 
* dont use route

* fix and cleanup
 2024-01-23 14:51:45 -08:00
Justin Newberry
65490bb3c5 plotjuggler: auto fallback to qlogs with prompt (#31110) 
* qlog fallback

* show a warning for that

* qlog fallback

* fix

* wording
 2024-01-23 12:53:19 -08:00
Justin Newberry
389b8ca30d add example of using the comma car segments database (#31117) 
* add vin fingerprinting example

* perhaps!

* remove segment

* easier
 2024-01-22 18:23:07 -08:00
Justin Newberry
caa9153974 CommaCarSegments: public database of segments for each platform (#31114) 
* comma car segments

* comma car segments for test_models

* oneliner

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* better name

* not used here

* sort

* remove print

* better comment

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
 2024-01-22 17:33:03 -08:00
Justin Newberry
2c86c023fe sanitizer: sanitize vin number (#31090) 2024-01-21 12:22:32 -05:00
Justin Newberry
2967cada71 auto_source: optimize api calls and use head to determine if file exists (#31025) 
* fast

* catch all

* source

* fix file_exists

* remove duplicate reset

* test multiple loops

* iterations

* cleanup imports
 2024-01-16 17:24:37 -08:00
Justin Newberry
61fe705160 LogReader: fix plotjuggler not reading properly (#31023) 
* fix plotjuggler

* simpler

* fix juggler

* fix that
 2024-01-16 12:40:49 -08:00
Justin Newberry
7d400112df LogReader: move opci to tools/lib (#31021) 
move opci
 2024-01-16 10:58:51 -08:00
Justin Newberry
0739d5d7b2 LogReader: support lists of identifiers (#31020) 
* support lists of logs

* mark as slow instead
 2024-01-16 10:40:00 -08:00
Justin Newberry
4da8d16514 LogReader: support only_union_types (#31019) 
support only-union-types
 2024-01-16 10:03:55 -08:00
Justin Newberry
3d73512c07 rename segmentrangereader to logreader (#30981) 
* Replace multilogiterator

* replace logreader

* update readme

* fix from_Bytes

* new section

* reset before iter

* selector

* fix internal

* whitespace
 2024-01-12 12:53:50 -08:00
Justin Newberry
9f1b72ac79 Replace multilogiterator (#30980) 2024-01-12 11:43:32 -08:00
Justin Newberry
1820b5f259 Proc Replay: cleanup iterable log typing (#30261) 
* cleanup log typing

* use iterable

* fix those

* Cleanup

* cleanup

* missed that one
 2023-10-17 12:58:28 -07:00
Adeeb Shihadeh
a9626f95b6 add openpilot prefix to imports (#29498) 
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
 2023-08-20 20:49:55 -07:00
Justin Newberry
62c1e65924 Ruff: enable most of bugbear (#29320) 
* added mutable default args

* most of the Bs

* add comment about lrucache
 2023-08-11 15:33:49 -07:00
Lukas Petersson
86f73a507e process replay: logreader as bytes (#24610) 
* willem's changes

* classmethod for bytes

* submodules

* submodules

* Update tools/lib/logreader.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add back files

* little cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
 2022-06-01 22:02:42 -07:00
Willem Melching
194e5fdf1c make normal logreader more robust (#24577) 2022-05-18 12:21:01 +02:00
Lukas Petersson
1439867d16 Latency logger bad data robustness (#24343) 
* robustness against bad data

* sort by time logreader

* loop until last frameid
 2022-04-29 13:32:21 -07:00
Lukas Petersson
65fca83abe Latency logging 2 (#24058) 
* msg_order and gantt

* frameId in long/lat planner

* track frame id

* controls frame id

* graph tracked events

* graph json

* cloudlog timestamp

* c++ cloudlog

* add frame id

* bug fixes

* bug fixes

* frame id visionicp

* bug fixes and debug level

* timestamp log placement

* print timestamps in table

* translate events

* more logging

* bug fixes

* daemon boardd

* print logs with boardd

* more timestamp logs

* cleanup

* remove publish logs

* bug fix

* timestamp received

* timestamp received

* bug fixes

* use json lib

* ignore driver camera

* prep for new timestamp pipeline

* bug fix

* read new pipeline unfinnished

* read new pipeline

* bug fix

* add frame to controlsstate

* remove controlsstate

* print

* cleanup

* more cleanup + bug fix

* clock build issue

* remove unused imports

* format durations

* increase speed

* pr comments fixes

* conflicts

* set MANAGER_DAEMON for boardd

* clean script code

* bug fix + argparse

* remove rcv time

* bug fixes

* print without tabulate

* fix pre-commits

* plot gnatt

* color bug fix

* read without timestampextra

* bump panda

* mono time instead of frame id

* finnish script

* clean unused

* clean unused logging

* monotonic + json fixes

* del test

* remove whilelines

* bump laika

* cleanup

* remove deps

* logs nicer strings

* remove plotting from scirpt

* reset pipfile

* reset pipfile

* nicer strings

* bug fix

* bug fix

* pr comments cleaning

* remove plotting

* bug fix

* new demo route

* bump opendbc and panda

* cereal master

* cereal master

* script less komplex

* assertions

* matplotlib

* readme

* Update README.md

* graph html

* design fixes

* more code design

* Update common/logging_extra.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update tools/latency_logger/latency_logger.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* pr comments

* bug fix

* readme + env once

* clean swaglog

* bug fix

* Update tools/latencylogger/README.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert

* revert

* clean swaglog with error

* remove typo file

* revert graph

* cereal

* submodules

* whitespaces

* update refs

Co-authored-by: Bruce Wayne <batman@workstation-openpilot2.internal>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
 2022-04-05 21:05:45 -07:00
Adeeb Shihadeh
c95ec211e1 MultiLogIterator: add function to reset 2022-03-25 19:56:22 -07:00
Adeeb Shihadeh
1680f1e251 can_print_changes improvements 2022-03-10 14:32:19 -08:00