mawei/sunnypilot
1
0
Fork 0
mirror of https://github.com/sunnypilot/sunnypilot.git synced 2026-02-19 20:33:53 +08:00
Code Issues Packages Projects Releases Wiki Activity
13,008 Commits 186 Branches 165 Tags
8e0a4f2faf9db787affe2bcd053d81119018cd73
Commit Graph

72 Commits

Author SHA1 Message Date
Shane Smiskol
dfd387520e process replay: use zst (#33138) 
* test

* update refs to zst

* update
 2024-07-30 01:46:03 -07:00
Shane Smiskol
1b3b5ab758 use zstandard library (#33110) 
* use zstandard

* run 10

* bye bye

* this was a little overzealous

* clean up
 2024-07-28 02:03:47 -07:00
Shane Smiskol
e68bb26e14 tools: keep re pattern file small (#33084) 
remove bz2 from re file
 2024-07-25 22:05:10 -07:00
Shane Smiskol
e38a1428aa LogReader: support multiple log extensions in route (#33066) 
* support rlog.zst

* TODO
 2024-07-24 14:47:33 -07:00
Shane Smiskol
3e41b1b287 LogReader: show total segment count in missing rlog prompt 2024-07-01 22:43:48 -07:00
StefanLekanic-SYRMIA
504dd4543d LogReader: print number of missing rlogs (#32830) 
* count rlogs

* minimization changes

* cache to avoid duplicate checks

* no real point in checking qlogs to just show the warning

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
 2024-06-26 22:15:13 -07:00
Shane Smiskol
b45caf4033 LogReader: try zst on internal source (#32751) 
* internal source list files like azure api

* messy but works

* no limit

* simpler

* clean up

* clean up

* clean up

* that's obvious

* better

* we need to unfortunately return a url, so best to take a naive approach for now

* todo

* fix

* clean up
 2024-06-14 01:12:19 -07:00
Shane Smiskol
68e22faa29 LogReader: revert broken check 
it returns files OR None
 2024-06-14 00:30:14 -07:00
Shane Smiskol
d5ce4b3085 SegmentRange: remove timestamp (#32750) 
* add deprecation warning

* remove timestamp

* Update logreader.py
 2024-06-13 23:19:32 -07:00
Shane Smiskol
3ede1e2a7c LogReader: improve error messages (#32747) 
* better error messages

* clean up
 2024-06-13 22:37:00 -07:00
Shane Smiskol
04a93dd849 add zstd Python library (#32731) 
* add zstd

* fix

* uploader

* logreader: zst support

* caps

* only logreader
 2024-06-12 21:14:23 -07:00
Dean Lee
c64bca97ba logreader.py: optimize event loading and sorting in _LogFileReader (#32729) 
* improve logfilereader

* less changes
 2024-06-12 14:20:06 -07:00
Justin Newberry
a819292073 logreader: fix auto source + interactive modes (#31847) 
* interactive modes

* these exceptions don't matter
 2024-03-12 20:04:17 -07:00
Shane Smiskol
e964c5944d LogReader: fix sort by time and union types (#31565) 
* fix :(

* test_sort_by_time

* this isn't required

* not slow, and just compare sorted

* messy

* works

* clean up

* clean up

* not here

* clean up

* clean up

* clean up

* makes network call

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
 2024-03-08 02:49:24 -08:00
Cameron Clough
995250ae49 use pyupgrade to update to new typing syntax (#31580) 
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
 2024-02-24 16:41:23 -08:00
Justin Newberry
16d1339553 test_logreader: test internal scenarios (#31484) 
* test source scenario

* test source scenario

* fix
 2024-02-15 12:10:56 -08:00
Justin Newberry
8aee0d2af2 test_logreader: test interactive mode + fix typo in AUTO_INTERACTIVE (#31481) 
* fix spelling

* test interactive

* remove that

* test taht

* move that
 2024-02-15 11:24:27 -08:00
Justin Newberry
33cf6bda9e LogReader: add typing hints (#31464) 
logreader typing
 2024-02-14 10:34:17 -08:00
Justin Newberry
1436f576df LogReader: retain old behavior for direct parsing of files (#31419) 
* maintain exception

* test that head is not called

* annoying mock

* test with cache
 2024-02-14 10:05:25 -08:00
Shane Smiskol
8fe9bc7a69 SegmentRange: simplify slice (#31455) 
* simplify slicing

* rm
 2024-02-14 04:17:03 -08:00
Shane Smiskol
0846175f44 tools/lib: format code (#31454) 
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
 2024-02-14 01:56:17 -08:00
Justin Newberry
d6762c3035 live_logreader to its own file (#31436) 
own file
 2024-02-13 13:29:52 -08:00
Justin Newberry
0a92c5bf96 LogReader: live_logreader helpers (#31416) 
live helper
 2024-02-12 12:58:25 -08:00
Greg Hogan
667693b8c2 logreader: skip internal source if not available (#31400) 
* logreader: skip internal source if not available

* raise exception

* but only when appropriate
 2024-02-10 00:20:43 -08:00
Justin Newberry
6010a39bf8 LogReader: skip file_exists check for comma_api (#31251) 
* valid file

* missed this one
 2024-01-31 16:43:58 -08:00
Justin Newberry
c782fbc34e LogReader: add ``.filter`` (#31222) 
add filter
 2024-01-29 17:33:47 -08:00
Justin Newberry
7835f9cce0 LogReader: add tqdm back to run_across_segments (#31216) 
tqdm
 2024-01-29 13:18:49 -08:00
Justin Newberry
824ddffec8 CommaCarSegments: BIG Database! (#31169) 
* sanetized selector

* god damn

* add to re

* slog branch

* slog

* source

* big

* not slog

* cleanup

* no space

* works!

* trigger

* main!
 2024-01-27 01:07:29 -08:00
Justin Newberry
edd2428b60 LogReader: fail-fast on invalid segments (#31152) 
* don't check all

* is
 2024-01-25 11:09:09 -08:00
Justin Newberry
dd0c474e6c LogReader: replace get_first_message with LogReader.first (#31146) 
* first

* str
 2024-01-24 10:21:57 -08:00
Justin Newberry
88dcaa51c4 LogReader: no redownloading on multiple iterations (#31141) 
* no redownload

* sort
 2024-01-23 23:54:11 -08:00
Justin Newberry
ac71c30ad5 auto_source: add commaCarSegments source (#31137) 
add source
 2024-01-23 21:40:04 -08:00
Justin Newberry
3d9b483e10 comma_api_source: fix qlogs (#31136) 
fix qlogs
 2024-01-23 20:51:15 -08:00
Justin Newberry
d574013d7b LogReader: don't use route for max_segment (#31129) 
* dont use route

* fix and cleanup
 2024-01-23 14:51:45 -08:00
Justin Newberry
65490bb3c5 plotjuggler: auto fallback to qlogs with prompt (#31110) 
* qlog fallback

* show a warning for that

* qlog fallback

* fix

* wording
 2024-01-23 12:53:19 -08:00
Justin Newberry
389b8ca30d add example of using the comma car segments database (#31117) 
* add vin fingerprinting example

* perhaps!

* remove segment

* easier
 2024-01-22 18:23:07 -08:00
Justin Newberry
caa9153974 CommaCarSegments: public database of segments for each platform (#31114) 
* comma car segments

* comma car segments for test_models

* oneliner

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* better name

* not used here

* sort

* remove print

* better comment

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
 2024-01-22 17:33:03 -08:00
Justin Newberry
2c86c023fe sanitizer: sanitize vin number (#31090) 2024-01-21 12:22:32 -05:00
Justin Newberry
2967cada71 auto_source: optimize api calls and use head to determine if file exists (#31025) 
* fast

* catch all

* source

* fix file_exists

* remove duplicate reset

* test multiple loops

* iterations

* cleanup imports
 2024-01-16 17:24:37 -08:00
Justin Newberry
61fe705160 LogReader: fix plotjuggler not reading properly (#31023) 
* fix plotjuggler

* simpler

* fix juggler

* fix that
 2024-01-16 12:40:49 -08:00
Justin Newberry
7d400112df LogReader: move opci to tools/lib (#31021) 
move opci
 2024-01-16 10:58:51 -08:00
Justin Newberry
0739d5d7b2 LogReader: support lists of identifiers (#31020) 
* support lists of logs

* mark as slow instead
 2024-01-16 10:40:00 -08:00
Justin Newberry
4da8d16514 LogReader: support only_union_types (#31019) 
support only-union-types
 2024-01-16 10:03:55 -08:00
Justin Newberry
3d73512c07 rename segmentrangereader to logreader (#30981) 
* Replace multilogiterator

* replace logreader

* update readme

* fix from_Bytes

* new section

* reset before iter

* selector

* fix internal

* whitespace
 2024-01-12 12:53:50 -08:00
Justin Newberry
9f1b72ac79 Replace multilogiterator (#30980) 2024-01-12 11:43:32 -08:00
Justin Newberry
1820b5f259 Proc Replay: cleanup iterable log typing (#30261) 
* cleanup log typing

* use iterable

* fix those

* Cleanup

* cleanup

* missed that one
 2023-10-17 12:58:28 -07:00
Adeeb Shihadeh
a9626f95b6 add openpilot prefix to imports (#29498) 
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
 2023-08-20 20:49:55 -07:00
Justin Newberry
62c1e65924 Ruff: enable most of bugbear (#29320) 
* added mutable default args

* most of the Bs

* add comment about lrucache
 2023-08-11 15:33:49 -07:00
Lukas Petersson
86f73a507e process replay: logreader as bytes (#24610) 
* willem's changes

* classmethod for bytes

* submodules

* submodules

* Update tools/lib/logreader.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add back files

* little cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
 2022-06-01 22:02:42 -07:00
Willem Melching
194e5fdf1c make normal logreader more robust (#24577) 2022-05-18 12:21:01 +02:00