Commit Graph

186 Commits

Author SHA1 Message Date
Shane Smiskol
aeb904d5da test_fw_query_on_routes: get first qlog (#31496)
* fast

* this isn't internal

* see
old-commit-hash: c5f1f4c676
2024-02-16 17:55:15 -08:00
Justin Newberry
8dbdd4736c test_logreader: test internal scenarios (#31484)
* test source scenario

* test source scenario

* fix
old-commit-hash: 16d1339553
2024-02-15 12:10:56 -08:00
Justin Newberry
42f292b3ce test_logreader: test interactive mode + fix typo in AUTO_INTERACTIVE (#31481)
* fix spelling

* test interactive

* remove that

* test taht

* move that
old-commit-hash: 8aee0d2af2
2024-02-15 11:24:27 -08:00
Greg Hogan
6c51d1563d URLFile: add typing and internalize pool manager (#31466)
* URLFile: add typing and internalize pool manager

* cleanup
old-commit-hash: e59fe0014a
2024-02-14 14:09:01 -08:00
Justin Newberry
edd4649d24 LogReader: add typing hints (#31464)
logreader typing
old-commit-hash: 33cf6bda9e
2024-02-14 10:34:17 -08:00
Justin Newberry
38fc6f9dd6 LogReader: retain old behavior for direct parsing of files (#31419)
* maintain exception

* test that head is not called

* annoying mock

* test with cache
old-commit-hash: 1436f576df
2024-02-14 10:05:25 -08:00
Shane Smiskol
9d941a9682 SegmentRange: more explicit slice matching (#31451)
* more explicit

* fix it

* use non capturing group

* only needed for regex101

* make test_logreader.py executable

* fix

* stash

* passes test

* none

* type anotate

* test

* fix

* nice for syntax highlighting
old-commit-hash: 796671fe1a
2024-02-14 04:36:58 -08:00
Shane Smiskol
5c16ae62d8 SegmentRange: simplify slice (#31455)
* simplify slicing

* rm
old-commit-hash: 8fe9bc7a69
2024-02-14 04:17:03 -08:00
Shane Smiskol
ae65a01afd SegmentRange: test API call (#31456)
* test

* better

* better
old-commit-hash: c4f7991bb6
2024-02-14 03:29:08 -08:00
Shane Smiskol
7afdb2393d SegmentRange: type annotations (#31453)
* type annotate SegmentRange

* proper formatting

* oops

* numpy?

format test too

* draft

* fixed

* clean up

* rm

* more

* clean up

* clean up

* rm

* not here

* revert
old-commit-hash: 8276371009
2024-02-14 02:05:55 -08:00
Shane Smiskol
4c7ad7f3b7 tools/lib: format code (#31454)
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
old-commit-hash: 0846175f44
2024-02-14 01:56:17 -08:00
Shane Smiskol
a4e61c1022 SegmentRange: define __repr__
old-commit-hash: 884bd5c7f6
2024-02-13 22:58:44 -08:00
Justin Newberry
8b5f1235f4 live_logreader to its own file (#31436)
own file
old-commit-hash: d6762c3035
2024-02-13 13:29:52 -08:00
Adeeb Shihadeh
1efa8db1b4 dongle id is only hex (#31426)
* dongle id is only hex

* so is the count
old-commit-hash: e9071f1198
2024-02-13 13:01:25 -08:00
Justin Newberry
fbf5ada69f LogReader: live_logreader helpers (#31416)
live helper
old-commit-hash: 0a92c5bf96
2024-02-12 12:58:25 -08:00
Greg Hogan
1384c10fb0 logreader: skip internal source if not available (#31400)
* logreader: skip internal source if not available

* raise exception

* but only when appropriate
old-commit-hash: 667693b8c2
2024-02-10 00:20:43 -08:00
Justin Newberry
02aea8b757 test_caching: use with_http_server (#31393)
use http server
old-commit-hash: 664a3c86ba
2024-02-09 20:06:11 -08:00
Justin Newberry
bcd22c1683 LogReader: test auto mode fallback (#31390)
* test auto mode

* better

* slow

* better
old-commit-hash: f873224235
2024-02-09 15:22:43 -08:00
Greg Hogan
cb6a47c6bf simplify URLFile (#31365)
* simplify URLFile

* more space
old-commit-hash: ec9f3dcef3
2024-02-08 10:24:45 -08:00
Justin Newberry
3f934381fe test_logreader: test run_across_segments (#31305)
* more logreader tests

* not in ci for now

* enable cache
old-commit-hash: b17f24d68e
2024-02-05 18:35:12 -08:00
Greg Hogan
54dc43fe14 make URLFile safe after fork() (#31309)
* make URLFile safe after fork()

* cache the pool manager in each instance

* type hints
old-commit-hash: a8aa04e6bd
2024-02-05 18:07:48 -08:00
Justin Newberry
9b4b5d3cf5 LogReader: skip file_exists check for comma_api (#31251)
* valid file

* missed this one
old-commit-hash: 6010a39bf8
2024-01-31 16:43:58 -08:00
Justin Newberry
16e0907129 LogReader: add ``.filter`` (#31222)
add filter
old-commit-hash: c782fbc34e
2024-01-29 17:33:47 -08:00
Justin Newberry
223b1ed065 LogReader: add tqdm back to run_across_segments (#31216)
tqdm
old-commit-hash: 7835f9cce0
2024-01-29 13:18:49 -08:00
Justin Newberry
abfa8fcda9 CommaCarSegments: BIG Database! (#31169)
* sanetized selector

* god damn

* add to re

* slog branch

* slog

* source

* big

* not slog

* cleanup

* no space

* works!

* trigger

* main!
old-commit-hash: 824ddffec8
2024-01-27 01:07:29 -08:00
Adeeb Shihadeh
048629564e bootlog: remove timestamp from filename (#31187)
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
old-commit-hash: 2504341070
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
f1a81dd57e tools: add LOG_ID regex pattern (#31186)
old-commit-hash: 52c7514452
2024-01-26 16:44:12 -08:00
Justin Newberry
0d0e6191a8 commaCarSegments cleanup (#31182)
* cleanup

* no space
old-commit-hash: 9518b66c9e
2024-01-26 13:20:25 -08:00
Greg Hogan
01eccef5de filereader should use connection pool for file_exists (#31158)
* filereader should use connection pool for file_exists

* remove debug var
old-commit-hash: 6901aada14
2024-01-25 13:26:12 -08:00
Justin Newberry
9edc902106 LogReader: fail-fast on invalid segments (#31152)
* don't check all

* is
old-commit-hash: edd2428b60
2024-01-25 11:09:09 -08:00
Justin Newberry
7d76ac8eba LogReader: replace get_first_message with LogReader.first (#31146)
* first

* str
old-commit-hash: dd0c474e6c
2024-01-24 10:21:57 -08:00
Justin Newberry
67bb21219c LogReader: no redownloading on multiple iterations (#31141)
* no redownload

* sort
old-commit-hash: 88dcaa51c4
2024-01-23 23:54:11 -08:00
Justin Newberry
0d558d02ee auto_source: add commaCarSegments source (#31137)
add source
old-commit-hash: ac71c30ad5
2024-01-23 21:40:04 -08:00
Justin Newberry
6a1d7fd732 comma_api_source: fix qlogs (#31136)
fix qlogs
old-commit-hash: 3d9b483e10
2024-01-23 20:51:15 -08:00
Justin Newberry
8768be968b LogReader: don't use route for max_segment (#31129)
* dont use route

* fix and cleanup
old-commit-hash: d574013d7b
2024-01-23 14:51:45 -08:00
Justin Newberry
0fb7448a9d LogReader: remove redirect message for internal data (#31088)
fix logging
old-commit-hash: 0234cadec3
2024-01-23 12:55:50 -08:00
Justin Newberry
c5c522c984 plotjuggler: auto fallback to qlogs with prompt (#31110)
* qlog fallback

* show a warning for that

* qlog fallback

* fix

* wording
old-commit-hash: 65490bb3c5
2024-01-23 12:53:19 -08:00
Justin Newberry
0ae82f96c6 SegmentRange: __str__ get preferred format (#31126)
get canonical
old-commit-hash: 35e1e8ecd2
2024-01-23 11:40:22 -08:00
Justin Newberry
c03fe6bb13 add example of using the comma car segments database (#31117)
* add vin fingerprinting example

* perhaps!

* remove segment

* easier
old-commit-hash: 389b8ca30d
2024-01-22 18:23:07 -08:00
Justin Newberry
f447062b66 CommaCarSegments: public database of segments for each platform (#31114)
* comma car segments

* comma car segments for test_models

* oneliner

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* better name

* not used here

* sort

* remove print

* better comment

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: caa9153974
2024-01-22 17:33:03 -08:00
Justin Newberry
b29eea47ce sanitizer: sanitize vin number (#31090)
old-commit-hash: 2c86c023fe
2024-01-21 12:22:32 -05:00
Justin Newberry
3d0ae1aaaa prevent typing issue in azure_container (#31044)
prvent that issue
old-commit-hash: 840db1f1b7
2024-01-17 15:34:24 -08:00
Justin Newberry
09b95b715c cleanup azure handling (#31034)
* wip cleanup

* Wip

* fixes

* fix

* cleanup

* keep this for now

* dest
old-commit-hash: 3f0b56b364
2024-01-17 14:21:47 -08:00
Justin Newberry
a9676e7086 auto_source: optimize api calls and use head to determine if file exists (#31025)
* fast

* catch all

* source

* fix file_exists

* remove duplicate reset

* test multiple loops

* iterations

* cleanup imports
old-commit-hash: 2967cada71
2024-01-16 17:24:37 -08:00
Justin Newberry
5df01b3d22 LogReader: fix plotjuggler not reading properly (#31023)
* fix plotjuggler

* simpler

* fix juggler

* fix that
old-commit-hash: 61fe705160
2024-01-16 12:40:49 -08:00
Justin Newberry
4b7edec2b0 LogReader: move opci to tools/lib (#31021)
move opci
old-commit-hash: 7d400112df
2024-01-16 10:58:51 -08:00
Justin Newberry
35dcd7ccd8 LogReader: support lists of identifiers (#31020)
* support lists of logs

* mark as slow instead
old-commit-hash: 0739d5d7b2
2024-01-16 10:40:00 -08:00
Justin Newberry
13e7366b6d LogReader: support only_union_types (#31019)
support only-union-types
old-commit-hash: 4da8d16514
2024-01-16 10:03:55 -08:00
Adeeb Shihadeh
96e9a7d3ce CI: speedup unit test job (#30995)
* start

* mv to buildjet

* fix
old-commit-hash: e17e66180c
2024-01-13 21:16:35 -08:00
Justin Newberry
c8cc30112d rename segmentrangereader to logreader (#30981)
* Replace multilogiterator

* replace logreader

* update readme

* fix from_Bytes

* new section

* reset before iter

* selector

* fix internal

* whitespace
old-commit-hash: 3d73512c07
2024-01-12 12:53:50 -08:00