Commit Graph

192 Commits

Author SHA1 Message Date
Adeeb Shihadeh
7cfc571f56 timeless routes (#31119)
* timeless route

* update sort

* update test

* fix param name
2024-03-05 20:43:33 -08:00
Justin Newberry
f4a7e8eae6 disable commaCarSegments tests (#31632)
disable this test too
2024-02-28 16:47:08 -08:00
Justin Newberry
9d1cafd0fc move with_http_server to selfdrive/test/helpers (#31597)
* move

* fix
2024-02-26 12:53:17 -08:00
Cameron Clough
995250ae49 use pyupgrade to update to new typing syntax (#31580)
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
2024-02-24 16:41:23 -08:00
Justin Newberry
556f973896 segment range docs update (#31560)
* the format

* cleaner
2024-02-23 11:50:33 -08:00
Greg Hogan
43f64ec500 URLFile: default value test (#31544)
* URLFile: default value test

* cleanup

* fix env

* improvements

* fix GET response

* only delete cache dir if it exists

* env pop

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-02-22 13:17:02 -08:00
Shane Smiskol
c5f1f4c676 test_fw_query_on_routes: get first qlog (#31496)
* fast

* this isn't internal

* see
2024-02-16 17:55:15 -08:00
Justin Newberry
16d1339553 test_logreader: test internal scenarios (#31484)
* test source scenario

* test source scenario

* fix
2024-02-15 12:10:56 -08:00
Justin Newberry
8aee0d2af2 test_logreader: test interactive mode + fix typo in AUTO_INTERACTIVE (#31481)
* fix spelling

* test interactive

* remove that

* test taht

* move that
2024-02-15 11:24:27 -08:00
Greg Hogan
e59fe0014a URLFile: add typing and internalize pool manager (#31466)
* URLFile: add typing and internalize pool manager

* cleanup
2024-02-14 14:09:01 -08:00
Justin Newberry
33cf6bda9e LogReader: add typing hints (#31464)
logreader typing
2024-02-14 10:34:17 -08:00
Justin Newberry
1436f576df LogReader: retain old behavior for direct parsing of files (#31419)
* maintain exception

* test that head is not called

* annoying mock

* test with cache
2024-02-14 10:05:25 -08:00
Shane Smiskol
796671fe1a SegmentRange: more explicit slice matching (#31451)
* more explicit

* fix it

* use non capturing group

* only needed for regex101

* make test_logreader.py executable

* fix

* stash

* passes test

* none

* type anotate

* test

* fix

* nice for syntax highlighting
2024-02-14 04:36:58 -08:00
Shane Smiskol
8fe9bc7a69 SegmentRange: simplify slice (#31455)
* simplify slicing

* rm
2024-02-14 04:17:03 -08:00
Shane Smiskol
c4f7991bb6 SegmentRange: test API call (#31456)
* test

* better

* better
2024-02-14 03:29:08 -08:00
Shane Smiskol
8276371009 SegmentRange: type annotations (#31453)
* type annotate SegmentRange

* proper formatting

* oops

* numpy?

format test too

* draft

* fixed

* clean up

* rm

* more

* clean up

* clean up

* rm

* not here

* revert
2024-02-14 02:05:55 -08:00
Shane Smiskol
0846175f44 tools/lib: format code (#31454)
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
2024-02-14 01:56:17 -08:00
Shane Smiskol
884bd5c7f6 SegmentRange: define __repr__ 2024-02-13 22:58:44 -08:00
Justin Newberry
d6762c3035 live_logreader to its own file (#31436)
own file
2024-02-13 13:29:52 -08:00
Adeeb Shihadeh
e9071f1198 dongle id is only hex (#31426)
* dongle id is only hex

* so is the count
2024-02-13 13:01:25 -08:00
Justin Newberry
0a92c5bf96 LogReader: live_logreader helpers (#31416)
live helper
2024-02-12 12:58:25 -08:00
Greg Hogan
667693b8c2 logreader: skip internal source if not available (#31400)
* logreader: skip internal source if not available

* raise exception

* but only when appropriate
2024-02-10 00:20:43 -08:00
Justin Newberry
664a3c86ba test_caching: use with_http_server (#31393)
use http server
2024-02-09 20:06:11 -08:00
Justin Newberry
f873224235 LogReader: test auto mode fallback (#31390)
* test auto mode

* better

* slow

* better
2024-02-09 15:22:43 -08:00
Greg Hogan
ec9f3dcef3 simplify URLFile (#31365)
* simplify URLFile

* more space
2024-02-08 10:24:45 -08:00
Justin Newberry
b17f24d68e test_logreader: test run_across_segments (#31305)
* more logreader tests

* not in ci for now

* enable cache
2024-02-05 18:35:12 -08:00
Greg Hogan
a8aa04e6bd make URLFile safe after fork() (#31309)
* make URLFile safe after fork()

* cache the pool manager in each instance

* type hints
2024-02-05 18:07:48 -08:00
Justin Newberry
6010a39bf8 LogReader: skip file_exists check for comma_api (#31251)
* valid file

* missed this one
2024-01-31 16:43:58 -08:00
Justin Newberry
c782fbc34e LogReader: add ``.filter`` (#31222)
add filter
2024-01-29 17:33:47 -08:00
Justin Newberry
7835f9cce0 LogReader: add tqdm back to run_across_segments (#31216)
tqdm
2024-01-29 13:18:49 -08:00
Justin Newberry
824ddffec8 CommaCarSegments: BIG Database! (#31169)
* sanetized selector

* god damn

* add to re

* slog branch

* slog

* source

* big

* not slog

* cleanup

* no space

* works!

* trigger

* main!
2024-01-27 01:07:29 -08:00
Adeeb Shihadeh
2504341070 bootlog: remove timestamp from filename (#31187)
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
52c7514452 tools: add LOG_ID regex pattern (#31186) 2024-01-26 16:44:12 -08:00
Justin Newberry
9518b66c9e commaCarSegments cleanup (#31182)
* cleanup

* no space
2024-01-26 13:20:25 -08:00
Greg Hogan
6901aada14 filereader should use connection pool for file_exists (#31158)
* filereader should use connection pool for file_exists

* remove debug var
2024-01-25 13:26:12 -08:00
Justin Newberry
edd2428b60 LogReader: fail-fast on invalid segments (#31152)
* don't check all

* is
2024-01-25 11:09:09 -08:00
Justin Newberry
dd0c474e6c LogReader: replace get_first_message with LogReader.first (#31146)
* first

* str
2024-01-24 10:21:57 -08:00
Justin Newberry
88dcaa51c4 LogReader: no redownloading on multiple iterations (#31141)
* no redownload

* sort
2024-01-23 23:54:11 -08:00
Justin Newberry
ac71c30ad5 auto_source: add commaCarSegments source (#31137)
add source
2024-01-23 21:40:04 -08:00
Justin Newberry
3d9b483e10 comma_api_source: fix qlogs (#31136)
fix qlogs
2024-01-23 20:51:15 -08:00
Justin Newberry
d574013d7b LogReader: don't use route for max_segment (#31129)
* dont use route

* fix and cleanup
2024-01-23 14:51:45 -08:00
Justin Newberry
0234cadec3 LogReader: remove redirect message for internal data (#31088)
fix logging
2024-01-23 12:55:50 -08:00
Justin Newberry
65490bb3c5 plotjuggler: auto fallback to qlogs with prompt (#31110)
* qlog fallback

* show a warning for that

* qlog fallback

* fix

* wording
2024-01-23 12:53:19 -08:00
Justin Newberry
35e1e8ecd2 SegmentRange: __str__ get preferred format (#31126)
get canonical
2024-01-23 11:40:22 -08:00
Justin Newberry
389b8ca30d add example of using the comma car segments database (#31117)
* add vin fingerprinting example

* perhaps!

* remove segment

* easier
2024-01-22 18:23:07 -08:00
Justin Newberry
caa9153974 CommaCarSegments: public database of segments for each platform (#31114)
* comma car segments

* comma car segments for test_models

* oneliner

Co-authored-by: Shane Smiskol <shane@smiskol.com>

* better name

* not used here

* sort

* remove print

* better comment

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2024-01-22 17:33:03 -08:00
Justin Newberry
2c86c023fe sanitizer: sanitize vin number (#31090) 2024-01-21 12:22:32 -05:00
Justin Newberry
840db1f1b7 prevent typing issue in azure_container (#31044)
prvent that issue
2024-01-17 15:34:24 -08:00
Justin Newberry
3f0b56b364 cleanup azure handling (#31034)
* wip cleanup

* Wip

* fixes

* fix

* cleanup

* keep this for now

* dest
2024-01-17 14:21:47 -08:00
Justin Newberry
2967cada71 auto_source: optimize api calls and use head to determine if file exists (#31025)
* fast

* catch all

* source

* fix file_exists

* remove duplicate reset

* test multiple loops

* iterations

* cleanup imports
2024-01-16 17:24:37 -08:00