Greg Hogan
cb6a47c6bf
simplify URLFile ( #31365 )
...
* simplify URLFile
* more space
old-commit-hash: ec9f3dcef3
2024-02-08 10:24:45 -08:00
Justin Newberry
3f934381fe
test_logreader: test run_across_segments ( #31305 )
...
* more logreader tests
* not in ci for now
* enable cache
old-commit-hash: b17f24d68e
2024-02-05 18:35:12 -08:00
Greg Hogan
54dc43fe14
make URLFile safe after fork() ( #31309 )
...
* make URLFile safe after fork()
* cache the pool manager in each instance
* type hints
old-commit-hash: a8aa04e6bd
2024-02-05 18:07:48 -08:00
Justin Newberry
9b4b5d3cf5
LogReader: skip file_exists check for comma_api ( #31251 )
...
* valid file
* missed this one
old-commit-hash: 6010a39bf8
2024-01-31 16:43:58 -08:00
Justin Newberry
16e0907129
LogReader: add ``.filter`` ( #31222 )
...
add filter
old-commit-hash: c782fbc34e
2024-01-29 17:33:47 -08:00
Justin Newberry
223b1ed065
LogReader: add tqdm back to run_across_segments ( #31216 )
...
tqdm
old-commit-hash: 7835f9cce0
2024-01-29 13:18:49 -08:00
Justin Newberry
abfa8fcda9
CommaCarSegments: BIG Database! ( #31169 )
...
* sanetized selector
* god damn
* add to re
* slog branch
* slog
* source
* big
* not slog
* cleanup
* no space
* works!
* trigger
* main!
old-commit-hash: 824ddffec8
2024-01-27 01:07:29 -08:00
Adeeb Shihadeh
048629564e
bootlog: remove timestamp from filename ( #31187 )
...
* bootlog: remove timestamp from filename
* revert route
* test
* revert that
* fix loggerd test
old-commit-hash: 2504341070
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
f1a81dd57e
tools: add LOG_ID regex pattern ( #31186 )
...
old-commit-hash: 52c7514452
2024-01-26 16:44:12 -08:00
Justin Newberry
0d0e6191a8
commaCarSegments cleanup ( #31182 )
...
* cleanup
* no space
old-commit-hash: 9518b66c9e
2024-01-26 13:20:25 -08:00
Greg Hogan
01eccef5de
filereader should use connection pool for file_exists ( #31158 )
...
* filereader should use connection pool for file_exists
* remove debug var
old-commit-hash: 6901aada14
2024-01-25 13:26:12 -08:00
Justin Newberry
9edc902106
LogReader: fail-fast on invalid segments ( #31152 )
...
* don't check all
* is
old-commit-hash: edd2428b60
2024-01-25 11:09:09 -08:00
Justin Newberry
7d76ac8eba
LogReader: replace get_first_message with LogReader.first ( #31146 )
...
* first
* str
old-commit-hash: dd0c474e6c
2024-01-24 10:21:57 -08:00
Justin Newberry
67bb21219c
LogReader: no redownloading on multiple iterations ( #31141 )
...
* no redownload
* sort
old-commit-hash: 88dcaa51c4
2024-01-23 23:54:11 -08:00
Justin Newberry
0d558d02ee
auto_source: add commaCarSegments source ( #31137 )
...
add source
old-commit-hash: ac71c30ad5
2024-01-23 21:40:04 -08:00
Justin Newberry
6a1d7fd732
comma_api_source: fix qlogs ( #31136 )
...
fix qlogs
old-commit-hash: 3d9b483e10
2024-01-23 20:51:15 -08:00
Justin Newberry
8768be968b
LogReader: don't use route for max_segment ( #31129 )
...
* dont use route
* fix and cleanup
old-commit-hash: d574013d7b
2024-01-23 14:51:45 -08:00
Justin Newberry
0fb7448a9d
LogReader: remove redirect message for internal data ( #31088 )
...
fix logging
old-commit-hash: 0234cadec3
2024-01-23 12:55:50 -08:00
Justin Newberry
c5c522c984
plotjuggler: auto fallback to qlogs with prompt ( #31110 )
...
* qlog fallback
* show a warning for that
* qlog fallback
* fix
* wording
old-commit-hash: 65490bb3c5
2024-01-23 12:53:19 -08:00
Justin Newberry
0ae82f96c6
SegmentRange: __str__ get preferred format ( #31126 )
...
get canonical
old-commit-hash: 35e1e8ecd2
2024-01-23 11:40:22 -08:00
Justin Newberry
c03fe6bb13
add example of using the comma car segments database ( #31117 )
...
* add vin fingerprinting example
* perhaps!
* remove segment
* easier
old-commit-hash: 389b8ca30d
2024-01-22 18:23:07 -08:00
Justin Newberry
f447062b66
CommaCarSegments: public database of segments for each platform ( #31114 )
...
* comma car segments
* comma car segments for test_models
* oneliner
Co-authored-by: Shane Smiskol <shane@smiskol.com >
* better name
* not used here
* sort
* remove print
* better comment
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: caa9153974
2024-01-22 17:33:03 -08:00
Justin Newberry
b29eea47ce
sanitizer: sanitize vin number ( #31090 )
...
old-commit-hash: 2c86c023fe
2024-01-21 12:22:32 -05:00
Justin Newberry
3d0ae1aaaa
prevent typing issue in azure_container ( #31044 )
...
prvent that issue
old-commit-hash: 840db1f1b7
2024-01-17 15:34:24 -08:00
Justin Newberry
09b95b715c
cleanup azure handling ( #31034 )
...
* wip cleanup
* Wip
* fixes
* fix
* cleanup
* keep this for now
* dest
old-commit-hash: 3f0b56b364
2024-01-17 14:21:47 -08:00
Justin Newberry
a9676e7086
auto_source: optimize api calls and use head to determine if file exists ( #31025 )
...
* fast
* catch all
* source
* fix file_exists
* remove duplicate reset
* test multiple loops
* iterations
* cleanup imports
old-commit-hash: 2967cada71
2024-01-16 17:24:37 -08:00
Justin Newberry
5df01b3d22
LogReader: fix plotjuggler not reading properly ( #31023 )
...
* fix plotjuggler
* simpler
* fix juggler
* fix that
old-commit-hash: 61fe705160
2024-01-16 12:40:49 -08:00
Justin Newberry
4b7edec2b0
LogReader: move opci to tools/lib ( #31021 )
...
move opci
old-commit-hash: 7d400112df
2024-01-16 10:58:51 -08:00
Justin Newberry
35dcd7ccd8
LogReader: support lists of identifiers ( #31020 )
...
* support lists of logs
* mark as slow instead
old-commit-hash: 0739d5d7b2
2024-01-16 10:40:00 -08:00
Justin Newberry
13e7366b6d
LogReader: support only_union_types ( #31019 )
...
support only-union-types
old-commit-hash: 4da8d16514
2024-01-16 10:03:55 -08:00
Adeeb Shihadeh
96e9a7d3ce
CI: speedup unit test job ( #30995 )
...
* start
* mv to buildjet
* fix
old-commit-hash: e17e66180c
2024-01-13 21:16:35 -08:00
Justin Newberry
c8cc30112d
rename segmentrangereader to logreader ( #30981 )
...
* Replace multilogiterator
* replace logreader
* update readme
* fix from_Bytes
* new section
* reset before iter
* selector
* fix internal
* whitespace
old-commit-hash: 3d73512c07
2024-01-12 12:53:50 -08:00
Justin Newberry
a729e102c7
Replace multilogiterator ( #30980 )
...
old-commit-hash: 9f1b72ac79
2024-01-12 11:43:32 -08:00
Justin Newberry
1b65d5cd85
segmentrangereader: support direct parsing ( #30973 )
...
* use correct source
* revert
* cleanup imports
* clean
* direct parsing
* rename
* move up
* fixes
* fix that
* better error message
old-commit-hash: eb09294fc2
2024-01-11 16:56:48 -08:00
Justin Newberry
11449845e7
segmentrangereader: support more sources ( #30970 )
...
* support more sources
* remove this
old-commit-hash: fb994ae782
2024-01-11 12:55:19 -08:00
Justin Newberry
3b86243f1f
SegmentRangeReader: log type selector ( #30960 )
...
* log type selector
* test this too
* and this
* invalid selector
* use strenum
* don't hardcode size
* oneline
old-commit-hash: be814ed447
2024-01-11 10:25:24 -08:00
Justin Newberry
9e6c6d92b0
segmentrangereader: support sort_by_time ( #30954 )
...
support sort-by-time
old-commit-hash: cfb23eb2d1
2024-01-10 13:36:55 -08:00
Justin Newberry
1f434b2714
SegmentRangeReader: new format for reading multiple segments ( #30940 )
...
* segment range reader
* rename that
* revert that
* cleanup
* revert this for now
* revert this for now
* Fix + test
* rm that
* rm that
* use for auto_fingerprint
* simpler
* for notebook too
* match numpy indexing
* just use numpy directly
* remove that
* spacing
* spacing
* use qlog for auto fingerprint
* add 'read mode'
* pass in read mode
* add test for modes
* numpy indexing
* fix that case
* more examples
* fix the notebook
* cleanup the notebook
* cleaner
* fix those
old-commit-hash: 0d126e1e9e
2024-01-10 11:55:19 -08:00
Justin Newberry
7aecd2f91d
url_file: fix non-200 files being cached ( #30886 )
...
* fix + test
* fix unclosed
* easier to read
Co-authored-by: Shane Smiskol <shane@smiskol.com >
* fix that
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: fba521ecc6
2024-01-02 12:42:08 -08:00
Adeeb Shihadeh
207073dc4c
fix unused
...
old-commit-hash: 51a93cf9aa
2023-12-17 16:32:56 -08:00
royjr
d41f215df8
dependency: remove pycurl package ( #30771 )
...
* Update qcomgpsd.py
* Update url_file.py
* remove pycurl
* requests -> urllib3
* unused
* redundant
* fix import
* Revert "requests -> urllib3"
This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.
* headless
* fix trail
* use requests.exceptions.RequestException
* use fp.tell
* fix indents
* reorder imports
* change timeout
* fix debug timing
* remove exception
* add timeout
* missing headers
* move to constructor
* move import
* unused import
* fix debug
* try
* no retries
old-commit-hash: 70624ffc81
2023-12-17 16:25:25 -08:00
Greg Hogan
e91032efb3
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion ( #30618 )
...
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
old-commit-hash: db35dcd0b5
2023-12-06 09:55:29 -08:00
Justin Newberry
661132be5a
Pytest: more post-test path cleanup ( #30556 )
...
* test cleanup
* missed this one
* remove that
* static class
old-commit-hash: 4086795c29
2023-11-30 09:55:48 -08:00
Kacper Rączy
6f51ee8267
URLFile: exception type for failed requests ( #30330 )
...
URLFileException for URLFile request errors
old-commit-hash: c27e977475
2023-10-25 16:20:12 -07:00
Greg Hogan
a544533476
framereader: eliminate tempfile usage ( #30289 )
...
old-commit-hash: 68acb26aa2
2023-10-18 19:48:26 -07:00
Greg Hogan
99d094a006
fix ffprobe on device ( #30286 )
...
* fix ffprobe on device
* use FileReader
* no more requests
old-commit-hash: 59e947dc6c
2023-10-18 18:31:14 -07:00
Justin Newberry
ef1acd4e6c
Proc Replay: cleanup iterable log typing ( #30261 )
...
* cleanup log typing
* use iterable
* fix those
* Cleanup
* cleanup
* missed that one
old-commit-hash: 1820b5f259
2023-10-17 12:58:28 -07:00
Greg Hogan
a62749f527
vidindex improvements ( #30196 )
...
* vidindex improvements
* fix spelling
old-commit-hash: 6f98a987af
2023-10-05 22:48:50 -07:00
Greg Hogan
e0469bdde6
filereader cleanup ( #30191 )
...
* filereader cleanup
* make name return url
* remove unused imports
old-commit-hash: 86b90a8ba2
2023-10-05 19:45:46 -07:00
Greg Hogan
29bb2cf867
convert vidindex to python ( #30176 )
...
* convert vidindex to python
* fix whitespace
* corrupt file option
* fix up typings
* fix return type
* update framereader
* change length delimiter to uint32 value
* change length to uint32 value
* move url_file changes to separate PR
* cleanup caching
* revert whitespace change
* fix frame type param type
old-commit-hash: f8e488f881
2023-10-05 18:40:24 -07:00
