Justin Newberry
abfa8fcda9
CommaCarSegments: BIG Database! ( #31169 )
...
* sanetized selector
* god damn
* add to re
* slog branch
* slog
* source
* big
* not slog
* cleanup
* no space
* works!
* trigger
* main!
old-commit-hash: 824ddffec8c67758f3ea080c75e805d4b27f38ef
2024-01-27 01:07:29 -08:00
Adeeb Shihadeh
048629564e
bootlog: remove timestamp from filename ( #31187 )
...
* bootlog: remove timestamp from filename
* revert route
* test
* revert that
* fix loggerd test
old-commit-hash: 25043410705f2a7a275e69ec513c8889465d4ba3
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh
f1a81dd57e
tools: add LOG_ID regex pattern ( #31186 )
...
old-commit-hash: 52c7514452f984db5036994c20be652ec0b44a6c
2024-01-26 16:44:12 -08:00
Justin Newberry
0d0e6191a8
commaCarSegments cleanup ( #31182 )
...
* cleanup
* no space
old-commit-hash: 9518b66c9e49f744591f8da858b201342a8c096d
2024-01-26 13:20:25 -08:00
Greg Hogan
01eccef5de
filereader should use connection pool for file_exists ( #31158 )
...
* filereader should use connection pool for file_exists
* remove debug var
old-commit-hash: 6901aada14df6aa68b5e3970da0487b8d2b4df8c
2024-01-25 13:26:12 -08:00
Justin Newberry
9edc902106
LogReader: fail-fast on invalid segments ( #31152 )
...
* don't check all
* is
old-commit-hash: edd2428b6067381ffaa25420d6fd9f0f142038a8
2024-01-25 11:09:09 -08:00
Justin Newberry
7d76ac8eba
LogReader: replace get_first_message with LogReader.first ( #31146 )
...
* first
* str
old-commit-hash: dd0c474e6cc09d17cd07b51098d826dc40bc5403
2024-01-24 10:21:57 -08:00
Justin Newberry
67bb21219c
LogReader: no redownloading on multiple iterations ( #31141 )
...
* no redownload
* sort
old-commit-hash: 88dcaa51c4d1fcc338d44f55134593760334ae23
2024-01-23 23:54:11 -08:00
Justin Newberry
0d558d02ee
auto_source: add commaCarSegments source ( #31137 )
...
add source
old-commit-hash: ac71c30ad5d8a5f303ac7a08cc73b8a4b0174498
2024-01-23 21:40:04 -08:00
Justin Newberry
6a1d7fd732
comma_api_source: fix qlogs ( #31136 )
...
fix qlogs
old-commit-hash: 3d9b483e107e119fd5322e00494a769ef0e081bc
2024-01-23 20:51:15 -08:00
Justin Newberry
8768be968b
LogReader: don't use route for max_segment ( #31129 )
...
* dont use route
* fix and cleanup
old-commit-hash: d574013d7bda94a43b29095887e176b9723d13cb
2024-01-23 14:51:45 -08:00
Justin Newberry
0fb7448a9d
LogReader: remove redirect message for internal data ( #31088 )
...
fix logging
old-commit-hash: 0234cadec3aefdca2e71c251ff6f8885a247c34a
2024-01-23 12:55:50 -08:00
Justin Newberry
c5c522c984
plotjuggler: auto fallback to qlogs with prompt ( #31110 )
...
* qlog fallback
* show a warning for that
* qlog fallback
* fix
* wording
old-commit-hash: 65490bb3c55fa81d5144eba2c09f054b73179cc4
2024-01-23 12:53:19 -08:00
Justin Newberry
0ae82f96c6
SegmentRange: __str__ get preferred format ( #31126 )
...
get canonical
old-commit-hash: 35e1e8ecd2e2a8a458467ecb3ec18730610da18a
2024-01-23 11:40:22 -08:00
Justin Newberry
c03fe6bb13
add example of using the comma car segments database ( #31117 )
...
* add vin fingerprinting example
* perhaps!
* remove segment
* easier
old-commit-hash: 389b8ca30d62f81ae40a7d026a299ce3930183da
2024-01-22 18:23:07 -08:00
Justin Newberry
f447062b66
CommaCarSegments: public database of segments for each platform ( #31114 )
...
* comma car segments
* comma car segments for test_models
* oneliner
Co-authored-by: Shane Smiskol <shane@smiskol.com >
* better name
* not used here
* sort
* remove print
* better comment
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: caa9153974c21fd827d0e991f1789cf3e81b5c3b
2024-01-22 17:33:03 -08:00
Justin Newberry
b29eea47ce
sanitizer: sanitize vin number ( #31090 )
...
old-commit-hash: 2c86c023fe2d3072910ed33ff97cd6d3ddf2915d
2024-01-21 12:22:32 -05:00
Justin Newberry
3d0ae1aaaa
prevent typing issue in azure_container ( #31044 )
...
prvent that issue
old-commit-hash: 840db1f1b70e5014f504908eb1beb6358c555cf2
2024-01-17 15:34:24 -08:00
Justin Newberry
09b95b715c
cleanup azure handling ( #31034 )
...
* wip cleanup
* Wip
* fixes
* fix
* cleanup
* keep this for now
* dest
old-commit-hash: 3f0b56b36472b04dca653ac5870f10d4bd53bc01
2024-01-17 14:21:47 -08:00
Justin Newberry
a9676e7086
auto_source: optimize api calls and use head to determine if file exists ( #31025 )
...
* fast
* catch all
* source
* fix file_exists
* remove duplicate reset
* test multiple loops
* iterations
* cleanup imports
old-commit-hash: 2967cada71fd1b40e86356585fa5d68301d9f1c8
2024-01-16 17:24:37 -08:00
Justin Newberry
5df01b3d22
LogReader: fix plotjuggler not reading properly ( #31023 )
...
* fix plotjuggler
* simpler
* fix juggler
* fix that
old-commit-hash: 61fe705160ddb9e5c55292c7f702c5502e2c0d2e
2024-01-16 12:40:49 -08:00
Justin Newberry
4b7edec2b0
LogReader: move opci to tools/lib ( #31021 )
...
move opci
old-commit-hash: 7d400112df6692ef026245b03951345cc36dd83e
2024-01-16 10:58:51 -08:00
Justin Newberry
35dcd7ccd8
LogReader: support lists of identifiers ( #31020 )
...
* support lists of logs
* mark as slow instead
old-commit-hash: 0739d5d7b25f1fbcb70a4dd2ef9b5071afb2c526
2024-01-16 10:40:00 -08:00
Justin Newberry
13e7366b6d
LogReader: support only_union_types ( #31019 )
...
support only-union-types
old-commit-hash: 4da8d165144404e7356e611e68b036ecb33126ef
2024-01-16 10:03:55 -08:00
Adeeb Shihadeh
96e9a7d3ce
CI: speedup unit test job ( #30995 )
...
* start
* mv to buildjet
* fix
old-commit-hash: e17e66180c3a9432e6d303ca36ff0e4af763dace
2024-01-13 21:16:35 -08:00
Justin Newberry
c8cc30112d
rename segmentrangereader to logreader ( #30981 )
...
* Replace multilogiterator
* replace logreader
* update readme
* fix from_Bytes
* new section
* reset before iter
* selector
* fix internal
* whitespace
old-commit-hash: 3d73512c0702598d27e04039976fe0a91d5952f0
2024-01-12 12:53:50 -08:00
Justin Newberry
a729e102c7
Replace multilogiterator ( #30980 )
...
old-commit-hash: 9f1b72ac792b8961cd903e425874f3a00a33ab3e
2024-01-12 11:43:32 -08:00
Justin Newberry
1b65d5cd85
segmentrangereader: support direct parsing ( #30973 )
...
* use correct source
* revert
* cleanup imports
* clean
* direct parsing
* rename
* move up
* fixes
* fix that
* better error message
old-commit-hash: eb09294fc265ffc9cc2ed7f03acc5037d064de81
2024-01-11 16:56:48 -08:00
Justin Newberry
11449845e7
segmentrangereader: support more sources ( #30970 )
...
* support more sources
* remove this
old-commit-hash: fb994ae782259e8ed4d9212edc3c9fb277f831f6
2024-01-11 12:55:19 -08:00
Justin Newberry
3b86243f1f
SegmentRangeReader: log type selector ( #30960 )
...
* log type selector
* test this too
* and this
* invalid selector
* use strenum
* don't hardcode size
* oneline
old-commit-hash: be814ed44747ab09f8db429ff0ee1e7f87180fec
2024-01-11 10:25:24 -08:00
Justin Newberry
9e6c6d92b0
segmentrangereader: support sort_by_time ( #30954 )
...
support sort-by-time
old-commit-hash: cfb23eb2d160639b870690a9bd6e7ba5350e3bc6
2024-01-10 13:36:55 -08:00
Justin Newberry
1f434b2714
SegmentRangeReader: new format for reading multiple segments ( #30940 )
...
* segment range reader
* rename that
* revert that
* cleanup
* revert this for now
* revert this for now
* Fix + test
* rm that
* rm that
* use for auto_fingerprint
* simpler
* for notebook too
* match numpy indexing
* just use numpy directly
* remove that
* spacing
* spacing
* use qlog for auto fingerprint
* add 'read mode'
* pass in read mode
* add test for modes
* numpy indexing
* fix that case
* more examples
* fix the notebook
* cleanup the notebook
* cleaner
* fix those
old-commit-hash: 0d126e1e9e60a3d995bc90454bee206b5d70024f
2024-01-10 11:55:19 -08:00
Justin Newberry
7aecd2f91d
url_file: fix non-200 files being cached ( #30886 )
...
* fix + test
* fix unclosed
* easier to read
Co-authored-by: Shane Smiskol <shane@smiskol.com >
* fix that
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: fba521ecc6d4c260de8f3e93dadbc3e157a9a9a6
2024-01-02 12:42:08 -08:00
Adeeb Shihadeh
207073dc4c
fix unused
...
old-commit-hash: 51a93cf9aaa3c1bc07738a412a4e19cb3dc6dcba
2023-12-17 16:32:56 -08:00
royjr
d41f215df8
dependency: remove pycurl package ( #30771 )
...
* Update qcomgpsd.py
* Update url_file.py
* remove pycurl
* requests -> urllib3
* unused
* redundant
* fix import
* Revert "requests -> urllib3"
This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.
* headless
* fix trail
* use requests.exceptions.RequestException
* use fp.tell
* fix indents
* reorder imports
* change timeout
* fix debug timing
* remove exception
* add timeout
* missing headers
* move to constructor
* move import
* unused import
* fix debug
* try
* no retries
old-commit-hash: 70624ffc819c29d842cb68fd86f42eac95421b10
2023-12-17 16:25:25 -08:00
Greg Hogan
e91032efb3
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion ( #30618 )
...
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
old-commit-hash: db35dcd0b5353d9c009fcf5817e611125a6b0b8b
2023-12-06 09:55:29 -08:00
Justin Newberry
661132be5a
Pytest: more post-test path cleanup ( #30556 )
...
* test cleanup
* missed this one
* remove that
* static class
old-commit-hash: 4086795c29bacd245a7cc372a16730e1a6ff974f
2023-11-30 09:55:48 -08:00
Kacper Rączy
6f51ee8267
URLFile: exception type for failed requests ( #30330 )
...
URLFileException for URLFile request errors
old-commit-hash: c27e977475e33e19c8042dfead745f5cbc1ad9ee
2023-10-25 16:20:12 -07:00
Greg Hogan
a544533476
framereader: eliminate tempfile usage ( #30289 )
...
old-commit-hash: 68acb26aa2dde973bd7a8b48dca4fa8a06d79fe3
2023-10-18 19:48:26 -07:00
Greg Hogan
99d094a006
fix ffprobe on device ( #30286 )
...
* fix ffprobe on device
* use FileReader
* no more requests
old-commit-hash: 59e947dc6c70f515e887cc2e09ed2ea0b39fa679
2023-10-18 18:31:14 -07:00
Justin Newberry
ef1acd4e6c
Proc Replay: cleanup iterable log typing ( #30261 )
...
* cleanup log typing
* use iterable
* fix those
* Cleanup
* cleanup
* missed that one
old-commit-hash: 1820b5f25930ae68e760157d6ff026516e3811ed
2023-10-17 12:58:28 -07:00
Greg Hogan
a62749f527
vidindex improvements ( #30196 )
...
* vidindex improvements
* fix spelling
old-commit-hash: 6f98a987afd4f32db3d04c5d4ba3bf49be4b8e07
2023-10-05 22:48:50 -07:00
Greg Hogan
e0469bdde6
filereader cleanup ( #30191 )
...
* filereader cleanup
* make name return url
* remove unused imports
old-commit-hash: 86b90a8ba263df067406e0089eb507c3a397640e
2023-10-05 19:45:46 -07:00
Greg Hogan
29bb2cf867
convert vidindex to python ( #30176 )
...
* convert vidindex to python
* fix whitespace
* corrupt file option
* fix up typings
* fix return type
* update framereader
* change length delimiter to uint32 value
* change length to uint32 value
* move url_file changes to separate PR
* cleanup caching
* revert whitespace change
* fix frame type param type
old-commit-hash: f8e488f881cec5c654282b44910b07a541832fa8
2023-10-05 18:40:24 -07:00
Justin Newberry
a9153302a3
URLFile: don't cache non-existent file's lengths ( #30071 )
...
* urlfile empty
* simplify with mock
* better test name
* PR cleanup
* cleanup the length file
old-commit-hash: fa51bbc2364c1024097dc085afb5982c42f9c524
2023-10-04 12:57:56 -07:00
YassineYousfi
eb7cad40dd
framereader: add cache_dir argument ( #29904 )
...
* framereader: add cache_dir argument
* make it an env var
old-commit-hash: 880157f5a614a4a524273a9833e0a066fdec371e
2023-09-14 14:36:32 -07:00
Greg Hogan
b5375cc82d
importing auth_config.py should not have side effects ( #29893 )
...
import should not create directory
old-commit-hash: 140a4ba5587b84fd234df04c23261f1e50dece08
2023-09-12 18:00:18 +00:00
Justin Newberry
dc6078a6c3
System: use paths for download folders too ( #29818 )
...
* use paths for download folders too
* trailing slash
* reset that
old-commit-hash: 73eda51a11955627f4d149fdf12c1c781983d52e
2023-09-07 12:49:03 -07:00
Justin Newberry
3b91610c0b
Precommit: ensure executable bit is set ( #29784 )
...
* precommit ensure executable
* exclude tinygrad
* bump submodules
* exclude tinygrad globally
old-commit-hash: 4e69937d0d3fbdc7d1d42cbc18d7ccf8ddb115f1
2023-09-05 16:33:26 -07:00
Justin Newberry
1cc555c37b
Tests: expand temporary directory helpers for more directories ( #29735 )
...
* create helpers for testing
* document it
* fix other tests
old-commit-hash: 405d09714c15956a6d220ff963d07b89c8e790ca
2023-08-31 14:00:31 -07:00
