Commit Graph

17 Commits

Author SHA1 Message Date
Greg Hogan
a17639bddb logreader: skip internal source if connection refused (#32418)
* logreader: skip internal source if connection refused

* fix indentation

* fix spacing

* explicit ipv4 and tcp
old-commit-hash: 2a46d71fc885201d88ca63bc52d26ef715545a23
2024-05-13 16:02:28 -07:00
Shane Smiskol
4c7ad7f3b7 tools/lib: format code (#31454)
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
old-commit-hash: 0846175f44ac9364527087db4ec54767e6884fca
2024-02-14 01:56:17 -08:00
Greg Hogan
1384c10fb0 logreader: skip internal source if not available (#31400)
* logreader: skip internal source if not available

* raise exception

* but only when appropriate
old-commit-hash: 667693b8c2ca7ef0b0457823cd76b93b22764038
2024-02-10 00:20:43 -08:00
Greg Hogan
01eccef5de filereader should use connection pool for file_exists (#31158)
* filereader should use connection pool for file_exists

* remove debug var
old-commit-hash: 6901aada14df6aa68b5e3970da0487b8d2b4df8c
2024-01-25 13:26:12 -08:00
Justin Newberry
a9676e7086 auto_source: optimize api calls and use head to determine if file exists (#31025)
* fast

* catch all

* source

* fix file_exists

* remove duplicate reset

* test multiple loops

* iterations

* cleanup imports
old-commit-hash: 2967cada71fd1b40e86356585fa5d68301d9f1c8
2024-01-16 17:24:37 -08:00
Greg Hogan
e0469bdde6 filereader cleanup (#30191)
* filereader cleanup

* make name return url

* remove unused imports
old-commit-hash: 86b90a8ba263df067406e0089eb507c3a397640e
2023-10-05 19:45:46 -07:00
Adeeb Shihadeh
16ec56398c add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
Justin Newberry
7d6d3dc9ea Ruff: flake8 pie (misc lints) (#29318)
flake8 pie
old-commit-hash: af3ed37c5cd8823f793aec60e1c74760cf795bd9
2023-08-10 15:28:51 -07:00
Mitchell Goff
a2d87101c7 Update DATA_ENDPOINT default to data-raw.comma.internal (#25597)
old-commit-hash: acbb230e0a2887971d906d9ae057ba0a7db44316
2022-08-29 13:31:43 -07:00
Greg Hogan
20670f0740 filereader better name for cd:/ replacement
old-commit-hash: a6b46c311e41875612e6d28f6978f4e1d1e20e46
2022-01-13 18:21:19 -08:00
Greg Hogan
c0e265b859 fix filereader cd:/ replacement
old-commit-hash: df35ebdcebc8704f964d3301004fcaf88e70336f
2022-01-13 16:09:56 -08:00
Greg Hogan
0b659ce9b6 eliminate xx filereader (#23514)
* eliminate xx filereader

* framereader cleanup
old-commit-hash: d5f4fdb1dbda7cfabdcc9d2c9342636e56388716
2022-01-13 15:56:54 -08:00
Greg Hogan
eca265120f FrameIterator that uses 1+ GB less RAM (#21687)
old-commit-hash: 8f1806602c4e4a70e073bf1abd8f61206864d652
2021-07-22 12:08:56 -07:00
Willem Melching
d849706bc9 remove parallel url downloader
old-commit-hash: 927ef086f785409931e4d9c5d1274e9ab5d1568a
2020-09-21 10:32:08 +02:00
Willem Melching
9c291968f6 Speedup URLFile (#1888)
* add parallel download support to URLFile

* make python 3.8 happy

* Fix chunk size

* Automatic number of threads

* No daemon threads in unlogger

* Cache length

* dont touch old filereader

* Remove debug info

* remove debug script

* Ignore type
old-commit-hash: c70700758d9e3227a157d2e9fdcb9d3204b433c2
2020-07-20 17:10:08 +02:00
Andy
738c3cca79 Tools: Storage API (#1161)
* filereader

* support URLs in filereader, logreader

* unused

* use route files api; add auth file

* Implement browser auth

* Update readme, fix up cache paths

* Add tests, clear token on 401

* Factor out URLFile

* space

old-commit-hash: c4af05868ba82d4295e3f508e8477f2f6f898834
2020-02-24 21:24:54 -05:00
George Hotz
99c5800ea5 merge in tools
old-commit-hash: 29ac3da7b84426c6764150cb233b9c7bab1446d8
2020-01-17 10:07:22 -08:00