Commit Graph

13 Commits

Author SHA1 Message Date
Justin Newberry
2967cada71 auto_source: optimize api calls and use head to determine if file exists (#31025)
* fast

* catch all

* source

* fix file_exists

* remove duplicate reset

* test multiple loops

* iterations

* cleanup imports
2024-01-16 17:24:37 -08:00
Greg Hogan
86b90a8ba2 filereader cleanup (#30191)
* filereader cleanup

* make name return url

* remove unused imports
2023-10-05 19:45:46 -07:00
Adeeb Shihadeh
a9626f95b6 add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
2023-08-20 20:49:55 -07:00
Justin Newberry
af3ed37c5c Ruff: flake8 pie (misc lints) (#29318)
flake8 pie
2023-08-10 15:28:51 -07:00
Mitchell Goff
acbb230e0a Update DATA_ENDPOINT default to data-raw.comma.internal (#25597) 2022-08-29 13:31:43 -07:00
Greg Hogan
a6b46c311e filereader better name for cd:/ replacement 2022-01-13 18:21:19 -08:00
Greg Hogan
df35ebdceb fix filereader cd:/ replacement 2022-01-13 16:09:56 -08:00
Greg Hogan
d5f4fdb1db eliminate xx filereader (#23514)
* eliminate xx filereader

* framereader cleanup
2022-01-13 15:56:54 -08:00
Greg Hogan
8f1806602c FrameIterator that uses 1+ GB less RAM (#21687) 2021-07-22 12:08:56 -07:00
Willem Melching
927ef086f7 remove parallel url downloader 2020-09-21 10:32:08 +02:00
Willem Melching
c70700758d Speedup URLFile (#1888)
* add parallel download support to URLFile

* make python 3.8 happy

* Fix chunk size

* Automatic number of threads

* No daemon threads in unlogger

* Cache length

* dont touch old filereader

* Remove debug info

* remove debug script

* Ignore type
2020-07-20 17:10:08 +02:00
Andy
c4af05868b Tools: Storage API (#1161)
* filereader

* support URLs in filereader, logreader

* unused

* use route files api; add auth file

* Implement browser auth

* Update readme, fix up cache paths

* Add tests, clear token on 401

* Factor out URLFile

* space
2020-02-24 21:24:54 -05:00
George Hotz
29ac3da7b8 merge in tools 2020-01-17 10:07:22 -08:00