Kacper Rączy
5dd1972f96
logreader: support filesystem DATA_ENDPOINT ( #34340 )
...
* Check if DATA_ENDPOINT is a dir
* Change url resolution to support joining dirs
2025-01-09 01:20:59 +00:00
Shane Smiskol
da2c70e097
Revert "LogReader: fix issue when your dns resolves all requests" ( #34229 )
...
Revert "LogReader: fix issue when your dns resolves all requests (#34089 )"
This reverts commit 7fc5040ed9
2024-12-13 15:11:30 -08:00
Justin Newberry
7fc5040ed9
LogReader: fix issue when your dns resolves all requests ( #34089 )
...
* terrible :(
* keep this spacing
2024-11-22 16:01:53 -08:00
Maxime Desroches
c995d5b9ae
ci: faster test_models ( #33941 )
...
* test
* try 4 runners
* try
* 100 for fun
* the fun is over
* try even less
2024-11-06 19:17:15 -08:00
Jimmy
937ed5f700
Add testing closet to LogReader source ( #33242 )
...
* add testing closet to logreader source
* check source availability
* use internal_source_available
old-commit-hash: 118932acd3
2024-08-11 15:10:14 -07:00
Greg Hogan
a17639bddb
logreader: skip internal source if connection refused ( #32418 )
...
* logreader: skip internal source if connection refused
* fix indentation
* fix spacing
* explicit ipv4 and tcp
old-commit-hash: 2a46d71fc8
2024-05-13 16:02:28 -07:00
Shane Smiskol
4c7ad7f3b7
tools/lib: format code ( #31454 )
...
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
old-commit-hash: 0846175f44
2024-02-14 01:56:17 -08:00
Greg Hogan
1384c10fb0
logreader: skip internal source if not available ( #31400 )
...
* logreader: skip internal source if not available
* raise exception
* but only when appropriate
old-commit-hash: 667693b8c2
2024-02-10 00:20:43 -08:00
Greg Hogan
01eccef5de
filereader should use connection pool for file_exists ( #31158 )
...
* filereader should use connection pool for file_exists
* remove debug var
old-commit-hash: 6901aada14
2024-01-25 13:26:12 -08:00
Justin Newberry
a9676e7086
auto_source: optimize api calls and use head to determine if file exists ( #31025 )
...
* fast
* catch all
* source
* fix file_exists
* remove duplicate reset
* test multiple loops
* iterations
* cleanup imports
old-commit-hash: 2967cada71
2024-01-16 17:24:37 -08:00
Greg Hogan
e0469bdde6
filereader cleanup ( #30191 )
...
* filereader cleanup
* make name return url
* remove unused imports
old-commit-hash: 86b90a8ba2
2023-10-05 19:45:46 -07:00
Adeeb Shihadeh
16ec56398c
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.
* fix pm test
old-commit-hash: a9626f95b6
2023-08-20 20:49:55 -07:00
Justin Newberry
7d6d3dc9ea
Ruff: flake8 pie (misc lints) ( #29318 )
...
flake8 pie
old-commit-hash: af3ed37c5c
2023-08-10 15:28:51 -07:00
Mitchell Goff
a2d87101c7
Update DATA_ENDPOINT default to data-raw.comma.internal ( #25597 )
...
old-commit-hash: acbb230e0a
2022-08-29 13:31:43 -07:00
Greg Hogan
20670f0740
filereader better name for cd:/ replacement
...
old-commit-hash: a6b46c311e
2022-01-13 18:21:19 -08:00
Greg Hogan
c0e265b859
fix filereader cd:/ replacement
...
old-commit-hash: df35ebdceb
2022-01-13 16:09:56 -08:00
Greg Hogan
0b659ce9b6
eliminate xx filereader ( #23514 )
...
* eliminate xx filereader
* framereader cleanup
old-commit-hash: d5f4fdb1db
2022-01-13 15:56:54 -08:00
Greg Hogan
eca265120f
FrameIterator that uses 1+ GB less RAM ( #21687 )
...
old-commit-hash: 8f1806602c
2021-07-22 12:08:56 -07:00
Willem Melching
d849706bc9
remove parallel url downloader
...
old-commit-hash: 927ef086f7
2020-09-21 10:32:08 +02:00
Willem Melching
9c291968f6
Speedup URLFile ( #1888 )
...
* add parallel download support to URLFile
* make python 3.8 happy
* Fix chunk size
* Automatic number of threads
* No daemon threads in unlogger
* Cache length
* dont touch old filereader
* Remove debug info
* remove debug script
* Ignore type
old-commit-hash: c70700758d
2020-07-20 17:10:08 +02:00
Andy
738c3cca79
Tools: Storage API ( #1161 )
...
* filereader
* support URLs in filereader, logreader
* unused
* use route files api; add auth file
* Implement browser auth
* Update readme, fix up cache paths
* Add tests, clear token on 401
* Factor out URLFile
* space
old-commit-hash: c4af05868b
2020-02-24 21:24:54 -05:00
George Hotz
99c5800ea5
merge in tools
...
old-commit-hash: 29ac3da7b8
2020-01-17 10:07:22 -08:00
