Commit Graph

9 Commits

Author SHA1 Message Date
Mitchell Goff
a2d87101c7 Update DATA_ENDPOINT default to data-raw.comma.internal (#25597)
old-commit-hash: acbb230e0a
2022-08-29 13:31:43 -07:00
Greg Hogan
20670f0740 filereader better name for cd:/ replacement
old-commit-hash: a6b46c311e
2022-01-13 18:21:19 -08:00
Greg Hogan
c0e265b859 fix filereader cd:/ replacement
old-commit-hash: df35ebdceb
2022-01-13 16:09:56 -08:00
Greg Hogan
0b659ce9b6 eliminate xx filereader (#23514)
* eliminate xx filereader

* framereader cleanup
old-commit-hash: d5f4fdb1db
2022-01-13 15:56:54 -08:00
Greg Hogan
eca265120f FrameIterator that uses 1+ GB less RAM (#21687)
old-commit-hash: 8f1806602c
2021-07-22 12:08:56 -07:00
Willem Melching
d849706bc9 remove parallel url downloader
old-commit-hash: 927ef086f7
2020-09-21 10:32:08 +02:00
Willem Melching
9c291968f6 Speedup URLFile (#1888)
* add parallel download support to URLFile

* make python 3.8 happy

* Fix chunk size

* Automatic number of threads

* No daemon threads in unlogger

* Cache length

* dont touch old filereader

* Remove debug info

* remove debug script

* Ignore type
old-commit-hash: c70700758d
2020-07-20 17:10:08 +02:00
Andy
738c3cca79 Tools: Storage API (#1161)
* filereader

* support URLs in filereader, logreader

* unused

* use route files api; add auth file

* Implement browser auth

* Update readme, fix up cache paths

* Add tests, clear token on 401

* Factor out URLFile

* space

old-commit-hash: c4af05868b
2020-02-24 21:24:54 -05:00
George Hotz
99c5800ea5 merge in tools
old-commit-hash: 29ac3da7b8
2020-01-17 10:07:22 -08:00