Shane Smiskol
fbbad834f3
LogReader: cache internal source available ( #35761 )
...
* cache
* fix
* match behavioir
2025-07-18 18:18:02 -07:00
Shane Smiskol
278781e5af
LogReader: extend FileName ( #35760 )
...
extend filename
2025-07-18 17:00:39 -07:00
Shane Smiskol
43ad1754da
LogReader: fix broken test ( #35758 )
...
fix lr test
2025-07-18 16:17:01 -07:00
Shane Smiskol
4a5385a5b0
LogReader: support connect URLs ( #35757 )
...
* support connect
* clean up
2025-07-18 16:03:30 -07:00
Bruce Wayne
dbe172f7fd
Fragile xx code needs this
2025-07-18 15:39:00 -07:00
Shane Smiskol
618a25a612
LogReader: simplify sourcing logic and improve AUTO performance ( #35753 )
...
* sourcing supports any file type!
* stuff
* no camera for now
* i guess these are fine without
* rename
* get rid of these too!
* fix
* fix
* this is better
* start to clean up!
* better
* holy
holy
* clean up sources
* more robust
* working but needs some clean up
* clean up
* remove some trash
* nl
* auto_source can only return if it finds acceptable logs from sources
* double negative is confusing
* default
* list isn't hashable
* fix typing
* clean up
* speed up -- test_models got zst before bz2 in openpilotci, so do that (some segments have both bz2 and zst!)
* don't be a hero
* same behavior for now
2025-07-18 05:15:55 -07:00
Shane Smiskol
b50b351b15
LogReader: remove commaCarSegments selector ( #35750 )
...
* a source should not be a readmode... and readmode should be logtype
* fix that
* fixup
2025-07-18 02:17:11 -07:00
Shane Smiskol
862a816215
LogReader: add data endpoint option ( #35751 )
...
* add data endpoint option
* clean up
2025-07-17 23:12:08 -07:00
Shane Smiskol
239646b20b
Revert "clean up"
...
This reverts commit 5339a13c34
2025-07-17 21:43:21 -07:00
Shane Smiskol
5339a13c34
clean up
2025-07-17 21:42:47 -07:00
Shane Smiskol
c553c1f872
LogReader: support passing list of sources ( #35749 )
...
* far too long
* this is a better experience
* no rename for now
2025-07-17 19:54:38 -07:00
Harald Schäfer
54da96dbdf
Route: add name format ( #35743 )
...
* needed for now
* TODO
* Add TODO
2025-07-17 18:22:36 -07:00
Shane Smiskol
632f7594a4
Ban time v2 ( #35744 )
...
* ban it!
* some legitimate blunders
* even more!
* this is from commaai/one
* here too
* this too
* ignore rest
* one liner
* Revert "one liner"
This reverts commit d96a1624032aaad829a005b523e579d953cfe690.
2025-07-17 16:50:52 -07:00
commaci-public
3a2c4a855a
[bot] Update Python packages ( #35726 )
...
* Update Python packages
* dep
* ref
* hint
---------
Co-authored-by: Vehicle Researcher <user@comma.ai >
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
2025-07-14 13:48:55 -07:00
Jason Young
b1972af6db
tools: fix log suffix for commaCarSegments v2 ( #35725 )
2025-07-14 05:37:33 -04:00
Adeeb Shihadeh
2b56a6c37e
Revert "tools: update to commaCarSegments v2 ( #35660 )"
...
This reverts commit 12a5d8c2db
2025-07-09 10:58:47 -07:00
Jason Young
12a5d8c2db
tools: update to commaCarSegments v2 ( #35660 )
2025-07-08 18:31:44 -04:00
Maxime Desroches
6a37d8a89e
fix framereader indent
2025-06-19 10:38:26 -07:00
Harald Schäfer
87a6e369aa
Framereader: minor cleanup ( #35577 )
...
* No wrapping
* unused test
* another list
* mypy
* cleaner
* Revert "cleaner"
This reverts commit ccc1446b9d649d64b20175e22a66e135c44b21e5.
* mypy
2025-06-19 09:49:51 -07:00
Harald Schäfer
5f3d876aaa
model replay: framereader cache ( #35576 )
...
* Simpler cache version
* cachetools
* different LRU
* lint
* smaller
* just write LRU
* mypy
* same length
2025-06-18 16:29:22 -07:00
Harald Schäfer
d9b6c16037
Cleanup framereader ( #35513 )
...
* squash
* misc cleanup
* no LLM garbage
* misc fixes
* typo
* fix CI
* fix hints
* LLM soo wordy
* improve
2025-06-09 22:39:35 -07:00
Harald Schäfer
a8639d3feb
rgb is default ( #35467 )
...
* rgb is default
* change dummy default
2025-06-04 23:40:41 -07:00
Harald Schäfer
5505338ffb
model replay: less frames and less complexity ( #35427 )
...
* Revert "ci: faster model_replay (#34036 )"
This reverts commit 847a5ce1f3
2025-06-02 21:54:37 -07:00
Trey Moen
19ad50a185
feat(route.py): add metadata, events retrieval ( #35261 )
...
* feat(route.py): add metadata, events retrieval
* whitespace
* raise for status
2025-05-21 11:33:47 -07:00
Trey Moen
60113632b4
feat(clip): delete get_metadata call ( #35229 )
...
* feat: delete get_metadata call
* no one else is using this now
2025-05-15 10:02:46 -07:00
Maxime Desroches
997a99926c
ci: overwrite previous comment for model_replay ( #35209 )
...
* less
* test
* fix
* cleanup
2025-05-13 21:06:30 -07:00
Trey Moen
f704d18a8b
feat(clip): title and metadata overlay ( #35099 )
...
* wip
* moar
* ensure inter is installed
* line len
* refactor
* dont need this
* no longer than
* show meta for 4s
2025-05-04 10:16:35 -07:00
Shane Smiskol
27d882cc0a
Revert "logreader.py: concurrent file existence checks" ( #34942 )
...
Revert "logreader.py: concurrent file existence checks (#34875 )"
This reverts commit e11b239b2e
2025-03-26 14:45:35 -07:00
Shane Smiskol
e652f435f9
max_lat_accel.py: use parallel processing ( #34936 )
...
* use run_across_segments
* disable tqdm
2025-03-25 13:26:16 -07:00
Dean Lee
e11b239b2e
logreader.py: concurrent file existence checks ( #34875 )
...
* concurrent file existence checks
* upper bound on parallel queries
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
2025-03-24 15:46:42 -07:00
Shane Smiskol
65d667e60e
Revert "logreader: avoid repeated prompts in auto_strategy when rlogs are missing" ( #34919 )
...
Revert "logreader: avoid repeated prompts in auto_strategy when rlogs are mis…"
This reverts commit b8229ebca6
2025-03-21 17:28:19 -07:00
Dean Lee
b8229ebca6
logreader: avoid repeated prompts in auto_strategy when rlogs are missing ( #34890 )
...
* avoid repeated prompts in auto_strategy when rlogs are missing
* shorter
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
2025-03-21 14:43:48 -07:00
Dean Lee
5cffaf5bb5
url_file.py: remove the unnecessary str() wrapping around the hexdigest() ( #34891 )
...
remove the unnecessary str() wrapping around the hexdigest()
2025-03-17 12:23:57 +00:00
Adeeb Shihadeh
071f8ba658
LogReader: add time_series helper
2025-02-19 16:43:54 -08:00
Adeeb Shihadeh
a30d3f7d72
test_onroad: cleanup with time series LogReader ( #34613 )
2025-02-17 21:26:21 -08:00
Adeeb Shihadeh
bab1254a02
LogReader: add time series helper ( #34608 )
...
* simple time series
* example
2025-02-17 16:26:41 -08:00
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
2025-02-08 12:55:31 -08:00
Kacper Rączy
5dd1972f96
logreader: support filesystem DATA_ENDPOINT ( #34340 )
...
* Check if DATA_ENDPOINT is a dir
* Change url resolution to support joining dirs
2025-01-09 01:20:59 +00:00
Shane Smiskol
da2c70e097
Revert "LogReader: fix issue when your dns resolves all requests" ( #34229 )
...
Revert "LogReader: fix issue when your dns resolves all requests (#34089 )"
This reverts commit 7fc5040ed9
2024-12-13 15:11:30 -08:00
Maxime Desroches
e9246df02e
ci: faster unit tests ( #34161 )
...
* fast
* lint
* try
* clean
* this
* try even more
* more
* maybe
* what
* maybe?
* maybe
* try this
* fix
* fast?
* now cache?
* debug
* again...
* maybe
* NOW!
* revert, this is already enough (for now?)
2024-12-05 16:41:38 -08:00
Dean Lee
e19ecbf75c
CommaApi: use context manager for response handling ( #34118 )
...
use context manager for response handling
2024-12-05 15:28:11 -08:00
Justin Newberry
7fc5040ed9
LogReader: fix issue when your dns resolves all requests ( #34089 )
...
* terrible :(
* keep this spacing
2024-11-22 16:01:53 -08:00
Maxime Desroches
847a5ce1f3
ci: faster model_replay ( #34036 )
...
* cache draft
* fix
* fix
* fix
* better
* zst
* more
* try
* pool
* fix
* fix
* revert :C
* better
* cleanup
* no cache
* this too
2024-11-16 15:34:21 -08:00
Maxime Desroches
c995d5b9ae
ci: faster test_models ( #33941 )
...
* test
* try 4 runners
* try
* 100 for fun
* the fun is over
* try even less
2024-11-06 19:17:15 -08:00
Shane Smiskol
2af9f68147
LogReader: more specific exceptions ( #33914 )
...
* more specific logreader exceptions
* huh
* fix
2024-11-01 15:59:46 -07:00
Maxime Desroches
f11e5492f8
ci: keep old comment on model replay report ( #33759 )
...
keep old
2024-10-09 15:29:41 -07:00
Maxime Desroches
596d8b13bb
ci: model_replay improvements ( #33753 )
...
* diff
* tr
* cleanup
* at the end
* fix
2024-10-08 17:39:13 -07:00
Maxime Desroches
2e83e37984
jenkins: model replay report in PR ( #33723 )
...
* first
* first
* first
* token
* edit previous comment
* clean
* plots
* linter
* cleaner
* comment
* save ref
* fix
* remove refs
* add tokens
* fix branch
* table
* fix
* real data
* title
* github
* fix
* github api
* better
* clean
* errors
* create bucket
* true
* fix
2024-10-07 21:40:00 -07:00
Shane Smiskol
606943010e
Reapply "joystickd is a real process ( #33490 )" ( #33514 )
...
* Reapply "joystickd is a real process (#33490 )"
This reverts commit c8465e3a21
2024-09-07 17:03:22 -07:00
commaci-public
1e92af9b3c
[bot] Update Python packages ( #33436 )
...
* Update Python packages
* bump
* specify any list of sources
ooh this is pretty nice
* update
* y
* fix
* fix that
* bump
---------
Co-authored-by: Vehicle Researcher <user@comma.ai >
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: 239cc69a20b7d3c2f285bd1907cecad9c9604d50
2024-09-03 18:57:28 -07:00
