10 Commits

Author	SHA1	Message	Date
Dean Lee	dbec761941	logreader: support reading from corrupt log (#23050) ... * catch exception outside loop * print decompress error * add test case for corrupt log * fix decompressbz2 stuck if log is corrupt * recovered from corrupt data * add output * ass space * std::endl * override load(), load from buffer * override FrameReader::load to load from the buffer * replace NULL with nullptr * fix test case for corrupt log * Trigger Build * check bzerror too Co-authored-by: Willem Melching <willem.melching@gmail.com>	2021-11-29 14:10:24 +01:00
Dean Lee	9cb46cc4a1	logreader: fix memory leak in Event (#22987)	2021-11-20 11:12:52 +01:00
Dean Lee	2b4a477fbc	replay: improve segment download and merge (#22654) ... * no-cache mode * fix test cases build error * space * don't create cache dir in no-cache mode * fix errors in test cases * no_local_cache_ * set the number of connections by chunk_size * use size_t instead of int64_t * add test case for no-cache mode * rename variables * fix SIGSEGV * cleanup * faster decompressBZ2 * always decompress bz2 * add test cases * prepare for python interface * fix test cases build error * continue * camera_replay: cache remote file * protected inheritance * single option name * TODO * test_case for LogReader&FrameReader * fix wrong require * test case for FileReader * cleanup test * test:fix wrong filename * check cached file's checksum * fix mkdir permissions err cleanup filereader * remove initialize libav network libraries. dd * abort all loading if one failed * cleanup tests * use threadpool to limit concurrent downloads * cache more segments * merge 3 segments for replay * one segment uses about 100M of memory * use segments_need_merge.size() * shutdown * fix stuck if exit replay before keyboard thread started * load one segment at a time * small cleanup * cleanup filereader * space * tiny cleanup * merge master * cleanup test cases * use util:create_directories * cleanup framereader	2021-11-01 11:55:56 +01:00
Dean Lee	d70e49dca5	replay: build on devices (#22632) ... * there is no QThread::create on device * add files to files_common * modify SConscript * no memory_resouce on device * #define HAS_MEMORY_RESOURCE * fix hangs on shutdown * build on device with the --extra flag * delete later * setup -> extras Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>	2021-10-29 12:21:57 +02:00
Dean Lee	94b3d4d267	replay: allocate events in contiguous memory pool (#22535) ... * memory pool * reserve events too * remove dctor * cleanup * move pool into class LogReader * cleanup include	2021-10-18 11:10:08 +02:00
Dean Lee	acc52ece20	replay: refactor Route and Segment (#22531) ... * new functions * fix wrong call to qUrl::isLocalFile * cleanup * keep extension in cached files * cleanup * simplify segment * delete thread * add output * pre-decompress * remove suffix * revert remove suffix * 1 connection for log file * cleanup * segment may not be continuous,use map * don't emit finish if aborting_ * use QFuture and thread pool * cleanup * fix segfault in LoadFromLocal * cleanup * handle segment failed to load * output info * continue error handling * Remove redundant testSeekTo * cleanup * always return true * keep time is ok now change to 1s write 1 byte at the end of the sparse file * log loading segment * merge #22476 * Update selfdrive/ui/replay/logreader.cc * correct connect * pub message in function * typo * Update selfdrive/ui/replay/replay.cc Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>	2021-10-15 14:35:17 -07:00
Dean Lee	c801c65b9d	replay: get EncoderIndex from capnp::AnyStruct (#22518) ... * get EncoderIndex from capnp::AnyStruct * const	2021-10-11 09:57:35 -07:00
Dean Lee	d28b98c602	replay : move utility functions into separate file (#22414) ... * move functions into util * read bz2 into stream * pre-decompress log in the download thread * cleanup logreader * cache sha256 path * use readBZ2file in test_logger * Revert "cache sha256 path" This reverts commit 60459d3ea09a2c80f4560cf95b1ce7d6af59f06d. * use macro * use ostringstream * cleanup readBZ2File * move precise_nano_sleep into util	2021-10-04 15:39:59 +02:00
Willem Melching	6881688af2	replay: send frames based on encodeIdx packet (#22361) ... * send frames based on encodeIdx * use start of frame time if set * also use end of frame if set * fix timestamp for encode packets * handle all cameras * add comment * add twice	2021-09-29 17:43:56 +02:00
Dean Lee	dff6dbfbe9	rename filereader.cc[h] to logreader.cc[h] (#22279)	2021-09-19 15:54:03 -07:00