Commit Graph

395 Commits

Author SHA1 Message Date
Greg Hogan
20670f0740 filereader better name for cd:/ replacement
old-commit-hash: a6b46c311e41875612e6d28f6978f4e1d1e20e46
2022-01-13 18:21:19 -08:00
Greg Hogan
c0e265b859 fix filereader cd:/ replacement
old-commit-hash: df35ebdcebc8704f964d3301004fcaf88e70336f
2022-01-13 16:09:56 -08:00
Greg Hogan
0b659ce9b6 eliminate xx filereader (#23514)
* eliminate xx filereader

* framereader cleanup
old-commit-hash: d5f4fdb1dbda7cfabdcc9d2c9342636e56388716
2022-01-13 15:56:54 -08:00
Adeeb Shihadeh
597535c014 linter: don't allow implicitly concatenated strings (#23513)
* linter: don't allow implicitly concatenated strings

* fix hyundai
old-commit-hash: 2c94f155840b49639b8bf1ec996d99e268fa9a52
2022-01-13 14:19:38 -08:00
Adeeb Shihadeh
8f9a6b06df tools: add bootlog helpers (#23504)
* tools: add bootlog helpers

* this is nice

* types
old-commit-hash: 7d7c0ff35fe91c480711f6213e9869000a3fe148
2022-01-12 21:37:43 -08:00
Adeeb Shihadeh
9908210bd6 tools: better joystick instructions
old-commit-hash: 7eca4d62078b14de62c5f2ce08e382eb31cc7076
2022-01-10 12:03:27 -08:00
Adeeb Shihadeh
1ea1b9072a smaller docker image (#23469)
* save 2gb

* not used

* more cleanup

* little more

* wget too big

* follow

* needed for sim
old-commit-hash: fa3055f280ca56ce4563108a85e6ca6e121310c5
2022-01-10 11:43:18 -08:00
Andrew
192978753d mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
old-commit-hash: 66644217100f17e0a0c4f95f86aed2fd8c09c28c
2022-01-07 15:15:18 -08:00
rzeydelis
3c7e41d900 tools: update README.md (#23447)
old-commit-hash: 207ce410b4de8d5a85448e8edc59c5596f84cf53
2022-01-07 14:03:27 -08:00
Adeeb Shihadeh
24314bdc3f fix up tools readme
old-commit-hash: f30a702414b75e97ab905797350522f8a12932ab
2022-01-04 19:59:49 -08:00
Greg Hogan
bb3402b54d plotjuggler: support segment names (#23263)
* plotjuggler: support segment names

* update docs

* generic parser

* convert segment number to int when parsing

* add SegmentName

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 71132edf17a78b629e3fa244caa21bebdc488929
2022-01-04 15:55:46 +01:00
Cameron Clough
f9e8fb3145 Joystick: learn axis min/max (#23377)
* Joystick: learn axis min/max

* clean up updating max/min

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 5a77157ea435260b3e7ecacb83f13d3753ede859
2022-01-04 14:17:30 +01:00
Greg Hogan
f6a9445de8 tools: configure PYTHONPATH in pipenv (#23361)
* automatically set PYTHONPATH in pipenv

* remove other place this was set
old-commit-hash: 3e5a2730227603e06e2b0df657dd7a3e874a6bd1
2022-01-03 20:15:10 -08:00
Adeeb Shihadeh
ba30137b2a MultiLogIterator: fix after adding sort_by_time
old-commit-hash: bbb47dc860f37ec6e34287d6696cb45e5637df74
2022-01-02 20:08:57 -08:00
Adeeb Shihadeh
c036e64c86 MultiLogIterator: remove wraparound mode (#23360)
old-commit-hash: 92f194decc2bce39d6dd0dbabf39b2a9b1aa53e5
2022-01-02 15:16:44 -08:00
Adeeb Shihadeh
02f1866b61 CI: use ubuntu_setup.sh (#23349)
* CI: use ubuntu_setup.sh

* works?

* need to fix paths

* set paths

* no batman for now

* pyenv version

* rehash after install packages

* unify python install

* revert that

* fix pyenv path

* no pipenv

* flip that

* fix rehash

* skip that

* revert panda
old-commit-hash: 066e3e3626f56d8f86c120defe4181eaed0182f4
2022-01-02 14:47:16 -08:00
Greg Hogan
2f843c3023 LogReader: add arg to sort by time (#23346)
* logreader optional sort by time

* robust logreader sort by time option
old-commit-hash: 9992ea1ae82dd02199e7e04bbbb8af54728d6200
2022-01-02 11:56:53 -08:00
Greg Hogan
e58562bcb6 plotjuggler: fix layout param (#23348)
old-commit-hash: 92b553be3ea0c4309961647a796dbdde3da5fdf6
2022-01-01 17:17:24 -08:00
Shane Smiskol
0c267f7685 PC: dynamically set PYTHONPATH from real openpilot path (#23322)
* dynamic PYTHONPATH setting based on actual openpilot location

* right above

* fix path

* absolute path all the time

* Revert "absolute path all the time"

This reverts commit c0bc2e08e76bd6c0abd36fa082ee00b4746e62dc.

* Update tools/openpilot_env.sh

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: fed7cfeef064b12f76b413298ffdf71fec1f537e
2021-12-31 19:34:08 -08:00
Adeeb Shihadeh
55e0fb4a55 fix setup scripts if git isn't installed
old-commit-hash: 7cd6a88638be390e0a7a13210e837afc36e1c18c
2021-12-31 19:29:38 -08:00
Adeeb Shihadeh
3b0d5834bd plotjuggler: add mac support (#23344)
* plotjuggler: add mac support

* fix test?

* update readme

* oops

* fix

* cleanup

* typo

* works

* little more

* fix test

* little faster
old-commit-hash: c26f294218a72e4a42d90b6560bde32e1a9cf5cb
2021-12-31 16:44:57 -08:00
Adeeb Shihadeh
d710eed2d9 mac_setup: install git-lfs
old-commit-hash: 8fe9c0ef931a19be187fe8fceb3cf69e8864f80f
2021-12-31 10:08:34 -08:00
Ewout ter Hoeven
f206ebd054 Pyupgrade 3.6: Update syntax with Python 3.6+ features (#23305)
Updated Python code with Python 3.6+ features:
- utf-8 encoding is now the default (PEP 3120)
- Replace list comprehensions by Generator Expressions (PEP 289)
- Replace yield loop by yield from (PEP 380)
- Remove the (object) subclass when defining a class
- Replace the IOError alias by OSError (PEP 3151)
- Define sets with curly braces {} instead of set()
- Remove "r" parameter from open function, which is default

Co-Authored-By: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-Authored-By: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>

Co-authored-by: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-authored-by: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>
old-commit-hash: 332f568a8241fba9459cb70c76840b9670e6993a
2021-12-24 11:18:39 -08:00
Ewout ter Hoeven
a962365292 Convert format strings strings to f-strings (#23241)
* Convert all text strings to f-strings

Reformats all the text from the old "%-formatted" and .format(...) format to the newer f-string format, as defined in PEP 498. This requires Python 3.6+.

Flynt 0.69 was used to reformat the strings. 120 f-strings were created in 51 files.

F-strings are in general more readable, concise and performant. See also: https://www.python.org/dev/peps/pep-0498/#rationale

* revert pyextra changes

* revert ublox.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 55390d273f36f49da3896e687ac5530f40c1d150
2021-12-16 14:58:17 +01:00
grekiki
9e4cc1f7ff Python: Replace more lists with generators (#23116)
* Replace lists with generators v2

* Replace set with {}

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Replace more set() with {}

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 6951b3271d1770297cb6bd53878463035ec0bf43
2021-12-03 22:57:19 -08:00
Adeeb Shihadeh
0827af77e5 MultiLogIterator: default wraparound to false
old-commit-hash: c8356d3b8f4ef822161af75087553506e5fb78df
2021-12-02 08:14:48 -08:00
Dean Lee
9b0fcaeb84 rename yuv streams (#23071)
* rename yuv streams

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 348d2d2b0d169b0d181a51eb0e23b1f9b8fc6793
2021-11-29 18:14:59 -08:00
Adeeb Shihadeh
6c90a5d445 logreader: remove log path print
old-commit-hash: 01b99eae35906ba95c25c2498b19a53a0e8fc591
2021-11-29 13:44:20 -08:00
Adeeb Shihadeh
807e84d900 juggle: add demo flag and improve README
old-commit-hash: 920b751888a09192f055241c7db6cfdfc5f1bf57
2021-11-28 14:19:49 -08:00
Adeeb Shihadeh
973a48acef remove dead + duplicate python code
old-commit-hash: 08f9316b56ffe2c36a5d9c23d0b4df49903ad52a
2021-11-28 14:02:06 -08:00
Willem Melching
70e2e78f52 sim: improve carla performance (#23046)
old-commit-hash: a4ca8e4835949f5f8a5d6123142f9ffcb7e36245
2021-11-28 11:32:37 +01:00
Adeeb Shihadeh
94d30c6c5f camerad: remove camera frame stream (#23045)
* camerad: remove camera frame stream

* fix release files
old-commit-hash: 8160cf3c1b2726709db58219c33d1616b4a8acb5
2021-11-27 21:58:21 -08:00
jimw
cf29eacca4 CARLA: send YUV and RGB over visionipc from bridge.py (#23012)
* CARLA: send YUV and RGB over visionipc

* CARLA: send YUV and RGB over visionipc-fix pipfile

* CARLA: send YUV and RGB over visionipc-Camerad class

* relock pipfile

* small bridge cleanup

* use tici camera resolution

* update vof

* HUD_SETTING has no counter

* no loggerd

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: a58d272ae4afa11624220b9392295ad6659db1df
2021-11-26 16:58:25 +01:00
Adeeb Shihadeh
5aebf5466a can_replay: warning & clone cmd if jungle lib is missing
old-commit-hash: b8393f7271c3b1845e7ad49e35db8688c01770cc
2021-11-23 23:33:26 -08:00
Adeeb Shihadeh
4ffc570eb8 link to ctf in tools readme
old-commit-hash: a64169af26c905521e85e1a48d1cff0095f24d8a
2021-11-19 21:16:49 -08:00
Adeeb Shihadeh
2e40fdfb0f juggle: strip input
old-commit-hash: 80d0aaadf448d9f47a7da4779791566323e5de22
2021-11-18 14:56:01 -08:00
Willem Melching
fd3140fd6f cleanup unused pip packages (#22947)
* cleanup unused pip packages

* fix linter
old-commit-hash: f1c77f97b934fac877230d9438fb4a15d1813c52
2021-11-17 16:23:03 +01:00
eFini
22ea8f17c2 macOS: Fix missing pip command issue. (#22924)
* Fixed missing pip command issue.

* add path to openpilot_env.sh for mac
old-commit-hash: a87190342bbe30aa4fd09c1f9586d9a7060e8b76
2021-11-17 11:23:05 +01:00
Adeeb Shihadeh
c9b2b90681 ubuntu_setup.sh: add option to continue on unsupported os
old-commit-hash: 0674726cf4e0dfffc30d4596e2c650821b792588
2021-11-16 14:30:51 -08:00
qadmus
2e3bf355a1 plotjuggler: plotjuggler: tuning layout w/ cruise setpoint, use carControl.enable not carControl.active (#22908)
old-commit-hash: 5f2c7ad69f68857c0a160032fc4308927e38302e
2021-11-15 13:20:53 -08:00
qadmus
229d987f10 PlotJuggler: Tuning layout (#22902)
* PlotJuggler layout for lateral and longitudinal tuning

* update README and tuning PR template
old-commit-hash: 65d1b5147694934385ec2943c0b67cf0f971c597
2021-11-13 23:16:42 -08:00
Adeeb Shihadeh
17b51d3fd8 sim: fix CAN error and block loggerd
old-commit-hash: 45ced84acf9d0c8fcb5d37a9be82f81b5ff59479
2021-11-13 12:21:24 -08:00
Willem Melching
c11eeb6c80 RobustLogReader that can recover corrupted bz2 files (#22835)
* LogReader with bzip2 recovery

* only rlogs

* add comment

* plotjuggler should also use robust logreader
old-commit-hash: 6d6f989b7f4f084ff2a1124aa4de05b90d7fc534
2021-11-10 16:41:00 +01:00
Adeeb Shihadeh
605c84634a tools/lib/route: expose raw file paths
old-commit-hash: ee33f8a8cd31dce6b6cfcab0dcd0c3c2d9f01595
2021-11-04 20:32:02 -07:00
Willem Melching
2dbecc8a15 tools/lib/auth.py: support github/apple login (#22766)
* tools/lib/auth.py: support github/apple login

* print some info about logged in user

* add docstring
old-commit-hash: 252f3c1c871909611d162596e163fd7e6b8541bb
2021-11-01 15:00:00 +01:00
Dean Lee
15ed1a50a3 replay: fixed the alignment issue when replaying from C3 qcamera (#22734)
* fix qcamera replay

* fix alignment in replay

* upscale yuv if needed

* remove space
old-commit-hash: 41e5e76596eed1b6391cb5770df2c628c3125023
2021-11-01 11:06:00 +01:00
lipniak
9fcb713e9c tools/setup: do not change global state (#22735)
* tools/setup: do not change global state

1. download packages in the venv
2. never change global python version

* update_requirements.sh: install to system if used by comma employees

* bump pip & pipenv versions

* no --upgrade

* run pre-commmit install in venv

* for consistency

Co-authored-by: predicate@bonzo <noreply@example.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1d55f2f23e31dd64568d729ef33325cf229fdf51
2021-10-31 16:37:07 +01:00
lipniak
dc816fc35c tools: add info on common issues (#22709)
* tools/README.md: add more information

1. Add info about OpenCL drivers
2. Add info about pipenv environment

* ubuntu_setup.sh: add clinfo

Adds the clinfo command so you can verify your OpenCL installation.

* tools/README.md: add info on GUI WSL
old-commit-hash: e68849cfc8e612eeadca316070e5f49464b98831
2021-10-29 11:19:43 +02:00
Willem Melching
67f41f32f1 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
old-commit-hash: b816b5b6442c21e63a09108c70986eeedb0372b2
2021-10-28 15:14:37 +02:00
Andrew
1e04063b9b tools/setup: add missing package for plotjuggler (#22713)
old-commit-hash: 999b2ee5cc5af8f356a76b0cb240a3bfffa7b30c
2021-10-27 10:56:41 -07:00