OpenBot Versions Save

The following summarizes the changes compared to the previous release v0.7.0.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.7.0...v0.7.1

Robot App

• Minor UI changes to Android app by @thias15 in https://github.com/isl-org/OpenBot/pull/360
• Adjust iOS UI to be more consistent with Android UI by @quentin-leboutet in https://github.com/isl-org/OpenBot/pull/361

  

Node.js Controller

• Node.js Web controller client UI improvements by @Coder-Lars in https://github.com/isl-org/OpenBot/pull/359

Policy learning

• Fix issue related to matplotlib when running webserver by @thias15 in https://github.com/isl-org/OpenBot/pull/362

The following summarizes the changes compared to the previous release v0.6.2.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.6.2...v0.7.0

Robot App

Android

• Add BLE support + DPAD support by @sparsh3dwe in https://github.com/isl-org/OpenBot/pull/330
• Fix speedMode during inference by @thias15 in https://github.com/isl-org/OpenBot/pull/343
• Update UI order and colors by @thias15 in https://github.com/isl-org/OpenBot/pull/349

iOS

• New iOS version of the app by @sparsh3dwe in https://github.com/isl-org/OpenBot/pull/329

Robot Body

• New DIY body with extra space and lego support by @thias15 in https://github.com/isl-org/OpenBot/pull/348

Firmware

• Add BLE support by @sparsh3dwe in https://github.com/isl-org/OpenBot/pull/330
• Add support for RTR_TT2 by @thias15 in https://github.com/isl-org/OpenBot/pull/356

Documentation

• Update README by @thias15 in https://github.com/isl-org/OpenBot/pull/346 and https://github.com/isl-org/OpenBot/pull/350
• Fix python style by @thias15 in https://github.com/isl-org/OpenBot/pull/347

The following summarizes the changes compared to the previous release v0.6.1.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.6.1...v0.6.2

Robot App

• Upgrade Android API from 29 to 32. by @sparsh3dwe in https://github.com/isl-org/OpenBot/pull/333
• Remember CAMERA_SWITCH setting across app screens by @reger24 in https://github.com/isl-org/OpenBot/pull/338
• Adjust robot speed based on distance to the tracked object by @reger24 in https://github.com/isl-org/OpenBot/pull/311

Policy training

• Fix dataloader and dependencies by @thias15 in https://github.com/isl-org/OpenBot/pull/337
• Control and inference via Python for Linux compute boards, e.g. Upboard by @Yunaik in https://github.com/isl-org/OpenBot/pull/323

Dependencies

• Bump json5 from 1.0.1 to 1.0.2 in /policy/frontend by @dependabot in https://github.com/isl-org/OpenBot/pull/326
• Bump express from 4.17.1 to 4.18.2 in /policy/frontend by @dependabot in https://github.com/isl-org/OpenBot/pull/316
• Bump ua-parser-js from 0.7.23 to 0.7.33 in /policy/frontend by @dependabot in https://github.com/isl-org/OpenBot/pull/331

The following summarizes the changes compared to the previous release v0.6.0.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.6.0...v0.6.1

Robot App

• Use R1 button to discard logging by @thias15 in https://github.com/isl-org/OpenBot/pull/291
• New vehicle screen by @thias15 in https://github.com/isl-org/OpenBot/pull/296
• Integrate object detector Yolov5 by @thias15 in https://github.com/isl-org/OpenBot/pull/309
• Add efficientDet models by @thias15 in https://github.com/isl-org/OpenBot/pull/317
• Remove redundant code for getScreenOrientation by @reger24 in https://github.com/isl-org/OpenBot/pull/318

Documentation & CI

• OS independent call to applyStyle by @reger24 in https://github.com/isl-org/OpenBot/pull/313
• Update badges by @thias15 in https://github.com/isl-org/OpenBot/pull/319
• App ReadMe: add animations and refine text by @thias15 in https://github.com/isl-org/OpenBot/pull/321

Policy training

• Add point goal nav training by @quentin-leboutet in https://github.com/isl-org/OpenBot/pull/314

The following summarizes the changes compared to the previous release v0.5.0.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.5.0...v0.6.0

New Platforms

• Multi-Terrain Vehicle (MTV) by @quentin-leboutet in https://github.com/isl-org/OpenBot/pull/278
• Ready-to-Run OpenBot by @thias15 in https://github.com/isl-org/OpenBot/pull/285

Android Apps

• Versioning based on tags with plugin by @thias15 in https://github.com/isl-org/OpenBot/pull/281

Robot App

• Update dependencies by @thias15 in https://github.com/isl-org/OpenBot/pull/229
• Improve tflite error handling by @thias15 in https://github.com/isl-org/OpenBot/pull/264
• Object nav benchmarking by @thias15 in https://github.com/isl-org/OpenBot/pull/267
• Update gradle.yml by @thias15 in https://github.com/isl-org/OpenBot/pull/282
• Check if stream output sizes exist to avoid app crash by @thias15 in https://github.com/isl-org/OpenBot/pull/280
• Point-goal navigation by @dvdhfnr in https://github.com/isl-org/OpenBot/pull/251

Firmware

• Update collision thresholds by @thias15 in https://github.com/isl-org/OpenBot/pull/265
• Integrate OpenBot Lite into firmware by @thias15 and William Tan in https://github.com/isl-org/OpenBot/pull/266
• Firmware fix for coast_mode by @quentin-leboutet in https://github.com/isl-org/OpenBot/pull/271
• Firmware support for RTR_520 with ESP32 by @thias15 in https://github.com/isl-org/OpenBot/pull/272

Documentation & CI

• Update readme to include micro:bit variant by @thias15 and William Tan in https://github.com/isl-org/OpenBot/pull/269
• Update gradle files for app versioning by @thias15 in https://github.com/isl-org/OpenBot/pull/263
• Fix link errors by @zhoushengming in https://github.com/isl-org/OpenBot/pull/277

Policy Learning

• Update dependencies to improve cross-platform support by @thias15 in https://github.com/isl-org/OpenBot/pull/229
• Fix error caused by user moving the dataset (redo matching by default) by @thias15 in https://github.com/isl-org/OpenBot/pull/279

The following summarizes the changes compared to the previous release v0.4.0.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.4.0...v0.5.0

Android Apps

Robot

• When a model is deleted in the model management screen, restore download option if available instead of removing it from model management list by @dhruv2295 in https://github.com/isl-org/OpenBot/pull/227
• Support new firmware features and message protocol by @thias15 in https://github.com/isl-org/OpenBot/pull/250
• Functions to parse config message from robot by @thias15 in https://github.com/isl-org/OpenBot/pull/253
• Refactor game controller and add test by @thias15 in https://github.com/isl-org/OpenBot/pull/257 and https://github.com/isl-org/OpenBot/pull/261
• Update gradle files for app versioning by @thias15 in https://github.com/isl-org/OpenBot/pull/263

Controller

• Remove RTSP (WebRTC is superior in every way) by @izivkov in https://github.com/isl-org/OpenBot/pull/245
• Improve stability when controller app is restarted by @izivkov in https://github.com/isl-org/OpenBot/pull/247
• Button to switch the camera used on the robot by @izivkov in https://github.com/isl-org/OpenBot/pull/249

NodeJS controller

• Robot can be tele-operated from the browser with live WebRTC video feed using the new NodeJS controller by @izivkov in https://github.com/isl-org/OpenBot/pull/240
• Improve stability (reload, close and open page without needing to restart the robot app or the NodeJS server by @izivkov in https://github.com/isl-org/OpenBot/pull/247
• Button to switch the camera used on the robot by @izivkov in https://github.com/isl-org/OpenBot/pull/249
• Tweak robot control by @thias15 in https://github.com/isl-org/OpenBot/pull/260

  

Body

• CAD models and instructions for building an OpenBot RC-Truck by @usman094 in https://github.com/isl-org/OpenBot/pull/241

  

Firmware

• Major refactor, support for new robot types (RTR and RC car) by @thias15 in https://github.com/isl-org/OpenBot/pull/250
• Config message by @thias15 in https://github.com/isl-org/OpenBot/pull/253
• Improve no-phone mode by @thias15 in https://github.com/isl-org/OpenBot/pull/256

Documentation

• Update readme by @thias15 in https://github.com/isl-org/OpenBot/pull/237, https://github.com/isl-org/OpenBot/pull/256, https://github.com/isl-org/OpenBot/pull/258
• Update requirements.txt by @thias15 in https://github.com/isl-org/OpenBot/pull/262

The following summarizes the changes compared to the previous release v0.3.2.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.3.2...v0.4.0

Android Apps

Robot

• WebRTC support for communication with the smartphone controller with much lower latency, thanks @izivkov for #192
• Add sensor selection menu to logger fragment, thanks @dhruv2295 for #202 and #228
• Settings menu to choose between WebRTC (only controller app) and RTSP, thanks @dhruv2295 for #203
• Fix app crash in object tracking fragment (Android 6), thanks @MohammedZ666 for #210 and #212
• Dropdown to choose from available local web servers in logger fragment and autopilot fragment, thanks @sanyatuning for #214

Controller

• WebRTC support and new features (mirror video feed and turn audio on/off), thanks @izivkov for #192
• New option for intuitive robot control (throttle/brake with on-screen pedals and steering by tilting the phone), thanks @izivkov for #205

Web Interface

• Add support for multiple connections between robots and local servers in the same network, thanks @sanyatuning for #214

Policy Training

• Add weights & biases option to monitor training + some refactoring, thanks @sanyatuning for #214
• Simplify image loading, thanks @dvdhfnr for #218
• Create and use tf-records for training + unification of training code (notebook, terminal, web interface) + update to tensorflow version 2.5, thanks @marcelsan for #204

CI

• Automated code style check for Python with black, #217

The following summarizes the changes compared to the previous release v0.3.1.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.3.1...v0.3.2

Android Apps

Robot

• Split the AI screen into two separate screens, one for running object tracking and one for running autopilot models. Object detectors can now track all 80 object classes from the COCO dataset. Thanks @dhruv2295 for #179.

  

• Refactor AI model definitions, #183
• Refactor code to move common functions to util classes, #184
• Improve stability of RTSP video stream, thanks @izivkov for #185
• Bugfixes, thanks @dhruv2295 for #198
• New model management screen that allows downloading more AI models, renaming/deleting model on phone and adding models from phone storage, thanks @dhruv for #188
• Add permission handling to settings screen, thanks @dhruv for #199

  

The app has the following known issues:

• Incorrect mapping of common BT game controllers (e.g. Xbox, PS4, Nvidia Shield, etc.) may occur on Android versions before Pie (9.0), see this article for more info. On the bright side, Android 11 supports many more controllers, see this article for more infos. Also, you can now use the button mapping screen to check what the app receives from your controller.

Controller

• Add video streaming to controller app and python interface, thanks @izivkov for #182

Documentation

• Update app documentation, #200

The following summarizes the changes compared to the previous release v0.3.0.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.3.0...v0.3.1

Android Apps

Robot

• Add file picker to model drop-down --> choose trained autopilot models from phone storage, thanks @dhruv2295 for #172
• Add Yolo-v4-tiny object detector, #174
• Development of a new screen for checking the button mapping of the BT controller, thanks @dhruv2295 for #175

  

• Fix navigation of AI fragment and add missing control handling, add audio effects for drive and speed modes, #180

The app has the following known issues:

• Incorrect mapping of common BT game controllers (e.g. Xbox, PS4, Nvidia Shield, etc.) may occur on Android versions before Pie (9.0), see this article for more info. On the bright side, Android 11 supports many more controllers, see this article for more infos. Also, you can now use the button mapping screen to check what the app receives from your controller.

Controller

• Reduce apk size of controller app, thanks @izivkov for #171
• New keyboard controller --> control the robot from a Python script running on a computer connected to the same network, thanks @izivkov for #173

Documentation

• Added QR codes for direct download of app apks, #178

The following summarizes the changes compared to the previous release v0.2.0.

Full Changelog: https://github.com/isl-org/OpenBot/compare/v0.2.0...v0.3.0

Android Apps

Robot

• Development of a new screen for free roaming and major refactor of the vehicle communication interface, thanks @dhruv2295 for #154

  

• Development of a new screen for logging with ability to store preview and/or training data and upload to local server, thanks @dhruv2295 for #156

  

• Development of a new screen to run autopilot and object detector models, thanks @dhruv2295 for #158

  

• Phone controller bugfix, thanks @dhruv2295 for #159
• Refactoring to improve USB connection and phone controller stability, thanks @dhruv2295 for #161
• Add video streaming between robot and phone controller - WIP currently disabled due to latency, thanks @ivo for #162

The app has the following known issues:

• Incorrect mapping of common BT game controllers (e.g. Xbox, PS4, Nvidia Shield, etc.) may occur on Android versions before Pie (9.0), see this article for more info. On the bright side, Android 11 supports many more controllers, see this article for more infos.

Controller

• Refactoring of phone controller connection for added stability, thanks @izivkov for #157

You can download the apks from the resources below and install them on your phone directly. Note, that the app is signed only with a debug key. Alternatively, you can build the app yourself.

Documentation

• Updated research paper (accepted for publication at ICRA'21)
• Updated technical documentation for controller app, thanks @izivkov for #162
• Documentation for new screens and instructions how to build new fragments, #161 and #170

Policy

• Update requirements.txt, thanks @eagleanurag for #153