Mj Envs Versions Save

A unified framework for robot learning

v0.7

1 month ago

Robohive V0.7 Preview

  • Supports all Gym and Gymnasium versions. Defaults to Gymnasium
  • [80ad5bf, 69c1303] Upgraded to MuJoCo 3.1.3
  • [777edf3] New teleOperation interfaces (Xbox controllers, spacemouse, keyboard, oculus, controllers) @dosssman

FEATURE

  • [abc3f70] examine_sim.py upgraded to mujoco bindings @andrearosasco
  • [69c1303] Checks added for FFmpeg
  • [676375f, e4414a1] Upgraded env reset to accept optional seed and kwargs
  • [fb90d46, ae51c9e] Better depth rendering accuracy
  • [89fe9b2, 65bb9d2, 76b3455] moving towards env.unwrapped instead of env.env...
  • [1cb8334] Loggers can use nested groups
  • [777edf3] Xbox 360 controller based tele-operation

    Myo Suite

    • [15bda40] MyoSuite's base class uses forward call from parent class to avoid duplication
    • [9f32f15, 3397e80, 3f74d12] Upgraded to include MyoSuite's MyoChallenge's developments
    • [3397e80] Adding the arms and legs models.
    • [3397e80] Updating envs to be compatible with gymnasium

BUGFIX

  • [82c6ab4] Improved robot class exit. Robot class doesn't delete the persistent robot connection anymore. It relises on the user to close the persistent connection (by calling robot.close() on atleast one of the robot instances) before existing the program. Skipping this for sim-robot shouldn't be a problem. For hardware robot it will leave the robot running. This cleans up the bug that was preventing clean termination due to multiple calls to the robot class.
  • [e160593] Removing spurious self collisions in fetch model that was preventing full range of motion
  • [7abd6c8, e828a2e] Removing torch dependency from testing.
  • [229221a, 7abd6c8] Proper Env seeding post unpickling. Better seeded randomization.
  • [3b56770] Removing hardcoded enums from the robot base class.
  • [7bea218] Improved MyoSuite sync. SED has a different syntax for -i option on mac.
  • [4898218] Camera index 0 gets out of range if no camera is modelled. Defaulting to free camera.
  • [315606e] Remove flipping of depth/segmentation buffers @sriramsk1999

Tests

  • [9e41485] adding a bash script that tests across a few versions
  • [0069093] check everything for different gym/gymnasium versions

v0.6

7 months ago

What's Changed

Full Changelog: https://github.com/vikashplus/robohive/compare/v0.5...v0.6

This release contains following task families -- Kitchen, Myo, HMS, Arms, and Quads along with associated NPG baselines.

Kitchen Baselines (full details)

Screenshot 2023-04-14 at 12 36 12 AM

Arms Baselines (full details)

Screenshot 2023-04-14 at 12 36 12 AM

HMS Baselines (full details)

Screenshot 2023-04-14 at 12 36 12 AM

Quads Baselines (full details)

Screenshot 2023-04-14 at 12 36 12 AM

Myo Baselines (full details)

Screenshot 2023-04-14 at 12 36 12 AM

v0.5

1 year ago

This is the first comprehensive pre-release under the umbrella RoboHive!

This release contains following task families -- Kitchen, Myo, HMS, Arms along with associated NPG baselines.

Kitchen Baselines (full details)

Screenshot 2023-04-14 at 12 36 12 AM

Myo Baselines (full details)

Screenshot 2023-04-14 at 12 37 36 AM

HMS Baselines (full details)

Screenshot 2023-04-14 at 12 39 09 AM

Arms Baselines (full details)

Screenshot 2023-04-14 at 12 40 01 AM

ChangeLog

Click to expand

FEATURES:

  • 2c8c63e CORE: Updating name to RoboHvie
  • 6d1a1bc 6e0635f fa1453e CORE: Refactored env base to better support visual tasks. Each envs now supports get_obs, get_proprioception, and get_exteroception. Note get_exteroception has to be explicitly called for it to update
  • 804d9f7 59f2c92 8894dd5 CORE Proprio dict and env state now has time as one of the keys.
  • b52ae85, 2c9f764 ENCODER Adding visual cortex encoders (VC1) as an encoder choice.
  • d861b8e ROBOT add frequently used capnp message files
  • f883265 Adding more prominent colors for warnings and errors
  • 52cbd53 Hands Suite: Renamed hand_manipulation_suite to hands
  • 8bf8856 Hands Suite: Default 3 cameras will be - view_1, view_4, and the vil_camera
  • da6dc2a Hands Suite: Adding the a simple indoor room scene. Also updating all DAPG envs to use this scene
  • 0be87c7 f09e722 LOGGER: Removing old examine_rollout. Please use logger/examine_logger.py moving forward. All functionalities have been ported over.
  • f258be0 LOGGER: name needs to be provided as an explicit argument
  • adc8f27 LOGGER: Logger can save in RoboHive as well as roboset format.
  • adc8f27 LOGGER: examine_logs mode==render now follows the convention of extracting actions and delaying the stepping to the end of the loop.
  • 47fef3c 48b6894 LOGGER: Support of enumeration on trace as list, or as dicts.
  • 85c4c44 LOGGER: Adding length, and iteration ability to the logs
  • 0e52724 LOGGER: Trace loaded from file is fully functional class now. It was just a file object earlier
  • 7bdfcda LOGGER: logs can be saved/rendered directly from the examine script
  • 61b015f ENV: get_sim is moved inside SimScene. We need to call SimScene.get_sim() now.
  • 2bf708f ENV: Adding credits to every env which is printed during env instantiation
  • 2bb6fdd SIM: Consolidation of meshes in the myo_sim repo
  • e171b62 SIM: Updating the name of the modules to SimHive
  • b63f780 MULTITASK Deprecating vanilla relay_kichen. Its a part of the multi_task suite now
  • 5cfc559 MULTITASK (1) changing ee_pos(pos) to ee pose(pos+euler) (2) Better handling of goal proximity
  • 5a945ee MULTITASK: Adding a readMe to track history and evolution of FrankaKitchen
  • 1eeb29b MULTITASK: Introducing Kitchen-v4 envs
    • Single entry point that supports all env variants (fixed, demo, random, random desk)
    • Consolidation of entrypoints into FIXED(relay demo entry) and RANDOM(random joint + kitchen-robot base)
    • support for get_obs, get_proprio, and get_extero
    • New naming schemes for the env. All envs are available in FIXED, RANDOM, and RANDOM_v2D variants
    • obs_keys, visual_keys etc are all defined inside the env. They are configured inside during the registration.
    • 93bc43b MULTITASK: Adding franka-kitchen randomization to the RANDOM_ENTRY_POINT. This is what was called RANDOMDESK_ENTRY_POINT in the R3M codebase. This randomization is important to study visual generalizaiton. Otherwise proprioception alone is enough to solve the tasks
  • 4570c8d MULTITASK: Moving demo initqpos/qvel to xml as keyframe. Envs load init values from the keyframe instead of it being hard coded in the env. Adding default proprio keys to the env. Visual keys are also staged in the env (if needed)
  • 5e7e6b8 MULTITASK: Adding a top cameras to the kitchen scene

BugFixes

  • c10aca6 (a) kwargs were not passed in the custom step for myobase (b) act dimensions weren't handled appropriately when na==0
  • f272bc4 A few of the obs data were passed as a reference in fmFrankaRobotiqData env
  • 0abae1b By default the logs will be now saved with f64 resolution. Leads to small bump in size, but improves on roundup errors.
  • fbd6d96 Print more informative errors if specified keys are not found
  • 46c6170 9dacf88 Obs now has ['time', 'time'] as keys to help expose the accidental singleton expansion errors-In examine_logs mode==render uses full state to reset the env, not just qpos and qvel.
  • 72bbe2b All reward terms are converted to floats. This now avoids data type issues in rewards calculations
  • 61b389a Add last step while creating logs. Render only when visual keys are present
  • 9dc71ca BUGFIX: Kwargs weren't being passed. So exteroceptors updates were missing. Also removing duplicate files in finger and basic.
  • 8c331a6 BUGFIX: robot velocity was hardcoded. Which is making it save/fail at various places
  • 9e17308 BUGFIX: matching the number of things that are returned
  • 65a3ced BugFix: If there is a single Visual and Proprio key that is passed as a string, it throws a bug. These keys have to be a list, but we can handle single keys specified as string. Handling this was important as this feels like a common mistake

Docs

  • a7821f8 Adding a tutorial on how to access the observation, proprio and exterior information
  • 4b76549 Centralization of docs and tutorial on the wiki.
  • cb1c2ea, 7eda971 Landing page updated to be the main landing page. 2nd order details moved to sub-pages (6d31b08, 8677cbb, 16d85b9)

Installation

  • 47f7f57, a639f72, 923e63c Adding instructions on installation choices and docs for users to avail optional dependencies
  • b71b793 Adding tests for imports and providing helpful suggestions if they are missing
  • e8f6374 Remove git dependencies from setup.py for pypi (#80)
  • 8e0d845 Adding the dm_control dependency along with mujoco. dm_control and official mujoco is optional as of now
  • 697fd82 Created .github/workflows/python-app.yml
  • 73c22ad Update python-app.yml to explicitly install r3m and vc1 to perform all the tests
  • bea2569 74d5ee1 myo_sim submodule now points to the public repo. RoboHive now has no private repo dependencies
  • e171b62 Updating the simulation suite name to simhive
  • d7544f5 BUGFIX: Properly extract state to init the env

v0.4

1 year ago

This pre-release contains following task families -- Kitchen, Myo, HMS, Arms along with NPG baselines.

Kitchen Baselines (full details)

Screenshot 2023-04-11 at 1 03 42 AM

Myo Baselines (full details)

Screenshot 2023-04-11 at 1 02 27 AM

HMS Baselines (full details)

Screenshot 2023-04-11 at 1 02 54 AM

Arms Baselines (full details)

Screenshot 2023-04-11 at 1 03 08 AM

v0.3

1 year ago

This pre-release contains following task families -- Kitchen, Myo, HMS, Arms along with NPG baselines.

Kitchen Baselines (full details)

Screen Shot 2022-12-28 at 5 59 21 AM

Myo Baselines (full details)

Screen Shot 2022-12-28 at 5 59 47 AM

HMS Baselines (full details)

Screen Shot 2022-12-28 at 5 59 02 AM

Arms Baselines (full details)

Screen Shot 2022-12-28 at 5 58 33 AM

v0.2

1 year ago

This pre-release contains three stable task families -- Kitchen, Myo, HMS along with NPG baselines.

Kitchen Baselines (full details)

Screen Shot 2022-07-09 at 9 57 34 AM

Myo Baselines (full details)

Screen Shot 2022-07-09 at 9 58 59 AM

HMS Baselines (full details)

drawing

v0.1

1 year ago

This pre-release contains two stable task families -- Kitchen and Myo along with NPG baselines.

Kitchen Baselines (full details)

Screen Shot 2022-03-10 at 11 42 07 PM

Myo Baselines (full details)

Screen Shot 2022-03-10 at 11 45 05 PM

Known Issues

  • Some envs are not serializable (fixed in v0.2dev)
  • Arms and HMS suite are missing baselines (planned for v0.2) 

v0.0.5

1 year ago

Tag for project R3M: A Universal Visual Representation for Robot Manipulation

R3M studies how to learn generalizable visual representation for robotics from videos of humans and natural language. R3M realizes pre-trained representations (trained on the Ego4D dataset) that are effective in general simulated as well as real-world manipulation tasks. For more details: R3M webpage

Installation

RoboHive uses git submodules to resolve dependencies. Please follow steps exactly as below to install correctly.

  1. Clone tag v0.0.5 with pre-populated submodule dependencies
git clone --branch v0.0.5 --recursive https://github.com/vikashplus/robohive.git
  1. Install package using pip
cd robohive
pip install -e .

About tag v0.0.5

This checkpoint overrides the default behavior of the environments from a fixed kitchen to one where the kitchen randomly moves around, making the tasks visually more challenging.

v0.0

2 years ago