Reality Mixer lets you use your iPhone or iPad to capture your favorite VR games and applications in Mixed Reality without a PC and without a green screen.
Follow us on Twitter for more updates!
|The Thrill of the Fight||Link|
|Space Pirate Trainer||Link|
You can find instructions and tutorials on this page.
The app is currently only compatible with the Oculus Quest 1 and 2, check this link for a list of the compatible games/applications.
Follow these instructions to install and configure AltServer on your PC or Mac, then install the AltStore app on your iPhone/iPad.
Open the camera app on your iPhone/iPad and scan this QR code:
To build the app using your own developer account, create a
DeveloperSettings.xcconfig config file inside
RealityMixer/ with your development team identifier and your organization identifier:
DEVELOPMENT_TEAM = YOUR_TEAM_ID ORGANIZATION_IDENTIFIER = com.yourcompany
Investigate the audio delay;
Improve the calibration screen and fix the positioning of the controller models;
These are features that could be implemented in the future:
Create a custom calibration app for the Quest to replace the Oculus MRC app, allowing the user to calibrate from VR itself;
Allow the user to adjust the FOV of the mixed reality capture;
Allow the app to cast the video output (although this should already be possible if you long press the "Screen recording" button on "Control Center" and then select a streaming app);
This project uses SwiftSocket to handle the TCP connection with the Oculus Quest, Apple's VideoToolbox to decode the stream, and ARKit for the "virtual green screen". Its video decoder is based on zerdzhong's SwiftH264Demo.
Old versions of Reality Mixer also used FFMPEG, and code from the Oculus MRC plugin for OBS.
The right and left controller models are modified versions of the
oculus-touch-v3 models from the WebXR Input Profiles.