Driver4VR: FBT VRChat App Support

Welcome

  • Can I migrate my Gold account to Steam?
    Since 7th June Driver4VR is available on the Steam store. You can still use the old version and the previous authentication system. If you want to migrate your Gold license to Steam you can do it by filling this form.
  • About Driver4VR Support and Help Webpage

    On this website, you can find instructions, find information on how to troubleshoot the problems, and finally raise a support ticket.

    Since most of the videos are up to date and some are in some still under the tests phase, for most a link to a specific tutorial will be provided. For those most popular like body tracking, head/hand tracking will put instruction here.

    In the troubleshooting section, you should find solutions to common problems.

    If you can't what you are looking for, have a great tip or suggestion, then please contact us.

  • Requirements

    For Kinect One you need USB 3.0 while for Kinect 360 you need USB 2.0. If you note low fps performance then try to switch to the different USB port and disconnect any extra devices. If you are on a desktop consider adding a PCI-e USB adapter.

    For devices: Joy-Con, PS Move, Wii Remote, Daydream, GearVR you need Bluetooth. In case of bad performance, I recommend using external (e.g. Asus BT400) on a short extension cable.

    PC Requirements: Windows 10, Intel i5-4590, 8GB RAM, SteamVR, SteamVR compatible vr headset (except tVR)

  • Refunding on Steam, App Store and Google Play

    Refunds for Driver4VR are readily available across all platforms, each governed by the accommodating terms and policies of the respective store; for your convenience, detailed instructions on how to request a refund on each platform can be found below.

    App Store (iOS)

    Users can request a refund for an app or game on iOS within a certain timeframe, typically within 14 days of purchase, provided they meet certain criteria set by Apple.

    1. Open your App Store app.
    2. Tap your profile picture.
    3. Go to "Purchased."
    4. Find Driver4VR, tap "Report a Problem," and request a refund.

    Google Play (Android)

    Users can request a refund for an app or game on Google Play within 48 hours of purchase.  Learn about refunds on Google Play.

    1. Open Google Play Store.
    2. Tap "Menu" > "Account" > "Order History."
    3. Find Driver4VR, select "Request a refund," and complete the process.

    Steam

    Users can request a refund for a game on Steam within 14 days of purchase and with less than 2 hours of playtime, regardless of the reason. Learn more about Steam refunds.

    1. Visit your Steam Library.
    2. Find Driver4VR in your list of games.
    3. Click "Support" > "Refund" and follow the prompts.

Body tracking in Virtual Reality

  • What methods for body tracking are currently available?

    Driver4VR supports the following devices to emulate Body Tracking in SteamVR:

    Standalone Meta Quest for VRChat using OSC protocol:
    1. Android and iPhone, no PC - instructions
    2. Kinect 360 and Kinect One require PC - video tutorial
    3. Webcam require PC- video tutorial
    On SteamVR platform that require that you run a VR setup on your PC:
    1. Kinetic - Emulatee body trackers - instructions
    2. Kinect 360 and Kinect OneOne - video tutorial
    3. Webcam - video tutorial
    4. Nolo VR - video tutorial
    5. PS Move via PSMoveService - use the manual calibration
    6. Camera Markers (alpha) - read more here
  • Puppeteer Full-Body Simulation Using Headset and Controllers

    Full Body Tracking Emulation with Puppeteer DLC

    Overview

    The Puppeteer uses a headset and hand controllers to simulate comprehensive body movements in VR by tracking head and hand positions and inferring full-body poses. Currently available only on PC-VR (SteamVR) as free DLC.

    First-time setup

    Here’s a streamlined setup guide for your Driver4VR Puppeteer DLC:
    1. Choose 'Puppeteer (Kinetic)' from the Body Tracking options and download the DLC. After launching Driver4VR, the Puppeteer application will automatically start. Verify that your avatar responds correctly.
    2. To calibrate the floor, press the 'Calibrate Floor' button and place the controllers on the floor. Wait for the process to complete, which will be signaled by an applause sound.
    3. Next, press 'Calibrate Height'.
    4. Enjoy 🙂

    Calibration of Avatar in VRChat

    Stand in the T-Pose for VRChat, and the system will automatically detect and emulate the same pose, which you can confirm by pressing the triggers.

    Puppeteer mode

    Introducing Puppeteer Mode: a cutting-edge feature in our emulated body tracking system that allows users to directly control their avatar's feet using the grip buttons on their controllers. This mode builds on the basic tracking of head and hand positions, providing an intuitive method for full-body avatar manipulation.
    • Enable Puppeteer mode by holding hands above your hand and holding grip.
    • Activate the grip to enable precise and responsive foot movement.

    Supported poses

    Supported poses and detection tips:
    1. Jump - just jump (after properly calibrating floor and height)
    2. T-Pose - when a person stands in T-Pose.
    3. Sit on the chair - head below average level.
    4. Sit on the floor - head below the medium level.
    5. On all four - head below average level looking slightly downwards and both hands on the floor (to enter pose).
    6. Laying on the left side - head below medium level and leaning left.
    7. Laying on the right side - head below medium level and head leaning right.
    8. Laying on the back - the head position is low and looking upwards.
    9. Handstand - head is low and looking upside down, hands on the floor.
  • Body Tracknig on Meta Quest in VRChat with iPhone and Android

    Body Tracking on Meta Quest in VRChat

    This is an instruction on setting up Full Body Tracking in VRChat for standalone Meta Quest with your iPhone or Android.
    1. iPhone - get it from App Store
    2. Android - get it from Google Play
    Your Quest and smartphone need to be in the same local network. First, we need to configure the connection between Driver4VR on your smartphone and Meta Quest. Go to App Store or Google Play and install Driver4VR. The instruction steps are as follows:
    1. Check the IP address on your Quest. Go to Quick Settings, WIFi, Your Network, Advanced.
    2. Go back to Driver4VR on your smartphone, and enter the IP of the Quest in the settings.
    3. Place it to make sure you are visible. I recommend the level of your waist or knees. It doesn’t have to be perfectly vertical. Make sure you are visible. You can also put it upside down and plug your charging.
    4. When you are ready, press Connect.
    The next step is to make sure that data about Body Trackers from your smartphone is going to VRChat. So switch back to your Quest and VRChat:
    1. Open Action Menu, Options, and OSC, and make sure it is set to Enabled.
    2. To double-check the connection open OSC Debug. You should see that the data come from Smartphone and Driver4VR to your Quest and VRChat.
    3. In the Quick Menu, and then in the settings, find the "Tracking and IK" section, and there should be more options related to Trackers. Make sure that “Toggle FBT” is ON, and Trackers is set to System. At this moment, you should see the trackers floating somewhere in VRChat, but not necessarily aligned with your body.
    Finally, we can calibrate Avatar:
    1. Open VRChat settings and press Calibrate FBT.
    2. Body Trackers might be not aligned with your pose. Stay directly in front of the Smartphone and point your head into it's direction. Long press Oculus button on right controller to recenter view into Smartphone's direction. Your orientation might change so use snap-turn with Joystick if required to look at the mirror for example.
    3. If the avatar’s feet are above or below the floor, then adjust the avatar’s height.
    4. Finally, just stay in T pose and press both triggers.That should be all 🙂
    Next time, just start Driver4VR and press Connect, and you should see trackers immediately in VRChat. Recenter view into Smartphone's direction and do and Avatar T-pose calibration, as usual. That is all. In Application Settings you can enable auto Connect on application Launch. If you don’t see trackers, make sure that the Quest IP address did not change. In most cases, it should not as far as you stay in same local network. Check also if OSC is Enabled and data is coming in the OSC Debug window.
  • Calibration for body tracking of Kinect 360/One with my VR Setup (Oculus, Vive, Index, etc).

    Preparation: Kinect device, adapter and drivers.

    Kinect is a great alternative for Vive Trackers. It is assumed here that you already have existing VR setup like Oculus, HTC Vive, HTC Cosmos, Valce Index or HP Reverb. Kinect will be used to emulate hip and leg trackers.

    For Kinect 360 for Xbox and Kinect 2.0 you need to purchase an adapter to PC. There is also Kinect 360 to PC that has already USB connection and an adapter is not required.

    For Kinect One you need USB 3.0 while for Kinect 360 you need USB 2.0.

    Optimal placement for Kinect 360 starts at 6 feet (1.8 m) from the floor. For Kinect One, device can be located as close as 5 feet (1.6 m). Remember to adjust angle to ensure your whole body is visible by camera. When located at 6 feet (1.8 m) I set angle to -16 degrees.

    Install Kinect Drivers from Microsoft website:

    Once you connect the device and install drivers, you are ready to set this up!

    Initial configuration

    1. On Tracking page in Driver4VR window select Kinect: Skeleton. Ensure you have Head tracking and Hand tracking turned OFF.
    kinect skeleton tracking settings
    1. Press Start on Driver4VR window. Now your device will be detected and tracking will start. Kinect should run about 30FPS. Driver4VR is running on higher frequency - 60FPS - to interpolate frames what makes tracking more smooth.
    kinect skeleton tracking started If you look around with your headset, you should see the trackers will float around somewhere. kinect body tracking controllers floating You will notice that they move accordingly when you move your legs but they are not in the right place. For that we need to do calibration. It might be just one time activity but when you chance something in room setup you might need to do it again.

    Calibration of Kinect and your VR setup

    There are three ways to calibrate Kinect and your VR Setup.

    • 5 point calibration - very first method, not practical but you can use it as an alternative - video tutorial.
    • Manual calibration - useful when you want manually tweak the position of trackers or other methods that don't work as expected - video tutorial.
    • Manual calibration for small room - video tutorial.
    • 2 step calibration - the fast recommended method - video tutorial.

    You can refer to the video tutorial for each method. I will describe here 2 step calibration with more details.

    1. Press Calibrate next to Body Tracking selection and then select New - 2 Steps.
    2. Very important: Before you put headset on, walk around your gameplay area and ensure that Kinect can track you properly.
    kinect check your playspace
    1. Now put your headset on and Click Calibrate Button. The window will pop-up with graphic that shows how it should be performed. You can turn on Desktop preview in SteamVR Overlay to see what happens.
    2. Now stay in the center of playspace (validated in step 2) and put your hands to the sides. Wait for confirmation signal - applause.
    3. Then take small step forward or backward and wait for second step to be completed - applause.
    Now the calibration is completed. You should see your body trackers at the position your actual hips and feet.

Head/Hand Tracking

  • Head and Hand tracking, Controller emulation

    Overview

    Driver4VR supports variety ways to emulate controllers and provide positional tracking. You can distinguish three cases as shown in table below.
    Virtual TrackersUsually, there is no head tracking. The position of the controllers is really emulated from actual devices that emulate Controllers. This is the same approach as one used in GearVR or Oculus GO
    Head and Controllers positional trackingThis is where we add full positional tracking for your head and controllers. You can use Kinect, PSMove with PSMoveService, NOLO VR. You can use also Leap Motion only for hand tracking.
    Head positional trackingThis is where you want only head tracking for example for car or flight simulators. Those methods from Head and Controllers tracking apply but you can use also OpenTrack.
    In sections below you can find tutorials how to connect and configure specific devices. For Controller emulation you can always use them alone as Virtual Trackers or together with Kinect for full positional tracking.

    Instructions

    Just Kinect?

    You can use just Kinect without actual controller (PS Move, Joy-Con, etc) and Kinect will emulate rotation of the Controller based on your head position or rotation. You can use then gestures, mouse, keyboard, VR Gamepad to emulate input (e.g. trigger).Please pay attention to tracking settings that can improve experience for some games.

    How to setup devices to emulate VR Controllers

    You can juse these devices alone as Virtual Trackers or with Kinect for full positional tracking. Those two topics are usually covered in each video. Even if you are planning to use devices I recommend view previous section for tracking settings for Kinect.

(tVR) - play Virtual Reality games on Monitor or TV

Troubleshooting

  • VRChat Body Calibration

    Note that you have to perform body tracking setup and calibrate with your VR setup before you start VRChat.

    For detailed steps on how to calibrate your avatar please watch Tupper's YouTube Video.

  • Joy-Con is pairing via bluetooth but is not recognized
    1. Install this: https://github.com/Davidobot/BetterJoyForCemu/releases
    2. Before uninstalling the drivers, navigate to http://localhost:26762/ and remove all the devices from the “Currently affected devices” list and then restart your computer.
    3. uninstall BetterJoyForCemu.
  • Kinect FPS is dropping below 20/25

    Disconnect other USB devices to free up the bandwidth.
    With only Oculus, Kinect, Mouse & Keyboard connected, just having plugged in USB dongle for Steam Controller or sometimes even USB3.0 flash drive resulted in Kinect behaving improperly (even in Kinect SDK tools).

  • Can’t pair Wii Remote Controller

    Some models of Wii Remote don't pair properly when using Driver4VR. In such case please use Dolphin emulator and launch retail Wii game or channel in dolphin and use "hybrid" Wii Remotes in the controller settings, pair them with 1 and 2 as you normally would. After that, they should be detected by Driver4VR.

    Please report your model of controllers so it can be added to Driver4VR.

  • Kinect V2 keeps disconnecting after every 10 seconds
    1. Go to Control Panel > Hardware and Sound > Sound > Recording and ensure that Xbox NUI Sensor is Enabled.
    2. Go to Settings > Microphone Privacy Settings and ensure that checkbox Allow apps to access your microphone is enabled. Uncheck and check if is already checked.