Staff recording · Electronauts · Meta Quest 3S · 71.3 fps
VR gameplay dataset · recorded inside the game
What the player saw, with head and controller poses on every frame.
Every clip in the free sample pairs the game’s own left-eye video with head and controller poses from the headset, on one clock.
- For world models: head and controller poses on every video frame
- For game studios: real players on real headsets, in your own game
- For VR labs: several commercial games, a consent record per session
- For robotics: head and two-controller motion, recorded to your tasks
Free 10-hour sample · RLDS and WebDataset · Pseudonymised · Players paid, consented in writingRLDS · WebDataset · Pseudonymised · Consented
The view. The pose. One clock.
A free 10-hour sample across several games, in RLDS and WebDataset, with the data card.
Explore it yourself
This clip comes from a staff recording. The graph and the skeleton follow the video frame by frame. Play it, scrub it, or click the graph to jump.
Recorded poses: head, left and right controller poses from the headset Estimated from recorded poses: the upper body and arms drawn between them
What is in a recording
Game view
The left-eye view the player saw, at the game's own frame rate.
Head and controller poses
Position and orientation (6DoF) for the head and both controllers for each video frame, on the same capture clock as the video, with flags where a device was lost or not reported.
Velocity
Linear and angular velocity for each device.
Tracking flags
Per-device flags say when the headset lost track, so you can drop those moments.
Hand joints
Articulated hand joints are present in a minority of sessions, where the headset tracked hands. Elsewhere the hands are the controller poses.
Paperwork
Every delivery comes with a data card, licence terms, a session list and checksums.
Formats
The free sample is the same set of clips in two formats. LeRobot is planned; ask us if you need it.
RLDS (TFDS)
One episode per clip (up to 60 seconds), steps at 15 Hz. Fields in observation:
image: left-eye view, 320x180 JPEGstate: head, left, right pose (px, py, pz, qx, qy, qz, qw)head_pose,left_hand_pose,right_hand_posevelocity: linear and angular, per devicetracking_flags,pose_presenthand_joints,hand_joints_validframe_index,timestamp_ns
Plus action (change to the next step), language_instruction and episode_metadata.
import tensorflow_datasets as tfds
ds = tfds.builder_from_directory(
"rlds/egogaming_vr_sample/1.0.0").as_dataset(split="train")
for ep in ds.take(1):
for step in ep["steps"].take(3):
print(step["observation"]["state"], step["action"])WebDataset
Tar shards, one sample per clip, at the full recorded rate (about 70 to 90 frames a second). Per clip:
.mp4: H.264 video, 720 pixels high, no audio.frames.npy,.pose.npy,.vel.npy,.flags.npy: row i matches video frame i.poses.parquet,.hands.parquet,.inputs.parquet.events.json: tracking loss, recenters, state changes.json: clip metadata
LeRobot
Planned. Ask us if you need it.
How it is collected
- Participants are paid adults who sign up, pass a review and give written consent before anything is captured.
- They play commercial VR games they own, on PC headsets.
- Our recorder captures what the game asks the headset for, through an OpenXR API layer, or an OpenVR route for OpenVR titles.
- Every session goes through automatic checks and a human review. Very short sessions and sessions with bad tracking are rejected.
What the free sample holds
Figures for the 10-hour sample, as of . Ask us for the current catalog.
- Hours
- Games
- Headsets
- Formats
Responsible data
- The data is pseudonymised. It carries no names, contact details or locations, and the licence forbids trying to identify anyone. VR movement can identify people, so treat every file as personal data.
- Only recordings that are licensable are delivered. Each recording has a consent record.
- Delivery follows region rules, and the paperwork shows where each recording may go.
- Participants can withdraw. When one does, their files come off the download page and you must delete every copy within 30 days and confirm it.
Request the free sample
A 10-hour sample across several games, with the data card.
We send you a download link and the data card. Links last 14 days.