Merit Data | Real-World Robotics Data for Physical AI
Robotics data infrastructure

Real-world data for robots that need to work reliably.

Custom egocentric, wrist-camera, teleoperation and failure-recovery datasets—built around your task, embodiment, sensors and training requirements.

Review matched samples and validate a pilot before committing to production volume.
Consent and provenance records
Written acceptance criteria
Pilot-first delivery process
MERIT_DATA / EPISODE_00412
Precision component placement Egocentric RGB + hand pose
QC ACCEPTED
03camera streams
60 FPScapture rate
RGBvisual modality
JSONtask metadata
Built for robotics and Physical AI teamsEvidence first. Scope second. Scale after validation.
01 / CAPTURETask-specific protocolsViews, hardware, behaviors and environments.
02 / QUALITYDocumented QCAcceptance, rejection and batch reporting.
03 / RIGHTSConsent-backed dataContributor and collection-location records.
04 / DELIVERYTraining-ready outputsMedia, metadata, labels and manifests.
Data solutions

Choose the signal your robot actually needs.

Start with the target behavior and model interface—not a generic video specification. We configure collection around your embodiment, sensing stack and learning objective.

Egocentric human demonstration example

Egocentric human demonstrations

Natural first-person task demonstrations for manipulation, planning, action understanding and world-model training.

HEAD CAMERATASK LABELSREAL ENVIRONMENTS
Egocentric and wrist camera example

Egocentric + wrist cameras

Synchronized head and wrist views that preserve both scene context and close-up hand-object interactions.

SYNCED VIDEOLEFT / RIGHT WRISTCONTACT EVENTS
UMI and gripper demonstration example

UMI and gripper demonstrations

Embodiment-relevant demonstrations for policy learning, imitation learning and task-specific manipulation.

UMIGRIPPER POSEACTION TRAJECTORY
Teleoperation and robot state example

Teleoperation + robot state

Robot-executed episodes paired with synchronized observations, actions, states and operator interventions.

ACTION / STATEPROPRIOCEPTIONTELEOP
Failure and recovery episode example

Failure, intervention and recovery

Capture the episodes that expose policy weaknesses: slips, misalignment, corrections and successful recovery.

FAILED ATTEMPTSHUMAN CORRECTIONEDGE CASES
Annotation and multimodal alignment example

Annotation and multimodal alignment

Task, subtask, event, object and quality labels aligned across video streams and supporting sensor data.

TEMPORAL LABELSOBJECT TRACKSQC NOTES
Sample data lab

Inspect the capture configuration before discussing volume.

Use these public previews to understand available configurations. Matched raw samples and detailed metadata can be shared through a controlled review workflow.

AVAILABLE CONFIGURATIONS
Four-view and infrared robotics data sample
LIVE SAMPLE PREVIEWMULTIVIEW
Four-view + infraredMulti-view manipulation with an additional infrared stream
STREAMS05
CAPTURE60 FPS
MODEMULTIVIEW
QCACCEPTED
Pilot-to-production workflow

From task brief to accepted production batches.

Each project starts with measurable requirements. The protocol, pilot and review loop reduce procurement risk before a larger collection begins.

01

Define the learning objective

Share the target behavior, robot or embodiment, sensors, environment diversity, expected volume and timeline.

OUTPUT / DATA REQUIREMENTS BRIEF
02

Design collection and QC

Agree camera placement, hardware, task instructions, metadata, consent flow, rejection rules and delivery schema.

OUTPUT / SOW + QUALITY PLAN
03

Run and review a pilot

Collect a small representative batch, inspect edge cases, test ingestion compatibility and refine the instructions.

OUTPUT / ACCEPTED PILOT BATCH
04

Scale with batch controls

Expand by task, operator, geography or environment while tracking acceptance, rejection and protocol changes.

OUTPUT / MILESTONE BATCHES
05

Deliver and iterate

Provide files, manifests and documentation; use model failures to inform the next collection cycle.

OUTPUT / TRAINING-READY RELEASE
Quality controls

Acceptance criteria are written before collection starts.

Quality is not a final spot check. It is designed into the capture protocol, operator instructions, review workflow and delivery manifest.

Visual and sensor integrity

V01

Confirm that every required stream is usable and aligned with the agreed technical specification.

Required viewpoints remain visible
No unacceptable blur, obstruction or dropped streams
Timestamp and synchronization checks

Task execution quality

T02

Review whether the episode follows the instruction and captures the behavior the model actually needs.

Correct task start and completion state
Natural manipulation and valid object interactions
Failure and intervention states identified

Metadata and annotation

M03

Ensure that files, episode records, task labels and quality notes reconcile across the delivered batch.

Consistent file and episode IDs
Required task, subtask and event labels
QC notes and rejection reason codes

Documentation and audit trail

D04

Provide the records that engineering, legal and procurement teams need to review the release.

Collection configuration and version history
Consent and provenance package
Accepted quantity and delivery manifest
Buyer questions

Before a pilot starts.

These are the questions we expect robotics, engineering, legal and procurement teams to ask.

Can we review samples before placing an order?

Yes. Public examples show representative configurations. For a relevant opportunity, matched samples can be shared under an agreed review process, with NDA handling where appropriate.

Do you provide existing inventory or custom collection?

Both may be possible. The first step is to compare your requirements with available inventory. When there is no suitable match, a pilot collection can be scoped around the task, sensors and environment you need.

How is quality measured?

Quality criteria are defined in writing before production. Reviews can cover stream integrity, task execution, metadata completeness, annotation accuracy, rights records and batch-level acceptance.

Can you collect failure and recovery episodes?

Yes, when included in the protocol. Collection instructions can target failed attempts, hesitation, intervention, re-grasping, re-alignment and successful recovery rather than only ideal demonstrations.

What delivery formats are supported?

Delivery can be aligned to an agreed schema, including media files, structured metadata, task labels, QC reports and transfer to approved storage. Exact compatibility should be confirmed during the pilot.

Do you claim security certifications?

This page does not claim certifications that have not been formally obtained. Project-specific security, confidentiality, storage and transfer requirements should be reviewed and documented during procurement.

Request a pilot

Request a pilot

Tell us what your robot needs to learn.

Share enough detail for us to identify relevant samples, flag specification gaps and suggest a practical pilot.
+1 415 555 0187
Please describe your project in detail (data type, volume, timeline, budget, etc.)*
Or
Merit Data | Real-World Robotics Data for Physical AI Request a pilot