Humanoid Training · Part of The Humanoid Group

Learning From Demonstration

Many humanoid skills begin with a person showing the robot what to do. This guide explains how demonstration and teleoperation data are collected, what makes that data useful, and what it means for your organisation.

By Arjun Rao · Updated

What learning from demonstration means

Learning from demonstration, often called imitation learning, trains a robot by example rather than by hand-written code. A person performs a task, the scene and the motion are recorded, and a learning model is trained to reproduce that behaviour in new situations. The appeal for humanoids is clear: their bodies are shaped like ours, so human movement translates more directly than it does for other machines. The challenge is generalisation. A policy that copies a demonstration well in one room may struggle when the lighting, objects or layout change, which is why the variety of demonstrations matters as much as the number.

How teleoperation data is collected

Teleoperation puts a person in control of the robot itself, usually through a VR headset, a motion-capture suit, an exoskeleton-style rig or handheld controllers. Because the robot's own joints and cameras record every movement, the data matches the body that will later perform the task. Other approaches record people doing the work directly, with wearable cameras or instrumented gloves, and adapt that footage afterwards. Each method trades cost against fidelity. Teleoperation tends to produce cleaner, robot-specific data but takes operator time; recordings of people are easier to gather in volume but need more processing before a robot can learn from them.

What it means for your organisation

If you plan to deploy humanoids, ask each maker how new tasks are taught and who does the teaching. Some makers collect demonstrations themselves; others expect customers to supply them, or offer tools for your own staff to teleoperate. Ask how many demonstrations a typical task needs, whether data recorded on your site stays yours, and how a learned skill is updated when your process changes. For research teams the questions are practical: which teleoperation hardware a platform supports, how data is logged and exported, and whether the software stack lets you train and run your own policies.

Sources and further reading

Common questions

Do I need to collect my own demonstration data?

It depends on the maker and the task. Some supply pre-trained skills, while others expect customers to teach site-specific tasks. Ask how teaching works before you shortlist a platform.

What hardware is used for teleoperation?

Common set-ups include VR headsets, motion-capture suits, exoskeleton-style rigs and handheld controllers. Check which ones a platform supports out of the box.

Visit The Humanoid Group

People also search for robot learning from demonstration, imitation learning robot, programming by demonstration, teaching robots by example, robot teleoperation and teleoperated humanoid robot.