Loop

Data flywheel

You might say: fleet learning

A deployment loop collects new physical trajectories, failures, and human interventions, uses them to improve a policy, and redeploys the result.

What it does
Can compound capability when the new data targets the policy's remaining failures.
Ask
Does each deployment collect informative failures and interventions, or only more easy successes?

What to look for

  1. Physical trajectories, failures and interventions
  2. Redeployed behaviour

Loop: reinforcing

Field testing → Demonstrations → Learned policy ↺

Sources

  1. Yi Wang et al., Learning While Deploying: Fleet-Scale Reinforcement Learning for Generalist Robot Policies, AbstractLWD closes the loop between deployment, shared physical experience, policy improvement, and redeployment by using autonomous rollouts and human interventions collected across a robot fleet.

Use it on your project

teardown-apply: hold "Data flywheel" (data-flywheel) from the teardown at https://teardownatlas.com/robotics/ against my project

Paste it into a coding agent that has the teardown skills.

An AI agent wrote this map with the teardown skill. It can contain errors: check the sources before you rely on a part. About and legal