Hadrien Cornier GitHub

Hadrien Cornier / Personal notes

Robotics, learning,
and the systems
behind them.

I build data infrastructure and production ML. Here I write about robot learning, the math behind it, and what I learn by building.

Control playground

Test different policies.

Pick a policy. Move a cube. See what changes.

Move a cube into the tray, seen from above A robot arm reaches from a fixed base to its gripper. A red cube and a blue cube sit on the table. The destination tray is at the upper right. With the controls enabled, drag either cube or focus it and use the arrow keys to move it. TRAY R B TOP VIEW
Actual movementPlanned route

Ready to follow a fixed path.

About this approach

Hand-written replay baseline

Saved route → tracking controller → movement

A fixed script follows a saved route. New observations do not change its commands.

Expect It works when the scene matches the taught route.

Watch for A moved cube or new obstacle can break the task.

Hand-written baseline. No learned model.

Diffusion is a way to generate actions. Pretraining is prior learning. A model can use both.

Action generation
Saved waypoints.
Training
No learned model.

Replay the same commands. Moving the target leaves the route unchanged.

What this shows

One arm, one speed, one scene. The learned methods are represented by simple rules. These runs illustrate mechanisms and failure causes. The arm drawing follows the gripper. Gripper contact decides collisions; the links are a visual sketch.

Diffusion describes how actions are generated. Pretraining describes what the model learned before this task. π₀ combines a pretrained vision-language model with a flow-based action expert. These ideas can be combined.

Execution timing is a separate choice. The RTC paper overlaps computation with motion for diffusion and flow policies. This toy also applies that timing idea to the action-transformer sketch.

The blue path marks commands that are already committed. New observations still take time to change movement.

Challenges introduce specific toy errors: a moving target, a sudden blocker, swapped visual labels, or wrong camera coordinates. Grasping, collisions, and the real cube identity decide the result.

The action-transformer, diffusion, and world-model sketches are set to the red-cube task. The VLA sketch also reads the red/blue instruction.

Essays & explorations

Writing

10 essays

Series / 6 parts

From policy to action: the last mile of robotics control

Part 1

36 min read

One equation, and every way the arm misses it

Start from torque = inertia × acceleration, then add each term a cheap servo arm really has: gravity, friction, a payload, dead time, a dead band. Each term is one way the arm misses its target.

Part 2

13 min read

Seeing finer than the sensor

The sensor side of the joint equation: why differences of encoder ticks explode the noise, and how an observer or a Kalman filter can estimate an angle finer than one tick.

Part 3

29 min read

Six ways to choose the goal

One general formula for the goal sent to a servo. Every controller I built, from a plain look-ahead to MPC, is that formula with some terms set to zero.

Part 4

19 min read

Learning what the physics misses

Where a neural network fits in a robot controller. A network that learns only what the physics model gets wrong does the same job as a Kalman disturbance estimate, with more freedom, and this is where recent research is going.

Part 5Hardware

17 min read

A pen holder that shows the arm’s error, not its own

I want to see my SO-101 trajectory errors as ink on paper. For that, the pen must not add an error of its own. I made five holder designs. The one I release is a printed sleeve that slides onto the stock gripper: 4 printed parts, nothing to buy, any pen from 8 to 13 mm.

Part 6

25 min read

Where the last millimeter of my drawing arm goes

My SO-101 arm cannot see its own pen tip. A tablet can. Here is what the tablet showed: how much error a learned correction removes, which causes are left, and why the base joint matters most.

Research in motion

Papers

All visual explanations

Visual explanation

EigenDEXplore

Human motion guides its experiments. Every joint stays free.

Beyond robotics

Notes on the work.

Short notes on engineering, hiring, and building things that matter.

All notes

Outside robotics

Projects

Culture Calendar

A calendar of film, classical music, opera, ballet, book clubs, and visual arts in Austin.

A little context

About me.

Engineering manager at Talroo, based in Austin. I work on data infrastructure, production ML, and teams. Outside work, I’m learning robotics through experiments with simulation and an SO-101 arm.