LEARNING IN THE OPEN

Start with intuition. Follow it into the math and the code.
Keep what is clear, and leave room for what is still taking shape.

AI / EXPLAINER

Why attention needs scaling

From dot-product variance to the concentration of softmax weights.

TransformerMathematical intuitionInteractive example
4 min read
ROBOTICS / Research note

What should we ask after a task fails?

Separate observations, explanations, and hypotheses before testing a repair.

Failure analysisExecution traces
Research note