From Letter to Sample: One Cube's Journey
A 3D visualisation of the MicroGPT forward pass — 16 dims, 4 heads, 1 layer, 4,192 parameters
Only 7 places along the whole route use trained parameters (marked in gold); everything else is fixed arithmetic or carrying data.
Space / click advances to the next stage (press again while playing = fast-forward)
← hold on the previous stage R restart F fullscreen
Click anywhere to begin
Swipe up for the next stage swipe down to hold on the previous one
A tap also advances (tap again while playing = fast-forward)
Tap anywhere to begin
Operationtrained parametersfixed arithmeticno computation
Cube height = magnitudepositivenegative · hue shifts by stage