Explore the geometry

Rotate through PCA projections of model activations by layer, component and prompt position. This accompanies the sections on horizon form and the turn boundary.

  1. Keep Color By on Time Horizon. Set Layer to Layer 31 and Component to Residual Post.
  2. In the Position panel, select the stated horizon, such as “1 second.”, and look at how the samples are arranged.
  3. Select the <|im_end|> token at the end of the prompt, then the “a)” token under Response, and compare.

The explorer loads 80 precomputed samples and 15 layers, not the full dataset behind the papers. L22 and L26 aren't included, so it can't show the peak steering or probe layers from Qwen3-4B. Use it to build intuition, not as evidence.

Built with React, Three.js and a FastAPI backend that serves precomputed embeddings. View the source.