FZ*

June 9, 2025

From Thinking in Its Head to Thinking with Its Hands

If you’ve tried coding with AI tools, you’ve probably encountered the classic debugging loop: you ask ChatGPT to generate some Python code, run it, hit an error, paste the error message back into the chat, and watch as the AI quickly fixes its own mistake. This isn’t just a workflow quirk—it’s the first glimpse of something profound. It’s like the difference between trying to solve a jigsaw puzzle in your head versus spreading the pieces on a table and moving them around. Modern AI is improving at both “thinking” (reasoning through problems internally) and “doing” (manipulating external tools and environments). The result? Thinking by doing.

This shift echoes the “extended mind” thesis from cognitive science. The famous thought experiment asks us to consider Otto, who has Alzheimer’s and relies on a notebook for memory. When Otto writes “The museum is on 53rd Street” and later consults his notebook to find the museum, philosophers Andy Clark and David Chalmers argued the notebook has become part of Otto’s cognitive system—it’s not just a tool but a genuine extension of his mind. But for AI, the extension goes beyond memory to active manipulation. Watch a child solve a shape-sorting toy—they don’t mentally rotate each piece through every angle. They pick it up, try it, feel it doesn’t fit, rotate it, try again. The knowledge comes through the hands. AI models now do something similar—when running code, querying tools, or experimenting in simulations, they are discovering through trial what they couldn’t deduce through reasoning alone.

Users had long wanted AI to operate beyond the chat window. At first, this meant custom plug-ins, hardcoded search tools, or sandboxed code execution. Anthropic’s Model Context Protocol (MCP) standardized these patterns—making tool use easier, more reliable, and more broadly adopted. This shared interface for models to interact with APIs, databases, or simulations as part of a generalized tool-use layer has led to an explosion of both new tools and interfaces to existing services.

To understand how this also links to reasoning, we need to split what we mean by “thinking.” On one hand, there’s internal reasoning—what people usually imagine when they talk about AI getting smarter. Prompting models to “think step by step” lets them simulate solutions, one token at a time. Reinforcement learning on math, logic, and coding tasks—where correct answers are known—made them better at this kind of structured thought. It’s how we get better test scores.

But there’s another kind: embedded reasoning, also called tool use. This is the kind of intelligence emerging in agentic models, where the system makes decisions not just about what to think, but what to do next. And these capabilities are also growing rapidly. If you use Claude 4.0 in Cursor, you will routinely see an alert reminding you that it has taken 25 actions—running tests, checking edge cases, retrying with modified inputs, verifying assumptions—since it last checked with you. These aren’t just outputs—they’re thinking steps executed externally. This kind of reasoning happens in real time, through interaction. Yet it doesn’t replace internal reasoning—it depends on it. To use a tool effectively, the model must first reason about what the tool does, what result it expects, and how to interpret the output. Embedded reasoning extends internal reasoning into action.

AI simulations at training time serve as laboratories—sealed worlds where models build internal intuitions. In Minecraft, SimCity, or StarCraft-like environments, they learn spatial reasoning, resource tradeoffs, and long-term planning. These lessons are distilled into statistical patterns: better “mental” models of cause and effect. But this is still thinking in the head. No matter how much the model saw during training, when it’s deployed, it no longer touches the world. By contrast, test-time interaction turns the environment into a workshop. A model adjusting a city’s layout or running dozens of code tests isn’t just drawing on stored wisdom—it’s discovering through feedback. Like someone solving a Rubik’s Cube by trying moves, the AI learns not just from memory but from manipulation. It’s not just acting on a plan—it’s planning by acting.

Each failed attempt, each edge case poked is a move in an externalized reasoning loop. It is just choosing external exploration over internal simulation. The world is no longer the object of thought—it’s a part of the reasoning process. What began as language models predicting next tokens is morphing into systems that reason through external scaffolding. The evolution path isn’t just bigger models—it’s better interfaces for thinking by doing: sandboxes, simulations, toolkits, games—environments that push back.

← All writing