What If the Best Thinking Tools Were Built by Machines?
From the Thinking Like AI collection
Most approaches to better thinking start from the same place: observe what smart people do, then codify it. Study the habits of effective leaders. Reverse-engineer the routines of successful founders. Read biographies and extract principles.
The problem is that human thinking, even excellent human thinking, is imprecise by design. People make good decisions without being able to explain their reasoning. They focus effectively without understanding the architecture of their attention. They pursue goals iteratively without a formal model of why iteration works. The principles extracted from their behavior are post-hoc narratives — approximate, untestable, and often contradictory across sources.
Machine learning had to solve the same problems — learning, focus, diagnosis, goal pursuit, decision-making under uncertainty — but under a constraint that human cognition never faces: every solution had to be mathematically precise, named, and auditable. There were no instincts to fall back on. No "just trust your gut." Every cognitive operation had to be specified formally enough that a machine could execute it.
The result is a set of thinking procedures that are more precise than human intuitions about the same problems. They are not metaphors borrowed from technology. They are rigorous solutions to cognitive challenges, and they transfer.
Gradient Descent: Don't Plan, Descend
Gradient descent is the clearest example. The problem: pursue a goal when you cannot see the full path to the answer. The human instinct is to plan — map the route, set milestones, execute. Gradient descent does the opposite. It measures only the local slope — which direction reduces error from the current position — takes one step, then measures again. The destination emerges from iteration, not from foresight.
This is not a vague injunction to "take it one step at a time." Gradient descent separates direction from step size and treats them as independent decisions. Step size — the learning rate — is where most failures occur. Too large and you overshoot the good answer, oscillating past it. Too small and you freeze in a local minimum — the nearest acceptable answer, not the best one. Most people lurch between these two failure modes: massive life overhauls that lose the signal, and paralytic inaction where the gap feels too large for any step to matter. Both are learning-rate errors. The discipline is in calibrating step size to the terrain, and recalibrating when the terrain changes — because it always does.
Attention Mechanisms: What You Ignore Is Strategy
Attention mechanisms address a different problem: how to process information when most of it is irrelevant. The transformer architecture — the engine behind modern language models — does not process every input equally. It learns, for each element, how much weight to assign every other element. The power comes not from amplifying the signal but from learning what to suppress.
This reframes focus from a willpower problem to an architecture problem. The conventional advice — resist distractions, block your calendar, try harder — treats focus as a resource that gets stolen. The attention mechanism model says: build a system that suppresses irrelevant inputs at the input layer, before they cost any processing power. The person who put the phone in another room didn't exercise more willpower; they redesigned their attention architecture.
Regularization: Punish Cleverness
Regularization solves the problem of models that perform perfectly on their training data and fail on everything new. The solution is counterintuitive: penalize complexity. Force the model toward simpler explanations that generalize, even if they fit the training data less precisely.
The human equivalent is the expert trap — the consultant whose elaborate frameworks explain yesterday perfectly but miss tomorrow, the veteran whose decision rules all derive from one formative experience. These are overfitted minds: brilliantly trained on their own history, failing on out-of-sample reality. Regularization as a cognitive discipline means adding a complexity penalty to your own beliefs — preferring simpler explanations that survive contact with new situations over elaborate ones that don't.
Transfer Learning: You're Further Along Than You Think
Transfer learning addresses the assumption that new domains require starting from scratch. A model trained on millions of images doesn't rebuild from zero when it encounters medical scans. It transfers the deep feature detectors — edges, textures, spatial relationships — and only retrains the final layers. Deep features travel; surface tasks change.
The implication for anyone navigating a domain transition is direct: the cognitive layers trained over years of work in one field carry into the next. Negotiation instincts trained in sales transfer to fundraising. Diagnostic rigor from medicine transfers to systems analysis. A domain transition is a fine-tuning operation, not a cold start — but only if you know which layers are deep features and which are surface-specific.
Loss Function Design: What Are You Actually Optimizing For?
And beneath all of these sits loss function design — the paradigm that governs every other. Everything in machine learning begins with specifying what "wrong" looks like. The entire training process minimizes that specification. If the specification is subtly off, a perfectly trained system will do exactly the wrong thing, brilliantly — optimizing the wrong metric with total commitment.
The human version is the most consequential of all. Every person is an optimizer, running gradient descent on an implicit objective function — adjusting behavior based on feedback from reward, pain, approval, status, comfort. The question is not whether you are optimizing. The question is which function. Optimizing for salary without a fulfillment term produces wealth and hollowness. Optimizing for approval without an authenticity term produces a polished persona and a lost identity. The problem in each case is not effort or discipline. It is a misspecified objective — and the fix is not trying harder. It is rewriting the function.
The pattern across all of these is the same. Machine learning had to make explicit what human cognition leaves implicit — and the explicit version turns out to be more precise, more auditable, and more transferable than the instinct it replaces. These are not analogies. They are precise, named procedures for cognitive problems that most people handle vaguely and by feel. The solutions exist because machines needed them. But the problems are human problems — and the procedures transfer to anyone willing to run them deliberately.