Free to read5 min read

When answers cost nothing, what is a well-made question worth?

From the The Science of Questions: The Academic Foundations collection

A request arrives at a help desk: how can the last three characters be removed from a file name? A helper answers it quickly and correctly, and two more exchanges pass before the goal comes out. The person wanted the file's extension, and extensions come in many lengths. Every answer was accurate, and the person was still stuck, because the question described an attempted solution and left the purpose unstated.

This pattern has a name, the XY problem, and it points to something larger about how thinking works. A question arrives before any answer and quietly sets the terms for it: which replies count, which facts are taken as settled, how much effort the listener will spend, and who holds control of the exchange. For most of history the expensive part of knowing something was finding the answer, and language models have made fluent answers nearly free. What stays scarce is the judgement that shapes the question and checks the reply.

A question is an instrument with design parameters, and those parameters can be named, studied and tuned. Logic, cognitive science, measurement, clinical and negotiation practice, and research methodology have each mapped part of that design. Read together, they describe one craft.

Every question draws a boundary

Erotetic logic, the logic of questions, treats a question as a precise object: the set of replies that would count as answering it. "Which train leaves first?" admits only trains and departure times. "Which of these three options is best?" admits only the three listed options. Framing a question is therefore designing an answer space.

The width of that space decides what kind of thinking the listener brings. A wide space invites invention and interpretation. A narrow one invites retrieval and confirmation. The same topic, asked two ways, recruits two different kinds of mind.

This turns question choice into a matter of fit. Retrieval, diagnosis, generation, measurement and reflection each call for a different boundary. A closed question suits a diagnosis that has to rule specific options in or out, and an open question suits a problem whose shape is still unclear. Skilled askers choose the boundary on purpose and match it to the job.

The claims a question carries

Inside every boundary sit presuppositions: claims that must hold for the question to make sense. "When did the error start?" assumes an error occurred. "Which of the three causes mattered most?" assumes there are exactly three. A listener who answers accepts those claims along the way, often without noticing them.

That is why presupposition is the first thing to examine in any question that matters. A loaded question hides a contested claim. A leading question signals the expected answer. In both cases the question smuggles in the answer, and the reply hands the asker's assumption back with added confidence.

The same mechanism appears with language models. A prompt that assumes a false fact often receives a fluent answer built on that fact. The model treats the presupposition as given, much as a polite human listener would. A good share of what looks like an answer-quality problem begins as a question-quality problem.

Effort is a design choice

Questions also set how much work the listener does, and memory research shows that the work itself teaches. Retrieving an answer strengthens it more than reading it again. Producing an answer, even a partial one, makes it more memorable than receiving it. Effort that feels harder in the moment often yields more durable learning, a pattern known as desirable difficulty.

Effort also has a ceiling. Answering requires holding the question in working memory while searching for a reply, so long, nested questions use up capacity before any thinking about content begins. Cognitive load theory explains why a compact question often draws a richer answer than an elaborate one.

Even silence belongs to the design. A pause of a few seconds after a question gives the listener room to reason, and replies grow longer and more considered. The practical point is calibration: a well-designed question asks for enough effort to build understanding and keeps the load within what the listener can carry.

The contract inside the grammar

When the listener is another person, a question is also a social act. Negotiation research describes calibrated questions, open forms beginning with "how" or "what", which invite the other party to work on the problem alongside the asker. Motivational interviewing and coaching use related forms so that people voice their own reasons and plans.

Cross-examination uses narrow, leading questions to keep control of a witness. Journalism asks for a record the public can check. The grammatical tools overlap across these settings, while the obligations differ sharply.

The same grammar can hand agency to the other person or quietly keep it with the asker. That makes question form an ethical choice as well as a tactical one. Every question carries an implied contract about who gets to decide what matters, and a careful asker knows which contract they are offering.

A frame changes what people will say

The pre-mortem shows how far a frame reaches. A team is asked to assume a project has already failed and to explain what happened. Treating failure as a given changes the social task, and people surface specific, candid risks with far less hesitation. The facts stay constant while the frame changes the conversation.

Public life shows the same effect at scale. Deliberative polls and citizens' assemblies give randomly selected people balanced evidence, structured discussion and a clearly framed question. Under those conditions, ordinary people produce substantive, evidence-informed recommendations.

The quality of public judgement depends on the conditions of the question. That places a large share of responsibility on whoever designs those conditions, whether the setting is a team meeting, a survey or a national deliberation.

The scarce skill

Taken together, these findings describe a single craft. A strong question fits its job, and its presuppositions are true or openly stated. Its load suits the person answering. Its frame opens the right answer space, and its grammar respects the other person's agency.

Each of these criteria comes from a different field, and each can be checked before the question is asked. That is what makes questioning a discipline with standards, open to study and steady improvement.

Abundant answers raise the value of that discipline. When a reply arrives in seconds, the decisive work happens earlier: in the boundary drawn, the claims built in, the effort requested and the stance taken toward the listener. The help-desk exchange resolves the moment someone asks what the file name is for. Understanding begins with a question, and the design of that question sets the ceiling on what any answer can deliver.