Why Do Energy Markets Fail Differently From Other Markets?
From the Energy Economics collection
Energy is unlike any other economic good. It cannot be seen, touched, or stored cheaply in most of its forms. It is demanded for the services it enables — heating, lighting, transport, computation. It is produced from resources that are exhaustible, converted through technologies that waste most of what they process, and traded in markets whose failures have consequences measured in atmospheric chemistry and geopolitical instability. The standard tools of microeconomics — supply, demand, equilibrium, efficiency — apply to energy markets, but they apply in conditions that strain every assumption they rest on.
Exhaustible resources
Exhaustibility introduces a time dimension that ordinary markets lack. A barrel of oil extracted today is a barrel that cannot be extracted tomorrow. Harold Hotelling's foundational insight is that the price of an exhaustible resource must rise over time at the rate of interest — the so-called Hotelling rule — because the owner of the resource must be indifferent between extracting and selling now versus leaving the resource in the ground and extracting later. If the price were not rising fast enough, owners would extract now, increasing current supply and depressing the current price until the condition was restored. In practice, the Hotelling rule has been a poor predictor of actual price paths because it abstracts away exploration, technological change, and the strategic behaviour of producer cartels. But its logic is inescapable: an exhaustible resource has a scarcity rent — a component of its price that reflects the opportunity cost of irreversible depletion — and that rent shapes investment, extraction, and substitution decisions across decades.
Derived demand and externalities
The derived demand for energy makes it uniquely difficult to substitute. A consumer does not want kilowatt-hours; a consumer wants a lit room, a warm house, a charged device. The demand for energy is derived from the demand for these services, and the link between them is mediated by the efficiency of the conversion technology. An improvement in insulation reduces the demand for heating energy without reducing the demand for warmth. A more efficient engine reduces the demand for fuel without reducing the demand for transport. This relationship — between energy consumed and service delivered — is captured by the concept of useful work, and it complicates demand analysis because a decline in energy consumption may reflect improved efficiency, reduced economic activity, or structural change in the economy, and each has different implications for policy.
Externalities are pervasive and large. The combustion of fossil fuels imposes costs on third parties — air pollution, climate change, water contamination, health effects — that are not reflected in the market price. The gap between the private cost of energy (what the consumer pays) and the social cost (the private cost plus the external damage) is the externality, and its magnitude is substantial. Estimates of the social cost of carbon — the damage caused by one additional tonne of carbon dioxide — range from tens to hundreds of dollars, depending on the discount rate, the damage function, and the time horizon. An energy market that ignores this externality overproduces fossil energy and underproduces alternatives, because the price signal is wrong. Carbon pricing — through a tax or a cap-and-trade system — corrects the signal by internalising the external cost, but the political difficulty of imposing a carbon price is well documented.
The physics of electricity markets
Electricity markets face physical constraints that no other commodity market shares. Electricity cannot be economically stored at scale (though this is changing slowly with battery technology). Supply must equal demand at every instant; an imbalance of even a few per cent can cause frequency deviations that damage equipment and, in extreme cases, cascade into blackouts. The market must therefore coordinate supply and demand in real time, using a dispatch mechanism that calls generators online in order of their marginal cost — the merit order. The result is a price that is set by the marginal generator: the most expensive unit needed to meet demand at that moment. This price can spike to extraordinary levels during peak demand or supply shortages and collapse to zero or negative values when renewable output exceeds demand and inflexible generators cannot shut down quickly enough.
The integration of renewable energy introduces intermittency as a structural feature of the electricity system. Solar output depends on the sun; wind output depends on the wind. Neither can be dispatched — called online when needed — in the way that a gas turbine or a hydroelectric plant can. The variability of renewable output must be managed through a combination of flexible generation (gas turbines that can ramp quickly), storage (batteries, pumped hydro), demand response (shifting consumption to match supply), and interconnection (transmitting surplus from one region to a deficit in another). Each of these solutions has costs, and the cost of managing intermittency is part of the total system cost of renewable energy, even when the marginal cost of generation is zero.
Energy security
Energy security adds a geopolitical dimension that pure economics cannot fully capture. A country that depends on imported energy is exposed to supply disruptions caused by political instability, conflict, or the strategic behaviour of exporters. The oil shocks of the 1970s demonstrated that supply disruptions can trigger recessions, and the geopolitical premium embedded in the oil price reflects the market's ongoing assessment of this risk. Energy security considerations may justify investments — in domestic production, strategic reserves, diversification of suppliers, or demand reduction — that fail a pure cost test yet reduce the country's vulnerability to events beyond its control.
Restructuring the capital stock
The transition to low-carbon energy is an exercise in restructuring the entire capital stock of the energy system. Power plants, refineries, pipelines, vehicles, buildings, and industrial processes represent trillions of dollars of capital with lifetimes measured in decades. The transition requires both deploying new technologies and retiring or repurposing existing ones before the end of their economic life — creating stranded assets whose owners bear the loss. The pace of the transition is determined by the interaction of technology costs (which are falling for renewables and storage), policy signals (carbon prices, mandates, subsidies), and the political economy of incumbent industries that have strong incentives to resist change.
Energy markets fail differently because the goods they trade are different. Exhaustibility introduces scarcity rents and intergenerational trade-offs. Externalities mean that the price is systematically wrong. Physical constraints make electricity a commodity that must be balanced in real time. Intermittency makes renewable supply a management problem as well as an engineering achievement. And geopolitics makes energy security a national interest that markets alone cannot guarantee. The discipline of energy economics exists to analyse these failures and to design policies that correct them — knowing that the corrections are themselves imperfect and that the trade-offs are as much political as they are economic.