In short, markets fail. Their failures are systemic, not accidental. They fail because market actors cannot know enough to maximise their interests in the way that market economics postulates. They fail because they cannot, by themselves, ensure that social costs are borne by those who incur them. And, as Adam Smith knew, they fail because they cannot secure the production of public goods. Because they fail, they have to be both regulated and supplemented; and it is the state that has to regulate and supplement them. The Keynesian social-democratic paradigm left plenty of room for debate about the extent and form of state intervention, but on two points all Keynesian social democrats were agreed. They were for extensive state intervention in the market, and against state suppression of the market. In James Meade’s language, they were ‘Liberal Socialists’;14 in Andrew Shonfield’s, they wanted a ‘mixed economy’, in which ‘supplies of goods and services are largely determined by market processes’, but in which the state and its agencies ‘have a large capacity for economic intervention’.15
The second set of arguments was moral and political. To make a reality of civil and political rights, Keynesian social democrats insisted, social rights had to be guaranteed as well; indeed, social rights were the emblems of social progress. In his seminal 1949 essay, ‘Citizenship and Social Class’, T. H. Marshall offered a classic summary of the argument.16 Citizenship, said Marshall, had three dimensions – civil, political and social. Over the preceding three centuries, the struggle for citizenship rights had shifted from the first to the second, and then from the second to the third. Civil citizenship, manifested in equal civil rights, had been established in the eighteenth century, or at any rate in the 150 years between the Glorious Revolution and the first Reform Act. Political citizenship – equality of political rights – was largely the work of the nineteenth century. In the twentieth century, the focus had shifted to social citizenship – the struggle for equal social rights. The post-war welfare state had now enshrined the principle of equal social rights in legislation.
The implications went wider than appears at first sight. The essence of citizenship lies in its autonomy: the fact that citizenship rights are held independently of market power or social status. If the domain of citizenship expands, the domain of the market-place contracts. In celebrating the extension of citizenship, Marshall was also celebrating the growth of the public domain at the expense of the market domain. In writing the history of the preceding 250 years as a history of growing citizenship, he was saying that successive aspects of social life had been ring-fenced from the operations of the market-place. In presenting that process as evidence of social progress, he was also saying that it had been right to ring-fence them: if the democratic promise of equal citizenship were to be honoured, the market domain should not be allowed to invade other domains.
Buttressing the arguments from market failure and democratic principle was an argument from historical necessity. As Albert Hirschman has suggested, one of the stock themes of ‘progressive’ rhetoric is an appeal to irrevocable laws of motion, carrying society, willy-nilly, in the desired direction.17 In the eighteenth and nineteenth centuries, the founding fathers of market economics had employed that trope to devastating effect. The invisible hand of free competition, and the accompanying switch from status to contract, produced opulence; opulence produced civility; with civility came felicity; with both came progress. Not the least of the achievements of the intellectual progenitors of Keynesian social democracy – and not the least of the reasons why Keynesian social-democratic governments exercised leadership as well as power – is that they turned this historiography on its head. The irrevocable laws of motion, as depicted by them, pointed in very nearly the opposite direction – from the disorganised to the organised, from the dispersed to the concentrated, from the individual to the collective. The visible hand of oligopoly had gradually, but inexorably, replaced the invisible hand of free competition. Big firms, big unions and big government were the inescapable hallmarks of the modern age. So the maverick Conservative Harold Macmillan saw existing forms of economic organisation as ‘a temporary phase in the onward march of developing social history’,18 which would, sooner or later, terminate in a planned economy. And so the Labour economist, Evan Durbin, dismissed the ‘liberal’ economics of Mises, Hayek and Robbins with a kind of mocking determinism. It was not, he wrote,
wholly inconceivable that the politician of the future, inspired by these economists, should persuade the trade unions voluntarily to disband, and the people to accept a permanent reduction of the social services with the enthusiasm that greeted the sharp deflationary budget of 1931. It is not impossible that the British working class could be persuaded, by the compelling force of ideas, to abandon with cheerful courage the social hopes that they have entertained for generations; and thus to acquiesce in a mournful return to a world that they had left behind them for ever. It is not impossible to conceive this; but such a change is, surely, in the highest degree improbable. Social systems have rarely developed backwards.19
The counter-arguments which gave the New Right its victory in the struggle for intellectual and moral leadership in the late 1970s and early 1980s must be seen against this background. Their most striking feature is that they were not new at all: they consisted of more or less ingenious re-statements of very old arguments, which the rising liberal collectivists of the late nineteenth and early twentieth centuries thought they had refuted. Inequality, said the New Right, is desirable; social justice is a chimera. So are the positive freedoms embodied in social-citizenship rights and the notion of a public domain, separate from the market domain. So far from erecting boundaries between the market and other domains, market relations should be given as free a rein as possible. The invisible hand of free competition does produce opulence, state intervention in the market-place does misallocate resources and the principles that govern the finances of a private household do apply to the public finances. From this, it followed that Keynesian pump priming was inherently inflationary and state planning, even of the modest kind attempted by the governments of the 1960s and 1970s, inherently wasteful. The role of the state was to enforce contracts, to supply sound money and to ensure that market forces were not distorted. To attempt more than this was to embark on a slippery slope to inflationary crisis and collectivist oppression.
To be sure, that was only the beginning of the story. If the New Right had confined itself to a re-statement of nineteenth-century economics, no one would have listened. The originality and power of its critique of the Keynesian social-democratic system came from its politics, not from its economics. Above all, they came from its answer to the Keynesian social-democratic argument from market failure. The New Right did not, on the whole, deny that markets can fail. But it added that market failure was balanced – and more – by government failure. It followed that attempts to correct market failure through government action did more harm than good.
One reason, derived from the pessimistic Austrian anti-rationalism of Hayek, was epistemological.20 No government or planning board, the argument ran, not even one equipped with the most sophisticated technology, can know enough to second-guess the ‘spontaneous order’ of the market-place. If it tries, it will fail; if it tries to compensate for its failure with further interventions (as it is inherently likely to do), it will make matters even worse. That leads on to the second reason, derived from the public-choice theorists of the so-called Virginia School. Excessive government intervention, according to this argument, is not the product of intellectual hubris alone. It springs from the inescapable pressures of party competition in conditions of mass democracy, and from the equally inescapable pressures of bureaucratic empire-building in the conditions created by an extended modern state. Behind all this lies the simple, not to say simplistic, premise that political processes can be reduced to economic ones: voters are like shoppers without a personal budget constraint; politicians seeking votes are like salesmen competing for custom; bureaucrats strive to maximise their bureaux as entrepreneurs strive to maximise their profits. On that key assumption rest the conclusions that politicians will always promise more than they can perform, voters will always vote for exaggerated promises,