‘Economics is what economists do’, but what do the numbers tell us?

Roger Backhouse, University of Birmingham;¶ Roger Middleton, University of Bristol;* Keith Tribe, University of Keele§

Paper for Annual History of Economic Thought Conference, University of Bristol, 3–5 September 1997

ABSTRACT This paper has two purposes: first, to survey existing quantitative analyses of economics and the economics profession; and, second, to suggest that a more rigorous quantitative approach towards certain aspects of the subject will not be possible until historians of economic thought take fuller advantage of available database resources and modern computing technology. This argument is sustained and illustrated by reference to the three author’s quantitative work on British and American economics and economists.

©Roger Backhouse, Roger Middleton and Keith Tribe, 1997

Addresses for correspondence: ¶ Professor Roger Backhouse, Department of Economics, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK Tel. 0121 414 6655; E–mail: [email protected]. * Dr Roger Middleton, Department of Historical Studies, University of Bristol, 13 Woodland Road, Bristol BS8 1TB, UK. Tel. 0117 928 7931; E–mail: [email protected]; URL: http://info.bris.ac.uk/~hirm/rmhome.html. § Dr Keith Tribe, Department of Economics, University of Keele, Keele ST5 RBG.

POSTSCRIPT No changes have been made to this document since it was written save that items then forthcoming by the authors have been replaced with their subsequent publication details. ‘Economics is what economists do’, page 2 of 35 §1. Introduction1

Twenty–five years ago in the JPE two economist–watchers, Hansen and Weisbrod (1972), proposed that just as professional baseball and football had their own Halls of Fame, so should economists. And, because they were economists, they should be selected according to a general theory of awards, which they in turn provided, and on the basis of strict empirical evaluation, in this case deriving from enumeration of individual economist’s publications in journals, as reported in the AEA’s Index of economic journals. Thus, unlike the then only recently instituted Nobel prize in economics, the economists’ Hall of Fame would be selected by the profession, and on the basis of explicit, ‘scientific’ criteria. Moreover, it would provide a variety of awards, supplementing those for lifetime achievement with those for current accomplishments and special category awards such as ‘most sacrifice bunts’ (most articles of ten pages or less) or ‘lifetime batting leaders by position’ (most total articles by major field). We reproduce in summary form, and with the sporting categories intact, the results of this exercise in Table 1(RM).2 The author’s light–hearted tone and appeal to sporting metaphor should not, however, obscure their deeper purpose: not just the economists’ delight in counting but the premise that league tables of individual economists’ journal output (at this time unadjusted for differences in quality or page size) provide the appropriate summary measure of economists’ professional activity. Whilst their levity was a useful antidote to the gloom then infecting the profession on both sides of the Atlantic,3 it is arguable that Hansen and Weisbrod’s premise and methodology have had an enduring impact on subsequent work which they may not have intended. Admittedly, this was not the first economists’ league table. The AEA had been publishing proxy institutional rankings since the 1930s, first for graduate schools and later for AEA conference attendance,4 with Yotopoulos (1961) the first to compile institutional rankings drawn from more than one journal (the AER, JPE and QJE) or professional association. In an early postwar work, Stigler (1949) compiled a world ranking of contemporary economists (reproduced here as Table 2(RM), but this was based on one source, an AEA survey of contemporary economics edited by Ellis (1948), and it failed the test of comprehensiveness on a variety of counts. Fifteen years later, Stigler (1964) shifted his focus to long–run trends in US journals (AER, QJE, JPE, REStat and Econometrica), providing an analysis of the occupations, nationality, language and level of technique of authors and their papers. He contemplated using the AEA’s index to examine fashion in economics, but concluded that the AEA’s major field categories at that time were ‘too broad, [with] the index itself recogniz[ing] only the categories of subjects which were fashionable in 1960!’ (p. 48). Overall, this was a tentative study, one designed to illustrate ‘a potentially large role for the statistical method in intellectual history’ (p. 49). The first systematic quantitative assessment of the AEA’s index – the first five volumes of which became available in 1962 – seems to have been Bronfenbrenner’s (1966) paper on trends, cycles and fads in economic writing, but the focus here was the major field of

1 The phrase ‘economics is what economists do’ has long been attributed to Jacob Viner (for example, Spiegel 1987, p. 814), but we have been unable to establish its textual origin. We have identified an early (?first) use of it in print as the opening sentence of Boulding (1941, p. 3), who after his PPE degree and a year’s postgraduate study in Oxford had spent 1932–3 on a Commonwealth Fellowship at Chicago with Viner as his adviser. In the British context, we might further observe that Viner’s functionalist definition mirrors the realpolitik implicit in one of Herbert Morrison’s maxims, ‘Socialism is what the Labour Government does’ (cited in Jenkins 1970, p. 101). 2 Hereafter, the origins of tables and graphs are identified by the initials of their author in parentheses. 3 Seasoned economist–watchers may remember the parallel efforts of Leijonhfvud’s (1973) life amongst the Econs and Covick’s (1974) quantity theory of drink to lighten the ‘crisis’ that featured so prominently in contemporary AEA, RES and BAAS (section F) presidential addresses – in sequence, Leontief (1971), Phelps Brown (1972) and Worswick (1972). 4 On the former, see Froman (1930; 1942; 1952) and Spellman and Gabriel’s (1978) update; on the latter, Fusfeld (1956) and Cleary and Edwards (1960), and also Siegfried’s (1972) update and extension of these works. ‘Economics is what economists do’, page 3 of 35 Table 1(RM) Hansen–Weisbrod (1972) league tables: rankings of top one hundred economists for ten awards

Economists/Awards I II III IV V VI VII VIII IX X Abbott, ER 4 Adelman, I 7 Adelman, MA 4IO Arndt, HW 10IE Backman, J 9IO Balogh, T 2 7 10 1 4 8= 1IE Barkin, S 8LE Bauer, PT 4A Beveridge, WH 7LE Black, JD 5 5 7 7 6 7 1A Bladen, VW 3IO Bonar, J 3HET Bowley, AL 4 8 8 3 1LE Bowman, MJ 9 Brems, H 10= Bronfenbrenner, M 6= 7 2 7 6ET Brown, EC 10 Brown, EH 6LE Buchanan, JM 10= Chapman, SJ 10IO Checkland, SG 8HET Clark C 2 Clark, JM 10ET Commons, JR 9LE Copland, DB 4IE Crum, WL 1IO Davis, JS 5A Douglas, PH 4 2LE Edgeworth, FY 7 8ET Farnsworth, H 8 Fetter, FW 4HET Fisher, I 9 4ET Flux AW 8IE Ford, JL 5 Frankel, SH 3 Galbraith, JK 2IO Gallaway, LE 4 10 Giblin, LF 5PF Gilboy, E 5 Goode, R 4PF Groves, HM 1PF Haberler, G 5IE Hansen, AH 3ET Harrod, RF 10 10 7ET Heady, EO 3 3 2A Hollander, JH 7HET Holzman, FD 6PF Innis, HA 9HET Isard, W 6 5 Johnson, DG 7A Johnson, HG 1 9 5 1 1 1 1 21E ‘Economics is what economists do’, page 4 of 35

Economists/Awards I II III IV V VI VII VIII IX X Jorgenson, DW 6 3 Kalecki, M 9 2 5 Keynes, JM 4 2HET Klein, LR 8= Knight, FH 6 3 5ET Kuznets, S 2 Lambert, P 7 Lester, RA 5LE Loria, A 10 5HET Lydall, HF 8= Machlup, F 5 Maxwell, JA 9PF Meade, JE 9IE Meek, RL 6HET Modigliani, F 8 2 Nicholls, WH 8A Northrup, HR 10LE Nourse, EG 9A Peacock, AT 2PF Phillips, CF 6IO Pigou, AC 6= 6 2ET Price, LL 4LE Reid, M 6 Robinson, J 1 Ruttan, VW 8 Samuelson, PA 3 9 8 9 3 6 1ET Schultz, TW 3A Schulz, T 10= Seers, D 8 4 Seligman, ER 3PF Sengupta, J 9 4 Shiomi, S 7PF Slichter, SH 3LE Smithies, A 1 2 Spengler, JJ 3 2 5 1HET Steindl, JJ 2 Stevens, WH 8IO Taussig, FW 6= 4 1 3IE Tawney, RH 10HET Taylor, HC 10A Thomas PJ 8PF Tinbergen, J 9ET Tucker, RS 7IO Viner, J 6IE Walters, AA 10 9 Waugh, FV 6A Willis, HP 7IE Worswick, GDN 10= Yamey, BS 5IO Award categories: I ‘Most total hits’ (most total articles published during lifetime, 1886–1967). II ‘Most total bases’ (most total pages published during lifetime, 1886–1965). III ‘Most home runs’ (most articles of twenty–five pages or more, 1886–1965). IV ‘Most sacrifice bunts’ (most articles of ten pages or less, 1886–1965). V ‘Lifetime batting average’ (most total articles per year based on twenty–one or more total lifetime articles, ‘Economics is what economists do’, page 5 of 35 1886–1965. VI ‘Lifetime slugging average’ (most total pages per year based on twenty–one or more total lifetime articles, 1886–1965). VII ‘Current batting champions’ (most total articles published currently, 1966–7). VIII ‘Current total–bases leaders’ (most total pages published currently, 1966–7). IX ‘Lifetime batting leaders by position’ (most total articles, by major field, 1886–1965. Field codes: ET=economic theory; IO=industrial organisation; HET=history of economic thought; A=agriculture; PF=public finance; LE=labour economics; IE=international economics) X ‘Special awards to female economists’ (most total articles published during lifetime, 1886–1965). Source: Hansen and Weisbold (1972, app.) with corrections for obvious errors.

publication rather than league tables of institutions and individuals. Thus, whether by design or by accident,5 it was Hansen and Weisbrod (1972) who appear to have initiated the economists’ modern preoccupation with league tables of their published output. Their paper was followed quickly by a flood of studies which extended and refined their use of the AEA index (for example, Lovell 1973, Stigler and Friedland 1975 and Quandt 1976, all still much cited), such that such exercises – which quickly adopted the Social Science Citation Index (SSCI, published triannually since 1966 by the Institute for Scientific Information) – have almost become a sub–discipline in their own right (perhaps class A15, ‘sociology of economics, quantitative studies’, in the current JEL schema).6 They are also perhaps the most frequently read papers in economics, yet, ironically, amongst the least cited! No comparable British sources are available, but pioneering work on the British economics profession was undertaken at this time by Coats and Coats (1970; 1973).

Table 2(RM) Economists cited most frequently in a 1948 AEA survey of contemporary economics Rank Name No of citations 1 Keynes, J.M. 70 2 Hicks, J.R. 34 3 Lange, O. 28 4 Marshall, A. 24 5 Pigou, A.C. 23 6 Lerner, A.P. 22 7 Samuelson, P.A. 20 8 Chamberlin, E.H. 19 9= Hansen, A.H. 18 Kuznets, S. 18 Schumpeter, J.A. 18 10 Clark, J.M. 17 11 Machlup, F. 16 12= Haberler, G 15 Robinson, J. 15 13= Fellner, W 14 Robertson, D.H. 14 14= Hart, A.G. 13 Ohlin, B. 13 15= Pareto, V. 12 Stigler, G.J. 12 Source: Stigler (1949, table 1).

Hansen and Weisbrod also anticipated later developments in their use of modern

5 They reported that their paper was an outgrowth of a Ford Foundation project on the determinants of economists’ earnings (Hansen and Weisbrod 1972, p. 422n). 6 See Broadus (1971) for a review of early work on the SSCI. ‘Economics is what economists do’, page 6 of 35 technology. While neither Stigler nor Bronfenbrenner made reference to use of a computer in compiling their tabulations,7 Hansen and Weisbrod (1972, p. 423) were quite explicit in their acknowledgement of machine–assistance, indeed with the computer as deus ex machina: ‘We trust that any errors in the tabulations and awards presented below will be attributed not to us or to our assistants, but to the Burroughs 5500 at the University of Wisconsin Computing Centre.’ Since then the IT revolution has transformed the computer hardware and software with which to pursue quantitative analyses to such an extent that a typical western academic now has on his or her desktop PC a level of computing power that is an order of magnitude greater than that provided by the most highly specified mainframe computer of this earlier era, and is available at a millionth or so of the cost. He or she also has access to off–the–shelf econometric and general statistical packages which have revolutionised the input, storage, transformation and processing of quantitative (and qualitative) data. They are thus liberated from the rigors of FORTRAN sub–routines and the clutches of computer science department programmers who, even with the best of intentions, necessarily impacted on research design and the questions asked of the evidence assembled. Finally, of course, the internet beckons, providing new opportunities for academic collaboration, data storage and dissemination. Yet, for all of this, it may well be that, in terms of the data collected, its organisation and the hypotheses tested, current quantitative work remains embedded largely in the intellectual world of the 1960s and 1970s, of league tables, of study of the great and the good and of those aspects of economists’ activities which are readily measurable as against those that are not. In short, is current work taking full advantage of the opportunities provided by leading– edge IT? Our contention is that they are not, and that as a result such quantitative work is failing to make the impact on the history of economic thought (HET) that it should be making. To make this case, we start (in §2) by surveying the (predominantly US) quantitative literature on the (principally US) economics profession, indicating its principal achievements.

§2. A survey of quantitative studies of the economics profession

In a review article of the state of quantitative work on the profession as of ten years ago, Colander (1989) distinguished three grounds upon which the economics profession might be of interest to its members: A. Prurience and professional interest; B. As a case study of economic theory; and C. As a case study in the sociology of scientific knowledge. Beginning our survey with these categories we summarise in Table 3(RM) recent quantitative work, distinguishing between its geographical coverage (global, US, European, UK and other) and the extent to which the datasets assembled relate to the near past (ST, ≤5 years), the medium–term (MT, ≥5≤10 years), the long–term (LT, ≥10≤50 years) and the very long–term (VLT, ≥50 years). The paucity of genuinely global empirical work is immediately apparent for all three categories, as is the emphasis on the short–term, particularly with respect to the basic league tables of departmental rankings (cols 1–2). By this test, JEL class A15 is thus largely an American literature on American economics (institutions and journals) and American economists, and with little interest in the past. This geographical focus may, of course, be an accurate reflection of the discipline. After all, it is now ten years since Portes (1987, p. 1330) argued that, with so many economists taking their professional standards and views of what constitutes an interesting problem from the US, and with publications, citations and Nobel prizes also so dominated, ‘It is perfectly reasonable to ask whether there is now

7 The connections between computer availability by institution and the development of empirical economics remains a largely unexplored area, but as the recent AEA conference session on 40 years of cliometrics made clear many of the cliometric pioneers did not make use of computers in what we now think of as seminal contributions to the new economic history (for example, Conrad 1997, pp. 408–10 on Conrad and Meyer 1958).

Table 3(RM) Summary of recent quantitative work on the current economics professiona A. Prurient and professional interest: Ranking of departments/journals Ranking of departments by field Rankings of individuals Rankings of journals ‘Rankings, rankings’ Global Burton and Phimister (1995): core Hall (1990): econometrics, MT Anderson et al. (1989): half–life Laband and Piette (1994b): Stigler et al. (1995): inter– journals, revision of Diamond (1989), Schwert (1993): finance, LT of dead economists changing industrial organi– journal citations, ST; ST Figlio (1994): empirical, ST zation of journals, LT characteristics of authors and techniques, VLT Hutchinson and Zivney (1995): publication profiles, LT Heck (1993): 80 years of the AER

US Scott and Anstine (1997): as PhD Borokhovich et al. (1995): finance, Medoff (1996): top 250 Jansen (1991): Federal Reserve producers, VLT LT economists and their research departments, MT Scott and Mitias (1996): updates of Tremblay et al. (1990): general, affiliations, LT Graves et al. (1982) and Hirsch et al. MT Chung et al. (1993): most (1984); also updated Hall of Fame, LT prolific authors, LT Conroy et al. (1995): core journals, ST Bairam (1994): core journals, MT

UK Taylor and Izadi (1996): RAE, research inputs and outputs, ST Johnes (1990) and Johnes and Johnes (1993; 1995): RAE & research output, ST Europe Kirman and Dahl (1994): EU research, various indicators, ST Other Towe and Wright (1995): Australia, ST Lucas (1995): Canadians, MT Note: a ST>0<5 years; MT>5<10 years; LT>10<50 years; and VLT>50 years.

B. Economics as a case study: Discrimination in economics Other C. Sociology of scientific knowledge DeLorme et al (1994): economists’ demand for Hudson (1996): multi–authored papers, LT Global journals, ST Anderson and Dewald (1994): replication and scientific standards, Journal of Money, Credit & Banking project, LT; also Hubbard and Vetter (1992), LT Laband and Piette (1994a; c): journal editorial practices, ST; MT Fels (1992): update of Leontief’s (1982) complaint, ST Holub et al. (1991): iron law of important papers (growth theory), LT Mirowski (1991): mathematics in economics, VLT; also Debreu (1991, based on 1986), LT Hindshaw and Siegfried (1995): Beil and Laband (1996): AEA discrimination in AEA dues and economists’ Alston et al. (1992): surveys of economists’ opinions, ST US program, LT behaviour, ST McMillen and Singell (1994): Goodwin and Sauer (1995) gender and first jobs, LT and Kenny and Studley Formby et al. (1993): gender (1995): life cycle productivity, and age, affects on salaries, ST LT Broder (1993a; b): gender and Laband and Taylor (1992): professional achievements, ST impact of bad writing, ST Mumford (1997): RES Ricketts and Shoesmith (1990; 1992): surveys of economists’ opinions, UK Women’s Committee: report ST; also Greenaway (1990): survey of opinion on efficient use of mathematics in economics (update of Grubel and Boland 1986), ST

Frey and Eichenberger (1992): surveys of economists’ opinions, ST Europe

Round and Siegfried (1994): surveys of economists’ opinions, ST Other Note: a ST>0<5 years; MT>5<10 years; LT>10<50 years; and VLT>50 years. ‘Economics is what economists do’, page 9 of 35 any economics outside and independent of the United States.’8 Unsurprisingly, this view is contested by many European economists (starting with Kolm’s 1988 response to Portes), and has been widely and publicly discussed.9

Table 4(RM) Leading British university economics departments and summary of Research Assessment Exercises, 1986, 1989, 1992 and 1996 Departmenta 1986 1989 1992b 1996b Out– Above Grade Grade Grade Grade Grade Grade Grade No of research standing average 5d 4d 5d 4d 5*d 5d 4d active staff Aberdeen (1495) B A 16.2 Birkbeck (1926)c • • B B 18.5 Birmingham (1900) • B B 20.3 Bristol (1909) • • A B 19.5 Cambridge (C13th) • • A A 57.0 Dundee (1967) B 11.0 East Anglia (1964) A B 13.0 Edinburgh (1583) B 10.3 Essex (1961) • • A B 28.0 Exeter (1955) B C 9.9 Glasgow (1451) • B C 13.2 Hull (1954) • 12.0 Keele (1962) B 14.0 Kent (1964) A 15.0 Liverpool (1903) B B 12.0 LSE (1895)c • • A A 53.8 Loughborough (1966) A 18.7 Manchester (1880) B 32.2 Newcastle upon Tyne (1963) • • B C 15.4 Nottingham (1948) A A 23.0 Oxford (C12th) • • A B 52.5 Queen Mary Westfield (1915)c A A 19.8 Reading (1926) • • A B 13.0 Southampton (1952) • • A A 34.0 St Andrews (1410) B 14.0 Stirling (1967) B 10.0 Strathclyde (1964) B B 23.0 Surrey (1966) A 14.1 Sussex (1961) • A A 20.0 Swansea (1920) A B 13.0 UCL (1907)c • • A A 24.1 Warwick (1965) • • A A 36.4 York (1963) • • A A 35.6 Notes: a Date of establishment of university in modern institutional form; b Proportion of academic staff included in submissions: A 95–100%; B 80–94%; C 60–79%; c Schools of the University of London; d 1996 RAE: 5* International excellence in a majority of sub–areas and of at least national excellence in all

8 On the spread of American–style economics, see Coats (1997). 9 See the debate initiated by Frey and Eichenberger (1993) in the Journal of Economic Perspectives, critical letters by Vives and Barmbold and colleagues and a response from Frey and Eichenberger in the Winter 1995 issue (vol. 9(1), pp. 203–7), a recent Kyklos symposium also organised by Frey (Frey and Frey 1995; see also Backhaus 1996 and Frey and Eichenberger 1992) and a working party convened by Bob Coats (1997). ‘Economics is what economists do’, page 10 of 35 others; 5 International excellence in some sub–areas and national excellence in virtually all others; 4 National excellence in virtually all sub–areas. Sources: Middleton (1998, table 7.6), derived from Universities: Commonwealth universities yearbook; RAEs: Times Higher Education Supplement; RES Newsletter, 80 (January 1993), p. 3; 97 (April 1997), p. 7.

In the Colander categories in Table 3, such empirical work as there is on Britain is mainly short–term, with much of it prompted by the four Research Assessment Exercises (RAEs) conducted since 1986 (Table 4(RM) summarises these results for the most highly ranked institutions). After a long period, therefore, in which there had been little quantitative work on British economics since Coats’s pioneering studies of RES membership conducted over twenty years ago,10 the British economics profession is once more the subject of study. Unlike the US literature, however, professional self–interest is somewhat differently motivated, although arguably the market effects will be similar to the way in which US league tables influence graduate school entry patterns, private and public sector funding of research and, even perhaps, the salaries of academics, or at least the employment opportunities (and thus opportunities for research) offered by Britain’s nascent ivy league. Viewed from the longer–run, and through the prism of professionalisation, the effects of the RAEs has been to accelerate the trend towards the Americanisation of British higher education, a process which can only be fuelled by the recent Dearing report (HMSO 1997), not with standing its clearly expressed reservations about research selectivity and the opportunity cost of research for high quality undergraduate teaching. In respect of category A studies Colander (1989, pp. 141–2) concluded ‘that the ranking game has been beaten to death’; that with the composition of the top ten US departments largely invariant to the measure selected, with all the action much lower down the league, and with the field categories crude and imperfect market signals to guide students in selecting graduate schools, the continued production of this literature can only be explained by their ‘political (show them to the dean to support your budget increase request), psychological, and sociological (show them to your friends and to yourself to make them feel worse and you feel better) roles’ with cognitive dissonance sweeping up the residuals. Given the current British love affair with league tables in education and other public outputs,11 and the belated but ineluctable development of private markets in British higher education, it seems safe to predict that category A studies will become routine features of academic competition and production. In economics their belated appearance relative to the US has much to do with the different professional roles played by the AEA and the RES since their inception. The AEA has since the 1970s been much concerned with the quality of economics education, whereas in Britain the RES was historically much more detached and laissez–faire, a stance which has only begun to change with the democratisation of the society initiated in the late 1980s and which have produced major reforms in the RES’s professional objectives and mode of operation. If, whenever, the funding councils carry out the teaching quality assessment of economics that most other disciplines have now undergone since 1992 there will no doubt be further impetus to produce institutional league tables. Yet, will they and the research league tables be of any use to future historians of economic thought? If their current consumption value, as providers of information to diverse agents, is questionable their longer–term historical value may indeed be for what they reveal about professionalisation, about economists’ value systems and behaviours. It is now nearly twenty years since Bob Coats (1980, p. 608) reminded the HET community that: from the standpoint of the economics profession as a whole it is average rather than peak performance that concerns us, whereas the opposite is true when one is primarily concerned with scientific achievement.

10 Beginning with Coats and Coats (1970; 1973) and, of the quantitative studies, including Booth and Coats’s (1978) examination of the market for economists and Coats’s (1991) study of British economics journals. 11 For the reservations of public sector professionals and statisticians about these trends, see Goldstein and Spiegelhalter (1996) and ensuing discussion; for an early critical survey of performance indicators in British higher education, see Johnes (1992). ‘Economics is what economists do’, page 11 of 35 but this distinction does not appear to have much influence upon how league tables are used, not at least in the US. By contrast, in Europe, state–controlled higher education systems and the maintenance of largely separate national economics professions has limited internationalisation until very recently (upon which see Coats 1997; 2000), resulting in no revealed demand for league tables. Moreover, as Eichenberger and Frey (1995) have argued in defence of their thesis that European economics ought to remain distinctively different from American economics, such league tables are utterly inappropriate for European economists whose performance has to be defined and measured differently so as to accord with European market incentives which value participation in local and national affairs, greater policy involvement and an emphasis upon undergraduate as against postgraduate education (Frey and Eichenberger 1992; 1993). In short, league tables confront what is the purpose of economics: a scientific game focusing on abstract issues, defined within the profession itself, or the direct improvement of human welfare through economists’ contribution to policy. If the latter, league tables measure inputs (publications) in the European economists’ production function and divert attention from outputs (the effects of economists on policy). Turning now to category B studies, economics as a case study of itself, we see what we might call – with no disrespect intended – the political correctness effect in the studies of discrimination (col. 6) and, perhaps, acceptance that such is the current dominance of US economists that such enumerations are no longer interesting (the absence of entries in col. 7). Of more interest, and bearing both on the market for economists and on the sociology of scientific knowledge, we have a variety of studies which explore rationality and self– interestedness through different aspects of behaviour. Once more this is an entirely US literature, and it remains unknown whether we can generalise from the picture that emerges from structured games of economists being more stereotypically rational and self–interested than other agents. Certainly the debate that has been provoked about whether studying economics so alters cooperate behaviour, by raising the propensity to free–ride and to defect in social dilemmas, that knowledge of the subject results in the production of more ‘bad’ citizens would be viewed as quite extraordinary by Marshall and the founding fathers of professional economics, for whom ethics underpinned the quest for rational deliberateness (see, for example, Yezer et al. 1996; cf. Frank et al. 1996). This brings us to the category C studies which are also very varied but exhibit greater preparedness to assemble longer–run datasets. We highlight five types of study here: 1. The onward march of multi–authored papers (Hudson 1996), a consequence of the ever widening breadth of economics, its increasingly technical content (both theoretically and quantitatively) and the expansion in the size of the profession from whom collaborators may be drawn. This is but one (readily quantifiable) aspect of the rise of the ‘scientific article’ format in economics journals. 2. Empirical studies on replication and of empirical results, many inspired by the Journal of Money, Credit & Banking project, initiated by Dewald et al. (1986), which reveal that in economics the replication of previous studies as part of new research remains highly unusual, as does the collection of data and its dissemination by professional journals (Anderson and Dewald 1994) and that the structure of publication biases (in favour of work that supports or overturns established results) changes over time (Goldfarb 1997). 3. Studies of whether the behaviour of journal editors and the results of refereeing practices enhances efficiency in the market for economic knowledge or produces favouritism and lower quality papers. Amongst recent contributions, two by Laband and Piette (1994a; c) suggest that, what might appear to be favouritism on the part of journal editors, is in practice the use of their contacts to identify and capture potentially high–impact papers, while the ‘blindness’ of peer–reviewing does appear to affect the papers selected for publication. Given the role of citations in such studies (the measure of final paper quality) their extension through time offers particularly interesting possibilities for the HET community, not least given what we now know about classic papers rejected first– time by leading journals (Gans and Shepherd 1994). ‘Economics is what economists do’, page 12 of 35 4. Leontief’s (1982, p. 104) complaint (first voiced in his 1971 paper), that ‘Page after page of professional economic journals are filled with mathematical formulae leading the readers from sets of more or less plausible but entirely arbitrary assumptions to precisely stated but irrelevant theoretical conclusions’, continues to excite interest (the first major update was Morgan 1988). The latest (Fels 1992) contribution uses a wider set of journals, a later time period and a different method to arrive at strikingly different conclusions: rather than economics being dominated by mathematical models without data the contrary is now the case, and with such papers displaying high empirical relevance. However, and here is a glaring example of economics without history, this research was based on only nine journals and but one recent issue (late 1989–early 1990) from each. There can be few hypothesis within the sociology of scientific knowledge more deserving of serious historical scrutiny than Leontief’s (1971; 1982) complaint, and the lack of empirical response may of itself be significant (unfortunately, Figlio 1994 did not directly address it in his long–run examination of empirical economics). 5. With most of the literature focusing on the production side of economics publications studies designed to assist consumers of this class of scientific literature are to be particularly welcomed, especially one formulated in terms of Borchardt’s iron law of important articles: that the number of scientifically significant papers increases to the extent of the square root of the total number of papers published. We here highlight Holub et al. (1991) which validates this hypothesis against the growth theory literature since Harrod (1939), and provides the depressing statistic that an economist, intending only to keep abreast of growth theory and reading just 12 papers per year in this field, will find at least one important article only every third to fifth year. Such studies as we detail in Table 3(RM), however, do not capture the full range of quantitative work being undertaken in HET or of relevance to HET. In Table 5(RM) we thus extend our sights beyond the rankings game and Colander’s other categories to focus upon: A. Trends in economic associations and their journals as indicators of professionalisation and the development of economic theory. B. Departments as producers of economists and economics. C. The influence of individual economists on other economists, as measured by citations. D. Classic paper replications, a natural extension of the Journal of Money, Credit & Banking project. E. Authorship puzzles, a long–standing preoccupation of the HET community. F. Economists and policy–making, this having particular topicality by virtue of the US vs. European economics debate and Frey’s attempt to reaffirm the importance of outputs (the effects of economists on policy) in the economists’ production function. Taking these in turn, the role of journals in economics has long been of interest (Coats 1971; 1991; Whitley 1991), but until very recently such works did not rest on quantitative foundations, with casual empiricism the norm. This is now beginning to change, with the IT revolution one reason for this. More particularly, we would cite spreadsheets as the reason, a software tool that ‘want[s] data the way lions used to want Christians’ (Solow 1990, p. 448). Since such studies will be considered in some detail later on, we proceed to the next category, that of departments. Here we invoke Harry Johnson’s (1977, pp. 98–9) concept of the social geography of economics departments as a means of understanding institutional differences in the character and style of economics research. Johnson admitted this was an ambitious and vague concept, with his definition perhaps uncharacteristically prolix: I mean by it generally the social relations among members of the same department, as influenced on the one hand by the hierarchy of tenure, remuneration, and power of decision or of influence over collective decision, and on the other hand by the activities and responsibilities of the department – especially teaching responsibilities, but sometimes also research responsibilities – and the cooperate efforts they may entail; also the social relations of the department with its clientele – mainly its students; with its colleagues (peers) in departments in the rest of the university or similar institution in which it exists; with the professional academic community at large; and with the larger society of which the university is a constituent and into which most of its students graduate. All these relationships have an influence on both the style and content of economic discussion with colleagues in and close acquaintance outside the department, and the choice of audience and style of addressing

Table 5(RM) Summary of recent (mainly quantitative) historical work on the economics profession Topic Global US UK Other A. Journals/ Backhouse (1998), LT Middleton (1998): EJ, VLT Coats (1997): various profession– Backhouse (1997): core British, LT European studies, ST–LT alisation Tribe (1992): EJ, LT Plasmeijer and Schoorl (1997): Dutch economics, ST–VLT B. Departments Lampman (ed) (1993): Wisconsin, LT

C. Individuals Biddle (1996): W.C. Mitchell, influence as Hodgson (1997): Sraffa and measured by citations, LT Cambridge capital controversy, citations, LT D. Classic paper Hendry and Morgan Madden (1995): decision criteria in selection of Wulwick (1996): on Phillips (1958) replications (1995), n.a. technique in econometric papers, LT and Lipsey (1960), n.a. E. Authorship Gherity (1993): early publication puzzles of Adam Smith, n.a. F. Economists and Adkisson and Blum (1996): education policy–making and attainment of members of the CEA, LT Goodwin and Sauer (1995): effects of government service on publishing productivity, LT Laband et al. (1990): re–examination of Stigler (1960) on environmental theory of idea entrepreneurship amongst economists, LT G. Other Margo and Siegfried (1996): production of economics graduates, LT Diamond and Haurin (1995): age cohorts and sub–field specialization, LT

‘Economics is what economists do’, page 14 of 35 it for oral (usually unpublished) and written (published) communication at the academic and professional level. In short, social geography underpins national research styles, a theme upon which Johnson also had much to say in connection with the sins of English economics (1968; 1973; 1975). Social geography is a potentially powerful concept, rich in hypotheses and data– collecting possibilities, and yet as the paucity of entries in Table 5 makes clear the department has not been much studied as an organisation, and especially not over the long– run.12 Yet, and in relation to the home of British professional economics, as one LSE economist, a long–time observer of Cambridge economics, has put it: Doing economics at Cambridge is like being a Christian during the English Civil War; you can’t just be a Christian. You have to identify yourself as to what sect, what party, what faction you belong to. Your views on the non–substitution theorem are as important as a marker for the rest of your world– view, on everything from beer to sherry to the stance on Vietnam, as your views on transubstantiation were in seventeenth–century England. [Desai 1997, p. xvii] Our next category (C), individual economists and their influence, is of course the life blood of HET, one given a recent transfusion with the maturity of citation studies from individual/institutional league tables to detailed, tightly–specified studies of individuals’ citation counts. Biddle (1996), author of a recent exercise of this type on Wesley Mitchell, argues that the timing and nature of an individual’s intellectual impact can be more precisely specified, with light shed on the basis of their reputation, the nature of their disputes, their intellectual allies (individuals and institutions) and so on. He also argues that, when related to citations counts of their contemporaries, such exercises provide a general ‘check on the validity of citations counts as a measure of stature and influence in the economics profession’ (p. 138). With the SSCI now on–line (in Britain as BIDS) we should expect many more of such studies, for the production costs have fallen significantly (for example, from my own desktop it takes but 1 minute 42 seconds to query BIDS for the number of times Maynard Keynes is cited in the SSCI between 1981–97 (1,018 for the numerically addicted), with more precise queries of this dynaset taking 15 seconds a piece).13 Given the transformation in power and user–friendliness of modern econometric software we would also expect classic paper replications to be a growth area, and, given the continued error–proneness of this class of software (Lovell and Selover 1994), to provide a continuing flow of suitable case studies. Here we identify some very varied Category D pieces, from Hendry and Morgan’s (1995) mammoth undertaking, which attempted – on the whole, very successfully – to reproduce and test the original empirical findings of key papers from five founding fathers of econometrics,14 to Wulwick’s (1996) more limited historical, econometric reconstruction of the Phillips curve. One by–product of the latter has been to prompt re–examination of the historical context in which researchers worked, thereby revealing how much of early British applied econometrics was frequently done by those self– taught in econometric technique and without benefit of localised access to computer hardware (the original Phillips curve was estimated on an electro–mechanical Marchant desk calculator, although at that time Phillips was rare amongst British economists in that he had experience of computers – Wulwick 1996, p. 395).15 The next class of studies (E, authorship puzzles), however, appears in terminal decline. This used to be a very active research area, but there has been little since O’Brien and Darnell

12 Lampman’s (1993) edited volume on Wisconsin, which could hardly be called quantitative, is a notable exception but of the US departments there has been little work since Samuels (1976) or Patinkin (1981) on Chicago (although see Stigler’s 1988, p. 16 on how Columbia and Harvard lost out to Chicago in 1933), and almost nothing, apart from De Marchi (1988) on the LSE and the tail–end of Young and Lee (1993) on Oxford, on postwar British departments (see also Tribe 1997 for British economists recollections of their departments). 13 For registered users BIDS is available via telnet at bids.ac.uk. 14 Irving Fisher, Lehfeldt, H.L. Moore, H. Schultz and Tinbergen. Usefully, and commendably, they have continued to make their data available for scrutiny at an FTP site (see Hendry and Morgan 1995, p. xii). 15 See also Richard Lipsey’s (1997, esp. p. xviii n.6) autobiographical reservations about historical reconstructions, econometric and otherwise. ‘Economics is what economists do’, page 15 of 35 (1982) appeared to settle many outstanding disputes. Recent years have seen the transformation of textual analysis software,16 but its major application is now in the stylistics component of the rhetoric debate prompted by McCloskey and others (for example, Diamond and Levy 1994 on AEA presidential addresses). By contrast, class F studies appear to be flourishing, at least in the US and it is to be hoped that the questions posed by Adkisson and Blum’s (1996) study of the CEA will be applied to the British case. Although we have no direct comparator, an examination of the personnel who served with the Economic Section (later the Government Economic Service) would be instructive about both government and British economics. Goodwin and Sauer’s (1995, p. 740) finding that US economists who have a spell in government service are subsequently no less productive (as producers of journal papers) will, we suspect, not be replicated for the British case, where it has been a long– standing complaint that those serving as civil service ‘irregulars’ found it difficult to maintain their academic networks and theoretical–economic human capital (for example, Little’s 1957 complaints voiced after his period as Deputy Director, Economic Section). Laband et al’s (1990) re–examination of an issue upon which young Stigler (1960) also contributed, that is the influence of events and policies on economic theory, is also to be welcomed, although the two dependent variables (the proportion of total articles in four general journals which included the words (un)employment or inflation in their title) might be thought rather crude proxies for their actual content and topicality. Finally, we have a miscellaneous (F) class of papers. Some reflect current US concerns about the decline in the number of economics majors and whether, judged against the long–term, this might be a transient development or not. Biddle (1999) tackles the spread of statistical techniques in economics, and Goodwin and Meardon (1998) use data from a survey of journal articles to establish changes in the level of US economists’ interest in ‘international’ issues, this comprising both ‘international economics’ and developments in other countries.

§3. Limitations of much current work

These studies, when taken together with those detailed in Table 3, provide clear evidence that elements of these earlier forms remain and we should, accordingly, anticipate continuing demand for rankings which satisfy professional prurience (the schadenfreude effect). Nonetheless, recent quantitative work by, or of utility to, historians of economic thought has moved on very considerably from the basic league tables and citation studies of the 1970s. But there is still a long way to go in several respects, with the result that the potential impact on HET has not been realised. The first problem with this literature is that it is still predominantly American. Important studies of other countries have been undertaken, but it raises the question of whether British historians of economic thought, as with an earlier generation of British economic historians who resisted quantification and the ‘new’ economic history (Middleton and Wardley 1990), are lagging their American counterparts and thus failing to take full advantage of the IT revolution? This question is prompted not just by the paucity of British studies but by fact that the US versus European economics debate provides a ready–made set of questions amenable, to a greater or lesser extent, to quantification and a particular, local interest if indeed Britain does prove to be a hybrid, mid–Atlantic case. Before examining these we must first ask whether the comparative neglect of quantitative studies by British economists might be rational. Obviously, HET, like the sub– fields of methodology and economic history, are of low status: ones populated, as McCloskey (1980, p. 213) once put it, by ‘the dolts who work the libraries instead of the bright lads at the blackboards.’ These professional rankings have recently been confirmed by Diamond and

16 Laband and Taylor (1992, p. 676) provide a now rather dated survey of this class of software as used by economists, while Middleton (1995) surveys use by historians, social scientists and computational linguists. ‘Economics is what economists do’, page 16 of 35 Haurin’s (1995) long–run study of changing patterns of sub–field specialisation, although it is unknown whether professional disdain for HET is stronger in Britain than in the US. Might it be significant that few of the studies detailed in Table 3(RM) derive from individuals with high–ranking affiliations? Might there then be other disincentive effects which constrain British economists from taking advantage of the more favourable supply–side (advances in software, techniques and data sources) which we would otherwise expect to open up the field? Part of the answer must surely be that British academics as a whole are on average less interested in professionalisation than their American counterparts, with economists conforming to this generalised absence of disciplinary introspection. Part of the answer must also be that historically the RES has provided far less information than the AEA upon which to base quantitative work. No index to the Economic Journal was published between 1934 and the issue of the first cumulative index in 1983 (RES 1983), while the first membership directory to include data beyond names and address was only issued to coincide with the first hundred years of the RES, and even then was the product of a joint project with the Econometric Society (RES–Econometric Society 1990). It was not until RES (1995) that any breakdown of membership was provided on the basis of JEL sub–field specialisations. By contrast, the AEA have been providing this level of detail in their membership directories since AEA (1942). We would contend also that important opportunities for long–run quantitative analysis of the British economics profession were missed in 1990, the centenary year of the RES. The RES–commissioned Hey and Winch (1990) volume contained surprisingly little history,17 while the celebratory January 1991 issue of the EJ contained no contribution from a historian of economic thought, and indeed it was left to Milton Friedman (1991) to (very briefly) consider trends in EJ papers (see also Oswald 1991 on microeconomic data, although for him relevant history appears to stretch back only to 1960).

FIGURE 1(RM): Economic Journal papers, notes and memoranda by Journal of Economic Literature (1983) classification at ten year intervals, 1891–1990

A. Successive EJ volumes, decomposed by JEL class 1891 1900 1910 50 50 50 40 40 40 30 30 30 20 20 20 10 10 10 % of total papers % of total papers % of total papers 0 0 0 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 JEL(1983) classification JEL(1983) classification JEL(1983) classification

1920 1930 1940 50 50 50 40 40 40 30 30 30 20 20 20 10 10 10 % of total papers % of total papers % of total papers 0 0 0 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 JEL(1983) classification JEL(1983) classification JEL(1983) classification

1950 1960 1970 50 50 50 40 40 40 30 30 30 20 20 20 10 10 10 % of total papers % of total papers % of total papers 0 0 0 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 JEL(1983) classification JEL(1983) classification JEL(1983) classification

1980 1990 50 50 40 40 30 30 20 20 10 10 % of total papers % of total papers 0 0 000 100 200 300 400 500 600 700 800 900 000 100 200 300 400 500 600 700 800 900 JEL(1983) classification JEL(1983) classification

17 See, however, Tribe (1992) which provides the missing quantitative dimension for the first half century of the EJ, and also counters the misleading conclusions drawn by Jha’s (1973) attempt to quantify (for the first quarter century) using 5*3 index cards instead of a computer. ‘Economics is what economists do’, page 17 of 35

B. Successive JEL classes, decomposed by EJ volume 000 100 200 50 50 50 40 40 40 rs rs rs pe pe pe 30 30 30 20 20 20 of pa of pa of pa % % % 10 10 10 0 0 0 1891 1910 1930 1950 1970 1990 1891 1910 1930 1950 1970 1990 1891 1910 1930 1950 1970 1990 year year year

300 400 500 50 50 50 40 40 40 rs rs rs pe pe pe 30 30 30 20 20 20 of pa of pa of pa % % % 10 10 10 0 0 0 1891 1910 1930 1950 1970 1990 1891 1910 1930 1950 1970 1990 1891 1910 1930 1950 1970 1990 year year year

600 700 800 50 50 50 40 40 40 rs rs rs pe pe pe 30 30 30 20 20 20 of pa of pa of pa % % % 10 10 10 0 0 0 1891 1910 1930 1950 1970 1990 1891 1910 1930 1950 1970 1990 1891 1910 1930 1950 1970 1990 year year year

900 50 40 rs

pe 30 20 of pa

% 10 0 1891 1910 1930 1950 1970 1990 year JEL classes: 000 General Economics; Theory; History; Systems; 100 Economic Growth; Development; Planning; Fluctuations; 200 Quantitative Economic Methods and Data; 300 Domestic Monetary and Fiscal Theory and Institutions; 400 International Economics; 500 Administration; Business Finance; Marketing; Accounting; 600 Industrial Organisation; Technological Change; Industry Studies; 700 Agriculture; Natural Resources; 800 Manpower; Labour; Population; 900 Welfare Programmes; Consumer Economics; Urban and Regional Economics. Source: Middleton (1998), figure 1.1.

Is it then that the potential returns to such research are lower in Britain, not to mention the high psychic (drudgery of keyboarding) costs and that the economic costs are potentially higher when individual British academics are less well resourced for small projects? If so, the quick–and–dirty quantitative work that has characterised most studies to–date may be close to the optimum. Diminishing returns may quickly set in, while potential producers may be only too conscious that most quantitative work only confirms the existing casual impressions of well–informed observers. As all three authors can attest, the derivation of long–run summary tables has to be based upon tens of hours of keyboarding and database design (for example, Figure 1(RM) on changing sub–field specialisms in the EJ since its inception must have cost 50 hours or so). We make some suggestions in §7 about how, through cooperation, these costs could be lowered. A much broader problem with a large part of the literature (including some of our own, we hasten to add) is that it is in a sense ‘quick and dirty’. The reason for this is the immense amount of time required to compile even the most limited database. Researchers are tempted not to compile databases that can be used for future research, but to extract simply the information they require for the immediate task in hand. Rather than throw stones at other people, take as an example the data on the proportion of UK academics whose doctorates were obtained in the United States, contained in Backhouse (1997). This involves getting a list of staff for each institution covered, and finding where they obtained their doctorate. Ideally this would be obtained from the relevant university’s Calendar or similar document, and all staff and their qualifications would be entered into a database. The database could then be analysed for the relevant information. This, however, would take hours, so short cuts are typically used. Using the Commonwealth Universities’ Yearbook rather than the university’s own publications is immensely time–saving, but not so reliable. But the main ‘Economics is what economists do’, page 18 of 35 problem is that rather than create a database, it is quicker to count the numbers of PhDs and US PhDs on the page, and simply to record those numbers. This gets the relevant information, but it means that no resource for future research is constructed. To cite other examples, Biddle (1999) and Goodwin and Meardon (1998) did construct databases, but they contained only those articles (statistical and international respectively) that were required for the studies. Potential economies of scale from collecting data that could be used for a wider range of research projects were not realised. A further problem with such work is the absence of any agreed standards for collecting and analysing data. Thus even when different authors have tackled similar problems, their data are difficult to combine. An obvious example here is the use of JEL classifications. Middleton used the 1983 JEL classification (because RES 1983 provided immense cost savings in coding fifty years worth of EJ papers), whereas Backhouse used the current classification. Another example is that both of us classified articles according to the type of mathematics used, but our definitions were slightly different. For specific comparisons this does not present too many problems, but it makes it difficult to combine the data into a single, consistent database. Obviously, complete consistency can never be achieved: the ways in which we wish to classify and analyse articles, and the information about economists that is considered important will change over time, but many of the problems result from taking short–cuts to save time. For example, if 3–digit classifications were used, it would be possible to convert from old to new JEL classifications reasonably accurately, but 1–digit classifications (much quicker to do) are too crude for this to be possible. Potential new data sources are also not being realised. Foremost here is the dataset which underlay Blaug and Sturges (1983) and Blaug (1986). When the first edition was published a number of reviewers noted its potential for empirical investigations, including those by historians of economic thought (for example, Brandis 1984, p. 471). Yet, most references to Blaug–Sturges have been casual enumerations: for example, Portes (1987, p. 1331), as part of his thesis on American dominance, used the place of residence of the 586 living economists he counted in the book (with, incidentally, different results pertaining when country of birth and education are factored in, a further rational for shifting to relational databases). There has been little systematic work on this source (and nothing, of which we are aware, since DeLorme and Kamerschen 1987 and Frey and Pommerehne 1988), no doubt because it is not available as a machine–readable dataset for others to use. Thus each exercise tends to be one– off, and inevitably quick–and–dirty in style. Consider, however, what might be possible if the Blaug–Sturges dataset had the same status and availability as a research tool that the Penn World Tables (Summers and Heston 1991) have in the applied growth literature. To overcome these problems, what is required is that instead of data being compiled study–by–study, databases be constructed that can be used in many studies. Some datasets are available (such as the SSCI, Econ–Lit, RES–AEA membership directories) but these contain different types of information and are not easily brought together. In Britain, any project in receipt of ESRC funding that generates a dataset has to deposit a properly documented machine–readable version of that data at the ESRC’s data archive at Essex, but these rules are not enforced as much as they ought, while in any case most exercises of the sort we have identified are American (where different rules seem to apply with respect to the Inter– University Consortium for Political and Social Research (ICPSR) Archive at Ann Arbor, Michigan) and, we suspect, the scale and status of most quantitative work in this field is insufficient to attract public funding in any case.18 In addition, the generation and use of datasets is constrained by two particular problems which are common to all of modern academia: the uncertain academic standing of datasets (as, for example, in their relegation to the low–status, ‘miscellaneous’ category in the recent RAE) and certain property–rights difficulties (for example, Wheatsheaf Books, the publisher of Blaug and Sturges (1983), has a vested interest in the underlying dataset not being made available).

18 See Anon (1989a; b; c) for details of these two archives and their holdings. The ICSPR can be contacted at http://www.icpsr.umich.edu/; the ESRC archive at http://dawww.essex.ac.uk/ index.html. ‘Economics is what economists do’, page 19 of 35 Copyright problems also arise with datasets which are published in the first instance in machine–readable format, as for example in the recent CD–ROM compilation of the current Who’s who with the complete Who was who since 1897 (Who’s who 1996). This is a potentially extremely valuable dataset for those investigating British professionalisation. Because it includes so many economists in the policy community, it provides a fascinating potential counterweight to the Blaug–Sturges dataset. It also well illustrates some potential pitfalls of all machine–readable sources. Consider the following comparison. Blaug (1986) lists 97 living economists who meet our definition of membership of the British profession (UK residence and/or significant participation in British professional activities), whereas a query of Who’s who (1996) for those with the occupation of economist yields a dynaset of 239 entries, of whom there is an overlap with the Blaug dataset of only 10.19 Of course, Blaug, following the tradition set by the young Stigler (1964) of defining an ‘important’ economist as one who influences other economists (as against policy–makers and/or the general public), has a view of eminence which, in effect, accords with the characteristics of American professionalisation. Yet, for Britain, this is inappropriate: non–academic economists were important for the first half century of professionalisation, and the financial press in Britain is highly influential, with a tradition of economist–journalists (Hartley Withers and F.W. Hirst before the First World War; Paul Einzig and Oscar Hobson between the wars; Geoffrey Crowther, Harold Wincott and Andrew Shonfield for the early postwar period; with Sam Brittan through to Will Hutton and the Keegan brothers today). Of these, only Shonfield and Brittan makes it into Blaug, but the latter does not come up as an economist in a query of occupation=economist in the Who’s who dataset, a graphic illustration of how you need to know your way around a dataset before embarking upon its interrogation (J.M. Keynes is also absent from an identical query of the Who was who dataset)! Moreover, copyright law prevents an academic storing in their database any information derived from Who’s who. The low standing of datasets and the need to ensure that they are available for others to use has long been a preoccupation of the historical computing community. Whilst no answers have been forthcoming to the former problem, it is arguable that on the latter historians have made rather more progress than historians of economic thought. Indeed, in terms of the use of relational database technology, historians are streets ahead of economists (for a recent survey of historian’s activities, see Harvey and Press 1996; see also the journal of the Association of History and Computing, History and Computing, now in its ninth year of publication). Historians of economic thought seem also unfamiliar with the techniques of prosopography which historians having been using for some time (Stone 1971) and which are being adopted elsewhere in the sociology of scientific knowledge (for example, Söderqvist and Silverstein 1994 on scientific meetings in immunology and Gascoign 1995 on the eighteenth–century scientific community). The computation analysis of qualitative data has also been subject to considerable technical advances in recent years, ones that have been adopted elsewhere in the social sciences (Fielding and Lee 1993 and Richards and Richards 1994). In a world in which economists have long been criticised for their over–reliance on quantitative indicators, and for their dismissal of qualitative matter, it is with some trepidation therefore that we suggest that those studying the economics profession have not yet adopted best practices exhibited elsewhere.

§4. The value of quantitative work of this type

Many readers will no doubt respond that the reason these opportunities have not been taken up is that they do not see the need for such work. Economists have no interest in the past, whilst historians are more interested in texts, great individuals and non–quantitative studies

19 These are R.J. Ball, Alec Cairncross, J.S. Flemming, Lawrence Klein, Douglas MacDougall, Marcus Miller, Alan Peacock, Brian Reddaway, Andrew Roy and Ralph Turvey. ‘Economics is what economists do’, page 20 of 35 of communities of economists. This is a mistaken attitude, for whilst quantitative analysis will never (and should never) replace more traditional historical research, it is an invaluable complement to such work. The first reason is that the use of databases makes it possible to focus on the average economist rather than on exceptional individuals. This is immediately of relevance if our interest is professionalisation and policy influence, and in particular the US vs. European economics debate. The second is that economists and historians continually make generalisations that are quantitative in nature, but without testing these statistically. For example it is often asserted that immigrants to the US from Germany and Eastern Europe played a significant role in the mathematization of economics since the 1940s. But is this is potentially amenable to statistical testing. Did a larger proportion of articles by such émigrés contain mathematics than those by other economists? Did Econometrica or the Review of Economics and Statistics contain a higher proportion of articles by German or Russian émigrés than the AER or the JPE? It may, of course, be that the average does not matter, and that it is a small number of individuals that matters, but the challenge of testing the hypothesis statistically forces one to be much more precise about what is being claimed. If the argument about émigrés is simply that, say, Marshak, Leontief, Schumpeter and Hurwicz transformed the subject, then one would test this differently (using perhaps citation counts) from if it is that the large number of mathematically–inclined émigrés mattered. The third reason is that statistical data can point to puzzles that need explanation, factors that might otherwise be forgotten, or suggest areas where new explanations are needed. For example, how many histories of economic thought pay attention to the movement of economists into government service during the Second World War? But a simple graph of the affiliations of contributors to leading US (and, to a lesser extent, British) journals makes it very clear that this took place on an enormous scale. We all knew this happened, but the data remind us of the fact. In short, we are claiming that economists should require the same standards of evidence that they would expect to find applied to other problems. If a macroeconomists makes a claim about income or unemployment having risen or fallen, he or she will be expected to substantiate that with empirical data (using proxy variables if the ideal data are not available). When historians make similar, potentially quantitative, claims they should expect to justify them. An excellent example of the potential for such quantitative research is the debate over US versus European economics debate. Frey and Eichenberger’s (1993) have offered several explanations for the distinctiveness of European economics. They see economists as market agents, responding to incentives and operating with a welfare function which might be specified as combining the maximisation of the present value of their lifetime income with certain culturally–determined non–pecuniary goals. The American academic market is large and competitive, whereas European markets are segmented and thin. This conditions the propensity of an economist to invest in acquiring local knowledge of markets and institutions, resulting in Americans maximising journal publications and Europeans seeking a more balanced portfolio which includes participation in local and national affairs. American economists concentrate on postgraduate teaching, while Europeans are largely preoccupied with undergraduate education. The differences between the US and European markets could explain why European research is more policy–oriented, less prone to fads. Thus, as Sargent (1963, pp. 1–2) put it many years ago, ‘American economists are fundamentally more serious about their subject than we are; and the result of this is that they are better economists, but less useful ones.’ In Frey’s formulation, European–style economics is superior because ‘economic knowledge is transformed more effectively into policy’ in Europe than in the US (p. 192), although the moves towards European integration and the internationalisation (Americanisation) of economics were now threatening the incentives which underpinned European economists’ production functions, leading to the pessimistic conclusion that ‘the future of economics as a relevant social science seems rather gloomy’ (p. 192). ‘Economics is what economists do’, page 21 of 35 From this literature, we can extract a list of key characteristics of American economics (Backhouse 2000): 1. Greater proneness to fashion and intolerance of heterodox ideas. 2. Greater homogeneity across departments, at least in research–oriented universities. 3. More competitive labour markets and higher mobility. 4. Greater emphasis on technique and less emphasis on applied theory. 5. Less hierarchical organisation of departments, with individuals free to pursue independent research at a much earlier age. 6. Less involvement in public policy debates. 7. Lower social status of academics. 8. More highly–developed graduate programmes. On many of these criteria, Britain has a hybrid status, falling in between the US and European models (Baumol 1995; Backhouse, 2000), and having moved significantly ‘Westward’ in the period since 1945 (Backhouse 1997, pp. 31–2): 1. Undergraduates increasingly use the same textbooks and learn substantially the same theory as their counterparts in other countries, notably the US. 2. Graduate coursework has increasingly become a precondition for research in economics, with the doctorate becoming essential to gain employment as an academic economist. 3. Frequent publication is important to secure professional advancement, with refereed articles published in a these being organised in a hierarchy of prestige and attracting an international cast of editors and contributors. 4. The development of conferences and pre–publication networks for the coterie, together with the exchange of staff between British and American institutions. 5. A growing emphasis on mathematical theory and econometric technique. Many of these are trends are potentially quantifiable, given suitable databases.

§5. British and American economics

Quantitative analysis is here applied to investigate two ‘transitions’: the spread of American– style professional economics in Britain after 1945, and the transformation of US economics from 1920 to 1960. The first of these involved using the Commonwealth Universities Yearbook to document the increasing spread of the PhD, and the numbers of staff in British universities whose PhDs were from overseas, in particular from the US. Our results are in Figure 2(REB). The proportion of staff with PhDs was fairly steady, at between 10% and 40%, up until till the mid 1970s, but then rose steadily with the late 1970s the crucial period. Most noticeable is the rise in the Oxbridge figures from 10% to 50%, and LSE from around 30% to around 70%. PhDs can be analysed by country. In 1945, most overseas PhDs were from Europe and only a minority from the US, but by the early 1970s the situation was reversed. The distribution of US PhDs across institutions differed greatly, and is shown in Figure 3(REB). LSE and the then ‘New Universities’ (Warwick and Essex) have a high proportion of US PhDs. Once we add to these the considerable number who have US first degrees, especially at the LSE (mostly Americans coming to Britain), we arrive at the conclusion that the proportion of staff trained in the US is very high indeed (see Backhouse 1997). The advantage of compiling quantitative data is that it makes precise the timing of the change – the 1970s are the crucial period – which can then be related to developments within the institutions concerned (such as the influence of Harry Johnson at LSE – see Backhouse 1997 for more detail). It also highlights the difference between LSE and other institutions, notably Oxbridge, a difference which emerged during the 1970s. Whereas a database of staff was crucial to investigating the changes in British economics, the transformation of US economics was investigated through a database of journal articles. This was analysed for changes that might be relevant to a perceived change from pluralism in the prewar period, to a more hegemonic neoclassical economics in the ‘Economics is what economists do’, page 22 of 35 postwar period. Associated with this are the decline of institutionalism and the rise of mathematical economics and econometrics. The sample used was of the three major ‘general’ journals, the AER, JPE and QJE. However, attention was also paid to the economists’ origins and training. Here the issue was not whether people had PhDs (most did), but which institution the PhD came from. Also of interest is the birthplace of economists writing in these journals. Figure 4(REB) shows that the migrations from Europe had a quantitative as well as qualitative influence on economics journals, the proportion of AER authors born in ‘Eastern’ Europe (including Germany) rising to nearly 40% by the late 1940s.

Figure 2(REB) Proportion of staff with doctorate in different types of university

90% 80% 70% Scotland 60% New 50% Redbrick 40% Oxbridge 30% LSE 20% 10% 0% 1950 1955 1960 1965 1970 1975 1980 1985 1990 1995

Source: Backhouse (2000). Scotland = St. Andrews, Edinburgh. New = Essex, Warwick. Redbrick = Birmingham, Bristol, Manchester. Oxbridge = Oxford, Cambridge. Averages are unweighted averages of ratios for individual universities.

Figure 3(REB) Proportion of staff with US doctorates in types of university

35%

30%

25% Scotland

20% New Redbrick 15% Oxbridge LSE 10%

5%

0% 1950 1955 1960 1965 1970 1975 1980 1985 1990 1995

Source: Backhouse (2000)

That these were economists who migrated to the US is made clear by comparing Figure 4(REB) with Figure 5(REB). The proportion of AER authors who gave a US affiliation declined after 1945, but remained around 90%. This contrasts clearly with the international character of British journals (Backhouse 1997). Figure 5(REB) also makes very clear the impact of the war on economists’ careers. The proportion of contributors to the AER giving a university affiliation fell below 40% in some years. In interpreting these, note that those not giving an affiliation will include some who have pursued an academic career, but who have retired. ‘Economics is what economists do’, page 23 of 35

Figure 4(REB) The nationality of AER authors

Note: Eastern Europe is defined to include Russia, Poland, Germany, Austria, Hungary and Czechoslovakia. Source: Backhouse (1998).

Figure 5(REB): Classification of AER authors by type of affiliation

100% 90% 80% 70% US 60% Foreign Academic 50% Govt 40% None (inc business) 30% 20% 10% 0% 1920 1925 1930 1935 1940 1945 1950 1955 1960

Note: In the nationality statistics, articles with no affiliation are excluded. A subjective impression is that the vast majority of the category ‘None’, where a city is given, it is in the US. International organizations (e.g. IMF) are classified as ‘government’.

Everyone is aware that economics has become more mathematical over the past half century. This has taken the form of a proliferation of journals specialising in mathematical economics, and also the increasing use of mathematics in more general journals. This is explored in some detail in Backhouse (1998). The possibilities for international comparisons are illustrated in Figures 6–9(REB), which provide comparisons between three journals – two general journals (AER and EJ) and one specialist one (Econometrica). The data are derived from examining the pages of the journals and recording for each article whether it uses ‘Economics is what economists do’, page 24 of 35 algebra, calculus, diagrams (excluding graphs of data) and econometrics (regression analysis). Figures 6–9(REB) give the percentage of articles using the technique mentioned. Here it is worth making a comment about the limitations of the data. To reduce data collection to manageable proportions, Middleton (1998) takes every 10th year. Backhouse (1998) every 5th year but for a more limited period (1920–80), and for the period 1920–60 a complete sample. The data on Econometrica have been added since. Comparison of the 5– year sample with the full sample for the AER reveals that sampling error can be a serious problem with such samples. 1950, 1955 and 1960 happened to be years when the use of regression analysis in the AER was below the average: the use of econometrics in the AER is thus understated (see Backhouse, 1998). With the AER, ‘Communications’ and ‘Papers and proceedings’ were excluded.

Figure 6(REB) The use of algebra in the AER, EJ and Econometrica

90%

80%

70%

60% EJ Algebra

50% AER Algebra

40% Econometrica Algebra 30%

20%

10%

0% 1891 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990

Source: EJ – Middleton (1998); AER – Backhouse (1998); Econometrica – newly calculated data.

Figure 7(REB) The use of calculus in the AER, EJ and Econometrica

Source: as Figure 6(REB).

‘Economics is what economists do’, page 25 of 35

Figure 8(REB)The use of Diagrams in the AER, EJ and Econometrica

Source: as Figure 6(REB).

Figure 9(REB) The use of regression analysis in the AER, EJ and Econometrica

Source: as Figure 6(REB).

Questions we might wish to ask of such data include the following: 1. Are there significant differences between the two general journals, and between them and the specialist one? 2. When did the use of various mathematical techniques become widespread? Tentative answers: 1. From 1910 to 1950, the EJ was significantly more mathematical than the AER. By 1970, however, the difference had disappeared. If we assume that the important developments in economics during this period have involved the use of mathematics, this is consistent with the EJ having lost its once pre–eminent role in the profession. Though Econometrica remained more ‘mathematical’ (according to this criterion), the gap between it and the other two journals narrowed sharply. (The decline in the use of algebra in the EJ in 1990 is surprising, but caution should be applied in interpreting it, lest it be due to sampling error.) 2. The mathematization of the EJ and the AER really starts from around 1940. 3. The use of diagrams took off later, the sharpest rise being from 1940 to 1950. ‘Economics is what economists do’, page 26 of 35 Interestingly, there is barely any difference between the frequency of articles using diagrams in the EJ and Econometrica. Also noticeable is a decline in the proportion of articles using diagrams after 1960 for the EJ. The AER exhibits falls in 1960 and 1980, but they are impossible to distinguish from sampling error. The use of diagrams in Econometrica remained fairly constant from 1960 to 1980. 4. The widespread use of econometrics (defined as regression analysis and diagnostic statistics) dates from the 1970s for the AER and the 1980s for the EJ. It is possible that this catching up was the result of deliberate editorial policy, to publish more applied articles. Interestingly, the proportion of articles using regression analysis in Econometrica remained very stable, and relatively low compared with the other journals. Taken on their own, graphs such as these are of limited use, but they are useful for making more precise claims about trends in the subject and for suggesting questions that need to be answered. As regards European–US comparisons, work such as this does little more than scratch the surface, but it provides a starting point.

§6. Student databases and their uses: the Cambridge economics tripos

TABLE 6(KT) Economics tripos, King’s College, Part I and II, 1905–55 Year CountOfScore AvgOfScore Norrington Year CountOfScore AvgOfScor Norrington I I I I II II e II II 1905 1 2.00 50.00% 1906 1 2.00 50.00% 1908 2 2.00 50.00% 1909 2 2.00 50.00% 1909 2 3.00 75.00% 1910 2 2.50 62.50% 1909 1 2.00 50.00% 1911 1 3.00 75.00% 1911 1 3.00 75.00% 1912 1 3.00 75.00% 1914 2 2.50 62.50% 1915 2 2.00 50.00% 1916 1 2.00 50.00% 1916 1 2.00 50.00% 1917 1 4.00 100.00% 1918 1 3.00 75.00% 1920 3 2.00 50.00% 1921 3 3.00 75.00% 1921 3 3.00 75.00% 1922 3 3.00 75.00% 1922 3 2.67 66.67% 1923 3 2.67 66.67% 1923 1 3.00 75.00% 1924 1 3.00 75.00% 1924 1 1.00 25.00% 1925 1 1.00 25.00% 1926 1 2.00 50.00% 1927 1 2.00 50.00% 1927 1 3.00 75.00% 1928 1 2.00 50.00% 1929 1 4.00 100.00% 1930 1 3.00 75.00% 1930 2 2.50 62.50% 1931 2 2.50 62.50% 1930 1 2.00 50.00% 1932 1 1.00 25.00% 1931 2 3.00 75.00% 1932 2 2.50 62.50% 1931 1 2.00 50.00% 1933 1 2.00 50.00% 1933 2 3.50 87.50% 1935 2 3.50 87.50% 1934 1 4.00 100.00% 1936 1 4.00 100.00% 1935 1 2.00 50.00% 1937 1 1.00 25.00% 1937 5 2.20 55.00% 1939 5 2.00 50.00% 1938 1 3.00 75.00% 1940 1 4.00 100.00% 1939 2 1.50 37.50% 1941 2 1.50 37.50% 1940 3 3.33 83.33% 1941 3 3.67 91.67% 1942 1 2.00 50.00% 1943 1 1.00 25.00% 1942 1 4.00 100.00% 1947 1 4.00 100.00% 1944 1 4.00 100.00% 1945 1 3.00 75.00% 1944 2 2.00 50.00% 1946 2 1.50 37.50% 1946 1 1.00 25.00% 1947 1 2.00 50.00% ‘Economics is what economists do’, page 27 of 35 1946 1 2.00 50.00% 1948 1 2.00 50.00% Year CountOfScore AvgOfScore Norrington Year CountOfScore AvgOfScor Norrington I I I I II II e II II 1947 2 3.00 75.00% 1948 2 2.50 62.50% 1948 1 1.00 25.00% 1950 1 1.00 25.00% 1949 4 1.75 43.75% 1950 4 2.00 50.00% 1950 3 3.67 91.67% 1952 3 3.33 83.33% 1953 1 3.00 75.00% 1955 1 3.00 75.00%

TABLE 7(KT) Economics tripos, Trinity College, Part I only, 1908–55 Year CountOfScore Norrington 1908 1 25.00% 1910 1 75.00% 1911 1 75.00% 1912 1 50.00% 1913 1 25.00% 1914 3 50.00% 1915 2 25.00% 1920 2 50.00% 1921 6 37.50% 1922 4 37.50% 1923 4 25.00% 1924 8 31.25% 1925 3 25.00% 1926 3 66.67% 1927 3 33.33% 1928 2 25.00% 1929 5 25.00% 1930 3 25.00% 1931 5 30.00% 1932 13 30.77% 1933 10 35.00% 1934 8 43.75% 1935 10 37.50% 1936 15 36.67% 1937 8 40.63% 1938 24 36.46% 1939 21 35.71% 1940 12 33.33% 1941 3 50.00% 1942 7 32.14% 1943 3 33.33% 1945 1 50.00% 1946 3 50.00% 1947 6 33.33% 1948 21 52.38% 1949 16 40.63% 1950 13 38.46% 1951 17 39.71% 1952 11 27.27% 1953 17 36.76% 1954 22 38.64% 1955 26 43.27%

‘Economics is what economists do’, page 28 of 35

FIGURE 10(KT) Economics tripos, Newnham minus Trinity Score

80%

60%

40%

20%

0% Norringto1921n diff. 1924 1926 1929 1930 1932 1934 1936 1939 1941 1942 1946 1946 1948 1950 1953 1955

-20%

-40%

-60% Year

§7. Conclusions

We offer two conclusions and two suggestions for further thought and, hopefully, action. First, if economics is what economists do, then the American–inspired league table approach generates potentially misleading answers about what European (including British) economists have done and may, if Frey’s worst fears about Americanisation are not realised, continue to do. We thus need to count, but we need also to count books, pamphlets, media output and participation in local, regional, national and international policy networks. As Frey and Pommerehne (1988, p. 109) concluded from their examination of the Blaug–Sturges dataset, not only is there something rather artificial about the American dominance of economics in its own terms, but a seriously misleading picture is being generated of what all economists do because of the confusion of inputs in the economists’ production function with outputs. Accordingly, future research needs to widen to embrace such central matters as time budgets and incentive structures. Certainly, an examination of cross–country and cross– institutional distributions of academics’ time, as between teaching, administration, research and the wider public stage, would yield fascinating results. As we have demonstrated, the US vs. European economics debate provides a wealth of potential questions amenable to empirical exploration, as indeed did Harry Johnson’s strictures about national research styles and the sins of English economics. For example, Johnson (1973, p. 66) made much of the more ‘professional’ behaviour of American than European (especially British) economists, ascribing this to the lower social standing of American academics as against Europeans who were members of the national elite. Casual empiricism suggests there is no European model (contrast the political positions attained by economists in Britain as against Italy) – but here is a topic rich in prosopographical possibilities, one which can potentially illuminate much about professionalisation and the policy influence of economists. Secondly, if historians of economic thought are economists first and historians only latterly, then they have obligations to the present and future direction of the parent discipline. Knowing what they do about the limitations of league tables, citation studies, and the longer– term trend of research and rhetoric, they need to remind their historically less animated colleagues of how the profession’s incentive structure is being transformed and with what likely consequences for economics’ future as a relevant social science. This seems particularly important in Britain where higher education, along with almost everything else in the public sector, is currently swept along in a league table fever. Anecdotal evidence has it ‘Economics is what economists do’, page 29 of 35 that in RAE–ranked 5 and 5* departments (listed in Table 4(RM) the traditional commitment to high–quality undergraduate education (identified by Johnson as a distinctive European characteristic) is under serious threat, while the effects of the RAE on the volume and value of research are potentially momentous,20 sufficient perhaps that, in the future, historians of British economic thought will devote considerable study to the RAE process. On a more positive note, four rounds of the RAE provide a rich store of economists’ non–journal publications with which to derive the broader enumerations that we argued for above. From these conclusions we make two suggestions. First, just as historians are now doing, it is time to move on from the quick–and–dirty, lets build a (flat file) spreadsheet and see what we get, to use of fully–featured RDBMS with careful database design so as to reap the full benefits of the relational model. Here historians can help, having a wealth of expertise with RDBMS (Harvey and Press 1996), a distinguished track record of empirical investigations of the development of professions (see Bradley 1994 for some of the technical issues), and above all a facility with prospography (collective biography), seen by many in the historical computing fraternity as ‘a means of getting underneath what historical actors said about themselves and explaining their behaviour with reference to their social, economic and political affiliations’ (Greenstein 1990, p. 60). Secondly, the constraints on quantitative studies that we have identified are not likely to lessen in the near future. More data will undoubtedly become available, principally through the internet, and much of this will be useful for the types of investigations we seek to promote. Unfortunately, we will also have to start paying for much of these new datasets, as for example in the JSTOR project and the new BIDS service, Journals Online.21 Academics will thus need to develop trade in data and knowledge of on–going research, making more active use of the internet to not only widen the invisible college but to make more resources available to the community and to increase the rate of utilisation of them. The History of Economics Society already has a page devoted to Archives.22 This could be easily supplemented, or a new site created, with a listing (and/or FTP facility) of datasets relevant to HET which are already in existence or under construction, together with details of their availability to other researchers and with full documentation of the datasets along the lines of the best practice suggested by Essex and other electronic data archives (the A15 page). The replicability of the Penn World Tables provides an obvious model, but no doubt is over–ambitious. But how to encourage trade, even if one can surmount the complex copyright problems that are entailed with many potentially useful sources? One suggestion is for HET journals to follow the practice initiated by the Journal of Applied Econometrics in 1994 in requiring that all authors deposit their datasets in a specifically designed anonymous FTP site, so as to encourage reproducibility.23 This will raise the status of datasets, although as historians have found what is needed is a cultural shift so that datasets become ‘editions’ in their own right (Speck 1994). And this is altogether more difficult, particularly perhaps for economists.

Acknowledgements We would like to thank Jeff Biddle for assistance with tracing the Viner quote and for providing bibliographical references to interesting current work, Kirsten Madden for drawing our attention to her 1995 Ph.D. dissertation.

20 For example, see McNay’s (1997) investigation of the impact of the 1992 RAE on institutional and individual behaviour. 21 Available, in order, from http://www.jstor.org/jstor and http://www.journalsonline.bids.ac. uk/JournalsOnline/. 22 Available at http://cs.muohio.edu/~HisEcSoc/. 23 Available at http://qed.econ.queensu.ca/JAE. ‘Economics is what economists do’, page 30 of 35

References

Adkisson, R.V. and Blum, A.A. (1996) ‘Education Baumol, W.J. (1995) ‘What’s different about and attainment of members of the Council of European economics?’, Kyklos, 48 (2), pp. 187– Economic Advisers, 1946–91’, Journal of 92. Economic Issues, 30 (4), pp. 1184–91. Beil, R.O. and Laband, D.N. (1996) ‘The American AEA (1942) ‘The 1942 directory of the American Economic Association dues structure’, Journal of Economic Association’, American Economic Economic Perspectives, 10 (4), pp. 179–86. Review, 32 (3, pt. 2, Supplement), pp. 1–194. Biddle, J. (1996) ‘A citation analysis of the sources ____ (1962) Index of economic journals, 1886–1959, and extent of Wesley Mitchell’s reputation’, 5 vols. Homewood, ILL: Richard D. Irwin. History of Political Economy, 28 (2), pp. 137–69. Alston, R.M., Kearl, J.R. and Vaughan, M.B. (1992) ____ (1998) ‘Institutional economics: a case of ‘Is there a consensus among economists in the reproductive failure?’, in M.S. Morgan and M. 1990s?’, American Economic Review, 82 (2, Rutherford (eds) (1998) q.v., pp. 108–33. Papers & Proceedings), pp. 203–9. ____ (1999) ‘Statistical economics, 1900–1950’, Anderson, G.M., Levy, D.M. and Tollison, R.D. History of Political Economy, 31 (4), pp. 607–51. (1989) ‘The half–life of dead economists’, Blaug, M. (ed.) (1986) Who’s who in economics: a Canadian Journal of Economics, 22 (1), pp. 174– biographical dictionary of major economists, 2nd 83. edn. Brighton: Wheatsheaf. Anderson, R.G. and Dewald, W.G. (1994) ____ (1992) The methodology of economics or how ‘Replication and scientific standards in applied economists explain, 2nd edn. Cambridge: economics: a decade after the Journal of Money, Cambridge University Press. Credit and Banking project’, Federal Reserve ____ and Sturges, R.P. (eds) (1983) Who’s who in Bank of St Louis Review, 76 (6), pp. 79–83. economics: a biographical dictionary of major Anon. (1989a) ‘A guide to historical datasets in US economists, 1700–1981. Brighton: Wheatsheaf. and European social science data archives, Pt I: Bradley, J. (1994) ‘Relational database design and Inter–University Consortium for Political and the reconstruction of the British medical Social Research, Ann Arbor (Michigan), profession: constraints and strategies’, History (ICPSR)’, Historical Social Research, 14 (2), pp. and Computing, 6 (2), pp. 71–84. 168–81. Brandis, R. (1984) Review of Blaug and Sturges ____ (1989b) ‘A guide to historical datasets in US (1983), History of Political Economy, 16 (3), pp. and European social science data archives, Pt I: 470–1. Inter–University Consortium for Political and Booth, A.E. and Coats, A.W. (1978) ‘The market for Social Research, Ann Arbor (Michigan), (ICPSR) economists in Britain, 1945–75: a preliminary ICPSR machine readable datasets (part II)’, survey’, Economic Journal, 88 (3), pp. 436–54. Historical Social Research, 14 (3), pp. 123–35. Boulding, K.E. (1941) Economic analysis. New ____ (1989c) ‘A guide to historical datasets in US York: Harper & Row. and European social science data archives, Pt II: Broadus, R.N. (1971) ‘The literature of the social Economic and Social Research Council (ESRC) sciences: a survey of citation studies’, Data Archive, University of Essex’, Historical International Social Science Journal, 23 (2), pp. Social Research, 14 (4), pp. 143–55. 236–43. Arestis, P., Palma, J.G. and Sawyer, M.C. (eds) Broder, I.E. (1993a) ‘Professional achievements and (1997) Capital controversy, post–Keynesian gender differences among academic economists’, economics and the history of economic thought: Economic Inquiry, 31 (1), pp. 116–27. essays in honour of Geoff Harcourt. Vol. I. ____ (1993b) ‘Review of NSF economics proposals: London: Routledge. gender and institutional patterns’, American Backhaus, J.G. (1996) ‘Good economics, bad Economic Review, 83 (4), pp. 964–70. economics and European economics’, Kyklos, 49 Bronfenbrenner, M. (1966) ‘Trends, cycles and fads (3), pp. 449–63. in economic writing’, American Economic Backhouse, R.E. (1997) ‘The changing character of Review, 56 (2, Papers & Proceedings), pp. 538– British economics’, in A.W. Coats (ed.) (1997) 52. q.v., pp. 33–60. Burton, M.P. and Phimister, E. (1995) ‘Core ____ (1998) ‘The transformation of US economics, journals: a reappraisal of the Diamond list’, 1920–1960, viewed through a survey of journal Economic Journal, 105 (2), pp. 361–73. articles’, in M.S. Morgan and M. Rutherford Chung, K.H., Cox, A.K. and Okunade, A.A. (1993) (eds) (1998) q.v., pp. 85–107. ‘Publishing behavior of individuals and most ____ (2000) ‘Economics in mid–Atlantic: British prolific authors in the economics literature’, economics, 1945–95’, in A.W. Coats (ed.) (2000) Quarterly Journal of Business and Economics, 32 q.v., pp. 31–60. (3), pp. 32–42. Bairam, E.I. (1994) ‘Institutional affiliations of Cleary, F.R. and Edwards, D.J. (1960) ‘The origins contributors to top economic journals, 1985– of the contributors to the AER during the ‘fifties’, 1990’, Journal of Economic Literature, 32 (2), American Economic Review, 50 (5), pp. 1011–14. pp. 674–9. Coats, A.W. (1971) ‘The role of scholarly journals in ‘Economics is what economists do’, page 31 of 35 the history of economics: an essay’, Journal of Diamond, A.M. (1989) ‘The core journals of Economic Literature, 9 (1), pp. 29–44. economics’, Current Contents, 21 (January), pp. ____ (1980) ‘The culture and the economists: some 4–11. reflections on Anglo–American differences’, ____ and Haurin, D.R. (1995) ‘Changing patterns of History of Political Economy, 12 (4), pp. 588– subfield specialization among cohorts of 609. economists from 1927–1988’, Research in the ____ (1991) ‘The learned journals in the History of Economic Thought and Methodology, development of economics and the economics 13, pp. 103–23. profession: the British case’, Economic Notes by ____ and Levy, D.M. (1994) ‘The metrics of style: Monte dei Pashi di Siena, 20 (1), pp. 89–116. Adam Smith teaches efficient rhetoric’, ____ (ed.) (1997) The post–1945 internationalization Economic Inquiry, 32 (1), pp. 138–45. of economics. Durham, NC: Duke University Eichenberger, R. and Frey, B.S. (1995) ‘American Press. and European economists: a response’, Journal of ____ (ed.) (2000) The post–1945 development of Economic Perspectives, 9 (1), p. 207. economics in Europe. London: Routledge. Ellis, H.S. (ed.) (1948) A survey of contemporary ____ and Coats, S.E. (1970) ‘The social composition economics. Philadelphia: Blakiston Co. of the Royal Economic Society and the Fels, R. (1992) ‘An update on Lientief’s complaint’, beginnings of the British economics “profession”, Journal of Economic Perspectives, 6 (1), pp. 1890–1915’, British Journal of Sociology, 21 (1), 201–4. pp. 75–85. Fielding, N.G. and Lee, R.M. (eds) (1993) Using ____ and ____ (1973) ‘The changing social computers in qualitative research, rev. edn. composition of the Royal Economic Society London: Sage. 1890–1960 and the professionalization of British Figlio, D. (1994) ‘Trends in the publication of economics’, British Journal of Sociology, 24 (2), empirical economics’, Journal of Economic pp. 165–87. Perspectives, 8 (3), pp. 179–87. Colander, D.C. (1989) ‘Research on the economics Formby, J.P., Gunther, W.D. and Sakano, R. (1993) profession’, Journal of Economic Perspectives, 3 ‘Entry level salaries of academic economists: (4), pp. 137–48. does gender or age matter?’, Economic Inquiry, Conrad, A.H. and Meyer, J.R. (1958) ‘The 31 (1), pp. 128–38. economics of slavery in the antebellum south’, Frank, R.H., Gilovich, T.D. and Regan, D.T. (1996) Journal of Political Economy, 66 (2), pp. 95–130. ‘Do economists make bad citizens?’, Journal of Rep. in A.H. Conrad and J.R. Meyer (1965) Economic Perspectives, 10 (1), pp. 187–92. Studies in econometric history. London: Frey, B.S. (1993) ‘An economic analysis of the new Chapman & Hall, pp. 43–92. institutional economics’, Journal of Institutional Conroy, M.E., Dusansky, R., Drukker, D. and and Theoretical Economics, 149 (1), pp. 351–9. Kildegaard, A. (1995) ‘The productivity of ____ and Eichenberger, R. (1992) ‘Economics and economics departments in the US: publications in economists: a European perspective’, American the core journals’, Journal of Economic Economic Review, 82 (2, Papers & Proceedings), Literature, 33 (4), pp. 1966–71. pp. 216–20. Covick, O.E. (1974) ‘The quantity theory of drink: a ____ and ____ (1993) ‘American and European restatement’, Australian Economic Papers, 13 economics and economists’, Journal of Economic (2), pp. 171–7. Perspectives, 7 (4), pp. 185–93. Debreu, G. (1986) ‘Theoretic models: mathematical ____ and Pommerehne, W.W. (1988) ‘The American form and economic content’, Econometrica, 54 domination among eminent economists’, (6), pp. 1259–70. Scientometrics, 14 (1–2), pp. 97–110. ____ (1991) ‘The mathematization of economic Frey, R.L. and Frey, B.S. (eds) (1995) ‘Is there a theory’, American Economic Review, 81 (1), pp. European economics?’, Kyklos, 48 (2), pp. 185– 1–7. 311. DeLorme, C.D., Dickie, M.T. and Kamerschen, D.R. Friedman, M. (1991) ‘Old wine in new bottles’, (1994) ‘The demand for economic journals’, Economic Journal, 101 (1), pp. 33–40. Applied Economics, 26 (5), pp. 563–5. Froman, L.A. (1930) ‘Graduate students in ____ and Kamerschen, D.R. (1987) ‘What Who’s economics, 1904 to 1928’, American Economic who in economics tells us about the economics Review, 20 (2), pp. 235–47. profession’, Quarterly Review of Economics and ____ (1942) ‘Graduate students in economics, 1904– Business, 27 (4), pp. 65–79. 1940’, American Economic Review, 32 (4), pp. De Marchi, N.B. (1988) ‘Popper and the LSE 817–26. economists’, in N.B. De Marchi (ed.) (1988) The ____ (1952) ‘Graduate students in economics’, Popperian legacy in economics. Cambridge: American Economic Review, 42 (4), pp. 602–8. Cambridge University Press, pp. 139–66. Fusfeld, D.R. (1956) ‘The program of the American Desai, M. (1997) Foreword, in P. Arestis et al. (eds) Economic Association meetings’, American (1997) q.v., pp. xvii–xx. Economic Review, 46 (4), pp. 642–4. Dewald, W.G., Thursby, J.G. and Anderson, R.G. Gans, J.S. and Shepherd, G.B. (1994) ‘How are the (1986) ‘Replication in empirical economics: the mighty fallen: rejected classic articles by leading Journal of Money, Credit and Banking project’, economists’, Journal of Economic Perspectives, 8 American Economic Review, 76 (4), pp. 587–603. (1), pp. 165–79. ‘Economics is what economists do’, page 32 of 35 Gascoigne, R. (1995) ‘The eighteenth–century Heck, J.L. (1993) ‘Eight decades of contributing scientific community: a prosopographical study’, authors and institutions to the American Social Studies of Science, 25 (3), pp. 578–81. Economic Review: a historical summary’, Journal Gherity, J.A. (1993) ‘An early publication by Adam of Economic Education, 24 (2), pp. 163–70. Smith’, History of Political Economy, 25 (2), pp. Hendry, D.F. and Morgan, M.S. (1995) The 241–82. foundations of econometric analysis. Cambridge: Goldfarb, R.S. (1997) ‘Now you see it, now you Cambridge University Press. don’t: emerging contrary results in economics’, Hey, J.D. and Winch, D. (eds) (1990) A century of Journal of Economic Methodology, 4 (2), pp. economics: 100 years of the Royal Economic 221–44. Society and the Economic Journal. Oxford: Basil Goldstein, H. and Spiegelhalter, D.J. (1996) ‘League Blackwell. tables and their limitations: statistical issues in Hinshaw, C.E. and Siegfried, J.J. (1995) ‘Who gets comparisons of institutional performance’, on the AEA program?’, Journal of Economic Journal of the Royal Statistical Society, ser A. Perspectives, 9 (1), pp. 153–63. 159 (3), pp. 385–409. Hirsch, B.T., Austin, R., Brooks, J. and Moore, J.B. Goodwin, C.D.W. and Meardon, S. (1998) ‘The (1984) ‘Economics departmental rankings: international dimension in American economics’, comment’, American Economic Review, 74 (4), in M.S. Morgan and M. Rutherford (eds) (1998) pp. 822–6. q.v., pp. 295–324. HMSO (1997) National committee of enquiry into Goodwin, T.H. and Sauer, R.D. (1995) ‘Life cycle higher education (Dearing committee), Report: productivity in academic research: evidence from higher education in the learning society, BPP the cumulative publication histories of academic 1996–7 (***). economists’, Southern Economic Journal, 61 (3), Hodgson, G.M. (1997) ‘The fate of the Cambridge pp. 728–43. capital controversy’, in P. Arestis et al. (eds) Graves, P.E., Marchand, P.E. and Thompson, R. (1997) q.v., pp. 95–110. (1982) ‘Economics departmental rankings: Holub, H.W., Tappeiner, G. and Eberharter, V. research incentives, constraints and efficiency’, (1991) ‘The iron law of important articles’, American Economic Review, 72 (5), pp. 1131–41. Southern Economic Journal, 58 (2), pp. 317–28. Greenaway, D. (1990) ‘On the efficient use of Hubbard, R. and Vetter, D.E. (1992) ‘The mathematics in economics: results of an attitude publication incidence of replications and critical survey of British economists’, European commentary in economics’, American Economist, Economic Review, 34 (7), pp. 1339–51. 36 (1), pp. 29–34. Greenstein, D.I. (1990) ‘Multi–sourced and Hudson, J. (1996) ‘Trends in multi–authored papers integrated databases for the prosopographer’, in in economics’, Journal of Economic E. Mawdsley, N.J. Morgan, L. Richmond and Perspectives, 10 (3), pp. 153–8. R.H. Trainor (eds) (1990) History and computing, Hutchinson, E.B. (1995) ‘The publication profile of III: historians, computers and data: applications economists’, Journal of Economic Education, 26 in research and teaching. Manchester: (1), pp. 59–79. Manchester University Press, pp. 60–6. Jansen, D.W. (1991) ‘Ranking Federal Reserve Groenewegen, P.D. and King, S. (1994) ‘Women as System research departments by publications in producers of economic articles: a statistical professional journals’, Journal of assessment of the nature and the extent of female Macroeconomics, 13 (4), pp. 733–42. participation in five British and north American Jenkins, P. (1970) The battle of Downing Street. journals, 1900–39’, University of Sydney Working London: Charles Knight. Papers in Economics, no 2001. Jha, N. (1973) The age of Marshall: aspects of Grubel, H.G. and Boland, L. (1986) ‘On the efficient British economic thought, 1890–1915, 2nd edn. use of mathematics in economics: some theory, London: Frank Cass. facts and results of an opinion survey’, Kyklos, 39 Johnes, G. (1990) ‘Measures of research output: (3), pp. 412–42. university departments of economics in the UK, Hall, A.D. (1990) ‘Worldwide rankings of research 1984–8’, Economic Journal, 100 (3), pp. 556–60. activity in econometrics: an update, 1980–1988’, ____ (1992) ‘Performance indicators in higher Econometric Theory, 6 (1), pp. 1–16. education: a survey of recent work’, Oxford Hansen, W.L. (1990) ‘Educating and training new Review of Economic Policy, 8 (2), pp. 19–34. economics PhDs: how good a job are we doing?’, ____ and Johnes, J. (1993) ‘Measuring the research American Economic Review, 80 (2, Papers & performance of UK economics departments: an Proceedings), pp. 437–44. application of data envelopment analysis’, Oxford ____ and Weisbrod, B. (1972) ‘Towards a general Economic Papers, n.s. 45 (2), pp. 332–47. theory of awards, or, do economists need a hall of Johnes, J. and Johnes, G. (1995) ‘Research funding fame?’, Journal of Political Economy, 80 (2), pp. and performance in UK university departments of 422–31. economics: a frontier analysis’, Economics of Harrod, R.F. (1939) ‘An essay in dynamic theory’, Education Review, 14 (3), pp. 301–14. Economic Journal, 49 (1), pp. 14–33. Johnson, H.G. (1968) ‘A catarrh of economists?: Harvey, C.E. and Press, J. (1996) Databases in from Keynes to Postan’, Encounter, 30 (5, May), historical research: theory, methods and pp. 50–4. applications. London: Macmillan. ____ (1973) ‘National styles in economic research: ‘Economics is what economists do’, page 33 of 35 the United States, the United Kingdom, Canada Literature, 11 (1), pp. 27–55. and various European countries’, Daedalus, 102 ____ and Selover, D.D. (1994) ‘Econometric (2), pp. 65–74. software accidents’, Economic Journal, 104 (3), ____ (1975) ‘What passes for economics in the pp. 713–25. English establishment’, The Banker, 125 Lucas, R.F. (1995) ‘Contributions to economics (October), pp. 1159–61. Rep. in E.S. Johnson and journals by the Canadian economics profession, H.G. Johnson (eds) (1978) The shadow of 1981–90’, Canadian Journal of Economics, 28 Keynes: Keynes, Cambridge and Keynesian (4a), pp. 945–60. economics. Oxford: Basil Blackwell, pp. 221–6. McCloskey, D.N. (1980) ‘Scattering in open fields: a ____ (1977) ‘Cambridge as an academic comment’, Journal of European Economic environment in the early 1930s: a reconstruction History, 9 (1), pp. 209–14. from the late 1940s’, in D. Patinkin and J.C. Leith McMillen, D.P. and Singell, L.D. (1994) ‘Gender (eds) (1977) Keynes, Cambridge and the General differences in first jobs for economists’, Southern theory. London: Macmillan, pp. 98–114. Economic Journal, 60 (3), pp. 701–14. Kenny, L.W. and Studley, R.E. (1995) ‘Economists’ McNay, I. (1997) The impact of the 1992 RAE on salaries and lifetime productivity’, Southern institutional and individual behaviour in English Economic Journal, 62 (2), pp. 382–93. higher education: the evidence from a research Kirman, A. and Dahl, M. (1994) ‘Economic research project. Bristol: HEFCE. in Europe’, European Economic Review, 38 (3), Margo, R.A. and Siegfried, J.J. (1996) ‘Long–run pp. 505–22. trends in economics bachelor’s degrees’, Journal Kolm, S.–C. (1988) ‘Economics in Europe and the of Economic Education, 27 (4), pp. 326–36. US’, European Economic Review, 32 (1), pp. Medoff, M.H. (1996) ‘A citation–based analysis of 207–12. economists and economics programs’, American Laband, D.N. and Piette, M.J. (1994a) ‘Favoritism Economist, 40 (1), pp. 46–59. versus search for good papers: empirical evidence Meyer, J.R. (1997) ‘Notes on cliometrics’ fortieth’, regarding the behavior of journal editors’, American Economic Review, 87 (2, Papers & Journal of Political Economy, 102 (1), pp. 194– Proceedings), pp. 409–11. 203. Madden, K. (1995) ‘Method choice in the history of ____ and ____ (1994b) ‘The relative impacts of econometrics: a study of decision criteria economics journals, 1970–1990’, Journal of involved in the selection of econometric Economic Literature, 32 (2), pp. 640–66. techniques as recorded by historians of economic ____ and ____ (1994c) ‘Does the “blindness” of peer thought’, unpublished Ph.D. Dissertation, review influence manuscript selection University of Carolina–Chapel Hill. efficiency?’, Southern Economic Journal, 60 (4), Middleton, R. (1995) ‘Annual review of information pp. 896–906. technology developments for economic and ____, Shughart, W.F. and Tollison, R.D. (1990) social historians, 1994’, Economic History ‘Economists and the economy’, Review of Review, 48 (2), pp. 370–95. Economics and Statistics, 72 (4), pp. 707–11. ____ (1998) Charlatans or saviours?: economists ____ and Taylor, C.N. (1992) ‘The impact of bad and the British economy from Marshall to writing in economics’, Economic Inquiry, 30 (4), Meade. London: Macmillan. pp. 673–88. ____ and Wardley, P. (1990) ‘Information Lampman, R.J. (ed.) (1993) Economists at technology in economic and social history: the Wisconsin, 1892–1992. Madison, WI: University computer as philosopher’s stone or Pandora’s of Wisconsin Press.*** box?’, Economic History Review, 2nd ser. 43 (4), Leijonhufvud, A. (1973) ‘Life among the Econ’, pp. 667–96. Western Economic Journal, 11 (3), pp. 327–37. Mirowski, P. (1991) ‘The when, the how and the Leontief, W.A. (1971) ‘Theoretical assumptions and why of mathematical expression in the history of nonobserved facts’, American Economic Review, economic analysis’, Journal of Economic 61 (1), pp. 1–7. Perspectives, 5 (1), pp. 145–57. ____ (1982) ‘Academic economists’, Science, 217 (9 Morgan, M.S. and Rutherford, M. (1998) On the July), pp. 104–7. transformation of American economics: from Lipsey, R.G. (1960) ‘The relation between interwar pluralism to postwar neoclassicism. unemployment and the rate of change of money Duke, NC: Duke University Press. wage rates in the United Kingdom, 1862–1957: a Morgan, T. (1988) ‘Theory versus empiricism in further analysis’, Economica, n.s. 27 (1), pp. 1– academic economics: update and comparisons’, 31. Journal of Economic Perspectives, 2 (4), pp. ____ (1997) ‘Introduction: an intellectual 159–64. autobiography’, in R.G. Lipsey (ed.) (1997) The Mumford, K. (1997) The gender balance of selected essays of Richard G. Lipsey, Vol. I: academic economics in the UK. York: Microeconomics, growth and political economy. Department of Economics and Related Studies, Cheltenham: Edward Elgar, pp. ix–xxxvii. University of York, on behalf of RES Women’s Little, I.M.D. (1957) ‘The economist in Whitehall’, Committee. Lloyds Bank Review, 44 (April), pp. 29–40. O’Brien, D.P. and Darnell, A.C. (1982) Authorship Lovell, M.C. (1973) ‘The production of economic puzzles in the history of economics: a statistical literature: an interpretation’, Journal of Economic approach. London: Macmillan. ‘Economics is what economists do’, page 34 of 35 Oswald, A.J. (1991) ‘Progress and microeconomic ‘Participation in scientific meetings: a new data’, Economic Journal, 101 (1), pp. 75–80. prosopographical approach to the disciplinary Patinkin, D. (1981) Essays on and in the Chicago history of science: the case of immunology, tradition. Durham, NC: Duke University Press. 1951–72’, Social Studies of Science, 24 (3), pp. Phelps Brown, E.H. (1972) ‘The underdevelopment 513–48. of economics’, Economic Journal, 82 (1), pp. 1– Solow, R.M. (1990) Discussion of Hansen (1990), 10. American Economic Review, 80 (2, Papers & Phillips, A.W.H. (1958) ‘The relationship between Proceedings), pp. 448–50. unemployment and the rate of change of money Speck, W.A. (1994) ‘History and computing: some wage rates in the United Kingdom, 1861–1957’, reflections on the achievements of the past Economica, n.s. 25 (4), pp. 283–99. decade’, History and Computing, 6 (1), pp. 28– Plasmeijer, H.W. and Schoorl, E. (1997) ‘The 32. postwar canon of Dutch economics: a demand Spellman, W. and Gabriel, B. (1978) ‘Graduate and supply analysis’, paper delivered to Third students in economics, 1940–74’, American European Conference on the History of Economic Review, 68 (1), pp. 182–7. Economics, Athens, April. Spiegel, H.W. (1987) ‘Jacob Viner (1892–1970)’, in Portes, R. (1987) ‘Economics in Europe’, European J. Eatwell, M. Milgate and P. Newman (eds) Economic Review, 31 (6), pp. 1329–40. (1987) The new Palgrave: a dictionary of Quandt, R.E. (1976) ‘Some quantitative aspects of economics. Vol. IV. London: Macmillan, pp. the economics journal literature’, Journal of 812–14. Political Economy, 84 (4, pt. I), pp. 741–55. Stigler, G.J. (1949) ‘A survey of contemporary RES (1983) The Economic Journal: cumulative economics’, Journal of Political Economy, 57 index of articles and book reviews, volumes 41– (2), pp. 93–105. 90 (1931–1980). Cambridge: Cambridge ____ (1960) ‘The influence of events and policies on University Press. economic theory’, American Economic Review, ____ (1995) Register of members, 1994. London: 50 (2, Papers & Proceedings), pp. 36–45. Rep. in RES. G.J. Stigler (1965) q.v., pp. 16–30. RES–Econometric Society (1990) Joint register of ____ (1964) ‘Statistical studies in the history of members, 1990. Oxford: Basil Blackwell. economic thought’. Rep. in G.J. Stigler (1965) Richards, T.J. and Richards, L. (1994) ‘Using q.v., pp. 31–50. computers in qualitative research’, in N.K. ____ (1965) Essays in the history of economics. Denzin and Y.S. Lincoln (eds) (1994) Handbook Chicago: University of Chicago Press. of qualitative research. London: Sage, pp. 445– ____ (1988) Memoirs of an unregulated economist. 62. New York: Basic Books. Ricketts, M. and Shoesmith, E. (1990) British ____ and Friedland, R. (1975) ‘The citation practices economic opinion: a survey of a thousand of doctorates in economics’, Journal of Political economists. London: IEA. Economy, 83 (3), pp. 477–507. ____ and ____ (1992) ‘British economic opinion: ____ and ____ (1979) ‘The pattern of citation positive science or normative judgement?’, practices in economics’, History of Political American Economic Review, 82 (2, Papers & Economy, 11 (1), pp. 1–20. Proceedings), pp. 210–15. ____, Stigler, S.M. and Friedland, C. (1995) ‘The Round, D.K. and Siegfried, J.J. (1994) ‘Can journals of economics’, Journal of Political economists agree or are some economists more Economy, 103 (2), pp. 331–59. agreeable than others?’, Anti–Trust Bulletin, 39 Stone, L. (1971) ‘Prosopography’, Daedalus, 100 (3), pp. 753–69. (1), pp. 46–79. Samuels, W.J. (ed.) (1976) The Chicago school of Summers, R. and Heston, A. (1991) ‘The PENN political economy. East Lansing, MI: Michigan world table (mark 5): an expanded set of State University. international comparisons, 1950–1988’, Sargent, J.R. (1963) ‘Are American economists Quarterly Journal of Economics, 106 (2), pp. better?’, Oxford Economic Papers, n.s. 15 (1), pp. 327–68. 1–7. Taylor, J. and Izadi, H. (1996) ‘The 1992 Research Schwert, G.W. (1993) ‘The Journal of Financial Assessment Exercise: outcome, outputs and Economics’, Journal of Financial Economics, 33 inputs in economics and econometrics’, Bulletin (3), pp. 369–424. of Economic Research, 48 (1), pp. 1–26. Scott, F.A. and Anstine, J.D. (1997) ‘Market Towe, J.B. and Wright, D.J. (1995) ‘Research structure in the production of economics PhDs’, published by Australian economics and Southern Economic Journal, 64 (1), pp. 307–20. econometrics departments, 1988–93’, Economic Scott, L.C. and Mitias, P.M. (1996) ‘Trends in Record, 71 (1), pp. 8–17. rankings of economics departments in the US: an Tremblay, C.H., Tremblay, V.J. and Lee, B. (1990) update’, Economic Inquiry, 34 (2), pp. 378–400. ‘Field publishing performance of US economics Siegfried, J.J. (1972) ‘The publishing of economic departments’, Atlantic Economic Journal, 18 (2), papers and its impact on graduate faculty ratings, pp. 37–48. 1960–1969’, Journal of Economic Literature, 10 Tribe, K. (1992) ‘The Economic Journal and British (1), pp. 31–49. economics, 1891–1940’, History of the Human Söderqvist, T. and Silverstein, A.M. (1994) Sciences, 5 (4), pp. 33–58. ‘Economics is what economists do’, page 35 of 35 ____ (1997) Economic careers: economics and economists in Britain, 1930–1970. London: Routledge. Whitley, R. (1991) ‘The organisation and role of journals in economics and other scientific fields’, Economic Notes by Monte dei Pashi di Siena, 20 (1), pp. 6–32. Who’s Who (1996) Who’s who, 1897–1996: one hundred years of biography. CD–ROM. London and Oxford: A. & C. Black/Oxford University Press. Worswick, G.D.N. (1972) ‘Is progress in economic science possible?’, Economic Journal, 82 (1), pp. 73–86. Wulwick, N.J. (1996) ‘Two econometric replications: the historic Phillips and Lipsey– Phillips curves’, History of Political Economy, 28 (3), pp. 391–439. Yezer, A.M., Goldfarb, R.S. and Poppen, P.J. (1996) ‘Does studying economics discourage cooperation?: watch what we do, not what we say or how we play’, Journal of Economic Perspectives, 10 (1), pp. 177–86. Yotopoulos, P.A. (1961) ‘Institutional affiliation of the contributors to three professional journals’, American Economic Review, 51 (4), pp. 665–70. Young, W.L. and Lee, F.S. (1993) Oxford economics and Oxford economists. London: Macmillan.