The Impact Factor Fallacy

Total Page:16

File Type:pdf, Size:1020Kb

The Impact Factor Fallacy bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 1 Title: 2 The impact factor fallacy 3 Authors: 4 Frieder Michel Paulus 1; Nicole Cruz 2,3; Sören Krach 1 5 Affiliations: 6 1 Department of Psychiatry and Psychotherapy, Social Neuroscience Lab, University of Lübeck, 7 Ratzeburger Allee 160, D-23538 Lübeck, Germany 8 2 Department of Psychological Sciences, Birkbeck, University of London, London, UK 9 3 Laboratoire CHArt, École Pratique des Hautes Études (EPHE), Paris, France 10 Corresponding Authors: 11 Frieder Paulus, phone: ++49-(0)451- 31017527, email: [email protected] 12 Sören Krach, phone: ++49-(0)451-5001717, email: [email protected] 13 Department of Psychiatry and Psychotherapy, Social Neuroscience Lab, University of Lübeck, 14 Ratzeburger Allee 160, D-23538 Lübeck, Germany 15 Author contributions: 16 FMP, NC, and SK wrote the manuscript. 17 Running title: The impact factor fallacy 18 Word count abstract: 2221 19 Word count manuscript: 4014 20 Number of tables: 1 21 Number of figures: 0 1 bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 22 Abstract 23 The use of the journal impact factor (JIF) as a measure for the quality of individual 24 manuscripts and the merits of scientists has faced significant criticism in recent years. We add to 25 the current criticism in arguing that such an application of the JIF in policy and decision making 26 in academia is based on false beliefs and unwarranted inferences. To approach the problem, we 27 use principles of deductive and inductive reasoning to illustrate the fallacies that are inherent to 28 using journal based metrics for evaluating the work of scientists. In doing so, we elaborate that if 29 we judge scientific quality based on the JIF or other journal based metrics we are either guided by 30 invalid or weak arguments or in fact consider our uncertainty about the quality of the work and 31 not the quality itself. 2 bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 32 Introduction 33 The journal impact factor (JIF) was initially used to help librarians make decisions about 34 journals (Garfield, 2006). However, during the last decades the usage of the JIF has significantly 35 changed. In deviating from its original purpose it is now widely used to evaluate the quality of 36 individual publications and the work of scientists (Amin & Mabe, 2003; Arnold & Fowler, 2010). 37 Since then, the measure itself has been criticized for various reasons. For example, it is well 38 known that the JIF is an inaccurate estimate for the expected number of citations of an article 39 within a specific journal (Callaway, 2016; Larivière et al., 2016) and that it is relatively easy to 40 manipulate (McVeigh & Mann, 2009; Tort, Targino, & Amaral, 2012). Nonetheless, the JIF has 41 deeply affected the work of scientists and decision making in academia. Scientists get jobs, 42 tenure, grants, and bonuses based on the impact of the journals they are publishing their 43 manuscripts in, outgrowths’ which were critically discussed in many previous reviews, comments 44 and editorials (Brembs, Button, & Munafò, 2013; Casadevall & Fang, 2014; Della Sala & 45 Crawford, 2007; DePellegrin & Johnston, 2015; Lehmann, Jackson, & Lautrup, 2006; Reich, 46 2013; Seglen, 1997; Simons, 2008; Werner, 2015). Notably, the JIF has also been explicitly 47 referred to as a tool to decide how to distribute funds across institutions, for example in Germany 48 (DFG, 2004), and thereby affects policy making on a much larger scale. 49 "For the calculation of the performance-based bonus of the unit providing the service 50 (department or clinic) the original publications may be used with the unweighted impact 51 factor of the publication organ, in the sense of a step-wise introduction of quality criteria. 3 bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 52 Thereby, a first- and last authorship may be considered with one third each and the 53 remaining third can be distributed across all remaining authors […]."1 54 Besides such explicit usage of the JIF for evaluating scientific excellence, the JIF also 55 implicitly affects other measures which have been suggested to better approximate the quality of 56 a scientist's work or of a specific study (e.g. the h-index, Hirsch, 2005 and the Relative Citation 57 Ratio (RCR), Hutchins, Yuan, Anderson, & Santangelo, 2015). For example, there is some 58 evidence that the number of citations of an article is influenced by the JIF of the journal where 59 the article was published, regardless of the quality of the article itself (Callaham, Wears, & 60 Weber, 2002; Cantrill, 2016). This implies that measures that are based on the citations of the 61 individual articles are still influenced by the JIF of the publication organ. With the many different 62 ways of how the JIF can influence decision making in academia, it is not surprising that empirical 63 data now demonstrate the JIF to be one of the most powerful predictors for academic success 64 (Van Dijk, Manor, & Carey, 2014).We could recently show that some scientists may have 65 adapted to these reward principles in their environment by showing a greater reward signal in the 66 brain’s reward structures in the prospect of an own high impact publication (Paulus, Rademacher, 67 Schäfer, Müller-Pinzler, & Krach, 2015). 68 In line with the rising initiatives to prevent the use of the JIF for evaluating the quality of 69 science (see e.g. the DORA initiative, Alberts, 2013, Cagan, 2013 or see the report of the German 70 Science Council, 2015), we have considerable doubts that the arguments in support of using the 1 "Für die Berechnung der LOM [leistungsorientierte Mittel; remark of authors] der jeweiligen leistungserbringenden Einheit (Abteilung bzw. Klinik) kann im Sinne einer stufenweisen Einführung von Qualitätskriterien die Bewertung erfolgter Original-Publikationen unter Verwendung des ungewichteten Impact Faktor der jeweiligen Publikationsorgane (JIF) erfolgen. Dabei können Erst- und Letztautorschaft mit je einem Drittel berücksichtigt werden; das verbleibende Drittel kann auf alle übrigen Autoren verteilt werden […]." (German Research Foundation, 2004, p. 15). 4 bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 71 JIF for measuring scientific excellence are justified. In this comment we want to look at the 72 problem of using the JIF from a different perspective and carefully (re)evaluate the arguments for 73 its use as an estimate of scientific quality. Thereby, we hope to better understand the beliefs about 74 the JIF that influence decisions in academia and the implications of policies that use the JIF to 75 assess and remunerate scientific quality. Beyond the specific case of the JIF, this exercise might 76 also help to specify more general misconceptions when using journal based properties to evaluate 77 science, in order to overcome incentive structures based on journal based metrics altogether. 78 Deductive fallacy when using the JIF 79 A basic belief when using the JIF for evaluating the quality of a specific manuscript 80 seems to be that (1) if a paper is published in a high impact factor journal (p) then the paper is of 81 high quality (q) 2. Why would scientists believe this? A straightforward reason is the idea that it is 82 more difficult to publish in a high impact factor journal because higher standards of research 83 quality and novelty have to be passed in order to be accepted. The average number of citations of 84 a journal's articles within in a specific time period signals the average breadth of interest in these 85 articles during that time period, which can of course be affected by many factors other than 86 research quality. But as a first approximation, let us suppose that belief (1) is the case. What can 87 we conclude from it? 88 If we see a paper published in a high impact factor journal, we could then draw the 89 deductively valid inference of modus ponens (MP: if p then q, p, therefore q )3 and conclude that 2 When we speak of "high" and "low" impact in this paper, the arguments we make are independent of whether "high" and "low" refer to the absolute JIF of a journal, or to the JIF relative to a specific research domain. 3 Here p and q stand for arbitrary propositions. For example, p might stand for "This paper is published in a high impact factor journal" and q for "This paper is of high quality". 5 bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 90 the paper is of high quality.
Recommended publications
  • Assessing School and Teacher Effectiveness Using HLM and TIMSS Data from British Columbia and Ontario
    Avoiding Ecological Fallacy: Assessing School and Teacher Effectiveness Using HLM and TIMSS Data from British Columbia and Ontario By Yichun Wei B. Eng. University of Hunan M. Sc. University of Hunan A Thesis submitted to the Faculty of Graduate Studies of The University of Manitoba in partial fulfillment of the requirements of the degree of DOCTOR OF PHILOSOPHY Faculty of Education University of Manitoba Winnipeg, MB. Canada Copyright © 2012 by Yichun Wei ABSTRACT There are two serious methodological problems in the research literature on school effectiveness, the ecological problem in the analysis of aggregate data and the problem of not controlling for important confounding variables. This dissertation corrects these errors by using multilevel modeling procedures, specifically Hierarchical Linear Modeling (HLM), and the Canadian Trends in International Mathematics and Science Study (TIMSS) 2007 data, to evaluate the effect of school variables on the students’ academic achievement when a number of theoretically-relevant student variables have been controlled. In this study, I demonstrate that an aggregate analysis gives the most biased results of the schools’ impact on the students’ academic achievement. I also show that a disaggretate analysis gives better results, but HLM gives the most accurate estimates using this nested data set. Using HLM, I show that the physical resources of schools, which have been evaluated by school principals and classroom teachers, actually have no positive impact on the students’ academic achievement. The results imply that the physical resources are important, but an excessive improvement in the physical conditions of schools is unlikely to improve the students’ achievement. Most of the findings in this study are consistent with the best research literature.
    [Show full text]
  • The Impact Factor Fallacy
    bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 1 Title: 2 The impact factor fallacy 3 Authors: 4 Frieder Michel Paulus 1; Nicole Cruz 2,3; Sören Krach 1 5 Affiliations: 6 1 Department of Psychiatry and Psychotherapy, Social Neuroscience Lab, University of Lübeck, 7 Ratzeburger Allee 160, D-23538 Lübeck, Germany 8 2 Department of Psychological Sciences, Birkbeck, University of London, London, UK 9 3 Laboratoire CHArt, École Pratique des Hautes Études (EPHE), Paris, France 10 Corresponding Authors: 11 Frieder Paulus, phone: ++49-(0)451- 31017527, email: [email protected] 12 Sören Krach, phone: ++49-(0)451-5001717, email: [email protected] 13 Department of Psychiatry and Psychotherapy, Social Neuroscience Lab, University of Lübeck, 14 Ratzeburger Allee 160, D-23538 Lübeck, Germany 15 Author contributions: 16 FMP, NC, and SK wrote the manuscript. 17 Running title: The impact factor fallacy 18 Word count abstract: 135 19 Word count manuscript (including footnotes): 4013 20 Number of tables: 1 21 Number of figures: 0 1 bioRxiv preprint doi: https://doi.org/10.1101/108027; this version posted February 20, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. 22 Abstract 23 The use of the journal impact factor (JIF) as a measure for the quality of individual 24 manuscripts and the merits of scientists has faced significant criticism in recent years.
    [Show full text]
  • What Can Ecological Studies Tell Us About Death? Yehuda Neumark
    Neumark Israel Journal of Health Policy Research (2017) 6:52 DOI 10.1186/s13584-017-0176-x COMMENTARY Open Access What can ecological studies tell us about death? Yehuda Neumark Abstract: Using an ecological study design, Gordon et al. (Isr J Health Policy Res 6:39, 2017) demonstrate variations in mortality patterns across districts and sub-districts of Israel during 2008–2013. Unlike other epidemiological study designs, the units of analysis in ecological studies are groups of people, often defined geographically, and the exposures and outcomes are aggregated, and often known only at the population-level. The ecologic study has several appealing characteristics (suchasrelianceonpublic-domain anonymous data) alongside a number of important potential limitations including the often mentioned ‘ecological fallacy’.Advantagesand disadvantages of the ecological design are described briefly below. Keywords: Ecological fallacy, Ecological studies, Epidemiology, Mortality, Study design Main text In this journal, Gordon et al. [4] employ an ecological "The aim of epidemiology is to decipher nature with re- design to demonstrate variations in mortality patterns spect to human health and disease, and no one should across districts and sub-districts of Israel during the underestimate the complexities of epidemiological research" five-year period of 2008–2013. Standardized mortality [1]. To achieve this lofty and complex goal, the epide- ratios (SMRs) reveal a 25% excess of kidney disease re- miologic investigative toolbox contains various study lated deaths in the Haifa district, for example, while the methodologies including individual-based experimental risk of death from influenza/pneumonia is 25% lower designs (e.g., randomized controlled trial), individual- there than the national average.
    [Show full text]
  • A Statistical Guide for the Ethically Perplexed Preamble Introduction
    A Statistical Guide for the Ethically Perplexed Lawrence Hubert and Howard Wainer Preamble The meaning of \ethical" adopted here is one of being in accordance with the accepted rules or standards for right conduct that govern the practice of some profession. The profes- sions we have in mind are statistics and the behavioral sciences, and the standards for ethical practice are what we try to instill in our students through the methodology courses we offer, with particular emphasis on the graduate statistics sequence generally required for all the behavioral sciences. Our hope is that the principal general education payoff for competent statistics instruction is an increase in people's ability to be critical and ethical consumers and producers of the statistical reasoning and analyses faced in various applied contexts over the course of their careers. Introduction Generations of graduate students in the behavioral and social sciences have completed mandatory year-long course sequences in statistics, sometimes with difficulty and possibly with less than positive regard for the content and how it was taught. Prior to the 1960's, such a sequence usually emphasized a cookbook approach where formulas were applied un- thinkingly using mechanically operated calculators. The instructional method could be best characterized as \plug and chug," where there was no need to worry about the meaning of what one was doing, only that the numbers could be put in and an answer generated. This process would hopefully lead to numbers that could then be looked up in tables; in turn, p-values were sought that were less than the magical .05, giving some hope of getting an attendant paper published.
    [Show full text]
  • Some Topics in Health Economics That Become Distorted Cliches for Health Policy
    Health Policy Papers Collection 2017 – 09 (bis) SOME TOPICS IN HEALTH ECONOMICS THAT BECOME DISTORTED CLICHES FOR HEALTH POLICY Guillem López Casasnovas Professor at the Department of Economics and Business Universitat Pompeu Fabra Centre for Research in Health and Economics (CRES) Ricard Meneu Fundación Instituto de Investigación en Servicios de Salud (IISS) Centre de Recerca en Economia i Salut (CRES) Barcelona The Policy Papers Collection includes a series form, in Health Economics and Health Policy, carried out and selected by Researchers from the Centre for Research in Health and Economics of the University Pompeu Fabra (CRES - UPF). The Collection Policy Papers is part of an agreement between UPF and Novartis, whose activities provided not conditioned support of Novartis to the dissemination of studies and research of the CRES-UPF. "This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0 International, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed" https://creativecommons.org/licenses/by/4.0/ Barcelona, October 2017 1 2 Health Policy Papers Collection 2017 – 09(bis) SOME TOPICS IN HEALTH ECONOMICS THAT BECOME DISTORTED CLICHES FOR HEALTH POLICY Guillem López i Casasnovas (1) y Ricard Meneu de Guillerna (2) (1) Department of Economics and Business. Centre for Research in Health and Economics (CRES). Universitat Pompeu Fabra (UPF). (2) Fundación Instituto de Investigación en Servicios de Salud (IISS). Centre for Research in Health and Economics (CRES) Introduction. The purpose of this paper is to pick up some of the best known clichés that surround the translation of the equivalent topics in health economics into health policy.
    [Show full text]
  • Appendix 1 a Great Big List of Fallacies
    Why Brilliant People Believe Nonsense Appendix 1 A Great Big List of Fallacies To avoid falling for the "Intrinsic Value of Senseless Hard Work Fallacy" (see also "Reinventing the Wheel"), I began with Wikipedia's helpful divisions, list, and descriptions as a base (since Wikipedia articles aren't subject to copyright restrictions), but felt free to add new fallacies, and tweak a bit here and there if I felt further explanation was needed. If you don't understand a fallacy from the brief description below, consider Googling the name of the fallacy, or finding an article dedicated to the fallacy in Wikipedia. Consider the list representative rather than exhaustive. Informal fallacies These arguments are fallacious for reasons other than their structure or form (formal = the "form" of the argument). Thus, informal fallacies typically require an examination of the argument's content. • Argument from (personal) incredulity (aka - divine fallacy, appeal to common sense) – I cannot imagine how this could be true, therefore it must be false. • Argument from repetition (argumentum ad nauseam) – signifies that it has been discussed so extensively that nobody cares to discuss it anymore. • Argument from silence (argumentum e silentio) – the conclusion is based on the absence of evidence, rather than the existence of evidence. • Argument to moderation (false compromise, middle ground, fallacy of the mean, argumentum ad temperantiam) – assuming that the compromise between two positions is always correct. • Argumentum verbosium – See proof by verbosity, below. • (Shifting the) burden of proof (see – onus probandi) – I need not prove my claim, you must prove it is false. • Circular reasoning (circulus in demonstrando) – when the reasoner begins with (or assumes) what he or she is trying to end up with; sometimes called assuming the conclusion.
    [Show full text]
  • List of Fallacies
    List of fallacies For specific popular misconceptions, see List of common if>). The following fallacies involve inferences whose misconceptions. correctness is not guaranteed by the behavior of those log- ical connectives, and hence, which are not logically guar- A fallacy is an incorrect argument in logic and rhetoric anteed to yield true conclusions. Types of propositional fallacies: which undermines an argument’s logical validity or more generally an argument’s logical soundness. Fallacies are either formal fallacies or informal fallacies. • Affirming a disjunct – concluding that one disjunct of a logical disjunction must be false because the These are commonly used styles of argument in convinc- other disjunct is true; A or B; A, therefore not B.[8] ing people, where the focus is on communication and re- sults rather than the correctness of the logic, and may be • Affirming the consequent – the antecedent in an in- used whether the point being advanced is correct or not. dicative conditional is claimed to be true because the consequent is true; if A, then B; B, therefore A.[8] 1 Formal fallacies • Denying the antecedent – the consequent in an indicative conditional is claimed to be false because the antecedent is false; if A, then B; not A, therefore Main article: Formal fallacy not B.[8] A formal fallacy is an error in logic that can be seen in the argument’s form.[1] All formal fallacies are specific types 1.2 Quantification fallacies of non sequiturs. A quantification fallacy is an error in logic where the • Appeal to probability – is a statement that takes quantifiers of the premises are in contradiction to the something for granted because it would probably be quantifier of the conclusion.
    [Show full text]
  • Ecological Inference
    P1: FZZ/FZZ P2: FZZ CB658-FMDVR CB654-KING-Sample CB658-KING-Sample.cls June 25, 2004 6:14 Ecological Inference Ecological Inference: New Methodological Strategies brings together a diverse group of scholars to survey the latest strategies for solving ecological inference problems in various fields. The last half decade has witnessed an explosion of research in ecological inference – the attempt to infer individual behavior from aggregate data. The uncertainties and the information lost in aggregation make ecological inference one of the most difficult areas of statistical inference, but such inferences are required in many academic fields, as well as by legislatures and the courts in redistricting, by businesses in marketing research, and by governments in policy analysis. Gary King is the David Florence Professor of Government at Harvard University. He also serves as the director of the Harvard–MIT Data Center and as a member of the steering committee of Harvard’s Center for Basic Research in the Social Sciences. He was elected president of the Society for Political Methodology and Fellow of the American Academy of Arts and Sciences. Professor King received his Ph.D. from the University of Wisconsin. He has won numerous awards for his work, including the Gosnell Prize for his book A Solution to the Ecological Inference Problem (1997), on which the research in this book builds. His home page can be found at http:// GKing.Harvard.edu. Ori Rosen is Assistant Professor of Statistics at the University of Pittsburgh. His research includes work on semiparametric regression models, applications of mixtures-of-experts neural network models in regression, and applications of Markov chain Monte Carlo methods.
    [Show full text]
  • Writing a Good History Paper
    WRITING A GOOD HISTORY PAPER Department of History Hamilton College ©Trustees of Hamilton College Acknowledgements This booklet bears one name, but it is really a communal effort. Iʼd like to thank the Director of the Writing Center, Sharon Williams, who origi- nally had the idea for a History Department writing guide, prodded me gently to get it done, and helped to edit and format it. My colleagues in the History Department read two drafts and made many valuable sugges- tions. Chris Takacs, a writing tutor in the class of 2005, helped me to see writing problems with a studentʼs eye. Yvonne Schick of the Print Shop carefully and professionally oversaw the production. Any limitations result solely from my own carelessness or stupidity. For the second edition, we have expanded the discussion of sources and listed some additional stylistic problems. --Alfred Kelly, for the History Department February, 2005 Cartoon reprinted with special permission of King Features Syndicate. Copyright Dan Piraro. Table of Contents Top Ten Reasons for Negative Comments on History Papers….......……1 Making Sure your History Paper has Substance……..........................…. 2 Common Marginal Remarks on Style, Clarity, Grammar, and Syntax Remarks on Style and Clarity.................................................................. 9 Remarks on Grammar and Syntax.........................................................14 Word and Phrase Usage Problems...........................................................19 Analyzing a Historical Document........................................................... 24 Writing a Book Review........................................................................... 26 Writing a Term Paper or Senior Thesis................................................... 27 Top Ten Signs that you may be Writing a Weak History Paper.............. 29 Final Advice............................................................................................ 29 Welcome to the History Department. You will fi nd that your history professors care a great deal about your writing.
    [Show full text]
  • Fashion Founded on a Flaw
    FASHION FOUNDED ON A FLAW For presentation at the IACCM Annual Conference Rotterdam School of Management, Erasmus University, 20—22 June, 2013 Brendan McSweeney Royal Holloway, University of London and Stockholm University What, I guess, we commonly believe • The world is not ‘flat’ (but how might we partition populations?) • The past matters (but we should not overstate lock-in due to initial conditions) • Culture matters (but what is ‘it’ and how does it operate?) • The idea of ‘culture’ is more easily invoked that defined. • I focus on one notion of culture: ‘national culture’ and as defined as ‘values’ • The ontological status of ‘national culture’; its depiction as bi-polar value ‘dimensions’; the validity of measurements of those dimensions; and the representativeness of samples, have been the object of considerable debate. • Here I addresses a different issue: a reliance on the ecological fallacy (Selvin, 1958). • The fallacious inference that the characteristics (concepts and/or metrics) of an aggregate (historically called ‘ecological’) level also describe those at a lower hierarchical level or levels. The Ecological Fallacy Supposed: What is true at one sub-national space is necessarily true at all other sub-national spaces. • Convent • Brothel (in the same country) • The objection here is not the generation of hypotheses from ecological comparisons. • Some of the recent discoveries of the causes of cancer (e.g. dietary factors) have their origin in the generation of such hypothesis from systematic international comparisons which were then investigated in lower level studies (Pearce, 2000). • The objection is to the doctrinaire (and invalid) transfer of aggregate results to lower levels i.e.
    [Show full text]
  • The Renaissance of Political Culture Or the Renaissance of the Ecological Fallacy? Author(S): Mitchell A
    The Renaissance of Political Culture or the Renaissance of the Ecological Fallacy? Author(s): Mitchell A. Seligson Source: Comparative Politics, Vol. 34, No. 3, (Apr., 2002), pp. 273-292 Published by: Ph.D. Program in Political Science of the City University of New York Stable URL: http://www.jstor.org/stable/4146954 Accessed: 15/07/2008 12:10 Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at http://www.jstor.org/action/showPublisher?publisherCode=phd. Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. JSTOR is a not-for-profit organization founded in 1995 to build trusted digital archives for scholarship. We work with the scholarly community to preserve their work and the materials they rely upon, and to build a common research platform that promotes the discovery and use of these resources. For more information about JSTOR, please contact [email protected]. http://www.jstor.org The Renaissance of Political Cultureor the Renaissance of the Ecological Fallacy? MitchellA.
    [Show full text]
  • Culture As a Consequence: a Multilevel Multivariate Meta-Analysis of the Effects of Individual and Country Characteristics on Work-Related Cultural Values
    Culture as a consequence: A multi-level multivariate meta-analysis of the effects of individual and country characteristics on work-related cultural values By: Piers Steel, and Vasyl Taras Taras, V. & P. Steel. (2010). Culture as a Consequence: A Multilevel Multivariate Meta-Analysis of the Effects of Individual and Country Characteristics on Work-Related Cultural Values. Journal of International Management. 16(3): 211-233. Made available courtesy of Elsevier: http://www.elsevier.com ***Reprinted with permission. No further reproduction is authorized without written permission from Elsevier. This version of the document is not the version of record. Figures and/or pictures may be missing from this format of the document.*** Abstract: Culture as a consequence is a neglected topic. Addressing this, we explore what factors are related to and potentially shape culture, what explains cultural variations within countries, and what the relationship is between cultural values at the individual and national levels. To answer these questions, we use a multi-level multivariate meta-analysis of 508 studies. The findings indicate that national and individual cultural values may be determined by the micro characteristics of age, gender, education, and socio-economic status as well as the macro characteristics of wealth and freedom. This provides a basis for explaining cultural change, both at the individual and national levels. Also, up to 90% of the variance in cultural values is found to reside within countries, stressing that national averages poorly represent specific individuals. Keywords: Culture, Explaining culture, Cultural change, Meta-analysis, HLM Article: Over the last several decades, culture's consequences have received an explosion of interest in fields ranging from psychology and education to accounting and marketing.
    [Show full text]