Rejection Rates and Impact Factors in Ecological Journals L.W
Total Page:16
File Type:pdf, Size:1020Kb
The Open Ecology Journal, 2008, 1, 14-19 14 Open Access Bang for Your Buck: Rejection Rates and Impact Factors in Ecological Journals L.W. Aarssen1,*, T. Tregenza2, A.E. Budden3, C.J. Lortie4, J. Koricheva5 and R. Leimu6 1Department of Biology, Queen’s University, Kingston, ON, K7L 3N6, Canada; 2Centre for Ecology and Conservation, University of Exeter, Cornwall Campus, Tremough, Penryn, TR10 9EZ, UK; 3Department of Biology, York University, 4700 Keele St., Toronto, Ontario, M6S 2E2, Canada; 4National Center for Ecological Analysis and Synthesis, 735 State Street, Suite 300. Santa Barbara, CA 93101; 5School of Biological Sciences, Royal Holloway, University of London, Egham, Surrey, TW20 0EX, UK; 6Department of Biology, University of Turku, FIN-20014, Finland Abstract: When choosing where to submit their research for publication, most ecologists are concerned with journal impact factor, but they are also concerned with the likelihood that their manuscripts will be accepted. Based on a survey of ecologists, we found different degrees of relative concern for these journal attributes depending on author experience and gender. However, the ability of authors to choose among journals based on these journal attributes is limited: while journal impact factors are published regularly, journal rejection rates are not. We obtained, by permission, rejection rate data for a sample of 60 ecology journals for the year 2004. As expected, journals with higher impact factors also have higher rejection rates, but the ratio of [rejection rate] / [impact factor] increases sharply with decreasing impact factor below 1.76. Journals with impact factors below this value therefore provide relatively low payback in terms of impact against cost as estimated by rejection rate. We discuss alternative possible interpretations of this relationship and alternative criteria that might affect an author’s decision about journal choice. Most importantly, our analysis indicates that the ability to make informed choices requires that journals publish their rejection rates annually. PREAMBLE With each iteration, the author selects a journal on the basis of several distinguishing traits including journal impact factor, How does an author decide where to submit a paper for likelihood of acceptance, and likelihood of rapid decision. The publication? This important decision is made routinely relative importance and scope of application of impact factors throughout the career of a typical researching and other publication related metrics is not without debate, i.e. scientist/academic. The choices made can profoundly how broadly they apply between researchers, fields, and affect the trajectory, rate of progress, and status of one’s journals, and how accurately they describe the relative success research career. Necessarily, the subject category of the of a journal or publication scientifically [1-4]. Nevertheless, in journals under consideration must be concordant with the our recent survey of ecologists, the majority of 1250 research topic of the paper. However after this, most respondents rated all three journal traits, including impact authors in the field of ecology at least, are usually still factor, as either ‘important’ or ‘very important’ (Table 1), presented with more than one choice of a topically suitable although less so with respect to likelihood of acceptance. Of subset of candidate journals. And, when the paper is course, from an author’s perspective, the ‘ideal’ journal would rejected (an experience that few if any manage to avoid have a high impact factor, a high likelihood of acceptance, and completely), the author is commonly inclined to iteratively provide a rapid decision. In this study, we test whether select alternative journals. journals with the first two desirable attributes exist. More Table 1. Percentages of Survey Responses (N=1250) in which Participants were Asked to Rate the Importance of Three Factors when Selecting a Journal for Submitting Manuscripts. [The Web-Based Survey was Designed by the National Centre for Ecological Analysis and Synthesis (NCEAS) Ecobias Working Group (www.ecobias.org), and was Posted Online from May 4th, 2006 to November 4th, 2006] Factor Very Important Important Somewhat Important Not Important High journal impact factor 39.6 46.0 12.6 1.8 High likelihood of acceptance 11.2 44.3 36.7 7.8 High likelihood of rapid decision 25.2 47.0 22.5 5.3 specifically, we identify the realized phenotype, or set of traits, for the majority of ecological journals including number of *Address correspondence to this author at the Department of Biology, papers received or published, gender of authors, citation rates Queen’s University, Kingston, ON, K7L 3N6, Canada; E-mail: over time, and total number of authors. We also integrate these [email protected] 1874-2130/08 2008 Bentham Open Journal Rejection Rates and Impact Factors The Open Ecology Journal, 2008, Volume 1 15 findings with the submission preferences expressed by The mean IF for responding journals (1.69) did not differ gender in the survey data and also provide a general metric significantly from that of non-responding journals (1.86) (t- of payback for cost (rejection) relative to gain (impact test; P=0.617). factor). The likelihood of rejection increases with increasing journal impact factor (Fig. 1, Pearson’s product moment ANALYSES AND RESULTS correlation: r = 0.741, P<0.001; partial correlation with num- The sample pool of ecological journals (107) was ber of papers published in 2004 held constant: r = 0.687, defined as the inclusive list of journals listed in the ‘Eco- P<0.001). This is not surprising, however the relationship is logy’ category by ISI Science (www.isiwebofknowledge. more accurately described as 'triangular' with a linear ‘lower- com). Rejection rates were assigned by contacting the bound' to the distribution (dashed line in Fig. 1). In other editors independently for all 107 journals. Editors were words, there is an absence of high impact factor journals with asked to provide the rejection rate for their journal for a low rejection rate (the bottom right corner), but there are 2004. The response rate was 56% (N=60 journals) (Table many journals with a low impact factor and relatively high 2). Impact factor was obtained from ISI Web of Science. rejection rates (top left corner of the graph). Table 2. The 60 Journals from the ‘Ecology’ Category List Provided by ISI Web of Science (http://www.isiwebofknowledge.com/) that Responded to Our Request for Rejection Rate Data American Naturalist Journal of Evolutionary Biology Animal Conservation J of Experimental Marine Biol and Ecol Annales Zoologici Fennici J of the NA Benthological Society Applied Vegetation Science Journal of soil water conservation Aquatic Microbital Ecology Journal of Vegetation Science Austral Ecology Journal of Wildlife Management Basic and Applied Ecology Landscape Ecology Behavioural Ecology Microbial Ecology Biotropica Natural Areas Journal Chemoecology New Zealand Journal of Ecology Conservation Biology Northeastern Naturalist Ecography Oikos Ecological Economics Oryx Ecological Engineering Proceedings of the Linnean Society of NSW Ecology Letters Paleobiology Ecological Research Pedobiologia Ecoscience Plant Ecology Ecosystems Polish Journal of Ecology Ecotoxicology Polar Biology Evolutionary Ecology Population Ecology Evolutionary Ecology Research Rangeland Journal Evolution Restoration Ecology Functional Ecology South African Journal of Wildlife Research Global Ecology and Biogeography Southeastern Naturalist Journal of Animal Ecology Southwestern Naturalist Journal of Applied Ecology Western North American Naturalist Journal of Arid Environments Wetlands Journal of Biogeography Wildlife Biology Journal of Chemical Ecology Wildlife Monographs Journal of Ecology Wildlife Society Bulletin 16 The Open Ecology Journal, 2008, Volume 1 Aarssen et al. 250 90 200 80 70 150 60 RR/IF 50 100 40 Rejection Rate 30 50 20 10 0 012345 0 Impact Factor 012345 Impact Factor Fig. (2). Relationship between journal impact factor and the ratio of rejection rate to impact factor. Solid line represents a significant Fig. (1). Scatterplot showing the relationship between journal inverse relationship and dashed line reflects the median ratio of 32.1. impact factor in 2004 and the percentage of papers rejected in 2004 for 60 journals listed in the ‘Ecology’ category by ISI Web the median value which suggests that there is little to of Science (http://www.isiwebofknowledge.com/). The relation- recommend these journals for an author that is deciding where ship is significantly positive (partial correlation with number of to submit. papers published in 2004 held constant: r = 0.687, P<0.001), but This trade-off between impact factor and the likelihood of note the generally triangular data distribution with a ‘lower- manuscript acceptance presents an interesting dilemma given boundedness' indicated by the dashed line through the origin. the results from our on-line survey indicating that most authors Authors wishing to be strategic in their publishing rank both of these journal traits as important or very important behaviour might selectively favour journals with a low in deciding where to submit. Moreover, the relative rejection rate to impact factor (RR/IF) ratio for submission importance placed on journal impact factor versus acceptance of their articles. In our dataset, the median RR/IF ratio was probability depends on whether an author had previously 32.1 (range 16.5 – 200.8). Therefore, journals