18-Aug-2016 Dear Dr. Nagendran Manuscript ID

Total Page:16

File Type:pdf, Size:1020Kb

18-Aug-2016 Dear Dr. Nagendran Manuscript ID 18-Aug-2016 Dear Dr. Nagendran Manuscript ID BMJ.2016.034309 entitled "Do randomised trials with very large treatment effects make further trials unnecessary? An empirical assessment." We sent it for external peer review and discussed it at our manuscript committee meeting. We recognise its potential importance and relevance to general medical readers, but I am afraid that we have not yet been able to reach a final decision on it because several important aspects of the work still need clarifying. We hope very much that you will be willing and able to revise your paper as explained below in the report from the manuscript meeting, so that we will be in a better position to understand your study and decide whether the BMJ is the right journal for it. We are looking forward to reading the revised version and, we hope, reaching a decision. Yours sincerely, Georg Roeggla [email protected] **Report from The BMJ’s manuscript committee meeting** These comments are an attempt to summarise the discussions at the manuscript meeting. They are not an exact transcript. Manuscript meeting 18.08.2016 Jose Merino (chair), Angela Wade (stats), Elizabeth Loder, Georg Roggla, Wim Weber, Tiago Villanueva, Jessamy Bagenal, Amy Price Decision: Ask for revision The committee was interested in the topic of your research. The following concerns were mentioned: • Were patients involved in discussion of this paper at outset? • There's a bit about patient recruitment in the PI statement, as if recruitment and involvement were synonymous. • What does this add to the recent JAMA paper (http://jama.jamanetwork.com/article.aspx?articleid=1386610) • The committee agreed with the issue about absolute risks vs relative risks raised by the reviewer Siegerink. • This is interesting and thought-provoking but the committee had concerns about the methods you've used to identify the initial VLE study and the subsequent larger study. It's not until Table 2 that we get a sense of the actual clinical questions and topics that are involved. One of them, we note is rizatriptan (where the initial VLE was upheld by a subsequent trial although it wasn't quite as large). We could not, however, locate which small study they referred to, or which subsequent large rizatriptan trial. However, having this concrete example made us realize that the authors don't take into account the context of a VLE. Riza was a me-too drug and there was every reason to think its effects would be in line with previous triptan results. It doesn't seem quite right to consider it in isolation from the known effects of similar drugs. We question whether a subsequent large trial was needed (or even ethical, if it involved placebo), yet the authors would say it was. • Unless we are interpreting table 2 incorrectly, it seems more VLEs were upheld than refuted. • Could you define what you mean by empirical? It appears in the title and then in the text. Also need to define "agreed with." • We thought this is an interesting read, although a bit abstract. First, please revise your paper to respond to all of the comments by the reviewers. Their reports are available at the end of this letter, below. Please also respond to the additional comments by the committee. In your response please provide, point by point, your replies to the comments made by the reviewers and the editors, explaining how you have dealt with them in the paper. ** Comments from the external peer reviewers** Reviewer: 1 Recommendation: Comments: Peer review report BMJ.2016.034309 Bob Siegerink, PhD [email protected] / bobsiegerink.com To the editor and authors I have read with great interest the paper by Nagendran et al with the title “Do randomised trials with very large treatment effects make further trials unnecessary? An empirical assessment”, aka BMJ.2016.034309. The authors ask whether a very large treatment effect (RR >5 or its inverse) in a trial can be seen as an indication of no need for follow up trials. This question, linked to the day-to-day practice that small trials provide an “obvious benefit” and therefore clinical equipoise is not applicable anymore, is a relevant question as it addresses concepts like reproducibility of research, potential source of publication bias as well as introducing new treatments that potentially could harm patients. The authors use data from the Cochrane reviews to which they apply several methods to identify RCT with very large effects and subsequent large trials that either refute or uphold that effect. The results indicate very large effects are not a reliable marker for true clinical benefit. The authors even draw the conclusion that therefore these smaller trials might better be skipped and that a new treatment should be investigated with a large trial at the end. The paper is well written, clear in its approach, results well reported and the topic is both relevant as well as attractive and relevant for readers of the BMJ. Nonetheless, I have several comments and question, which I will provide below in a point-by-point fashion. Please note that I have no conflict of interest with regard to this paper and that I am very happy to relinquish my anonymity in this peer review process. Bob siegerink // Major comments. 1. relative risks vs absolute risks. All calculations, selections and definitions are based on relative risks. Even though these measures are the most used measured to estimate the effect size of an intervention, they do not convey the true impact of an intervention. For this, a form of absolute measure is needed, which can either be an absolute risk reduction, number needed to treat or otherwise. This is not only relevant to understand what “very large effects” indeed mean in clinical practice, but is also important as the initial VLE trial and subsequent large trial can have similar RR while the NNT is different, and vice versa. The figure below shows a numeric example, in which only the absolute risk and total number of persons in the subsequent trials is changed. IN each of the subsequent trials, either the RR or the ARR is similar to the initial VLE trial even though the other measure is then not the same. This shows that there is a problem in interpretation of the RR between trials when there is no information on the absolute risk. It is not unrealistic to think that the subsequent analyses trial could have a different absolute risk compared to the VLE trial, either due to chance, different inclusion criteria, change in co-treatment over time periods, change in geographic location etc. I am not sure to what extend whether such scaling of the RR indeed hampers the interpretation of the results provided by the authors. Details on the absolute risk in both the VLE trials and subsequent trial (e.g. extra row in table 2) would help the reader to understand the impact of this scaling problem. << please refer to pdf for table>> In line with this question on the absolute risk, where the authors able to ensure that there was sufficient overlap in the patient populations of the initial and subsequent trials (overlapping external validity?) 2. upheld/refute. The definitions of “upheld” and “refute” are unclear to me. The authors describe their two methods on page 10 line 4 to 14. The first approach is clear, but the second approach is unclear, as it speaks of “agreed with the index trial” in which agreed which is not defined. After repeatedly reading the second approach, I think the authors mean that when multiple large trials are present, a meta analyses is performed and the result of this meta analyses is checked based on the same criteria as the first approach (effect in opposite direction or non-statistically significant effect). But if this is the case, does approach 1 not rule out that approach 2 is even possible? The figures provide some indication on the definitions, i.e. that everything that stays significant is upheld. Although understandably when it comes to clear definition, I doubt whether a statistical significant of RR 1.1-2 in a subsequent large trial should indeed be seen as “upheld”. It is quite dependent on the research question (PICO) whether the finding of this second trials should next to statistically significant also be seen as ‘just as clinically relevant” as the finding of the index trial. 3. Selection bias. I wonder whether this analyses suffers from selection bias due to the definition of index trial. As is stated at page 7 line 35 an index trial is a VLE trial followed by at least one large trial. If this is the case selection bias might be introduced through this selection: consider all VLE trials that are possible. It is likely that the characteristics of those who are followed by a large trial are indeed different from those VLE trials who are not followed by large trials – and as such never reach the status of index trial-. Perhaps VLE trials who are followed by a large trial (i.e. index trial) are more “disbelieved” by the medical community, perhaps due subject matter knowledge of problems with the initial VLE trial. VLE trials who are not followed by a large trial are could indeed be more solid in terms of effect and these are, as far as I can judge, not part of this analyses. If this is the case, it is no wonder that VLE in the index trials are indeed a poor predictor of success in a subsequent large trial. There is some information in the paper which makes the it not easier for the reader to understand what is going on, being the reference in the flowchart which reads “index RCT not followed by RCT=2”.
Recommended publications
  • Stephen P. Lock on "Journalology"
    INSTITUTE FOn SCIENTl FICl NF0F4MAT10N8 3501 MARKET ST PHILADELPHIA PA 19104 Stephen P. Lock on “Journalology” Number 3 January 15, 1990 I don’t remember exactly how long I have Lock: Editor and Scholar known Stephen P. Lock. Our first encounter was probably at a meeting of the Council of Biology Editors (CBE) some 20 years Stephen P. Lock was born in 1929 and re- ago. It is somewhat unsettling to realize that ceived his education at Queen’s College, so much time has gone by. Equally disquiet- Cambridge University, UK, and the Medical ing is the notion that Steve will soon retire College of St. Bartholomew’s Hospital. as editor of the venerable British Medical Trained as a hematologist, he served on the Journal (BMJ). But in the near future Steve staffs of various London teaching hospitals, will indeed step down, having helped train including St. Bartholomew’s and the Hos- his successor, due to be appointed in the fall pital for Sick Children, before being ap- of 1990. pointed assistant editor of BMJ in 1964. It seems odd to refer to Lock as an elder After serving as senior assistant editor and statesman of biomedical editing-however deputy editor, Lock became editor in 1975. accurate that description might be. The word I am amused that Steve opened his talk that comes to mind when I think of Steve with the traditional, mythical reminder about is youth. This youthfidness is reflected in the estimates of the number of extant jour- his writing and in his approach to problems. nals.
    [Show full text]
  • Defining Covid-19 Elimination
    EDITORIALS Department of Preventive and Social BMJ: first published as 10.1136/bmj.n1794 on 15 July 2021. Downloaded from Medicine, University of Otago, Dunedin, Defining covid-19 elimination New Zealand Correspondence to: D C G Skegg Elimination is achievable and should not be confused with eradication [email protected] Cite this as: BMJ 2021;374:n1794 David CG Skegg, Philip C Hill http://dx.doi.org/10.1136/bmj.n1794 Speaking about progress towards ending the covid-19 “zero covid” for a prolonged period. Even with border Published: 15 July 2021 epidemic in the United States, Anthony Fauci said: restrictions and strict quarantine, incursions of the “We will end the epidemic phase, and we will likely virus occur from time to time, leading to clusters of get somewhere between control and elimination, infections and occasional large outbreaks. In the more likely closer to control.”1 Now authorities in Australian state of Victoria, for example, a resurgence England are abandoning most efforts to control, let of covid-19 last year peaked at over 700 cases a day, alone eliminate, the infection.2 Throughout the before being extinguished after three months.11 pandemic, the word “elimination” has been used in Despite such setbacks, Australia and New Zealand different senses. Many confuse elimination with remain healthy economies with largely normal eradication, which normally means permanent community life, apart from temporary border reduction to zero of the worldwide incidence of an restrictions. Both are developing plans for a phased infection—as was achieved for smallpox.3 This reopening of borders. confusion helps to make the idea of eliminating The likely consequences of not aiming for elimination covid-19 seem impossible and not worth pursuing.
    [Show full text]
  • Open Access Policies of Leading Medical Journals: a Cross-Sectional Study
    Open access Research BMJ Open: first published as 10.1136/bmjopen-2018-028655 on 20 June 2019. Downloaded from Open access policies of leading medical journals: a cross-sectional study Tim S Ellison, 1 Tim Koder, 2 Laura Schmidt, 2 Amy Williams, 1 Christopher C Winchester 2 To cite: Ellison TS, Koder T, ABSTRACT Strengths and limitations of this study Schmidt L, et al. Open Objectives Academical and not-for-profit research access policies of leading funders are increasingly requiring that the research they ► This manuscript includes a cross-sectional analysis medical journals: a cross- fund must be published open access, with some insisting sectional study. BMJ Open of open access policies of medical journals with a on publishing with a Creative Commons Attribution (CC 2019;9:e028655. doi:10.1136/ high impact factor, including society-owned jour- BY) licence to allow the broadest possible use. We aimed bmjopen-2018-028655 nals, from multiple publishers. to clarify the open access variants provided by leading ► The open access policies of all journals analysed ► Prepublication history medical journals and record the availability of the CC BY were clarified, and confirmation of our findings and additional material for licence for commercially funded research. was received by email from 97% of the contacted this paper are available Methods We identified medical journals with a 2015 online. To view these files, journals. impact factor of ≥15.0 on 24 May 2017, then excluded please visit the journal online ► Open access policies of the journals and publishers from the analysis journals that only publish review articles.
    [Show full text]
  • The Journal Impact Factor Denominator Defining Citable (Counted) Items
    COMMENTARIES The Journal Impact Factor Denominator Defining Citable (Counted) Items Marie E. McVeigh, MS The items counted in the denominator of the impact fac- tor are identifiable in the Web of Science database by hav- Stephen J. Mann ing the index field document type set as “Article,” “Re- view,” or “Proceedings Paper” (a specialized subset of the VER ITS 30-YEAR HISTORY, THE JOURNAL IMPACT article document type). These document types identify the factor has been the subject of much discussion scholarly contribution of the journal to the literature and and debate.1 From its first release in 1975, bib- are counted as “citable items” in the denominator of the im- liometricians and library scientists discussed its pact factor. A journal accepted for coverage in the Thom- Ovalue and its vagaries. In the last decade, discussion has 6 son Reuters citation database is reviewed by experts who shifted to the way in which impact factor data are used. In consider the bibliographic and bibliometric characteristics an environment eager for objective measures of productiv- of all article types published by that journal (eg, items), which ity, relevance, and research value, the impact factor has been are covered by that journal in the context of other materi- applied broadly and indiscriminately.2,3 The impact factor als in the journal, the subject, and the database as a whole. has gone from being a measure of a journal’s citation influ- This journal-specific analysis identifies the journal sec- ence in the broader literature to a surrogate that assesses tions, subsections, or both that contain materials likely to the scholarly value of work published in that journal.
    [Show full text]
  • ACADEMIC 1 Improving Healthcare Outcomes
    Sharing knowledge and expertise ACADEMIC 1 Improving healthcare outcomes Sharing the newest ideas, opinions and data Supporting health professionals’ learning and development Developing tools to make information accessible and useful Using digital technology to make best evidence instantly available That’s what BMJ does. We’ve been doing it since 1840. 2 A healthier world Since starting out as the publisher of a single “We have a clear vision of ‘A Healthier World’ medical journal in 1840, we have developed a and use our values to inform the decisions unique range of capabilities to meet the needs professionals, institutions and organisations. we take to help achieve that vision. The voice of our customers is vitally • Leading source of medical information for over important to us - we listen and respond 170 years to their needs, ensuring we provide high- • The BMJ is the fourth most cited general quality evidence based products for medical journal in the world healthcare professionals, their institutions, • Each month, more than five million users visit organisations and governments.” our websites, where we have content available in 11 languages • Over 700,000 healthcare professionals from Peter Ashman more than 100 countries access our revision CEO, BMJ resources and online learning tools [email protected] bmj.com/company 3 Global healthcare knowledge provider BMJ shares knowledge and expertise to improve experiences, outcomes and value. From specialist publications and decision support to online learning, our products and services help improve the educational development of students and professionals. They also help organisations improve their research and development services. Alert Drive research to publication Receive customisable emails containing Help improve research outputs and interest-related content.
    [Show full text]
  • Journals from BMJ
    Journals from BMJ journals.bmj.com BMJ started out over 170 years ago as Providing high quality content for health professionals and a medical journal, publishing our first researchers across the world. Our journals include not only the BMJ, research paper. but some of the most influential speciality journals in their field. Now, as a global brand with a worldwide audience, we help medical organisations and clinicians tackle today’s most critical • In the last 12 months, over 50 million unique users accessed healthcare challenges. our subscription journals online, generating over 107 million page views. What is an Our vision is to create ‘a healthier world’. • Nearly 80% of our titles saw Impact Factor rises in 2014. Impact Factor? BMJ’s journals division now publishes more than 50 of the • 21% of our users view journal content from mobile devices. An Impact Factor (IF) is a measure of world’s leading medical and allied science journals. In doing so, the frequency with which the average we have pioneered the migration to digital publishing and the article in a journal has been cited in development of open access. a particular year. The annual Journal For more information or to of Citation Reports impact factor is a ratio between citations and recent Today, our expertise extends to medical education, clinical arrange a trial, please contact: citable items published. Thus, the decision support, data analytics and quality improvement to BMJ Consortia sales impact factor of a journal is calculated enhance day to day decision-making and healthcare delivery. by dividing the number of current E: [email protected] year citations to the source items T: +44 (0) 20 7383 6438 published in that journal during the “At BMJ we believe the work we do previous two years.
    [Show full text]
  • NLM Board of Regents Public Service Working Group on Clinicaltrials.Gov Modernization
    NLM Board of Regents Public Service Working Group on ClinicalTrials.gov Modernization Chair: Carlos R. Jaén, MD, PhD, University of Texas Health Science Center at San Antonio Executive Secretary: Rebecca (Becky) J. Williams, PharmD, MPH, National Library of Medicine, NIH Board of Regents Members: • Lourdes Baezconde-Garbanati, PhD, MPH, University of Southern California • Kent J. DeZee, MD, MPH, FACP, COL, MC, U.S. Army Office of the Surgeon General • Gary A. Puckrein, PhD, National Minority Quality Forum Ex Officio Members: • Lyric A. Jorgenson, PhD, Office of Science Policy, NIH • Pamela Reed Kearney, MD, Office of Extramural Research, NIH External Members: • Carrie Dykes, PhD, University of Rochester Medical Center • Alissa Gentile, MSN, RN, The Leukemia and Lymphoma Society • Sally A. Gore, MS, MS LIS, University of Massachusetts Medical School • Barbara Kress, BSN, RN, Merck • Seth A. Morgan, MD, National Multiple Sclerosis Society • Stephen J. Rosenfeld, MD, MBA, SACHRP • Joseph S. Ross, MD, MHS, Yale School of Medicine • Steven Woloshin, MD, The Dartmouth Institute Page 1 of 7 Biographies CHAIR: CARLOS R. JAÉN Carlos R. Jaén, MD, PhD, is the Holly Distinguished Chair, Patient-Centered Medical Home, Professor and Chair of Family and Community Medicine, and Professor of Population Health at the University of Texas Health Science Center at San Antonio. Dr. Jaén’s research interests focus on improving preventive care for individuals of all ages and preventing complications from chronic diseases such as diabetes, high blood pressure, and heart disease. He is passionate about building and studying high-performance primary care offices. He served on the panels that published smoking cessation guidelines in 1996 and 2000 and was co-chair of the panel that published an update in 2008.
    [Show full text]
  • Contents Commentaries Original Articles
    Contents Volume 63 Issue 5 | GUT May 2014 Commentaries 753 Characterisation of faecal protease activity 705 Oesophageal mucosal barrier: a key factor in the in irritable bowel syndrome with diarrhoea: pathophysiology of non-erosive refl ux disease OPEN ACCESS origin and effect of gut transit (NERD) and a potential target for treatment D Tooth, K Garsed, G Singh, L Marciani, C Lam, P Woodland, D Sifrim I Fordham, A Fields, R Banwait, M Lingaya, R Layfi eld, M Hastings, P Whorwell, R Spiller Gut: first published as on 1 May 2014. Downloaded from Caption: Night view of the beautiful skyline of Chicago downtown. The Gut family wish everyone 706 The antidiabetic gutsy role of metformin a very successful DDW meeting in Chicago. uncovered? Infl ammatory bowel disease R Burcelin 761 Colonic mucosa-associated diffusely adherent afaC+ Escherichia coli expressing lpfA and pks An international journal of 707 Fbxw7 hotspot mutations and human OPEN ACCESS are increased in infl ammatory bowel disease gastroenterology and hepatology colon cancer: mechanistic insights and colon cancer Impact Factor: 10.732 M Prorok-Hamon, M K Friswell, A Alswied, Editor from new mouse models C L Roberts, F Song, P K Flanagan, P Knight, Emad El-Omar (UK) J E Grim Deputy Editor (Hepatology) C Codling, J R Marchesi, C Winstanley, N Hall, Alexander Gerbes (Germany) J M Rhodes, B J Campbell Deputy Editor (Luminal 709 Editing liver tumours Gastroenterology) S Colnot, P Fortes William Grady (USA) 771 Mortality and causes of death in Crohn’s disease: results from 20 years of follow-up
    [Show full text]
  • National Citation Patterns of NEJM, the Lancet, JAMA and the BMJ in the Lay Press: a Quantitative Content Analysis
    Open Access Research BMJ Open: first published as 10.1136/bmjopen-2017-018705 on 12 November 2017. Downloaded from National citation patterns of NEJM, The Lancet, JAMA and The BMJ in the lay press: a quantitative content analysis Gonzalo Casino,1 Roser Rius,2 Erik Cobo2 To cite: Casino G, Rius R, ABSTRACT Strengths and limitations of this study Cobo E. National citation Objectives To analyse the total number of newspaper patterns of NEJM, The Lancet, articles citing the four leading general medical journals ► This is the first study that analyses the citations of JAMA and The BMJ in the and to describe national citation patterns. lay press: a quantitative the four leading general medical journals in the lay Design Quantitative content analysis. content analysis. BMJ Open press. Setting/sample Full text of 22 general newspapers in 2017;0:e018705. doi:10.1136/ ► This study shows the existence of a national factor 14 countries over the period 2008–2015, collected from bmjopen-2017-018705 in science communication that needs to be further LexisNexis. The 14 countries have been categorised into monitored and analysed. ► Prepublication history for four regions: the USA, the UK, Western World (European ► Citation and correspondence analyses offer a new this paper is available online. countries other than the UK, and Australia, New Zealand To view these files, please visit way to quantify and monitor the media impact of and Canada) and Rest of the World (other countries). the journal online (http:// dx. doi. scientific journals. Main outcome measure Press citations of four medical org/ 10. 1136/ bmjopen- 2017- ► This study is observational and descriptive; thus, it journals (two American: NEJM and JAMA; and two British: 018705).
    [Show full text]
  • Altmetrics to Quantify the Impact of Scientific Research Published in Open Full Text Repositories Bertil Dorch
    Altmetrics to quantify the impact of scientific research published in open full text repositories Bertil Dorch To cite this version: Bertil Dorch. Altmetrics to quantify the impact of scientific research published in open full text repositories. 2013, pp.6773. 10.5281/zenodo.6773. hprints-00822129 HAL Id: hprints-00822129 https://hal-hprints.archives-ouvertes.fr/hprints-00822129 Submitted on 14 May 2013 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Discussion paper Altmetrics to quantify the impact of scientific research published in open full text repositories S. B. F. Dorch The Royal Library / University of Copenhagen Library, Copenhagen, Denmark First version March 8, 2013 Abstract Measures of the impact of scientific research increasingly become tools for various administrative applications. Bibliometric measures of the impact of research typically rely on citation analyses, which may not be appropriately representing all areas of scholarship, e.g. Arts and humanities. Metrics alternative to citation analyses are referred to as altmetrics, and include parameters derived from usage data, e.g. the number of times a paper is downloaded. In this paper I consider usage data from the open full text repository hprints.org for Nordic arts and humanities, and on the basis of an analysis of a small dataset from hprints.org, suggest new altmetrics based on the normalized squared number of downloads d downloads that could prove to be a valuable tool to quantify the impact of research published in open full text repositories.
    [Show full text]
  • Contents Volume 65 Issue 2 | GUT February 2016
    Contents Volume 65 Issue 2 | GUT February 2016 Commentaries Gut immunity 189 Barrett’s oesophagus: size does matter 256 Compartment-specifi c immunity in the human gut: P J F de Jonge, F Hvid-Jensen properties and functions of dendritic cells OPEN ACCESS in the colon versus the ileum 190 Defi ning dysbiosis threatens Koch’s postulates E R Mann, D Bernardo, N R English, J Landy, H O Al-Hassi, S TC Peake, R Man, T R Elliott, and current dogma on the role of Paneth cells Gut: first published as on 1 February 2016. Downloaded from Caption: Saint Bartholomew at the sea of Kings in in Crohn’s disease H Spranger, G H Lee, A Parian, S R Brant, Berchtesgaden, Bavaria, Germany. See inside the M Chamaillard, K Radulovic M Lazarev, A L Hart, X Li, S C Knight excellent paper by Schaubeck et al from Munich. 191 Relief of obstructive jaundice from pancreatic cancer: Endoscopy the end of the plastic stent era? 271 Ten-year incidence of colorectal cancer following a An international journal of T H Baron, I S Grimm negative screening sigmoidoscopy: an update from gastroenterology and hepatology the Colorectal Cancer Prevention (CoCaP) programme Impact Factor: 14.660 Editor V P Doria-Rose, T R Levin, A Palitz, C Conell, Endoscopy news N S Weiss Emad El-Omar (UK) 193 Prospective evaluation of endoscopic Deputy Editor (Hepatology) ultrasonography-guided double-balloon-occluded Alexander Gerbes (Germany) gastrojejunostomy bypass (EPASS) for malignant GI cancer Deputy Editor (Luminal gastric outlet obstruction Small-molecule inhibitors prevent the Gastroenterology)
    [Show full text]
  • Altmetrics: What, Where, Why? by Catherine Chimes Head of Marketing & Customer Relations Altmetric LLP
    ARTICLE Altmetrics ARTICLE Altmetrics: What, Where, Why? By Catherine Chimes Head of Marketing & Customer Relations Altmetric LLP Altmetrics have become a buzzword in scholarly altmetrics data add a new layer of insight into the publishing in the last year. But just what is all the attention and societal impact the work has gar- fuss about? nered. As evaluation criteria expand and budgets tight- By providing both qualitative and quantitative en, authors, publishers, universities, and research data for a paper, altmetrics can help authors and bodies are increasingly looking for additional ways publishers explore, understand, and engage in to demonstrate the reach and value of their work. the conversations that are going on around the Traditional measures of scholarly impact, such as research. This can be used to help influence fu- the Impact Factor, tend to focus only at the jour- ture publications or research, and serves to further nal level—with little insight into how the individ- stimulate the academic discussion. ual articles within a publication perform. Recent advancements have therefore seen new measures emerge, which take a more granular view of the dissemination of articles and associ- ated research content. Commonly referred to as The task of tracking and reporting on an indi- altmetrics, or alternative metrics, these new forms vidual scholarly article is not without obstacles— of measurement look beyond citation and pub- not least the need to disambiguate between differ- lisher usage counts, with a focus on online “men- ent versions of a single piece of work. In order to tions” of a research work. By collating data from do this with accuracy, at Altmetric, data collation sources, such as social media, blogs, news outlets, is based on a scholarly identifier unique to each bookmarking sites, peer-review forums, and policy article—for example, the DOI or PubMed ID, documents, we are now able to see a much richer will remain the same whether hosted on the pub- picture of the true reach of the scholarly content.
    [Show full text]