Skip to main content

Main menu

  • HOME
  • ONLINE FIRST
  • CURRENT ISSUE
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • SUBSCRIBE
  • BJGP LIFE
  • MORE
    • About BJGP
    • Conference
    • Advertising
    • eLetters
    • Alerts
    • Video
    • Audio
    • Librarian information
    • Resilience
    • COVID-19 Clinical Solutions
  • RCGP
    • BJGP for RCGP members
    • BJGP Open
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers

User menu

  • Subscriptions
  • Alerts
  • Log in

Search

  • Advanced search
British Journal of General Practice
Intended for Healthcare Professionals
  • RCGP
    • BJGP for RCGP members
    • BJGP Open
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers
  • Subscriptions
  • Alerts
  • Log in
  • Follow bjgp on Twitter
  • Visit bjgp on Facebook
  • Blog
  • Listen to BJGP podcast
  • Subscribe BJGP on YouTube
British Journal of General Practice
Intended for Healthcare Professionals

Advanced Search

  • HOME
  • ONLINE FIRST
  • CURRENT ISSUE
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • SUBSCRIBE
  • BJGP LIFE
  • MORE
    • About BJGP
    • Conference
    • Advertising
    • eLetters
    • Alerts
    • Video
    • Audio
    • Librarian information
    • Resilience
    • COVID-19 Clinical Solutions
Life & Times

Books: Measuring Research: What Everyone Needs to Know

Anyone For Donuts?

Roger Jones
British Journal of General Practice 2018; 68 (672): 337-338. DOI: https://doi.org/10.3399/bjgp18X697793
Roger Jones
. Email:
Roles: Editor
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: roger.jones@kcl.ac.uk
  • Article
  • Figures & Data
  • Info
  • eLetters
  • PDF
Loading
Cassidy R Sugimoto and Vincent Lariviére Oxford University Press USA, 2018, PB, 160pp, £10.99, 978-0190640125
Figure

Every summer, journal editors and publishers anxiously await the publication of the Journal Impact Factors, hoping that their journal’s IF will have gone up and that their competitors’ will have gone down. This used to be the only game in town but, in our heart of hearts, we know that Impact Factors are merely one, unsatisfactory, measure of the impact that publications in the biomedical sciences have on practice, policy, and society, and that better metrics are needed. An IF of 3, for example, means that on average each of the peer-reviewed research articles published in a journal has been cited in the mainstream, peer-reviewed literature three times during a specified 2-year window. At the same time, however, there will probably have been hundreds of thousands, if not millions, of website visits and full-page downloads of articles published in that journal. The IF is an aggregate measure of ‘journal impact’ and tells us nothing about the impact of an individual paper. It is also extremely susceptible to manipulation.

The limits of bibliometrics supplemented by peer review have been recognised for some time by the UK funding councils so that ‘impact case studies’ are an important component of universities’ research quality submissions. There have been many calls to ditch Impact Factors altogether, but researchers still try to get the work published in the most prestigious journals, which in practice means those with the highest Impact Factors. This can be problematic for primary care research because some of the top-quality clinical research in primary care has found its way into specialist, subject-specific journals rather than the more mainstream general practice and primary care literature.

This short book is a welcome guide to an increasingly complex and important area. The authors, from Indiana and Montréal, present a UK-friendly account of the research landscape, considered under the three general themes of input, output, and impact. There are a series of excellent descriptions of important components of the research measurement jigsaw — the Web of Science, Google Scholar, definitions of authorship and interdisciplinarity, the measurement of citations, and the calculation of the Impact Factor. Slightly more obscure aspects of bibliometrics are also lucidly described, including the Eigenfactor score, the SCImago Journal rankings, and the h-index, which increasingly appears at the top of CVs. There is an excellent section on alternative metrics, not just the widely used Altmetric — you will have seen the Altmetric donuts on the BJGP webpage — but also Plum Analytics and ImpactStory, which set out to capture article impact in different ways, all of which depend on extracting data from various social media platforms, online repositories, and social reference managers. The origins and trajectories of these innovative, leading-edge companies are extremely interesting but the best ways of making use of them as research impact metrics remain somewhat unclear. The excellent list of references includes a useful literature review on the scholarly use of social media and altmetrics, to which both authors of this book contributed.

The final section, ‘The Big Picture’, reflects on important questions about the control of research measurement, including the grip held by the big publishers on some of these metrics, the responsibilities of researchers and research administrators to understand and use the available metrics appropriately, recognising the potential adverse effects of some of these tools, and the potential for their misuse.

Biomedical science publishing and university research funding are both big businesses, and we are still some way from having perfect measures of their quality, impact, benefits, and harms.

  • © British Journal of General Practice 2018
Back to top
Previous ArticleNext Article

In this issue

British Journal of General Practice: 68 (672)
British Journal of General Practice
Vol. 68, Issue 672
July 2018
  • Table of Contents
  • Index by author
Download PDF
Download PowerPoint
Article Alerts
Or,
sign in or create an account with your email address
Email Article

Thank you for recommending British Journal of General Practice.

NOTE: We only request your email address so that the person to whom you are recommending the page knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Books: Measuring Research: What Everyone Needs to Know
(Your Name) has forwarded a page to you from British Journal of General Practice
(Your Name) thought you would like to see this page from British Journal of General Practice.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Books: Measuring Research: What Everyone Needs to Know
Roger Jones
British Journal of General Practice 2018; 68 (672): 337-338. DOI: 10.3399/bjgp18X697793

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Books: Measuring Research: What Everyone Needs to Know
Roger Jones
British Journal of General Practice 2018; 68 (672): 337-338. DOI: 10.3399/bjgp18X697793
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
  • Mendeley logo Mendeley

Jump to section

  • Top
  • Article
  • Figures & Data
  • Info
  • eLetters
  • PDF

More in this TOC Section

  • Being philosophical when it’s complicated
  • Sleepwalking into a two-tiered healthcare system
  • Books: 36 Hours
Show more Life & Times

Related Articles

Cited By...

Intended for Healthcare Professionals

BJGP Life

BJGP Open

 

@BJGPjournal's Likes on Twitter

 
 

British Journal of General Practice

NAVIGATE

  • Home
  • Current Issue
  • All Issues
  • Online First
  • Authors & reviewers

RCGP

  • BJGP for RCGP members
  • BJGP Open
  • RCGP eLearning
  • InnovAiT Journal
  • Jobs and careers

MY ACCOUNT

  • RCGP members' login
  • Subscriber login
  • Activate subscription
  • Terms and conditions

NEWS AND UPDATES

  • About BJGP
  • Alerts
  • RSS feeds
  • Facebook
  • Twitter

AUTHORS & REVIEWERS

  • Submit an article
  • Writing for BJGP: research
  • Writing for BJGP: other sections
  • BJGP editorial process & policies
  • BJGP ethical guidelines
  • Peer review for BJGP

CUSTOMER SERVICES

  • Advertising
  • Contact subscription agent
  • Copyright
  • Librarian information

CONTRIBUTE

  • BJGP Life
  • eLetters
  • Feedback

CONTACT US

BJGP Journal Office
RCGP
30 Euston Square
London NW1 2FB
Tel: +44 (0)20 3188 7400
Email: journal@rcgp.org.uk

British Journal of General Practice is an editorially-independent publication of the Royal College of General Practitioners
© 2023 British Journal of General Practice

Print ISSN: 0960-1643
Online ISSN: 1478-5242