Read the COMPare papers:

  • A prospective cohort study correcting and monitoring 58 misreported trials in real time
  • Qualitative analysis of researchers’ responses to critical correspondence on a cohort of 58 misreported trials

COMPare

Tracking switched outcomes in clinical trials

  • Methods
  • Results
  • Team
    • SPEAKING DATES
  • FAQ
  • Blog

Resistance and misunderstanding from the journal editors on outcome switching – What does the ICMJE say?

February 1, 2016 - by Carl Heneghan 1 Comment

There seems to be some resistance and misunderstanding from the journal editor and academic community on outcome switching, so we thought it would be useful to give an overview of what various authoritative bodies have to say on the topic. In this series, we will cover CONSORT, the FDA, ICMJE and the Word Of God. Today, we look at ICMJE.

The International Committee of Medical Journal Editors (ICMJE) includes the BMJ, JAMA and Annals of Internal Medicine, and its primary aim is to improve the reporting quality of medical science.

Their recommendations on the conduct, reporting, editing and publication of research are endorsed by a significant number of top journals, including the Lancet and NEJM. Clarification of the these recommendations might therefore shed some light on the resistance or misunderstanding shown by some editors when addressing outcome switching.

In terms of results reporting, all the ICMJE recommendations ask for is the ‘data on all primary and secondary outcomes identified in the Methods Section.’; no mention of pre-specification of outcomes. Perhaps the ICMJE does not consider this important?

It is only when you consider the ICMJE recommendations on registration of clinical trials prior to the patient enrolment that the rationale for pre-specification becomes clearer.

Screen Shot 2016-02-01 at 15.47.54
ICMJE recommendations on clinical trial reporting, https://www.icmje.org/icmje-recommendations.pdf, last accessed 01/02/2016

 

ICMJE accepts registration in any registry that is a primary register of the WHO International Clinical Trials Registry Platform (ICTRP) or in ClinicalTrials.gov, and deems a registry acceptable when it includes the minimum 20-item trial registration dataset: items 19 and 20 required the primary and secondary outcome measures to be stated.

Journal editors have collectively gone on the record to assert the need for registration prior to publication. In a 2007 editorial, ICMJE editors also stated trial registration with ‘missing or uninformative fields for the minimum data elements is inadequate.’

So, If I have this right, authors must register their trial in a named registry including pre-specified primary and secondary outcomes – as part of the mandatory 20 data items – and if they don’t include these items in sufficient detail then the registry is deemed inadequate.

The logic of the ICMJE requirements for registration, which ‘aims to increase public trust in medical science’ is therefore to act as the public record for outcome specification, amongst other data items. Indeed, the ICMJE clinical trial registration policy states the purpose of registration is to prevent selective reporting of research outcomes. If editors don’t want to use the registry entry as a record of pre-specified outcomes, then what should we think of the ICMJE recommendations they all endorse?

The next blog in the series will look at – What does CONSORT say?

 

FacebooktwitterFacebooktwitter

About Carl Heneghan

Comments

  1. Swift says

    April 4, 2016 at 6:09 am

    NICE ONE

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

How to cite us

Prior to publication of the first paper on COMPare, please cite this project as:

The COMPare Trials Project. Goldacre B, Drysdale H, Powell-Smith A, et al. www.COMPare-trials.org, 2016.

Or alternatively:

The COMPare Trials Project. Ben Goldacre, Henry Drysdale, Anna Powell-Smith, Aaron Dale, Ioan Milosevic, Eirion Slade, Philip Hartley, Cicely Marston, Kamal Mahtani, Carl Heneghan. www.COMPare-trials.org, 2016.

University of Oxford logo Nuffield Department of Primary Care Health Sciences logo Centre for Evidence-Based Medicine logo

Copyright © 2019 · Bennett Institute for Applied Data Science