Evaluating the Impact of Assessing During Peer Review the CONSORT Checklist Submitted by Authors

Completeness of Reporting Clinical Trial

Official title:

Evaluating the Impact of Assessing During Peer Review the CONSORT Checklist Submitted by Authors: a Randomised Controlled Trial

Clinical Trial Details — Status: Completed

Administrative data

• NCT number: NCT03751878
• Other study ID #: EC 02
• Status: Completed
• Phase: N/A
• Start date: December 7, 2018
• Est. completion date: April 13, 2019

Study information

• Verified date: May 2019
• Source: Universitat Politècnica de Catalunya
• Contact: n/a
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

Randomised trials are considered the gold standard in medical research. The CONSORT (Consolidated Standards of Reporting Trials) Statement aims to improve the quality of reporting of randomised trials. Without transparent reporting, readers cannot judge the reliability and validity of trial findings, and therefore these findings cannot inform clinical practice. Different stakeholders, including biomedical journals, have taken different actions to try to improve author adherence to CONSORT. The most popular action among biomedical journals is to instruct authors to submit a completed RG checklist with page numbers indicating where the CONSORT items are addressed when they submit their manuscript. However, this measure alone has been proven not to be effective. In this study, the investigators intend to evaluate in a real editorial context whether assessing during peer review the consistency between the submitted CONSORT checklist and the information reported in the manuscripts of randomised trials, as well as to provide feedback to authors on the inconsistencies found, improves the completeness of reporting of published trials.

Description:

Randomised trials are considered the gold standard in medical research. The CONSORT (Consolidated Standards of Reporting Trials) Statement aims to improve the quality of reporting of randomised trials. Without transparent reporting, readers cannot judge the reliability and validity of trial findings, and therefore these findings cannot inform clinical practice.

In recent years, different stakeholders have acted to boost the completeness of reporting of the published randomised trials, and therefore their transparency and reproducibility. In a recently completed scoping review, the investigators identified and classified 31 interventions to improve adherence to reporting guidelines. This review revealed that it is primarily journals that have taken most efforts to improve the completeness of reporting of randomised trials - although most of their actions have been shown not to have the desired effect.

One of the most popular strategies used by journals to improve adherence to CONSORT requires authors to submit a populated checklist together with their manuscript indicating page numbers corresponding to each item. However, journals usually lack further actions throughout the editorial process to ensure that the corresponding information to each item is reported in the randomised trial manuscript. This has been hypothesized to be one of the reasons why this editorial strategy has not achieved optimal results.

In an effort to take full advantage of requiring the submission of populated checklists, the investigators intend to evaluate in a real editorial context whether assessing during peer review the consistency between the submitted CONSORT checklist and the information reported in the manuscripts of randomised trials, as well as to provide feedback to authors on the inconsistencies found, improves the completeness of reporting of published trials.

Recruitment information / eligibility

• Status: Completed
• Enrollment: 24
• Est. completion date: April 13, 2019
• Est. primary completion date: April 13, 2019
• Accepts healthy volunteers: Accepts Healthy Volunteers
• Gender: All
• Age group: N/A and older

Eligibility

Inclusion Criteria:

Manuscripts will be eligible if:

• They have been submitted to BMJ Open,

• They are original research submissions reporting the results of a randomised trial, and

• They have passed the first editorial filters and have been subsequently sent out for peer review.

• Authors of these manuscripts have provided a completed CONSORT checklist.

According to the official CONSORT extensions, the investigators will also consider other study designs (cluster, non-inferiority and equivalence, pragmatic, N-of-1 trials, Pilot and feasibility, and within person trials), and different intervention types (Herbal, non-pharmacologic, acupuncture and Chinese herbal medicine formulas) in all areas of clinical specialty.

Exclusion Criteria:

• Protocols of randomised trials

• Secondary trial analysis studies

Related Conditions & MeSH terms

• Completeness of Reporting
• Peer Review, Publishing

Intervention

Behavioral:
• Evaluation of reporting inconsistencies
The completed CONSORT checklist submitted by authors of manuscripts randomised to the intervention group will be assessed by the lead investigator (DB) as to whether it is consistent with the information that was actually reported in the manuscript. This evaluation will be focused on 8 core CONSORT items. DB will produce a standardised report containing precise requests for authors in order to improve the completeness of reporting of the items where reporting inconsistencies were found. This report will consist of a brief introduction followed by a point by point description of the inconsistencies found together with precise requests related to the information missing and examples extracted from CONSORT. DB will upload this report to the submission on the managing system of the journal (Scholar One) to make it accessible to the handling editor of the manuscript. This editor will include the report in the letter to authors alongside the standard peer review reports.
• Standard Peer Review.
Manuscripts will undergo the usual peer review process.

Locations

Country	Name	City	State
United Kingdom	BMJ Open	London

Sponsors (3)

Lead Sponsor	Collaborator
Universitat Politècnica de Catalunya	The BMJ, University of Liverpool

Country where clinical trial is conducted

United Kingdom, 

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Overall completeness of reporting	Proportion of adequately reported CONSORT items in the first revised manuscript	Following manuscript revision (usually 2-3 months)
Secondary	Completeness of reporting for each item	Proportion of manuscripts where each CONSORT item is adequately reported	Following manuscript revision (usually 2-3 months)
Secondary	Time to perform the evaluation	Time to perform the evaluation of reporting inconsistencies by the lead investigator (DB)	Following the evaluation of reporting inconsistencies (1 week)