Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This one is for editing

Transferred  

Source: https://community.cochrane.org/editorial-and-publishing-policy-resource/cochrane-review-management/cochrane-peer-review-policy/cochrane-peer-review-policy-guidance-implementation

...

In this policy the term 'peer reviewer' describes someone who peer reviews a manuscript (previously referred to as a peer referee) and the term 'review author' refers to the author of a Cochrane Review.  

1    Aim of peer review 

Peer review is a term that describes the objective evaluation of clinical and scientific research, usually (but not restricted to) before publication.  All new Cochrane Reviews undergo peer review, and most updates of Cochrane Reviews also undergo peer review. Please see Section 1 of the Cochrane peer review policy for further information.

...

Cochrane Reviews are peer reviewed to ensure that they follow the published Cochrane Protocol (or any deviation from the published protocol is sufficiently explained); the research question is still valid, to identify whether any relevant and important studies have been excluded, the clinical context is correct and up-to-date, the methodology is appropriate and that the conclusions are based only upon the data available. Cochrane Reviews may be rejected before or after peer review; for example, if the methodology is unsound, or if the authors are unable to revise the review to the satisfaction of the peer reviewers.  For more information, see the policy on the rejection of Cochrane Reviews.

2    Number and expertise of peer reviewers

As a minimum standard, every Cochrane Review will be peer-reviewed by at least one clinical/topic specialist (with a minimum of one external to the CRG editorial team) and one statistician/methodologist (who may, in certain circumstances, be part of the CRG editorial team).

...

The number and type of peer reviewer recruited to comment upon each Cochrane Review will vary, but may include content specialists, systematic review specialists, methodologists, statisticians, information specialists and consumers or other potential users of the review. 

2.1    Peer review of Cochrane Reviews of diagnostic test accuracy

The peer review process for Cochrane Reviews of diagnostic test accuracy (DTA Reviews; see section 1.3 of the Cochrane peer review policy) is managed centrally under the direction of the Editorial and Methods Department (EMD) to assure scientific quality and manage the limited peer review expertise for these reviews. Each Cochrane Review is managed through the DTA peer review process (which runs in parallel with the CRG peer review process) by a DTA contact editor who returns peer reviewer and editorial comments to the CRG for transmission to the author.

2.2    Fields

When a Cochrane Review covers a topic that is relevant to the scope of a Cochrane Field, it is advisable to contact the Field to obtain a subject-specialist peer reviewer. Cochrane Fields have access to methodologists, clinicians, policy-makers and consumers with expertise and experience relevant to their topic area. Obtaining peer review input from a Field can ensure that the review has addressed all methodological and clinical issues appropriately and has maximum relevance to, and impact upon, the external stakeholders in this area. 

2.3    Consumers as peer reviewers

Consumers have an important role to play in the peer review of a Cochrane Review, and it is an expectation that all CRGs seek involvement from consumers, or from other potential users of the Cochrane Review. Consumer peer review ensures that Cochrane Review questions are relevant to people requiring and accessing health care, and that meaningful outcomes and potential harms are considered.

...

For additional guidance on seeking a suitable consumer peer reviewer, please see the ACTIVE project resources available from the Cochrane Training website.

2.4    Study authors as peer reviewers

It may be necessary for authors of trials or studies included in a Cochrane Review (study authors) to be invited to be peer reviewers; for example, when the field is small and it is difficult to find peer reviewers with expertise in the field. This is acceptable as long as at least one other peer reviewer is external to the CRG editorial team and independent of any studies included in the review. The fact that a peer reviewer is an author of an included trial must be made clear in the conflict of interest statement, and the authors of the Cochrane Review should be made aware of this when receiving peer review comments.

3    Inviting peer reviewers

It is best practice to contact new potential peer reviewers at an institutional email address rather than a generic email address (for example, Gmail, Yahoo, etc.) to reduce the risk of peer reviewer fraud.  This can occur when someone other than a legitimate peer reviewer is able to complete a peer review report by intercepting an invitation email. Of course, there are circumstances when this might not be possible and, in such cases, the CRG editorial team should be aware of the risk and proceed with common sense. 

...

* Only necessary if you are inviting the peer reviewer for the first time. 

4    Peer review checklists

Cochrane peer review checklists can be used and modified as needed. It is not a requirement for CRGs to use these checklists, but some sections and statements are mandatory and must be sent to all peer reviewers (see below). These checklists provide a structured series of questions to guide peer reviewers through the process and provide structured peer review feedback. Guided peer review can be especially helpful to less experienced peer reviewers or for people undertaking named peer review. The following checklists are available, and will be updated from time to time:

...

    •    Guidance on using the consumer reviewer checklist

4.1 Mandatory sections and statements that must be sent to peer reviewers

If a CRG does not use the standard Cochrane peer review checklists, the following sections/statements must be included in the materials sent to the peer reviewer, and the responses reviewed and recorded appropriately in Archie.

...

A statement that acceptance of the invitation to peer review for Cochrane is also taken as consent for peer reviewer details to be stored within the Cochrane peer reviewer database.

5    Managing named peer review

From January 2019, and consistent with Cochrane's core principles, including open and transparent communication and decision making, all CRGs will adopt a named peer review process, in which the Cochrane Review author and peer reviewer know each other’s names and affiliations during the peer review process. See section 2 of the Cochrane Peer Review Policy.

...

Note Title | Contains | 2018 closed peer review submitted

6    Delegation of peer review responsibilities

Cochrane recognises the need for training and mentoring for early career researchers, and the delegation of peer review responsibilities to junior staff members is therefore permitted under certain circumstances.  For example, when the junior staff member is a subject expert and the experience is used as a training/mentoring exercise.  The invited peer reviewer must request permission from the CRG, or the DTA Editorial Team if appropriate, to delegate their responsibilities, and must provide the full name and contact details (including position and institutional email address) for the junior staff member so that they can be acknowledged appropriately.  The invited peer reviewer must sign-off on, and take responsibility for, the final peer review report.  Both the original peer reviewer and the delegated peer reviewer must return the “Potential conflicts of interest” and the “Permissions” statements from the peer review checklist; they may both be acknowledged in the permitted ways for their contributions to the peer review report. 

Note that the CRG and DTA Editorial Teams are under no obligation to grant permission to delegate peer review responsibilities

7    Declarations of potential conflicts of interest for peer reviewers

Peer reviewers must declare any potential conflicts of interest every time they undertake peer review of a Cochrane Review. See Section 5 of the Cochrane peer review policy for further details.

...

If necessary, the CRG or DTA Editorial Team may request advice from the Cochrane funding arbiter.

8    Acknowledgement 

As a minimum, the names of all peer reviewers who have submitted a peer review report or completed peer review checklist during the current calendar year will be published on the CRG website, unless the peer reviewer has not consented to this. Lists from previous years must be archived and publically accessible from the CRG website. See Section 6 of the Cochrane peer review policy for further details.

8.1 Acknowledgement on the CRG website

To generate a list of peer reviewers who have submitted a peer review report or completed a peer review checklist during the current calendar year, the following actions can be taken:

...

See Cochrane Wounds for an example of how the annual lists of peer reviewers can be displayed on the CRG website.

8.2 Acknowledgement in the Cochrane Review

If the Cochrane Review authors agree and permission is granted by the peer reviewer (as requested in the peer review checklist), peer reviewers should be acknowledged in the published Cochrane Review. A suitable acknowledgement might be:  “The authors [or the CRG Editorial Team, if you prefer] are grateful to the following peer reviewers for their time and comments: [Insert peer reviewer names and affiliations]”

If peer reviewers would prefer to remain anonymous use wording to ensure that it is clear how many peer reviews were involved in the process, for example: "The authors [or the CRG Editorial Team, if you prefer] are grateful to the following peer reviewers for their time and comments: [insert peer reviewer names and affiliations], and also to the [insert number of anonymous peer reviewers] who wish to remain anonymous.

8.3 Other forms of acknowledgment

Peer reviewers may, in some circumstances, receive payment from the CRG; for example, for undertaking a rapid review or when specialist/expert input is needed.  This is at the discretion of the CRG, who will fund this payment.

...

Two other avenues for acknowledging peer reviewer contributions that CRGs should be aware of are Publons and ORCID. In both instances the peer reviewer is responsible for registering with the relevant service and creating a profile. 

8.3.1    Publons 

Publons is a service that provides credits for peer review in a format that can be used in CVs and funding applications. See the Publons website for more information. 

...

Note that Publons has the facility to upload full peer review reports. As peer reviewers of Cochrane Reviews are bound to confidentiality until the Cochrane Review is published (see the Committee on Publication Ethics’ Ethical guidelines for peer reviewers), peer review reports of Cochrane Reviews that have yet to be published should not be posted to Publons. Any confidential comments to the Editor should also not be posted on Publons.

8.3.2    ORCID

ORCID provides a unique, persistent digital identifier to all registered researchers to support automated links between the researcher and their professional activities to ensure that work is recognized and attributed correctly. Peer review activity can be recorded in an ORCID account, either via a service such as Publons, or it may be added manually.

ORCID identifiers can be recorded in peer reviewers’ individual Archie accounts.

9    Collating peer review comments

Peer review comments should be collated before sending to the Authors. Ensure that peer reviewer names and affiliations are included for those participating in named peer review, and removed for those not participating in named peer review.  Peer reviewer comments may be edited for clarity and also if they are contrary to Cochrane standards; comments may also be merged or prioritised. 

10    Ensuring that authors address peer reviewers’ comments

Authors must provide a point-by-point response to peer review comments indicating how they have been addressed. CRGs and the DTA Editorial Team are under no obligation to undertake any further editorial steps until they are able to check the corrected version meets the requirements of the peer reviewers. See Section 7 of the Cochrane peer review policy for further information.

The CRG or DTA Editor with sign-off responsibility for the Cochrane Review is responsible for ensuring that authors have considered and incorporated any relevant and reasonable peer reviewers’ comments that they receive.

11    Feedback to peer reviewers

Providing comments and feedback to peer reviewers should improve the quality of peer review reports over time. Feedback is particularly valuable to new consumer peer reviewers and will motivate them to continue the relationship with Cochrane.   You might consider implementing a mentoring system, whereby experienced consumer peer reviewers give support to new consumer peer reviewers.

Upon request, CRGs or the DTA Editorial Team should provide peer reviewers with a copy of the authors’ responses to their peer-review comments (note that all post-publication peer review comments will receive a response). Note that with the release of Archie v4.12 (October 2016) there is a custom task in workflows to send feedback/thanks to referees and advisors.

12    Inviting peer reviewers to be authors

If a peer reviewer’s comments or recommendations result in major modifications to a Cochrane Review and the peer reviewer has relevant expertise, the Cochrane Review author team may invite the peer reviewer to become a co-author. The invitation must be made after the peer-review process is completed and with the agreement of the existing author team, and the peer reviewer must contribute sufficiently to the Cochrane Review to fulfil Cochrane authorship criteria ; otherwise they may be recognised in the acknowledgements section of the Cochrane Review. Peer reviewers are under no obligation to accept the invitation to become authors. 

NOTE:

The Cochrane peer review policy is available from the Cochrane Editorial and Publishing Policy Resource (EPPR). The websites of individual Cochrane Review Groups (CRGs) and the Diagnostic Test Accuracy (DTA) editorial team include specific peer review information relating to that particular group. For general queries relating to the Cochrane policy on peer review, please contact the Editorial and Methods Department (ceu@cochrane.org).