Changes to review heading structure for intervention reviews

What business value does this epic create? / Which problem is this epic trying to solve?

Strategic fit

Link to strategy: GOAL 1 Streamlining production of reviews and simplifying editorial systems and processes

Future of review production project: New review format

Hypothesis

Success metric

Which assumptions are made in relation to the value?

  • Supplementary materials mandatory when this is introduced
  • Likely need an optional period.--> will need to support old and new structure at the same time
  • All review types need to be included in scope but launch could be staged for different review types

What are the dependencies for fulfilling the business value?

What are the risks related to this roadmap item?

  • Accidentally removing review text that is relevant to keep
    • Mitigation: Rigorous testing of process to merge
  • Intentionally removing review text that is relevant to keep 
    • Mitigation: Sign off solutions to merging and deleting review text with editorial stakeholders 

What is included in the scope of this solution?

  • Changes to headings structure see  NRF_Subheading changes_intervention_Aug2023.xlsx
    • For all reviews, the following headings structure changes are applied to heading structure in RevMan Web, JATS, view, PDF & xml in export when Focused Review Format is enabled 
      • Adding a level 1 heading "Additional Information" in JATS and moving headings below it
        • Move Acknowledgements to  Additional information
        • Move "Contributions of authors" to after "Acknowledgements"
        • Move "Declarations of interest" to after "Contributions of authors"
        • Move "Sources of support" to after "Declarations of interest"
        • Add level 2 heading "Registration and protocol" after "Sources of support" 
        • Add level 2 heading "Availability of data, code and other materials" after "Registration and protocol" 
      • Removal of Differences between protocol and review
      • Order of Figures/Tables
      • Add level 2 heading "Funding" to abstract after Authors' conclusions
      • Add level 2 heading "Registration" to abstract after Authors' conclusions
    • For intervention reviews, the following headings structure changes are applied to heading structure in RevMan Web, JATS & view when Focused Review Format is enabled 
      • Rename Background to Rationale in Abstract
      • Rename Selection criteria to Eligibility criteria in Abstract
      • Add level 2 heading "Outcomes" to Abstract between Eligibility criteria and Risk of bias
      • Add level 2 heading "Risk of bias" to Abstract between Outcomes and Synthesis methods
      • Rename "Data collection and analysis" to "Synthesis methods"
      • Add level 2 heading "Included studies" to abstract after Synthesis methods
      • Rename Main results "Synthesis of results" in abstract and move after Included studies
      • Add level 2 heading "Funding" to abstract after Authors' conclusions
      • Add level 2 heading "Registration" to abstract after Authors' conclusions
      • Description of the condition in Background- make heading optional
      • Merge Description of the intervention & How the intervention might worm to "Description of the intervention and how it might work" in Background - make heading optional
      • Types of outcome measures changed to Outcome measures and moved to heading level 2 
      • Rename "Primary outcomes" to "Critical outcomes" in Methods, change to heading level 3
      • Rename Secondary outcomes to "Important outcomes" in Methods - optional, change to heading level 3
      • Rename "Assessment of risk of bias in included studies" to "Risk of bias assessment in included studies" in Methods
      • Remove "Assessment of heterogeniety" under Methods - move text to after the text in 'Synthesis methods' in Methods
      • Rename "Assessment of reporting biases" to "Reporting bias assessment"in Methods
      • Rename "Data synthesis" to "Synthesis methods"
      • Rename "Subgroup analysis and investigation of heterogeneity" to "Investigation of heterogeneity and subgroup analysis" in Methods
      • Add level 4 heading "Equity-related assessment" after "Investigation of heterogeneity and subgroup analysis" and before "Sensitivity analysis" - make heading optional
      • Make "Summary of findings and assessment of the certainty of the evidence" a proper standard heading (level 3), you should also be able to link to it & rename it to "Certainty of the evidence assessment" 
      • Add level 2 heading "Consumer involvement" after "Certainty of the evidence assessment" in Methods
      • Rename "Effects of interventions" to "Synthesis of results"
      • Add level 3 heading "Equity assessment" after "Synthesis of results" and before "Reporting biases" - make it optional
      • Add level 3 heading "Reporting biases" after "Equity assessment" and before "Certainty of the evidence" - make it optional
      • Rename Overall completeness and applicability of evidence to "Limitations of the evidence included in the review"
      • Remove heading Quality of the evidence and move text under it to before the text in 'Limitations of the evidence included in the review'
      • Rename "Potential biases in the review process" to "Limitations of the review processes"
      • Add level 3 heading "Equity-related implications for practice" after "Implications for practice" and before "Implications for research" in Authors' conclusions - make it optional
      • Add level 3 heading "Equity-related implications for research" after "Implications for research" in Authors' conclusions - make it optional
      • Add level 1 heading Additional information before "Acknowledgements"
      • Move Acknowledgements to Additional information
      • Move "Contributions of authors" to after "Acknowledgements"
      • Move "Declarations of interest" to after "Contributions of authors"
      • Move "Sources of support" to after "Declarations of interest"
      • Add level 2 heading "Registration and protocol" after "Sources of support"
      • Add level 2 heading "Data, code and other materials" after "Registration and protocol"
      • What's new remains after "Data, code and other materials" (part of Additional information)
      • History remains after What's new (part of Additional information)
      • Remove "Differences between protocol and review", the text in section is moved to  immediately after the Methods heading 
      • Figures moved to after references
      • Tables moved to after figures
  • Link options changed according to the above
  • Update validation rules if you have enabled focused review format
  • Ask Evidence prime to change Quality to Certainty of the evidence in all places in SoF
  • During grace period, allow reverting but not after that, what are implications of this? 
    • Keep in case of data loss during conversion 

Out of scope

  • Address Version History problems.pptx, NOTE: impacts view, PDF & CLIB, Don't consider MVP but coul bean iteration (timeline: next year) → add to post MVP MURAL
  • Maybe later: Add at the end of the title ": a systematic review and meta-analysis (in JATS only?)
      • Another approach is enabling editing of the title in RevMan'

How much time do we estimate to implement this roadmap item?

Small = within 1 sprint = within 2 weeks, the estimate depends on whether it's possible to get the new heading structure into a RevMan 5 file as CCAs & Archie search still depend on the RevMan 5 file. We don't need to be able to import in reviewDB but the file needs to be valid.

This is a guesstimate made by the Review Production Team based on known information about the roadmap item and the capacity of the team at the time of estimation (2023-01-26).