[Q3Q4-2024]

Roadmap




Product team OKRs

  1. Objective: Drive uptake of the focussed review format
    KR: When we switch the remaining reviews to FRF, there are no requests to roll them back to the old format
  2. Objective: Reduce opportunities for errors in submitted text
    KR: The number of reviews that pass the QA editor check for "Possible data entry errors" increases by 20%
    KR: The number of reviews that pass the QA editor check for "Key findings consistent across the summary versions" increases by 20%
  3. Objective: Improve the usability/stability of RevMan
    KR: Post-submission, users are 'somewhat satisfied' or 'very satisfied' in at least 95% of cases.
  4. Objective: Improve data interoperability with other tools in the review production ecosystem
    KR: An additional 2 tools support the import or export of RevMan data, including 1 guideline development tool.

Metrics





Reviews in long review format
2025-01-10279
2024-12-13300
2024-11-15332
2024-11-01345
2024-10-18354
2024-10-07361
2024-09-18382
2024-09-06394
2024-08-22411
2024-08-07430
2024-07-05471
2024-06-21474


Sprint Review - 10 Jan 2025

Sprint focus 🎯

Sprint goal 1: Dynamic analysis results available in the Abstract check mark button 

Sprint goal 2: Team understands permission model and it is released man running 

Demo

  1. Consistent UI behavior when searching/creating reviews 
  2. Update message when there is no project started on a Cochrane review
  3. Option to add new analysis in analysis group
  4. Link to relevant handbook chapters in analysis options
  5. Dynamic analysis results in Abstract and update on future improvements

Sprint Review -13 Dec 2024

Sprint focus 🎯

Sprint goal 1: Release dynamic analysis results check mark button 

Sprint goal 2: The team has a clear understanding of permission model man running 

Demo

Insert dynamic analysis results.

Goal

Reduce workload for authors and editors to keep reporting of analyses up-to-date, consistent between different parts of the review and in line with the Cochrane style manual.

Coming/considering:

  1. Insert in Abstract
  2. Support for subgrouped analyses (subgroups and stratified analyses)
  3. Prediction interval
  4. Include figure link
  5. Different unit of analysis than participants
  6. Certainty of evidence synched from SoF table
  7. P value (Consensus in the EPM team is to leave out the P value for heterogeneity altogether.)

Sprint Review -15 Nov 2024

Sprint focus 🎯

Sprint goal: automated management of projects on publication, reject and remove decision  check mark button 

Demo

Automated management of projects on publication, reject and remove decision

Goals:

  1. Save time for support who would otherwise manually close and open projects
  2. Protect income revenue for RevMan when a Cochrane review is rejected 

Reviews in RevMan need to have an active project to be editable. Once the ongoing migration of reviews from Archie to RevMan is complete we will have a clear idea of which reviews are truly active. This sprint has been focused on helping to manage project opening and closing automatically to manage the work involved in maintaining oversight of active reviews in Cochrane. 

Key changes:

  1. Authors will now need an invitation to update their Cochrane review after it is published
  2. A reject decision means the author no longer has edit rights and will need to buy a subscription to edit the review in RevMan 
  3. When a submission at review or protocol stage is marked as rejected or removed the existing project is closed 
  4. When a review at review stage is marked as published, the existing project is closed
  5. When a review at protocol stage is marked as published, the existing project is closed a new "Review/update" project is opened with the template marked as default
    1. Support is informed via Happyfox if a project fails to be started 

Adjustments to management of document roles

  • Require confirmation and link to editorial policy

 

Sprint Review -1st Nov 2024

Sprint focus 🎯

Sprint goal 1: Introduce editorial & production lock for reviews managed by RevMan check mark button 

Sprint goal 2: Help support find reviews in any organization check mark button 

Demo

Introduce editorial & production lock for reviews managed by RevMan

Goals

  1. Make sure authors and unit leads do not make changes to the review after submission and accept decision (unless they are asked to)
  2. Make sure copy editors have access to reviews in production

Permissions for reviews managed in RevMan

CES MEs - Always access to all Cochrane reviews

Copy editors - Access to reviews in production (accepted reviews)

Unit leads - Access to edit reviews in their unit before submission and during author proofs, otherwise view

Authors/Author support -  Access to edit reviews they have a role on before submission and during author proofs, otherwise view

When will these changes be available? 

The lock will be available when reviews are moved from Archie to RevMan.

From 11 November-2 December all reviews handled by Central Editorial Service will be moved to be managed in RevMan. Progressively, all reviews will display this lock.  

There are no other changes for editors – the lock will replicate the editorial phase. After 2 December, if editors see any submitted reviews which do not show the lock, please contact Cochrane Support. 

The new production workflow using the lock will be available on the central Editorial Manager site from 11 November. From that point, copy editors will no longer need to change the phase in Archie during copy editing.  

After 11 November, if copy editors see any Central Editorial Service reviews in copy editing which do not show the lock, please contact Cochrane Support. 

The small number of reviews remaining on group sites will continue to be managed in Archie, to avoid disruption for CRG Managing Editors completing editorial work. The lock will not display on these reviews. 

Sprint Review - 18th Oct 2024

Sprint focus 🎯

Manage document roles released and enabled man running 

Goals:  

  1. Allow author support roles to be managed (original goal) 
  2. Consolidate related functionality (manage invitations, change contact person) into the same dialog in order to shorten reviews' context menu 
  3. Allow multiple invitations to be sent swiftly 
  4. Give immediate feedback when a user is added or invited, to reassure that the operation was successful 

Demo

Sprint Review - 20th Sep 2024

Sprint focus 🎯

Complete new random effects methods check mark button 

Demo RevMan sprint demo-20240920_101543-Meeting Recording.mp4

  1. New method for calculating heterogeneity estimator (Tau2) - RevMan now offers two methods REML (new) and DL (old)
  2. Calculate and display confidence interval for heterogeneity estimate (Tau2) in the forest plot
  3. New method for calculating confidence interval for the summary estimate - RevMan now offers two methods HKSJ (new) and Wald (old) 
  4. Calculate and introduce prediction interval in the forest plot 



Sprint Review - 6th Sep 2024

Sprint focus 🎯

  • New heterogeneity estimation method - Restricted Maximum Likelihood (REML)man running 

Sprint Review - 23d Aug 2024 Liable Lion's mane mushrooms

Recording 

Sprint focus 🎯

  • New heterogeneity estimation method - Restricted Maximum Likelihood (REML)man running 

Demo

  • User defined footnotes for study-centric results
  • Calculate Standardized Mean Difference from Mean Difference (manual analyses)