2023Q1

Sprint plan

Sprint startEpic/backlog item
30/01/2023Remove dependencies on RevMan 5 and RevMan 5 format/Supplementary materials
13/02/2023Supplementary materials
27/02/2023Supplementary materials
13/03/2023Supplementary materials
27/03/2023Supplementary materials
10/04/2023

Prepare to remove check in/check out to RevMan 5(release 25/4)

House rules



Agenda Sprint demo

  1. Key learnings and decisions

  2. Progress towards quarerly targets

Sprint started  

Update

  • Ready to retire RevMan 5 (star)
    • Development work completed
    • KB updated to remove mentions of RevMan 5
    • Training pages to be updated & link to download RevMan 5 removed
    • First message sent out to authors and core staff
  • Preparation of training materials & webinars for launch of study-centric data workflow is in progress
  • Development for data package completed (comms & KB articles in progress)
  • Flat reference list implemented
  • Specification and refinement for competing priorities in progress
    • Tooltips to support uptake of study-centric data (specification and refinement needed)
    • Improvements to import of references (specifications almost completed, estimate on 24/4)
    • GRADEpro data package import (add ids to overall estimates and settings & subgroup sheets) (estimate on 24/4?) 
    • Subgroup by intervention (specifications in progress, estimate TBA)
    • DTA improvements (specified, not refined)

Key learnings & decisions

  • Misunderstanding of suggested solution for working with citations; expected renumbering to have been completed in RevMan after submission
    • Check implications with stakeholders - how acceptable is it to not renumber on submission?
    • Discuss effort of implementing renumbering (only after submission)
    • Compare value with other improvements
  • Identified that since authors should complete Review criteria section in protocol stage, it should not be greyed out in protocol stage (revert this change)
  • New ideas for left hand navigation & showing supplementary materials in RevMan identified
    • Mockups to be completed 25/4
    • Feedback from user testing to be incorporated
    • Deep dive planned for 27/4 2h to discuss new ideas and go through user journey step by step
    • Need to invest more than usual in preparing stories next sprint after deep dive to have them ready for the sprint after

Progress on epic level

Remove dependencies on RevMan 5 & Retire RevMan 5

Includes enabling study-centric data and updating PICO tab. 

Estimated completion date: 2023-05-19 - on track

Ideal completion date: 2023-04-25, 2023-05-19

CompletedRemainingTotalUnestimated stories
573600

Samples for supplementary materials

Estimated completion date: 2023-04-07 - completed

Ideal completion date: 2023-03-27

Completion date: 2023-04-21

CompletedRemainingTotalUnestimated stories
200200

Generate JATS & supplementary materials

Estimated completion date: 2023-05-19  0.6 sprints ~6 days off track (based on velocity, capacity and work left for epic, excluding any work on competing priorities)

Ideal completion date:  2023-05-05

CompletedRemainingTotalUnestimated stories
48521000

Enable supplementary materials

Estimated completion date: TBD

Ideal completion date: 2023-06-16 2023-06-02

Templates

Estimated completion date: TBD

Ideal completion date: 2023-06-16

Heading structure changes

Estimated completion date: TBD

Ideal completion date: 2023-06-30

Competing priorities (all relate to matching experience with RevMan 5)

  • Improvements to import of references 
  • DTA improvements (estimate TBA)
  • GRADEpro import
  • Subgroup by intervention (estimate TBA)


Activity panel last 30 days

Reviews with advanced features in Cochrane (only use RevMan Web)

  • In total: 409 (+11)  398
  • GRADEPro integration: 276 (+12)
  • RoB 2: 223 (+8)
  • Study-centric data: 43 (+5)

Reviews in Porto

  •  194 (+36)

Number of study-centric analyses (Cochane & external users)

  • 951 (+157)


Overall activity RevMan Web vs. RevMan 5 (2 years)

Sprint started  

Update

  • JATS for main article without references can now be generated
  • All tickets related to main article and supplementary materials refined and estimated
  • All tickets to remove dependencies on RevMan 5 library completed
  • Initial story break down for enabling supplementary materials completed
  • New ideas for alternative left-hand navigation solutions identifed
  • Feedback from internal stakeholders on citation management
  • User testing completed by Sarah, update onr results next week

Key learnings & decisions

  • Decision: Numbers to be inserted when citing in RevMan Web 

Progress on epic level

Remove dependencies on RevMan 5 & Retire RevMan 5

Includes enabling study-centric data and updating PICO tab. 

Estimated completion date: 2023-05-19

Ideal completion date: 2023-04-25, 2023-05-19

CompletedRemainingTotalUnestimated stories
3918570

Samples for supplementary materials

Estimated completion date: 2023-04-07

Ideal completion date: 2023-03-27

CompletedRemainingTotalUnestimated stories
155200

Generate JATS & supplementary materials

Estimated completion date: 2023-05-05 (based on velocity, capacity and work left for epics above)

Ideal completion date:  2023-05-05 (To be confirmed)

CompletedRemainingTotalUnestimated stories
31691000

Enable supplementary materials

Estimated completion date: TBD

Ideal completion date: 2023-06-16 2023-06-02

Templates

Estimated completion date: TBD

Ideal completion date: 2023-06-16

Heading structure changes

Estimated completion date: TBD

Ideal completion date: 2023-06-30

Competing priorities (all relate to matching experience with RevMan 5)

  • Improvements to import of references (estimate TBA)
  • DTA improvements (estimate TBA)
  • GRADEpro import (estimate TBA)


Activity panel last 30 days

Reviews with advanced features in Cochrane (only use RevMan Web)

  • In total:  398
  • GRADEPro integration: 264
  • RoB 2: 215
  • Study-centric data: 38

Reviews in Porto

  • 158

Number of study-centric analyses (Cochane & external users)

  • 794


Overall activity RevMan Web vs. RevMan 5 (2 years)

Update this sprint

  • User testing citations completed & results shared
  • Mockups for user testing related to enabling study-centric data and supplementary materials handed over to Sarah
  • Sprint board update

Key learnings & decisions

  • Results user testing citations, no need to implement renumbering when editing for MVP, (meeting to be scheduled next week to decide approach for what to show instead)
  • Tracked changes and yellow markings included in main article and supplementary materials
  • Should notes be included in main article and supplementary materials?
    • Requires decisions on where to place notes in supplementary materials
    • Note system is not ideal according to user feedback
    • Could decide to implement inline commenting system (and not include in view?), risk of scope creep
  • Internal links in the submission PDF have never worked → TOC blocked until fixed, handed over to Gert and CIT team
  • UX feedback from Wiley resulted in adding move to top of page for supplementary materials, any changes to risk of bias tables excluded from MVP 
  • Estimates of stories accurate?

Progress on epic level

Remove dependencies on RevMan 5

Estimated completion date: 2023-04-07

Ideal completion date: 2023-04-25

Samples for supplementary materials

Estimated completion date: 2023-02-24

Ideal completion date: 2023-03-27

Generate JATS & supplementary materials

Estimated completion date: 2023-05-05 (based on velocity, capacity and work left for epics above)

Ideal completion date:  2023-05-05 (To be confirmed)

Enable supplementary materials

Estimated completion date: TBD

Ideal completion date: 2023-06-16

________________________________________________________

Activity panel last 30 days

Reviews with advanced features in Cochrane (only use RevMan Web)

  • In total:  
  • GRADEPro integration: 
  • RoB 2: 
  • Study-centric data: 

Reviews in Porto

Number of study-centric analyses (Cochane & external users)

Overall activity RevMan Web vs. RevMan 5 (2 years)

Sprint started  

Sprint review

Velocity: 36
Capacity: 32

  • 9 tickets in Done (4 planned, 2 unplanned 3E2E tests, 1 bug);  30 story points
  • 6 planned stories not done:
    • 3 in code review (25 points)
    • 1 in test 
    • 1 in sign off
  • 8 unplanned tickets in progress (2 points)
  • E2E tests (6 points)
  • 4 user testing interviews conducted to inform decision on citation management (2 planned next week)

Progress towards quarterly targets

See RevMan Web Quarterly report (visuals in two sprints).



Activity panel last 30 days

Reviews with advanced features in Cochrane (only use RevMan Web)

  • In total:  
  • GRADEPro integration: 
  • RoB 2: 
  • Study-centric data: 

Reviews in Porto

Number of study-centric analyses (Cochane & external users)

Overall activity RevMan Web vs. RevMan 5 (2 years)

Sprint started  

Review of Q4 2023

RevMan Web roadmap

https://trello.com/b/2WiJIzpq/revman-web-roadmap

Work completed in the sprint

Feedback

  • LG & ER: I need to add more advanced PRISMA flowcharts 
  • LG: it would be helpful to see study names for citations while editing text


Activity panel last 30 days

Reviews with advanced features in Cochrane (only use RevMan Web)

  • In total:  368 (+10)
  • GRADEPro integration: 251 (+8)
  • RoB 2: 199 (+3)
  • Study-centric data: 20 (+2)

Reviews in Porto

  • 103 (+27)

Number of study-centric analyses (Cochane & external users)

  •  703 (+92)

Overall activity RevMan Web vs. RevMan 5 (2 years)