New HEDS Discussion Paper - Mapping the Health of Nation Outcomes Scale (HoNOS) onto the Recovering Quality of Life Utility Index (ReQoL-UI)

Anju Keetharuth and Donna Rowen

                                          Abstract

Dr Anju Devianee Keetharuth

Aim: The aim of this project is to develop and assess a mapping function to predict ReQoL-UI (a patient-reported mental health-specific preference-based measure) scores from HoNOS scores (clinician-reported measure, Health of Nation Outcomes Score).

Methods: Participants were recruited from 14 secondary mental health services in England, UK, and their clinician completed HoNoS. Mapping models were estimated using Ordinary Least Squares (OLS) on individual level and mean level data and different model specifications were explored. Model performance was assessed using mean absolute error (MAE), root mean square error (RMSE), percentage of observations with absolute errors greater than 0.1, and plots of the observed and predicted ReQoL-UI utilities and errors.

Results: Matched ReQoL-UI and HoNOS scores were collected for 649 participants. The sample comprised 56% inpatients, with overall mean ReQoL-UI utility of 0.683 and range from 1 to -0.195. Correlations between ReQoL-UI (items and utility) and HoNOS scores were moderate (0.2<r<0.4) or small (<0.2). The best model was OLS estimated using mean level data, with lowest MAE (0.046) and RMSE (0.056).

Discussion: There is little conceptual overlap between ReQoL-UI and HoNOS. They measure different concepts and, arguably, service users and clinicians, who complete the measures respectively, have different perspectives. Under these circumstances, caution is recommended when applying these estimates.        

Download the Discussion Paper here.     

Dr Donna Rowen

             

New HEDS Discussion Paper - Estimating a preference-based index for mental health from the Recovering Quality of Life (ReQoL) measure : valuation of ReQoL-UI

Anju Devianee Keetharuth, Donna Rowen, Jakob Bue Björner and John Brazier

Dr Anju Devianee Keetharuth

Abstract

Objectives There are increasing concerns about the appropriateness of generic preference-based measures to capture health benefits in the area of mental health. This study estimates preference weights for a new measure, Recovering Quality of Life (ReQoL-10), to better capture the benefits of mental health care.

Methods Psychometric analyses of a larger sample of mental health service users (n = 4266) using confirmatory factor analyses and item response theory (IRT) were used to derive a health state classification system and inform the selection of health states for utility assessment. A valuation survey with members of the UK public representative in terms of age, gender and region was conducted using face-to-face interviewer administered time-trade-off (TTO) with props. A series of regression models were fitted to the data and the best performing model selected for the scoring algorithm.

Results The ReQoL-UI classification system comprises six mental health items and one physical health (PH) item. Sixty-four health states were valued by 305 participants. The preferred model was a random effects model, with significant and consistent coefficients and best model fit. Estimated utilities modelled for all health states ranged from -0.195 (state worse than dead) to 1 (best possible state).

Conclusions The development of the ReQoL-UI is based on a novel application of IRT methods for generating the classification system and selecting health states for valuation. Conventional TTO was used to elicit utility values that are modelled to enable the generation of QALYs for use in cost-utility analysis of mental health interventions.

Download the HEDS Discussion Paper here

ScHARR Short Course - The Application of Psychometrics for Measuring Health Outcomes and Quality of Life

The Application of Psychometrics for Measuring Health Outcomes and Quality of Life - 2 part course (can be done together or individually)

Part 1: 2-day course - Mon 1st - Tues 2nd June 2020

Part 2: 3-day course - Weds 3rd - Fri 5th June 2020

Part 1: The aim of this 2 day course is to provide participants with an introduction to psychometrics as applied to health. It will cover the core psychometric and statistical methods used in scale construction and the development of multi-item patient-reported outcome measures (PROMs). Sessions will be delivered by external staff Professor Jakob Bue Bjorner - Optum Patient Insights and Georgina Jones - Leeds becket University, who have an international reputation in psychometric methods and questionnaire development, analysis and interpretation and ScHARR Staff Anju Keetharuth. The course will be interactive and practical. Sessions will be delivered using lectures and individual and small group practical exercises using real world examples.

By the end of this course participants should be able to:
Identify the key stages involved in scale construction and development
Understand the qualitative process involved in the development of a PROM and item generation
Describe the different ways of scoring and scaling a PROM and the theory underpinning these
Understand exploratory (EFA) and confirmatory (CFA) factor analysis and be able to carry out EFA using SPSS
Understand what is meant by reliability, validity, and responsiveness and be able to analyse and interpret these using SPSS
Explore the above concepts using datasets from a range of existing disease-specific and generic PROMs
Be aware of the use of different software other than SPSS where applicable.

Part 2: The aim of this 3 day course is to provide participants with an introduction to advanced psychometric models in analysis of multi-item patient-reported outcome measures (PROMs). The course will cover confirmatory factor analytic methods for categorical data, Rasch models, and other items response theory (IRT) models. Sessions will be delivered by external staff Jakob Bue Bjorner - Optum Patient Insights, who has an international reputation in advanced psychometric methods and ScHARR Staff Anju Kaeetharuth. The course will be interactive and practical. Sessions will be delivered using lectures and individual and small group practical exercises using real world examples.

By the end of this course participants should be able to:

Perform item-level confirmatory factor analysis (CFA) of PROMs using Mplus software
Understand the assumptions of CFA models, evaluate model fit, and revise the model
Understand the similarities and differences between CFA models, Rasch models and other IRT models
Perform IRT analyses using the Mplus software
Understand the assumptions of Rasch and IRT models and the principles for testing the models
Use results from IRT analyses to develop or select the optimal PROM for a particular research purpose
Be aware of the use of other software for CFA, Rasch and IRT analyses.

Early bird booking rate for these courses will close 1st April 2020. Standard booking will close 21st May 2020

Link to further information on Part 1 of the course https://www.sheffield.ac.uk/scharr/shortcourseunit/psychometrics-part1

Link to further information on Part 2 of the course https://www.sheffield.ac.uk/scharr/shortcourseunit/psychometrics-part2

ReQoL - Focus of UoS research feature

A team led by Professor John Brazier, together with colleagues from ScHARR – Dr Anju Keetharuth, Dr Jill Carlton, Dr Lizzie Taylor Buck and Janice Connell – and Professor Michael Barkham from the Department of Psychology, are the focus of one of the University's current research features, for their work with ReQoL.

For the full feature, please see link below.

https://www.sheffield.ac.uk/research/features/recovering-quality-life

Visit the ReQoL website

The Application of Psychometrics for Assessing Health Outcomes and Quality of Life - Advanced (Part 2) - 2 1/2 Days Course: Wednesday, 15th - Friday, 17th February 2017

Dr Anju Keetharuth

Following on from part one of the intermediate course which takes place earlier in the same week, Dr Anju Keetharuth from HEDS will lead on this 2.5 day course is to provide participants with an introduction to advanced psychometric models in analysis of multi-item patient-reported outcome measures (PROMs). The course will cover confirmatory factor analytic methods for categorical data, Rasch models, and other items response theory (IRT) models. Sessions will be delivered by external staff Georgina Jones - Leeds Beckett University and Jakob Bue Bjorner - Optum Patient Insights, who have an international reputation in advanced psychometric methods. The course will be interactive and practical. Sessions will be delivered using lectures and individual and small group practical exercises using real world examples.

Who will benefit from this course?

The course content is aimed at participants with basic knowledge of psychometrics who want to apply advanced methods in scale construction and evaluation. The course content is set at an intermediate/advanced level. It will focus on modern psychometric methods: factor analysis for categorical data, Rasch models, and other IRT models. It will be relevant to researchers, students, clinicians and other health care professionals and members of the pharmaceutical industry interested in using or developing PROMs.

Learning Outcomes

By the end of this course participants should be able to:

• Perform item-level confirmatory factor analysis (CFA) of PROMs using Mplus software
• Understand the assumptions of CFA models, evaluate model fit, and revise the model
• Understand the similarities and differences between CFA models, Rasch models and other IRT models
• Perform IRT analyses using the Mplus software
• Understand the assumptions of Rasch and IRT models and the principles for testing the models
• Use results from IRT analyses to develop or select the optimal PROM for a particular research purpose
• Be aware of the use of other software for CFA, Rach and IRT analyses.

Course Materials

Participants are asked to supply their own Laptop throughout the course. Participants will work on laptops using Mplus during the course. An Mplus demo version will be provided during the course for participants who do not have Mplus.

All course materials will be provided on a USB (plus hard copies of handouts/exercises as required for the course).

Prior Learning/Entry Requirements

Participants should have completed Part 1 of this course (which runs immediately prior to this course) or have sufficient suitable experience or other qualification.

Participants who wish to join the course without completing Part 1 should contact the Short Course Unit in the first instance. Approval from the Course Leader is required for all bookings who will not be completing Part 1, prior to making their booking. 

Course Faculty

Anju Keetharuth is the Course Leader for this course.

Jakob Bjorner and Georgina Jones.

Can't make the date? Get updated on future dates by registering interest in the course here

Dates

PART 1 - 2.5-day course: Monday, 13th - Wednesday, 15th February 2017

PART 2 - 2.5-day course: Wednesday, 15th - Friday, 17th February 2017

Times

TBC

FEES - Part 1

£990 - Early Bird Fee - For bookings received on or before Sunday, 11th December 2016

£1,290 - Standard Fee - For bookings received on or after Monday, 12th December 2016

FEES - Part 2

£840 - Early Bird Fee - For bookings received on or before Sunday, 11th December 2016

£1,140 - Standard Fee - For bookings received on or after Monday, 12th December 2016

FEES - Discounted Full Course

£1,540 - Early Bird Fee - For bookings received on or before Sunday, 11th December 2016

£1,850 - Standard Fee - For bookings received on or after Monday, 12th December 2016

NB: All fees do not include any accommodation. We do have a preferential rate at Halifax Hall for our delegates (subject to availability). Booking details and contact information will be automatically provided upon receipt of your online booking (a booking reference will be given along with the name and contact details of the person this should be booked with, to ensure you receive our preferential rate of £65 per night/room).

Booking and Payment

Provisional bookings are now being accepted. Please email scharr-scu@sheffield.ac.uk to reserve your place. You will then be contacted once the course has gone live on our Online Store to finalise your booking.

Bookings are processed through our Online Store. Payment is by Credit/Debit Card or PayPal.

If you employer is paying your fees and they would prefer to be invoiced, then please select the Invoice option for the course and ensure that all invoice details are provided (contact email address, full address, purchase order number) and please also forward a copy of the Purchase Order to scharr-scu@sheffield.ac.uk.

If you have any queries relating to fees and payment, please do not hesitate to contact us.

Venue

Halifax Hall Hotel and Conference Centre, Endcliffe Vale Rd, Sheffield, S10 3ER. 

Halifax Hall

http://www.halifaxhall.co.uk/

Contact

For further information please do not hesitate to contact us via email at scharr-scu@sheffield.ac.uk

or call +44 (0)114 222 2968.