Measures of outer setting constructs for implementation research: a systematic review and analysis of psychometric quality
| dc.contributor.author | McHugh, Sheena M. | |
| dc.contributor.author | Dorsey, Caitlin N. | |
| dc.contributor.author | Mettert, Kayne | |
| dc.contributor.author | Purtle, Jonathan | |
| dc.contributor.author | Bruns, Eric | |
| dc.contributor.author | Lewis, Cara C. | |
| dc.contributor.funder | National Institute of Mental Health | en |
| dc.contributor.funder | Fulbright Association | en |
| dc.contributor.funder | Health Research Board | en |
| dc.date.accessioned | 2022-05-09T15:10:22Z | |
| dc.date.available | 2022-05-09T15:10:22Z | |
| dc.date.issued | 2020-01 | |
| dc.date.updated | 2022-05-09T14:39:29Z | |
| dc.description.abstract | Background: Despite their influence, outer setting barriers (e.g., policies, financing) are an infrequent focus of implementation research. The objective of this systematic review was to identify and assess the psychometric properties of measures of outer setting used in behavioral and mental health research. Methods: Data collection involved (a) search string generation, (b) title and abstract screening, (c) full-text review, (d) construct mapping, and (e) measure forward searches. Outer setting constructs were defined using the Consolidated Framework for Implementation Research (CFIR). The search strategy included four relevant constructs separately: (a) cosmopolitanism, (b) external policy and incentives, (c) patient needs and resources, and (d) peer pressure. Information was coded using nine psychometric criteria: (a) internal consistency, (b) convergent validity, (c) discriminant validity, (d) known-groups validity, (e) predictive validity, (f) concurrent validity, (g) structural validity, (h) responsiveness, and (i) norms. Frequencies were calculated to summarize the availability of psychometric information. Information quality was rated using a 5-point scale and a final median score was calculated for each measure. Results: Systematic searches yielded 20 measures: four measures of the general outer setting domain, seven of cosmopolitanism, four of external policy and incentives, four of patient needs and resources, and one measure of peer pressure. Most were subscales within full scales assessing implementation context. Typically, scales or subscales did not have any psychometric information available. Where information was available, the quality was most often rated as â 1-minimalâ or â 2-adequate.â Conclusion: To our knowledge, this is the first systematic review to focus exclusively on measures of outer setting factors used in behavioral and mental health research and comprehensively assess a range of psychometric criteria. The results highlight the limited quantity and quality of measures at this level. Researchers should not assume â one size fits allâ when measuring outer setting constructs. Some outer setting constructs may be more appropriately and efficiently assessed using objective indices or administrative data reflective of the system rather than the individual. | en |
| dc.description.sponsorship | Health Research Board Health (Impact Scholarship 2017) | en |
| dc.description.status | Peer reviewed | en |
| dc.description.version | Published Version | en |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.citation | McHugh, S. M., Dorsey, C. N., Mettert, K., Purtle, J., Bruns, E. and Lewis, C. C. (2020) 'Measures of outer setting constructs for implementation research: a systematic review and analysis of psychometric quality'. Implementation Research and Practice, 1 , (20pp). doi: 10.1177/2633489520940022 | en |
| dc.identifier.doi | 10.1177/2633489520940022 | en |
| dc.identifier.endpage | 20 | en |
| dc.identifier.journaltitle | Implementation Research and Practice | en |
| dc.identifier.startpage | 1 | en |
| dc.identifier.uri | https://hdl.handle.net/10468/13158 | |
| dc.identifier.volume | 1 | en |
| dc.language.iso | en | en |
| dc.publisher | Sage | en |
| dc.rights | © The Author(s) 2020. This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://uk.sagepub.com/aboutus/openaccess.htm). | en |
| dc.rights.uri | https://creativecommons.org/licenses/by-nc/4.0/ | en |
| dc.subject | Implementation science | en |
| dc.subject | Systematic review | en |
| dc.subject | Measures | en |
| dc.subject | Scale | en |
| dc.subject | Psychometric | en |
| dc.subject | Incentive | en |
| dc.subject | Policy | en |
| dc.title | Measures of outer setting constructs for implementation research: a systematic review and analysis of psychometric quality | en |
| dc.type | Article (non peer-reviewed) | en |
