Publications
2024
Longworth, Giuliana R; Goh, Kunshan; Agnello, Danielle M; Messiha, Katrina; Beeckman, Melanie; Zapata-Restrepo, Jorge R; Cardon, Greet; Chastin, Sebastien; Giné-Garriga, Maria
A review of implementation and evaluation frameworks for public health interventions to inform co-creation: a Health CASCADE study Journal Article
In: Health Res Policy Sys, vol. 22, no. 1, 2024, ISSN: 1478-4505.
Abstract | Links | BibTeX | Tags: Evaluation
@article{Longworth2024b,
title = {A review of implementation and evaluation frameworks for public health interventions to inform co-creation: a Health CASCADE study},
author = {Giuliana R Longworth and Kunshan Goh and Danielle M Agnello and Katrina Messiha and Melanie Beeckman and Jorge R Zapata-Restrepo and Greet Cardon and Sebastien Chastin and Maria Giné-Garriga},
doi = {10.1186/s12961-024-01126-6},
issn = {1478-4505},
year = {2024},
date = {2024-12-00},
urldate = {2024-12-00},
journal = {Health Res Policy Sys},
volume = {22},
number = {1},
publisher = {Springer Science and Business Media LLC},
abstract = {Background
By including the needs and perspectives of relevant stakeholders, co-creation is seen as a promising approach for tackling complex public health problems. However, recommendations and guidance on how to plan and implement co-creation are lacking. By identifying and analysing existing implementation and evaluation frameworks for public health, this study aims to offer key recommendations for professional stakeholders and researchers wanting to adopt a co-creation approach to public health interventions.
Methods
Firstly, PubMed and CINAHL databases were screened for articles introducing original implementation and evaluation frameworks for public health interventions. Backwards snowballing techniques were applied to the included papers. Secondly, identified frameworks were classified and relevant data extracted, including steps and constructs present in the frameworks. Lastly, recommendations were derived by conducting thematic analysis on the included frameworks.
Results
Thirty frameworks were identified and data related to their nature and scope extracted. The frameworks’ prominent steps and constructs were also retrieved. Recommendations related to implementation and evaluation in the context of co-creation were included.
Conclusion
When engaging in co-creation, we recommend including implementation considerations from an early stage and suggest adopting a systems thinking as a way to explore multiple levels of influence, contextual settings and systems from an early planning stage. We highlight the importance of partnering with stakeholders and suggest applying an evaluation design that is iterative and cyclical, which pays particular attention to the experience of the engaged co-creators.},
keywords = {Evaluation},
pubstate = {published},
tppubtype = {article}
}
By including the needs and perspectives of relevant stakeholders, co-creation is seen as a promising approach for tackling complex public health problems. However, recommendations and guidance on how to plan and implement co-creation are lacking. By identifying and analysing existing implementation and evaluation frameworks for public health, this study aims to offer key recommendations for professional stakeholders and researchers wanting to adopt a co-creation approach to public health interventions.
Methods
Firstly, PubMed and CINAHL databases were screened for articles introducing original implementation and evaluation frameworks for public health interventions. Backwards snowballing techniques were applied to the included papers. Secondly, identified frameworks were classified and relevant data extracted, including steps and constructs present in the frameworks. Lastly, recommendations were derived by conducting thematic analysis on the included frameworks.
Results
Thirty frameworks were identified and data related to their nature and scope extracted. The frameworks’ prominent steps and constructs were also retrieved. Recommendations related to implementation and evaluation in the context of co-creation were included.
Conclusion
When engaging in co-creation, we recommend including implementation considerations from an early stage and suggest adopting a systems thinking as a way to explore multiple levels of influence, contextual settings and systems from an early planning stage. We highlight the importance of partnering with stakeholders and suggest applying an evaluation design that is iterative and cyclical, which pays particular attention to the experience of the engaged co-creators.
Longworth, Giuliana R; de Boer, Janneke; Goh, Kunshan; Agnello, Danielle M; McCaffrey, Lauren; Restrepo, Jorge R Zapata; An, Qingfan; Chastin, Sebastien; Davis, Aaron; Altenburg, Teatske M; Verloigne, Maite; Giné-Garriga, Maria
Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components Journal Article
In: BMJ Glob Health, vol. 9, no. 7, 2024, ISSN: 2059-7908.
Abstract | Links | BibTeX | Tags: Evaluation
@article{Longworth2024c,
title = {Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components},
author = {Giuliana R Longworth and Janneke de Boer and Kunshan Goh and Danielle M Agnello and Lauren McCaffrey and Jorge R Zapata Restrepo and Qingfan An and Sebastien Chastin and Aaron Davis and Teatske M Altenburg and Maite Verloigne and Maria Giné-Garriga},
doi = {10.1136/bmjgh-2023-014483},
issn = {2059-7908},
year = {2024},
date = {2024-07-00},
urldate = {2024-07-00},
journal = {BMJ Glob Health},
volume = {9},
number = {7},
publisher = {BMJ},
abstract = {Background
Co-creation is seen as a way to ensure all relevant needs and perspectives are included and to increase its potential for beneficial effects and uptake process evaluation is crucial. However, existing process evaluation frameworks have been built on practices characterised by top-down developed and implemented interventions and may be limited in capturing essential elements of co-creation. This study aims to provide a review of studies planning and/or conducting a process evaluation of public health interventions adopting a co-creation approach and aims to derive assessed process evaluation components, used frameworks and insights into formative and/or participatory evaluation.
Methods
We searched for studies on Scopus and the Health CASCADE Co-Creation Database. Co-authors performed a concept-mapping exercise to create a set of overarching dimensions for clustering the identified process evaluation components.
Results
54 studies were included. Conceptualisation of process evaluation included in studies concerned intervention implementation, outcome evaluation, mechanisms of impact, context and the co-creation process. 22 studies (40%) referenced ten existing process evaluation or evaluation frameworks and most referenced were the frameworks developed by Moore et al (14%), Saunders et al (5%), Steckler and Linnan (5%) and Nielsen and Randall (5%).
38 process evaluation components were identified, with a focus on participation (48%), context (40%), the experience of co-creators (29%), impact (29%), satisfaction (25%) and fidelity (24%).
13 studies (24%) conducted formative evaluation, 37 (68%) conducted summative evaluation and 2 studies (3%) conducted participatory evaluation.
Conclusion
The broad spectrum of process evaluation components addressed in co-creation studies, covering both the evaluation of the co-creation process and the intervention implementation, highlights the need for a process evaluation tailored to co-creation studies. This work provides an overview of process evaluation components, clustered in dimensions and reflections which researchers and practitioners can use to plan a process evaluation of a co-creation process and intervention.},
keywords = {Evaluation},
pubstate = {published},
tppubtype = {article}
}
Co-creation is seen as a way to ensure all relevant needs and perspectives are included and to increase its potential for beneficial effects and uptake process evaluation is crucial. However, existing process evaluation frameworks have been built on practices characterised by top-down developed and implemented interventions and may be limited in capturing essential elements of co-creation. This study aims to provide a review of studies planning and/or conducting a process evaluation of public health interventions adopting a co-creation approach and aims to derive assessed process evaluation components, used frameworks and insights into formative and/or participatory evaluation.
Methods
We searched for studies on Scopus and the Health CASCADE Co-Creation Database. Co-authors performed a concept-mapping exercise to create a set of overarching dimensions for clustering the identified process evaluation components.
Results
54 studies were included. Conceptualisation of process evaluation included in studies concerned intervention implementation, outcome evaluation, mechanisms of impact, context and the co-creation process. 22 studies (40%) referenced ten existing process evaluation or evaluation frameworks and most referenced were the frameworks developed by Moore et al (14%), Saunders et al (5%), Steckler and Linnan (5%) and Nielsen and Randall (5%).
38 process evaluation components were identified, with a focus on participation (48%), context (40%), the experience of co-creators (29%), impact (29%), satisfaction (25%) and fidelity (24%).
13 studies (24%) conducted formative evaluation, 37 (68%) conducted summative evaluation and 2 studies (3%) conducted participatory evaluation.
Conclusion
The broad spectrum of process evaluation components addressed in co-creation studies, covering both the evaluation of the co-creation process and the intervention implementation, highlights the need for a process evaluation tailored to co-creation studies. This work provides an overview of process evaluation components, clustered in dimensions and reflections which researchers and practitioners can use to plan a process evaluation of a co-creation process and intervention.
Coming Soon...
- YoCo conceptual framework: Integrating interdisciplinary approaches for the design and evaluation of a youth-centered co-creation project towards healthy urban public space.
- Adolescents’ experiences of a shortened co-creation process to adapt a healthy sleep intervention – A Health CASCADE study
- Co-creating a multicomponent complex intervention to improve the experience of hospitalization for people with chronic obstructive pulmonary disease (COPD) using intervention mapping
- Explore the experience and expectations of hospital care during acute exacerbations of chronic obstructive pulmonary disease: Perspective of patients
- Teachers’ experiences with a co-creation process to develop an implementation plan for a school-based intervention targeting healthy sleep in adolescents: a Health CASCADE study
- Process evaluation of a school-based intervention to promote healthy sleep among adolescents: comparison between a school with a co-created implementation plan and a school with a standard implementation plan (a Health CASCADE study).
- Dissolving implementation barriers: a co-creation process with teachers to refine an implementation plan of an intervention targeting physical activity and sedentary behaviour in adolescents (a Health CASCADE study).
- Actualizing child and adolescent empowerment in participatory action research for health promotion: a six-element framework
- Designing a communication tool for primary care: Understanding patient needs and experiences using collaborative research methods
- Predictive Modelling of a Digital Health Intervention’s Impact on Obstetrics Care Costs: Insights from a Randomized Controlled Trial
- The dark side of co-creation for health promotion interventions: insights from Health CASCADE researchers
- Implementing a youth centred approach to placemaking to co-create a socially and physically activating public space for teens – A Health Cascade Study
- Enabling Evidence-based Public Health Co-creation through Large Language Model and Deep learning systems: A Health CASCADE study.
- Optimizing Large Language Models (LLM) for Domain-Specific Tasks through Dataset Creation, Model Fine-tuning and Preference Optimization: A Health CASCADE Study
- Leveraging Large Language Models for Patient Profile Generation, Literature Retrieval and Medical Information Summarization: A Health CASCADE Study
- Passage Retrieval and Question Answering systems to support evidence-based co-creation methodology: A Health CASCADE Study
- Engage4Change: Co-creating indoor common spaces in care homes and outdoor community spaces to improve movement behaviour and reduce social isolation: study protocol within the Health CASCADE study.
- Enriching the Existing Knowledge about Co-creation: Identifying Dimensions of Co-creation using Explicit Theory in Various Research Fields
- Towards System-Level Co-creation in eHealth Tool Development: Case Study of developing an eHealth tool for people with COPD.
- Revising the PRODUCES Framework to meet the current needs in co-creation for Public Health Intervention Design and Implementation
- The experiences of school staff with their involvement in the co-creation of school-based actions: A thematic synthesis of qualitative studies to inform Health CASCADE
- Co-creating digital tools in health care: Results from three case studies
- Elicited Insights from International Academics and a Dutch NGO on Youth Participatory Action Research – A Health CASCADE Study
- Adapting co-created interventions: usability of the ADAPT framework and recommendations. A Health CASCADE study
- Empirical ethical decision-making among those involved in co-creation practice: a Health CASCADE critical scoping review
- Comparison of Co-creation Methods in Research and in Practice: A Health CASCADE Study
- Establishing a Set of Evaluation Criteria for Assessing the Effectiveness of Co-creation Methods: A Health CASCADE Study
- Ecosystem of Digital Technologies for Co-creation (EDTC): A Health CASCADE taxonomy
- Co-creating statistical analysis pipelines in psychology: Applications in processing and analysing data for digital health tools
- Impact of co-creation methods on user engagement in digital health tools
- An end-to-end transcription and summarisation system to support the co-creation process
- Scoping review of needs for digital technologies in co-creation
- Leveraging Large Language Models for Patient Profile Generation, Literature Retrieval and Medical Information Summarization: A Health CASCADE Study
- A Health CASCADE assessment of digital technological needs for co-creation
- A Cross-Case Comparative Study of Co-Creation Experiences in Three Scottish SMEs.
- Adolescents’ experiences of a shortened co-creation process to adapt a healthy sleep intervention – A Health CASCADE study
- How to set up a co-creation protocol? Roadmap from a Health CASCADE study on sedentary behaviour in Scottish workplaces
The Iteration Of Three Co-Creation Processes From A Health CASCADE Study On Sedentary Behaviour In Scottish Workplaces - Evaluating The Sustainability And Co-created Solutions of Three Co-Creation Processes From A Health CASCADE Study On Sedentary Behaviour In Scottish Workplaces
- Evaluating The Effect Of Co-Created Interventions To Reduce Sedentary Behaviour In Scottish Workplaces: A Health CASCADE Study
- Ecosystem of Digital Technologies for Co-creation (EDTC): A Health CASCADE taxonomy
- Youth perspectives on the ethics of co-creation: a qualitative description  
- Grey Literature Scoping Review: A Synthesis on Participatory Methodologies in Aging Underrepresented Groups to Address Dementia
- Co-creation meets Critical Realism: Reflections and Recommendations Following a Participatory Workshop with Underrepresented Individuals for a Dementia Project
- Co-design and co-creation with people with disabilities
Sign up for our newsletter
Hear from Health CASCADE and contribute to the development of a co-creation methodology