How was the Engage with Impact Toolkit developed?
The Engage with Impact Toolkit was developed by the Evaluating Patient Engagement Working Group over a two-year period. The toolkit was developed in full collaboration with Working Group members who included patient, family and caregiver partners, government employees, engagement specialists and researchers. We also consulted with the broader patient engagement community. The development process is outlined below.
Literature Review
A review of the published and grey literature (e.g., reports, conference proceedings, government publications) was conducted to identify potential impacts of engagement and existing evaluation metrics. The results were shared with Working Group members who deliberated and discussed the value of the results including how they would apply to their own organizations, which impacts were most important and what was missing.
Concept Mapping
Recognizing the need for further input on the impacts of interest, a modified concept mapping process was completed. Working Group members identified other members of the patient, family and caregiver engagement community who could participate. Additionally, the Patient, Family and Caregiver Engagement Ontario Health Team (OHT) Community of Practice members were invited to participate. A brainstorming survey was sent to all identified participants. 23 individuals participated and were asked to provide as many responses as they wanted to the prompt: "when patient, family and caregiver partners are engaged in health system organizations, the impact that patient engagement and partnering has on people, programs, organizations and the health system is...". A list of 237 items were generated from these survey responses.
These items were sorted and combined where possible resulting in 81 unique items. The same individuals were then asked to complete a survey to rate the importance of each item; 24 individuals responded.
The results of the concept mapping were used to identify 8 key domains of interest with a number of items in each domain.
Working Group Deliberation
The results of the concept mapping process were presented to the Working Group for further discussion and deliberation. The Working Group feedback was used to further refine the list of items and domains.
Based on all sources of feedback, a final list of 35 potential core and supplementary items were identified. A final survey was sent to Working Group members requesting they rate these items one final time to determine which were most important. Based on these results, 8 core items (1 per domain) and 25 supplementary items were identified.