Early results from our PY1 evaluation, including changes in screening rates, suggest the CRCCP is working; program reach was measurable and substantial, clinics enhanced EBIs in place or implemented new ones in clinics, and we observed an increase in the overall average screening rate.

DeGroff A, Sharma K, Satsangi A, Kenney K, Joseph D, Ross K, Leadbetter S, Helsel W, Kammerer W, Firth R, Rockwell T, Short W, Tangka F, Wong F, Richardson L. Increasing Colorectal Cancer Screening in Health Care Systems Using Evidence-Based Interventions. Prev Chronic Dis. 2018 Aug 9;15:E100. doi: 10.5888/pcd15.180029. PMID: 30095405; PMCID: PMC6093266.

To assist public health organizations in correctly implementing EBIs, it is critical to offer intervention-specific guidance in addition to general instructions on how to use evidence as suggested by the Interactive Systems Framework.[[14]]

Escoffery C, Hannon P, Maxwell AE, Vu T, Leeman J, Dwyer A, Mason C, Sowles S, Rice K, Gressard L. Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S. BMC Public Health. 2015 Jan 31;15:49. doi: 10.1186/s12889-015-1386-1. PMID: 25636329; PMCID: PMC4318175.

Although there is fairly moderate use of EBIs among the grantees, greater adoption and quality implementation of these strategies may be realized through training and individualized TA provided by CDC, other cancer-focused national organizations, and cancer experts.

Escoffery C, Hannon P, Maxwell AE, Vu T, Leeman J, Dwyer A, Mason C, Sowles S, Rice K, Gressard L. Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S. BMC Public Health. 2015 Jan 31;15:49. doi: 10.1186/s12889-015-1386-1. PMID: 25636329; PMCID: PMC4318175.

Meeting grantees’ training and TA needs is important, as their capacity to implement EBIs will be crucial for meeting the program goal of increasing levels of CRC screening population-wide.

Escoffery C, Hannon P, Maxwell AE, Vu T, Leeman J, Dwyer A, Mason C, Sowles S, Rice K, Gressard L. Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S. BMC Public Health. 2015 Jan 31;15:49. doi: 10.1186/s12889-015-1386-1. PMID: 25636329; PMCID: PMC4318175.

A large proportion of CRCCP grantees expressed the need for training with regards to specific EBIs, especially system-level EBIs and provider-directed EBIs to promote CRC screening. Grantees rated these EBIs as more difficult to implement than client-oriented EBIs and fewer grantees reported use of these EBIs.

Escoffery C, Hannon P, Maxwell AE, Vu T, Leeman J, Dwyer A, Mason C, Sowles S, Rice K, Gressard L. Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S. BMC Public Health. 2015 Jan 31;15:49. doi: 10.1186/s12889-015-1386-1. PMID: 25636329; PMCID: PMC4318175.

Individualized TA can provide more in-depth information on how to implement a specific strategy and also address unique contextual factors (e.g., organizational systems such as paper records or electronic medical records, staffing, resources). These combinations of prevention support reported by grantees match the common strategies found in other studies that promote the adoption of EBIs such as in person training and TA,[[29,30]] packaged materials or recommendations, [[31,32]] and conference calls.[[33]] These prevention supports have been proven to increase adoptions of evidence-based prevention strategies.[[31,32,34]]

Escoffery C, Hannon P, Maxwell AE, Vu T, Leeman J, Dwyer A, Mason C, Sowles S, Rice K, Gressard L. Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S. BMC Public Health. 2015 Jan 31;15:49. doi: 10.1186/s12889-015-1386-1. PMID: 25636329; PMCID: PMC4318175.

Many grantees also noted that working with providers was difficult given challenges in changing their systems or practice patterns and that they are often overburdened and have limited time.

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn M, Leeman J, Carvalho ML, Pfeiffer DJ, Dwyer A, Fernandez ME, Vernon SW, Liang L, DeGroff A. Colorectal Cancer Control Program grantees' use of evidence-based interventions. Am J Prev Med. 2013 Nov;45(5):644-8. doi: 10.1016/j.amepre.2013.06.010. PMID: 24139779; PMCID: PMC4618374.

Overall, more grantees used small media and client reminders, and rated these EBIs easier to implement than interventions to reduce structural barriers, provider reminders, or provider assessment and feedback, which have been shown to have greater impact on improving screening rates than either small media or client reminders.[[13]]

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn M, Leeman J, Carvalho ML, Pfeiffer DJ, Dwyer A, Fernandez ME, Vernon SW, Liang L, DeGroff A. Colorectal Cancer Control Program grantees' use of evidence-based interventions. Am J Prev Med. 2013 Nov;45(5):644-8. doi: 10.1016/j.amepre.2013.06.010. PMID: 24139779; PMCID: PMC4618374.

Grantees were most likely to implement small media (96%) and client reminders (75%) and also rated these as easier to implement than the other strategies (Table 2).

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn M, Leeman J, Carvalho ML, Pfeiffer DJ, Dwyer A, Fernandez ME, Vernon SW, Liang L, DeGroff A. Colorectal Cancer Control Program grantees' use of evidence-based interventions. Am J Prev Med. 2013 Nov;45(5):644-8. doi: 10.1016/j.amepre.2013.06.010. PMID: 24139779; PMCID: PMC4618374.

Adoption and implementation of the provider-oriented EBIs (provider reminders, provider assessment and feedback) and reduction of structural barriers was more gradual, with a few new grantees adopting these EBIs each year. There was also more turbulence in terms of implementation for these EBIs, with several grantees discontinuing them before 2015. Notable reasons for discontinuing EBIs were lack of resources, partners’ priorities, and ending of funding. These less-frequently implemented and sustained EBIs may have more potential to affect screening rates.[[15,16,21)]] However, provider-oriented EBIs are more complex, which can reduce implementation.[[22]]

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn MJ, Gressard L, Dillon-Sumner L, Mason C, DeGroff A. Adoption and Implementation of Evidence-Based Colorectal Cancer Screening Interventions Among Cancer Control Program Grantees, 2009-2015. Prev Chronic Dis. 2019 Oct 10;16:E139. doi: 10.5888/pcd16.180682. PMID: 31603404; PMCID: PMC6795067.

We found that grantees’ reasons for discontinuing an EBI most often related to capacity issues. Context also may be an important factor. For instance, electronic health records systems were identified as a barrier to EBI implementation. This suggests that sustainability in clinic settings may be challenged when electronic health records systems cannot support integration of client and provider reminder systems as well as provider assessment and feedback reports.

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn MJ, Gressard L, Dillon-Sumner L, Mason C, DeGroff A. Adoption and Implementation of Evidence-Based Colorectal Cancer Screening Interventions Among Cancer Control Program Grantees, 2009-2015. Prev Chronic Dis. 2019 Oct 10;16:E139. doi: 10.5888/pcd16.180682. PMID: 31603404; PMCID: PMC6795067.

Across EBIs, many grantees mentioned successful partnerships as key facilitators to implementation. In many cases, grantees’ partners led implementation activities; in others, they provided connections, materials, or staff time.

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn MJ, Gressard L, Dillon-Sumner L, Mason C, DeGroff A. Adoption and Implementation of Evidence-Based Colorectal Cancer Screening Interventions Among Cancer Control Program Grantees, 2009-2015. Prev Chronic Dis. 2019 Oct 10;16:E139. doi: 10.5888/pcd16.180682. PMID: 31603404; PMCID: PMC6795067.

We found that most grantees adopted and implemented small media and client reminders early in the study period; most grantees also maintained these 2 EBIs through 2015. These client-oriented EBIs are often considered simpler to implement than the provider-oriented EBIs because they do not necessarily require partnerships with health systems or modifications to electronic health records.

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn MJ, Gressard L, Dillon-Sumner L, Mason C, DeGroff A. Adoption and Implementation of Evidence-Based Colorectal Cancer Screening Interventions Among Cancer Control Program Grantees, 2009-2015. Prev Chronic Dis. 2019 Oct 10;16:E139. doi: 10.5888/pcd16.180682. PMID: 31603404; PMCID: PMC6795067.

The EBIs listed above vary in terms of complexity and partnerships required. The client-oriented EBIs could be implemented directly by grantees or by their clinical or community partners. The provider-oriented EBIs may be more complex from the perspective of a typical grantee organization because they require 1 or more clinic or health system partners. In addition, implementing provider reminders or provider assessment and feedback may require working with or adapting electronic health records.

Hannon PA, Maxwell AE, Escoffery C, Vu T, Kohn MJ, Gressard L, Dillon-Sumner L, Mason C, DeGroff A. Adoption and Implementation of Evidence-Based Colorectal Cancer Screening Interventions Among Cancer Control Program Grantees, 2009-2015. Prev Chronic Dis. 2019 Oct 10;16:E139. doi: 10.5888/pcd16.180682. PMID: 31603404; PMCID: PMC6795067.

Implementation readiness — an organization’s combined capacity, commitment, and willingness to implement a new program, policy, or practice — facilitates implementation success.[[16–18]] Because public health resources are limited, identifying a clinic’s readiness to successfully implement and sustain interventions, as well as gaps in clinic resources or practices that need to be addressed before implementation, is critical. Such assessment practices can guide clinics to select interventions with the greatest potential for long-term sustainability, and in turn help maximize the impact of public health spending, optimize clinic success, reduce cancer disparities, and improve population health.

Hohl SD, Melillo S, Vu TT, Escoffery C, DeGroff A, Schlueter D, Ross LW, Maxwell AE, Sharma KP, Boehm J, Joseph D, Hannon PA. Development of a Field Guide for Assessing Readiness to Implement Evidence-Based Cancer Screening Interventions in Primary Care Clinics. Prev Chronic Dis. 2022 May 12;19:E25. doi: 10.5888/pcd19.210395. PMID: 35550244; PMCID: PMC9109642.

Key informants who represented current and previous recipients generally said that mixed-methods assessments conducted before implementation prepared them to use results to inform development of tailored action plans for EBI implementation and technical assistance with partners.

Hohl SD, Melillo S, Vu TT, Escoffery C, DeGroff A, Schlueter D, Ross LW, Maxwell AE, Sharma KP, Boehm J, Joseph D, Hannon PA. Development of a Field Guide for Assessing Readiness to Implement Evidence-Based Cancer Screening Interventions in Primary Care Clinics. Prev Chronic Dis. 2022 May 12;19:E25. doi: 10.5888/pcd19.210395. PMID: 35550244; PMCID: PMC9109642.

Program planners should carefully consider the potential reach and infrastructure costs of direct CRC screening services given available sources of funding, the size of the potential target population relative to the capacity and funding of program implementers, the selection of EBIs that maximize program effects while minimizing costs, and the ability of program implementers to leverage the resources of other public and nonpublic health organizations to facilitate implementation.

Joseph DA, DeGroff A. The CDC Colorectal Cancer Control Program, 2009-2015. Prev Chronic Dis. 2019 Dec 5;16:E159. doi: 10.5888/pcd16.190336. PMID: 31808418; PMCID: PMC6896829.

The authors found that most grantees implemented and maintained client-oriented EBIs such as client reminders and small media. Grantees considered these EBIs easier to implement than provider-oriented EBIs or reduction of structural barriers.

Joseph DA, DeGroff A. The CDC Colorectal Cancer Control Program, 2009-2015. Prev Chronic Dis. 2019 Dec 5;16:E159. doi: 10.5888/pcd16.190336. PMID: 31808418; PMCID: PMC6896829.

Third, we found that grantees allocated a disproportionate amount of their awards toward interventions with limited evidence for their effectiveness (eg, mass media), and grantees found client-oriented interventions, such as client reminders and small media, easier to implement.

Joseph DA, DeGroff A. The CDC Colorectal Cancer Control Program, 2009-2015. Prev Chronic Dis. 2019 Dec 5;16:E159. doi: 10.5888/pcd16.190336. PMID: 31808418; PMCID: PMC6896829.

Second, each EBI was modified to fit the needs and staffing model for this health system, which may have improved efficiency and impact.

Kim KE, Tangka FKL, Jayaprakash M, Randal FT, Lam H, Freedman D, Carrier LA, Sargant C, Maene C, Hoover S, Joseph D, French C, Subramanian S. Effectiveness and Cost of Implementing Evidence-Based Interventions to Increase Colorectal Cancer Screening Among an Underserved Population in Chicago. Health Promot Pract. 2020 Nov;21(6):884-890. doi: 10.1177/1524839920954162. Epub 2020 Sep 29. PMID: 32990041; PMCID: PMC7894065.

This study demonstrates that EBIs to increase CRC screening may be effective in clinics with fewer resources that serve populations who have poor access to or under-utilize health care services. Tailoring the EBIs to the needs and capacity of participating clinics may have been key to their effectiveness.

Kim KE, Tangka FKL, Jayaprakash M, Randal FT, Lam H, Freedman D, Carrier LA, Sargant C, Maene C, Hoover S, Joseph D, French C, Subramanian S. Effectiveness and Cost of Implementing Evidence-Based Interventions to Increase Colorectal Cancer Screening Among an Underserved Population in Chicago. Health Promot Pract. 2020 Nov;21(6):884-890. doi: 10.1177/1524839920954162. Epub 2020 Sep 29. PMID: 32990041; PMCID: PMC7894065.

Using a participatory implementation approach, a pre-implementation assessment was conducted to assess readiness for implementation of EBIs in order to increase CRC screening uptake.

Kim KE, Tangka FKL, Jayaprakash M, Randal FT, Lam H, Freedman D, Carrier LA, Sargant C, Maene C, Hoover S, Joseph D, French C, Subramanian S. Effectiveness and Cost of Implementing Evidence-Based Interventions to Increase Colorectal Cancer Screening Among an Underserved Population in Chicago. Health Promot Pract. 2020 Nov;21(6):884-890. doi: 10.1177/1524839920954162. Epub 2020 Sep 29. PMID: 32990041; PMCID: PMC7894065.

First, the pre-implementation process allowed the awardee to determine the infrastructure needs and their capacity to implement EBIs.

Kim KE, Tangka FKL, Jayaprakash M, Randal FT, Lam H, Freedman D, Carrier LA, Sargant C, Maene C, Hoover S, Joseph D, French C, Subramanian S. Effectiveness and Cost of Implementing Evidence-Based Interventions to Increase Colorectal Cancer Screening Among an Underserved Population in Chicago. Health Promot Pract. 2020 Nov;21(6):884-890. doi: 10.1177/1524839920954162. Epub 2020 Sep 29. PMID: 32990041; PMCID: PMC7894065.

Third, the effectiveness of these EBIs on CRC order and screening uptake was significant across all populations served and independent of insurance status.

Kim KE, Tangka FKL, Jayaprakash M, Randal FT, Lam H, Freedman D, Carrier LA, Sargant C, Maene C, Hoover S, Joseph D, French C, Subramanian S. Effectiveness and Cost of Implementing Evidence-Based Interventions to Increase Colorectal Cancer Screening Among an Underserved Population in Chicago. Health Promot Pract. 2020 Nov;21(6):884-890. doi: 10.1177/1524839920954162. Epub 2020 Sep 29. PMID: 32990041; PMCID: PMC7894065.

Findings from these surveys help in understanding and prioritizing the needs of public health agencies and their community partners in implementing evidence-based approaches to increase CRC screening. These needs might best be met by a multilevel approach that includes developing systems to help practice agencies promote long-lasting protective interventions (ie, screening), using effective and audience-specific information and education.[[17]]

Kreuter MW, Garibay LB, Pfeiffer DJ, Morgan JC, Thomas M, Wilson KM, Pieters J, Szczepaniec K, Scott A, Poor TJ. Small media and client reminders for colorectal cancer screening: current use and gap areas in CDC's Colorectal Cancer Control Program. Prev Chronic Dis. 2012;9:E131. doi: 10.5888/pcd9.110317. Epub 2012 Jul 19. PMID: 22814237; PMCID: PMC3469321.

National programs like CRCCP must balance the desire for a common campaign identity with the need to help state and local agencies customize resources to best serve their local mix of constituents. For example, CRCCP leaders and their partners must choose specific types of small media and client reminders and adapt them for different settings and populations.

Kreuter MW, Garibay LB, Pfeiffer DJ, Morgan JC, Thomas M, Wilson KM, Pieters J, Szczepaniec K, Scott A, Poor TJ. Small media and client reminders for colorectal cancer screening: current use and gap areas in CDC's Colorectal Cancer Control Program. Prev Chronic Dis. 2012;9:E131. doi: 10.5888/pcd9.110317. Epub 2012 Jul 19. PMID: 22814237; PMCID: PMC3469321.

Another explanation is that some EBIs and SAs can be integrated into clinical practice through clinics’ electronic health records systems. For example, by using data from electronic health records, patient reminder letters can be generated and personalized with each patient’s name and address, preferred language, the name of the patient’s primary care provider, and their history of CRC screening (eg, type and time of most recent test). Although it takes resources to program electronic health records and to set up these strategies initially, clinic health information technology and automated calling and texting systems can support implementation.[[27,28]]

Maxwell AE, DeGroff A, Hohl SD, Sharma KP, Sun J, Escoffery C, Hannon PA. Evaluating Uptake of Evidence-Based Interventions in 355 Clinics Partnering With the Colorectal Cancer Control Program, 2015-2018. Prev Chronic Dis. 2022 May 19;19:E26. doi: 10.5888/pcd19.210258. PMID: 35588522; PMCID: PMC9165474.

Uptake may be facilitated through technical and financial support provided by CRCCP awardees and integration of these strategies into clinic electronic health records systems.

Maxwell AE, DeGroff A, Hohl SD, Sharma KP, Sun J, Escoffery C, Hannon PA. Evaluating Uptake of Evidence-Based Interventions in 355 Clinics Partnering With the Colorectal Cancer Control Program, 2015-2018. Prev Chronic Dis. 2022 May 19;19:E26. doi: 10.5888/pcd19.210258. PMID: 35588522; PMCID: PMC9165474.

Among clinics that had EBIs and SAs in place by the end of each year, most considered those EBIs and SAs fully integrated into health systems or clinic operations and sustainable with or without CRCCP resources, especially in years 2 and 3 (Table 4).

Maxwell AE, DeGroff A, Hohl SD, Sharma KP, Sun J, Escoffery C, Hannon PA. Evaluating Uptake of Evidence-Based Interventions in 355 Clinics Partnering With the Colorectal Cancer Control Program, 2015-2018. Prev Chronic Dis. 2022 May 19;19:E26. doi: 10.5888/pcd19.210258. PMID: 35588522; PMCID: PMC9165474.

Sustainability and integration into clinic operations during the 3-year period increased most for activities that largely focused on providers, such as provider reminder systems, an increase of 14 percentage points from 79% in year 1 to 93% in year 3. Similarly, full integration of provider assessment and feedback increased 27 percentage points, from 69% to 96% of clinics; full integration of professional development or provider education increased by 16 percentage points, from 76% to 92% of clinics, followed by full integration of small media for an increase of 11 percentage points from 81% to 92% of clinics.

Maxwell AE, DeGroff A, Hohl SD, Sharma KP, Sun J, Escoffery C, Hannon PA. Evaluating Uptake of Evidence-Based Interventions in 355 Clinics Partnering With the Colorectal Cancer Control Program, 2015-2018. Prev Chronic Dis. 2022 May 19;19:E26. doi: 10.5888/pcd19.210258. PMID: 35588522; PMCID: PMC9165474.

Specifically, CRCCP grantees were twice as likely as nongrantees to use small media and 3 to 4 times more likely to use client reminders to increase community awareness of CRC screening guidelines and to increase community demand for CRC screening. The frequent use of small media and client reminders may be due to their ease of implementation and the fact that the CRCCP grantees are able to take the lead on the implementation of these activities.

Maxwell AE, Hannon PA, Escoffery C, Vu T, Kohn M, Vernon SW, DeGroff A. Promotion and provision of colorectal cancer screening: a comparison of colorectal cancer control program grantees and nongrantees, 2011-2012. Prev Chronic Dis. 2014 Oct 2;11:E170. doi: 10.5888/pcd11.140183. PMID: 25275807; PMCID: PMC4184085.

CRCCP grantees and nongrantees similarly rated the ease or difficulty of implementing Community Guide-recommended interventions. On a 5-point scale (1= very difficult, 2 = somewhat difficult, 3 = neutral, 4 = somewhat easy, 5 = very easy), patient-directed interventions were rated from 3.2 (reducing structural barriers) to 3.8 (small media), and provider-directed interventions were rated from 3.1 (provider assessment and feedback) to 3.5 (provider reminders) for all organizations combined.

Maxwell AE, Hannon PA, Escoffery C, Vu T, Kohn M, Vernon SW, DeGroff A. Promotion and provision of colorectal cancer screening: a comparison of colorectal cancer control program grantees and nongrantees, 2011-2012. Prev Chronic Dis. 2014 Oct 2;11:E170. doi: 10.5888/pcd11.140183. PMID: 25275807; PMCID: PMC4184085.

Fewer grantees used interventions directed at health care providers, such as provider assessment and feedback and provider reminders, which usually require collaboration with a partner organization.

Maxwell AE, Hannon PA, Escoffery C, Vu T, Kohn M, Vernon SW, DeGroff A. Promotion and provision of colorectal cancer screening: a comparison of colorectal cancer control program grantees and nongrantees, 2011-2012. Prev Chronic Dis. 2014 Oct 2;11:E170. doi: 10.5888/pcd11.140183. PMID: 25275807; PMCID: PMC4184085.

Given the limited nature of public health funding cycles, it is critical that health systems change efforts not only work to achieve population health outcomes but also dedicate time and resources to integrating effective strategies for increased likelihood of long-term sustainability. Integrating EBIs and SAs into existing FQHC processes proved essential to CRCCP sustainability.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Awardees also provided ongoing support to overcome the complexity of many EHR systems, a challenge among FQHCs that stalled their ability to optimize data management and reporting features.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Effective EHR use is foundational for institutionalizing EBIs and SAs and supports high-quality data management and reporting, thereby making continued implementation more feasible.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Study results support the need for awardees and implementation partners to provide health systems and clinics with tailored TA for their specific EHR system throughout the funding cycle to support EHR optimization for CRC screening, including avoiding common pitfalls (e.g., improper data entry, overly complex systems, changing EHRs) in ever-changing health care environments.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Respondents in this study largely discussed the utility of integration within existing team-based care structures. Clinics without team-based structures in place prior to implementing a CRC health systems change effort may require additional support as they adjust to providing integrated services.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Respondents described aspects of FQHC communication and culture that bolstered early implementation, including the importance of identifying champions from varied roles (e.g., QI expert, physician) during FQHC recruitment or early implementation who could help prioritize CRC screening within FQHCs.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Whether champions served in leadership or other FQHC staff roles, their ongoing promotion of EBIs and SAs, and clear and consistent leadership support, was paramount to prioritize these efforts. CRC screening champions have been associated with increased CRC screening rates and higher overall clinic performance.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Integrating evidence-based processes into multiple aspects of clinic operations—including funding allocation, staff training, care delivery models, and EHR systems—can be complex but improve the prospect of sustainability.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Our findings highlight the essential role of awardees in using readiness assessment findings to “meet clinics where they are” and mobilize strength-based partnerships—a critical tenet of public health service—to identify opportunities to integrate EBIs and SAs into existing clinic protocols.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

A key theme across all awardees was the essential nature of coordinating EBIs and SAs with existing FQHC practices to expand reach of clinics’ prevention efforts and increase efficiency.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

Respondents from three awardees described working with FQHCs to formally assess their implementation readiness during the application process or initial site visits. Although the scope of assessments and definitions of “readiness” varied, awardees generally examined: (a) CRC burden and risk, (b) CRC screening practices, (c) experience implementing similar EBIs and SAs, (d) effectively engaging partners, (e) current EHR systems, including problems with EHRs related to EBI implementation or measuring CRC screening rates, and (f) CRC screening rates. FQHC staff, in collaboration with awardees, used assessment results to inform selection of EBIs and SAs for implementation and address EHR issues.

Schlueter D, DeGroff A, Soloe C, Arena L, Melillo S, Tangka F, Hoover S, Subramanian S. Factors That Support Sustainability of Health Systems Change to Increase Colorectal Cancer Screening in Primary Care Clinics: A Longitudinal Qualitative Study. Health Promot Pract. 2023 Jul;24(4):755-763. doi: 10.1177/15248399221091999. Epub 2022 May 18. PMID: 35582930; PMCID: PMC9672135.

That non-FQHC clinics had higher screening rates than FQHCs may highlight the fact that the latter serve patients who are more disadvantaged with lower screening rates than other populations included in this study. Similarly, our finding that clinics with larger patient populations had higher screening rates suggests availability of resources and clinic capacity may underlie their performance.

Sharma KP, DeGroff A, Scott L, Shrestha S, Melillo S, Sabatino SA. Correlates of colorectal cancer screening rates in primary care clinics serving low income, medically underserved populations. Prev Med. 2019 Sep;126:105774. doi: 10.1016/j.ypmed.2019.105774. Epub 2019 Jul 15. PMID: 31319118; PMCID: PMC6904949.

All four priority EBIs were positively associated with clinic screening rates with statistical significance (Table 3).

Sharma KP, DeGroff A, Scott L, Shrestha S, Melillo S, Sabatino SA. Correlates of colorectal cancer screening rates in primary care clinics serving low income, medically underserved populations. Prev Med. 2019 Sep;126:105774. doi: 10.1016/j.ypmed.2019.105774. Epub 2019 Jul 15. PMID: 31319118; PMCID: PMC6904949.

Clinic champions, also found to be more common in Q4 clinics, can play an important role in facilitating EBI implementation.

Sharma KP, Leadbetter S, DeGroff A. Characterizing clinics with differential changes in the screening rate in the Colorectal Cancer Control Program of the Centers for Disease Control and Prevention. Cancer. 2021 Apr 1;127(7):1049-1056. doi: 10.1002/cncr.33325. Epub 2020 Dec 10. PMID: 33301173; PMCID: PMC9242539.

The EBIs used in the CRCCP can be implemented differently, and practitioners can benefit from ensuring that the interventions are appropriate for their unique clinic population and context.

Sharma KP, Leadbetter S, DeGroff A. Characterizing clinics with differential changes in the screening rate in the Colorectal Cancer Control Program of the Centers for Disease Control and Prevention. Cancer. 2021 Apr 1;127(7):1049-1056. doi: 10.1002/cncr.33325. Epub 2020 Dec 10. PMID: 33301173; PMCID: PMC9242539.

The study findings support that clinics may choose to implement strategies best suited for their unique circumstances and availability of resources.

Sharma KP, DeGroff A, Maxwell AE, Cole AM, Escoffery NC, Hannon PA. Evidence-Based Interventions and Colorectal Cancer Screening Rates: The Colorectal Cancer Screening Program, 2015-2017. Am J Prev Med. 2021 Sep;61(3):402-409. doi: 10.1016/j.amepre.2021.03.002. Epub 2021 May 14. PMID: 33994253; PMCID: PMC11008572.

This combined variable indicates that if a clinic directed any additional resources toward a specific EBI, regardless of whether the EBI was already in place or implemented new, then screening rates increased.

Sharma KP, DeGroff A, Maxwell AE, Cole AM, Escoffery NC, Hannon PA. Evidence-Based Interventions and Colorectal Cancer Screening Rates: The Colorectal Cancer Screening Program, 2015-2017. Am J Prev Med. 2021 Sep;61(3):402-409. doi: 10.1016/j.amepre.2021.03.002. Epub 2021 May 14. PMID: 33994253; PMCID: PMC11008572.

Having a clinic CRC screening champion was among the most important program components associated with increased CRC screening both in this analysis and in the earlier analysis.[[10]] The literature supporting the importance of champions in public health program effectiveness continues to grow.[[23]] Champions may be critical to improving CRC screening practice by promoting and prioritizing screening efforts, supporting sustained practice improvements guided by a vision and commitment, and making sure that individual practice changes fit together into a meaningful whole.[[2]]

Sharma KP, DeGroff A, Maxwell AE, Cole AM, Escoffery NC, Hannon PA. Evidence-Based Interventions and Colorectal Cancer Screening Rates: The Colorectal Cancer Screening Program, 2015-2017. Am J Prev Med. 2021 Sep;61(3):402-409. doi: 10.1016/j.amepre.2021.03.002. Epub 2021 May 14. PMID: 33994253; PMCID: PMC11008572.

Overall, the average clinic-level screening rate increased by 11.7 percentage points from baseline (33.5%) to PY2 (45.2%).

Sharma KP, DeGroff A, Maxwell AE, Cole AM, Escoffery NC, Hannon PA. Evidence-Based Interventions and Colorectal Cancer Screening Rates: The Colorectal Cancer Screening Program, 2015-2017. Am J Prev Med. 2021 Sep;61(3):402-409. doi: 10.1016/j.amepre.2021.03.002. Epub 2021 May 14. PMID: 33994253; PMCID: PMC11008572.

To determine appropriate EBIs and ensure clinic capacity to implement them, programs can conduct readiness assessments of clinics prior to implementation. However, clinics may lack resources to implement all available interventions, and may strategically choose EBIs that are less resource intensive.

Sharma KP, DeGroff A, Hohl SD, Maxwell AE, Escoffery NC, Sabatino SA, Joseph DA. Multi-component interventions and change in screening rates in primary care clinics in the Colorectal Cancer Control Program. Prev Med Rep. 2022 Jul 9;29:101904. doi: 10.1016/j.pmedr.2022.101904. PMID: 35864930; PMCID: PMC9294188.

A study of the first CRCCP from 2009 to 2015 found that many clinics were more likely to put in place EBIs that were easier to implement, and thus opportunities may exist to further increase screening uptake by facilitating implementation of other EBIs. (Hannon et al., 2013)

Sharma KP, DeGroff A, Hohl SD, Maxwell AE, Escoffery NC, Sabatino SA, Joseph DA. Multi-component interventions and change in screening rates in primary care clinics in the Colorectal Cancer Control Program. Prev Med Rep. 2022 Jul 9;29:101904. doi: 10.1016/j.pmedr.2022.101904. PMID: 35864930; PMCID: PMC9294188.

Average clinic CRC screening rates generally increased when clinics implemented or enhanced any number EBIs or SAs compared to clinics that did not newly implement or enhance any EBIs/SAs.

Sharma KP, DeGroff A, Hohl SD, Maxwell AE, Escoffery NC, Sabatino SA, Joseph DA. Multi-component interventions and change in screening rates in primary care clinics in the Colorectal Cancer Control Program. Prev Med Rep. 2022 Jul 9;29:101904. doi: 10.1016/j.pmedr.2022.101904. PMID: 35864930; PMCID: PMC9294188.

The ability to access and share accurate patient information, including EHR data, was identified as another factor supporting readiness for integrated implementation of CRC screening.

Soloe C, Arena L, Schlueter D, Melillo S, DeGroff A, Tangka F, Hoover S, Subramanian S. Factors that support readiness to implement integrated evidence-based practice to increase cancer screening. Implement Sci Commun. 2022 Oct 6;3(1):106. doi: 10.1186/s43058-022-00347-6. PMID: 36199117; PMCID: PMC9535984.

Similarly, data sharing among quality improvement (QI) teams promotes a collective understanding of where clinics stand on the delivery of health promotion activities that can foster understanding of opportunities to potentially improve these metrics through integrated implementation.

Soloe C, Arena L, Schlueter D, Melillo S, DeGroff A, Tangka F, Hoover S, Subramanian S. Factors that support readiness to implement integrated evidence-based practice to increase cancer screening. Implement Sci Commun. 2022 Oct 6;3(1):106. doi: 10.1186/s43058-022-00347-6. PMID: 36199117; PMCID: PMC9535984.

At the clinic level, a team-based approach was found to support staff ability to integrate implementation of EBIs and supporting activities to promote CRC screening with other patient care activities.

Soloe C, Arena L, Schlueter D, Melillo S, DeGroff A, Tangka F, Hoover S, Subramanian S. Factors that support readiness to implement integrated evidence-based practice to increase cancer screening. Implement Sci Commun. 2022 Oct 6;3(1):106. doi: 10.1186/s43058-022-00347-6. PMID: 36199117; PMCID: PMC9535984.

Across all interventions and multicomponent interventions, increases in the overall FQHC screening uptake ranged from 4.9 to 26.7 percentage points. Each FQHC implemented interventions that increased CRC screening among its low-income population.

Subramanian S, Tangka FKL, Hoover S. Role of an Implementation Economics Analysis in Providing the Evidence Base for Increasing Colorectal Cancer Screening. Prev Chronic Dis. 2020 Jun 25;17:E46. doi: 10.5888/pcd17.190407. PMID: 32584756; PMCID: PMC7316416.

Third, staff turnover was seen as a major barrier to both implementation success and sustainability. The burden consists of the need to train new staff, the loss of institutional knowledge, and the need to rebuild informal communication channels that are often required for coordination of multilevel interventions and supporting activities.

Subramanian S, Tangka FKL, Hoover S, DeGroff A. Integrated interventions and supporting activities to increase uptake of multiple cancer screenings: conceptual framework, determinants of implementation success, measurement challenges, and research priorities. Implement Sci Commun. 2022 Oct 5;3(1):105. doi: 10.1186/s43058-022-00353-8. PMID: 36199098; PMCID: PMC9532830.

Fifth, the capacity and capabilities of the electronic medical records to support cancer screening by quickly identifying patients due for screening, tracking screening completion, and generating provider-level summary screening uptake were seen as critical for successful implementation and maintenance.

Subramanian S, Tangka FKL, Hoover S, DeGroff A. Integrated interventions and supporting activities to increase uptake of multiple cancer screenings: conceptual framework, determinants of implementation success, measurement challenges, and research priorities. Implement Sci Commun. 2022 Oct 5;3(1):105. doi: 10.1186/s43058-022-00353-8. PMID: 36199098; PMCID: PMC9532830.

The key determinants of successful implementation [of integrating EBIs across cancer screening] that were deemed to have the most impact (average score of 3.0) were complexity of the intervention, implementation cost, overall implementation climate, and ensuring appropriate individuals were involved in the implementation process. Higher levels of complexity and cost were negatively related to implementation success.

Subramanian S, Tangka FKL, Hoover S, DeGroff A. Integrated interventions and supporting activities to increase uptake of multiple cancer screenings: conceptual framework, determinants of implementation success, measurement challenges, and research priorities. Implement Sci Commun. 2022 Oct 5;3(1):105. doi: 10.1186/s43058-022-00353-8. PMID: 36199098; PMCID: PMC9532830.

We found that the complexity of the intervention, cost of delivering the intervention and supporting activities, implementation climate at the clinic, and engaging appropriate team members in the implementation process were key determinants of implementation success.

Subramanian S, Tangka FKL, Hoover S, DeGroff A. Integrated interventions and supporting activities to increase uptake of multiple cancer screenings: conceptual framework, determinants of implementation success, measurement challenges, and research priorities. Implement Sci Commun. 2022 Oct 5;3(1):105. doi: 10.1186/s43058-022-00353-8. PMID: 36199098; PMCID: PMC9532830.

Given the large variation across grantees on screening promotion interventions, a systematic assessment of needs matched with promotion activities, and their impact on screening rates, could provide better guidance on optimal resource allocation.

Tangka FKL, Subramanian S, Hoover S, Cole-Beebe M, DeGroff A, Joseph D, Chattopadhyay S. Expenditures on Screening Promotion Activities in CDC's Colorectal Cancer Control Program, 2009-2014. Prev Chronic Dis. 2019 Jun 6;16:E72. doi: 10.5888/pcd16.180337. PMID: 31172915; PMCID: PMC6583814.

Small media was often used at the initiation of the program, and this could be due to the availability of small media materials[[20]] and tools that grantees could easily tailor.

Tangka FKL, Subramanian S, Hoover S, Cole-Beebe M, DeGroff A, Joseph D, Chattopadhyay S. Expenditures on Screening Promotion Activities in CDC's Colorectal Cancer Control Program, 2009-2014. Prev Chronic Dis. 2019 Jun 6;16:E72. doi: 10.5888/pcd16.180337. PMID: 31172915; PMCID: PMC6583814.

Across the 5 years, grantees allocated more resources to small media in the first year of the program. Small media might be easier to implement while other interventions might require more planning; CDC and other organizations provide small media materials that grantees can easily tailor to implement targeted campaigns.

Tangka FKL, Subramanian S, Hoover S, Cole-Beebe M, DeGroff A, Joseph D, Chattopadhyay S. Expenditures on Screening Promotion Activities in CDC's Colorectal Cancer Control Program, 2009-2014. Prev Chronic Dis. 2019 Jun 6;16:E72. doi: 10.5888/pcd16.180337. PMID: 31172915; PMCID: PMC6583814.

Integrating CRC interventions into the standard operating procedures and work flow processes of health systems, when possible, will contribute to sustainability (e.g., incorporating client reminders into the electronic health record system so that reminders are automated).

Tangka FKL, Subramanian S, Hoover S, Lara C, Eastman C, Glaze B, Conn ME, DeGroff A, Wong FL, Richardson LC. Identifying optimal approaches to scale up colorectal cancer screening: an overview of the centers for disease control and prevention (CDC)'s learning laboratory. Cancer Causes Control. 2019 Feb;30(2):169-175. doi: 10.1007/s10552-018-1109-x. Epub 2018 Dec 14. PMID: 30552592; PMCID: PMC6382575.

Screening uptake increased across all the sites during the implementation period, ranging from 7.1 to 18.9 % points.

Tangka FKL, Subramanian S, Hoover S, Lara C, Eastman C, Glaze B, Conn ME, DeGroff A, Wong FL, Richardson LC. Identifying optimal approaches to scale up colorectal cancer screening: an overview of the centers for disease control and prevention (CDC)'s learning laboratory. Cancer Causes Control. 2019 Feb;30(2):169-175. doi: 10.1007/s10552-018-1109-x. Epub 2018 Dec 14. PMID: 30552592; PMCID: PMC6382575.

According to ID-DHW stakeholders, there were several program elements that facilitated the initiation of cancer screening prevention integration after their planning phase. The first of these elements was a pre-implementation checklist for health clinics to determine their capacity for implementing each type of cancer screening and undertake specific enhancements for coordinated and integrated screenings to be initiated.

Tangka FKL, Subramanian S, Hoover S, Cariou C, Creighton B, Hobbs L, Marzano A, Marcotte A, Norton DD, Kelly-Flis P, Leypoldt M, Larkins T, Poole M, Boehm J. Improving the efficiency of integrated cancer screening delivery across multiple cancers: case studies from Idaho, Rhode Island, and Nebraska. Implement Sci Commun. 2022 Dec 16;3(1):133. doi: 10.1186/s43058-022-00381-4. PMID: 36527147; PMCID: PMC9756516.

Grantees also reported a moderate need for training regarding many aspects of EBI implementation, from identifying EBIs and assessing organizational capacity to implement selected EBIs to conducting a process and outcome evaluation.

Escoffery C, Hannon P, Maxwell AE, Vu T, Leeman J, Dwyer A, Mason C, Sowles S, Rice K, Gressard L. Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S. BMC Public Health. 2015 Jan 31;15:49. doi: 10.1186/s12889-015-1386-1. PMID: 25636329; PMCID: PMC4318175.