Assessing physician awareness of the Choosing Wisely Canada recommendations

Background: Choosing Wisely Canada (CWC), an initiative to reduce low-value care, launched in April 2014. However, it remains unclear to what extent physicians are aware of the initiative and specific recommendations. The objective of this study was to assess physician awareness of the CWC campaign and recommendations, in addition to assessment of attitudes and perspectives on low-value medical care.Methods: This study was conducted as a survey of faculty physicians and residents of McMaster University. Electronic surveys were sent to all faculty physicians and residents within specialties with CWC recommendations. Responses were analyzed to determine awareness of CWC recommendations, defined as awareness of ≥3 recommendations targeted to a respondent’s respective specialty.Results: A total of 361 respondents were included in the analysis (response rate = 33%). Eighty-eight percent of respondents were aware of the CWC campaign. Only 30.1% (95% CI 23.5–36.7%) of respondents were able to correctly describe ≥3 of the recommendations targeted to their respective specialty, with a mean of 1.6 (95% CI 1.4–1.9) recommendations correctly identified per respondent. Most recommendations (70.9%) were reported as already being part of a respondents’ practice prior to release of the CWC recommendations. Interpretation: Despite general awareness of the CWC campaign, more than two thirds of physicians cannot describe most recommendations targeted to their own specialty. Nonetheless, many of these physicians report already practicing in compliance with these recommendations. Future studies are required to identify methods to improve communication, to track compliance with current CWC recommendations, and to determine areas of care that would most benefit from additional recommendations. Choosing Wisely Canada (CWC), an initiative to reduce low-value and unnecessary medical care, launched in April 2014.1 Modeled after the Choosing Wisely campaign in the US,2 CWC seeks to engage clinicians and patients in conversation about unnecessary tests and treatments. The campaign centres on “top five” lists developed by medical specialty societies of items within their respective specialties deemed to be of low-value, lacking benefit, or potentially harmful.3 CWC recommendation lists were intended to be physician-led, patient-focused, evidence-based, multi-professional, and transparent,4 with each group formulating their own list using these guiding principles.The Institute of Medicine estimates that approximately 30% of health care in the US adds no value to patient care.5 Additionally, a large majority of physicians have recognized over-testing as an issue, and 72% of those surveyed acknowledge ordering at least one unnecessary test or treatment each week.6 Common reasons cited for doing so included concerns for malpractice, safety, and patient preference.Specific list recommendations have been rolled out by national specialty societies and in local campaigns in hospitals across Canada. Further, Canadian medical schools are beginning to incorporate the campaign into the undergraduate curriculum through the Students and Trainees Advocating for Resource Stewardship campaign, and resource stewardship has been added to the CanMEDS ‘Leader’ competency.7,8 However, early research out of the US suggests that its now 3-year-old campaign has had variable success, with little effect on national physician practice. Analysis of 7 low-value services found only a very modest improvement in practice in two specific Choosing Wisely recommendations.9 Of the remaining five, three demonstrated no change in practice, and two revealed changes contradictory to the recommendation.As the campaign has passed the 3-year mark in Canada, it is not yet known what effect it has had on physician practice. Furthermore, it remains unclear to what extent physicians, including trainees, have been aware of the initiative, and whether they are aware of specific recommendations relevant to their own specialty. The objective of this study was to assess physician awareness of the CWC campaign, both in terms of general awareness and of specialty-specific recommendations, in addition to assessment of attitudes and perspectives on low-value medical care.MethodsDesign and PopulationThe study was conducted as a survey among physician residents and faculty at McMaster University in Hamilton, Ontario. The project was exempted from full review by the Hamilton Integrated Research Ethics Board.The survey was sent to all residents and faculty within specialties that had existing CWC recommendations at the time of survey dissemination. Email lists of residents and faculty physicians were provided to us from individual programs. Emails were initially sent in March 2016, with reminder emails sent out monthly for two subsequent months. The survey remained open from March to June 2016. Respondents were excluded from survey analysis if their primary specialty lacked CWC recommendations, or if they self-reported that less than 10% of their work was devoted to clinical duties.ContentThe survey questions were created to collect data on respondent demographics, awareness of CWC recommendations, and to assess attitudes and perspectives of respondents on low-value medical care. Questions were devised via discussion among content experts, and in conjunction with previously unpublished surveys that assessed similar themes. After initial completion, the survey was pilot tested among ten residents and faculty physicians, and subsequent changes were made to improve on its readability, avoid misinterpretation of specific questions, and improve response options.The primary outcome of the survey was the proportion of respondents with awareness of at least three of the CWC recommendations targeted to their respective specialty. If a respondent answered positively to awareness of the CWC campaign, they were asked to describe up to five of the recommendations in their own words, including for each recommendation the (1) target population, (2) test, procedure, and/or intervention, and (3) clinical context (when applicable). Responses were categorized as correctly aware of the recommendation if they included all of (1), (2), and (3, when applicable). Two independent adjudicators assessed responses; if disagreement occurred following a consensus step, the response was assessed by a third adjudicator.Data AnalysisSurvey data was analyzed using descriptive statistics. Primary outcome data was presented using confidence interval on a proportion.ResultsDemographicsThe survey was sent to 1361 physicians, with 446 individuals (201 faculty physicians, 245 residents) responding to the survey (response rate = 33%). Of these, 85 were excluded for various reasons (47 for incomplete surveys, 26 for primary specialty without CWC recommendations, and 12 for self-reporting less than 10% of their work as devoted to clinical duties). A total of 361 responses, representing 22 specialties, were included in the final analysis (Table 1). The mean age of respondents was 37.6 (SD ±12.0). The largest proportion of responses came from Family Medicine (25%), Internal Medicine (20%), Emergency Medicine (10%), and Anesthesia (8%).Table 1. Demographics of survey respondents Awareness of the Campaign and its RecommendationsA total of 316 respondents (88%) were aware of the CWC campaign (Table 2). Respondents reported awareness via word of mouth (26%), medical publications, (21%), conferences (16%), and hospital communications (10%). Of these, 185 (59%) reported awareness of their own specialty’s recommendations. Only 56 respondents (30.1%, 95% CI 23.5–36.7%) were able to correctly identify ≥3 of these recommendations. Respondents correctly identified an average of 1.6 (95% CI 1.4–1.9) recommendations (1.7, 95% CI 1.3–2.1 vs. 1.5, 95% CI 1.2–1.8, for faculty physicians versus residents, respectively). The frequency of specific recommendations correctly identified by respondents is presented in Table 2.Table 2. Awareness of the Choosing Wisely Canada Campaign Perspectives on Specific CWC RecommendationsRespondents were presented with the specific CWC recommendations targeted to their specialty, and asked to respond to the recommendations’ influence on their practice (Table 3). A total of 2,425 recommendations were presented to the 361 respondents. Respondents noted that the individual recommendations were likely to change their practice in 18.5% of cases. In only 10.6% of cases did the respondent note that the recommendation would not change their practice. The remaining 70.9% of cases stated that the recommendation was already their practice prior to release of the CWC recommendations. Table 3. Perspectives on Specific Choosing Wisely Canada Recommendations  Views on Low-Value Medical ServicesRespondent attitudes and perspectives on low-value medical services are presented in Figure 1. A majority of respondents either agreed or strongly agreed that they have a responsibility to decrease use of inappropriate health care services (95%, 95% CI 93–97%), and that many patients would benefit from implementation of recommendations to decrease use of these services (82%, 95% CI 78–86%). Respondents mostly disagreed or strongly disagreed with the notion that patients have sufficient information to make informed decisions about inappropriate use of services (54%, 95% CI 49–59%). Most respondents either agreed or strongly agreed that cost to society is an important factor in decision-making around interventions (65%, 95% CI 60–70%), though many disagreed or strongly disagreed that they were aware of the costs of these tests and/or treatments (30%, 95% CI 25–35%). Figure 1. Views on low-value medical services (n = 347 ) Respondents were additionally asked to rank four barriers to implementing recommendations to decrease use of inappropriate services (Figure 2). Most respondents (38%, 95% CI 33–43%) ranked concern regarding medico-legal risk as the number one barrier, with patient requests for tests and treatments closely following (33%, 95% CI 28–38%). Lack of time to assess whether an individual would or would not benefit from a service was ranked first by 25% (95% CI 20–30%) of respondents. Only 4% (95% CI 2–6%) of respondents ranked payment policies that reward ordering more services as the top barrier.  Figure 2. Barriers to implementing recommendations (n = 347). DiscussionAs far as we are aware, this is the first survey to assess physician awareness of the CWC campaign. Our results indicate that while most physicians have a general awareness of the campaign, few are able to describe most of the specific recommendations targeted to their own specialty. Only 30.1% of respondents could appropriately describe three or more recommendations, and over half of respondents were able to describe only one, or couldn’t describe any, of the recommendations. In addition, respondents’ views were largely supportive of reducing low-value medical care, with physicians acknowledging both responsibility and a patient-benefit to reducing use of inappropriate services.Our results suggest, however, several possible barriers to the campaign having an impact on practice. For one, the lack of awareness may indicate that there has been inadequate communication of specific recommendations. Previous work in the United States has found that physicians aware of the Choosing Wisely campaign view it as a legitimate source of guidance, and report that it has empowered them to reduce the use of unnecessary tests and procedures.10 Accordingly, a lack of awareness would likely be a significant impediment in attempts to reduce resource utilization of low-value medical care. However, our findings additionally demonstrate that respondents report practicing in compliance with 70.9% of recommendations prior to release of the CWC campaign.While it is possible that there is a discrepancy between physicians’ reported and actual practice, these findings are in keeping with other studies suggesting that certain recommendations had high rates of baseline adherence prior to publication of the campaign. A study from the United States identified very low baseline rates of preoperative stress testing before low-risk surgeries,11 while another identified infrequent rates of Pap testing among women under 21 years of age and sinusitis imaging for acute mild-to-moderate sinusitis or uncomplicated acute rhinitis.9 These findings were all in accordance with published Choosing Wisely recommendations, suggesting that some recommendations were not targeting high-yield areas of low-value care. However, while a recent Canadian study by Kirkham and colleagues assessing preoperative testing prior to low-risk surgical procedures within Ontario hospitals demonstrated low baseline utilization of certain tests (e.g., echocardiography, stress tests), it did show widely variable utilization of other tests (e.g., electrocardiogram) among institutions.12 This may indicate that further communication of the CWC recommendations may have greater impact within institutions with lower rates of baseline compliance. Additionally, measurements of baseline utilization prior to release of further recommendations may help identify areas of greatest potential impact.Our study additionally demonstrated other areas in which further interventions could potentially impact rates of utilization of low-value care. Many of our respondents believed that patients drive inappropriate services more often than physicians, but that patients largely lack the information to make these informed decisions. Strengthening communication of the campaign to the general public, while targeting specific high-yield areas of patient utilization, may help further reduce use of certain services. Furthermore, though a majority of respondents identified cost to society as an important factor in the decision to use or not use an intervention, less than half of respondents reported awareness of the cost of tests and treatments they prescribe. Numerous other studies have found deficits in both self-reported and actual awareness of the costs of medical care in the US.10,13 Surveys of Canadian physicians have demonstrated very poor cost awareness among both family physicians and residents.14,15 While enhancing knowledge of low-value areas of care is the primary goal of campaigns such as CWC, it is possible that physician education on the costs of tests and treatments would lead to further improvements in resource utilization. Finally, evidence suggests that physicians who value cost consciousness are more likely to avoid the use of low-value services, while greater knowledge of guidelines alone is not associated with reduced use of low-value services.16 Accordingly, efforts may be further focused on enhancing a sense of cost consciousness among trainees and physicians.LimitationsOur survey does possess several limitations. Firstly, our response rate was only 33%; thus, it remains possible that our sample was not fully representative of the target population, and we cannot rule out a selection bias favouring respondents more familiar with the CWC campaign. Secondly, we restricted our population to physicians associated with McMaster University. We cannot extrapolate these findings to physicians associated with other universities or physicians in non-academic settings, especially given the fact that local CWC communication initiatives have been occurring to variable extents across the country. Thirdly, we were unable to avoid the possibility that respondents were able to search for their specialty-specific recommendations while completing the survey. However, we have no reason to believe respondents would have any incentive to do so. Lastly, we were unable to account for physicians who identify with more than one medical specialty.ConclusionsDespite general awareness of the CWC campaign, most physicians cannot describe recommendations targeted to their own specialty. Nonetheless, many of these physicians report already practicing in compliance with these recommendations. Multiple barriers to implementing change were identified, including the potential of recommendations targeting lower-yield areas of care, patient requests for tests and treatment, physician awareness of cost, and concern regarding medico-legal risk. Future studies are required to explore awareness of the campaign in other academic and community sites across the country. Additionally, future efforts should be directed towards identifying methods of improving communication of current CWC recommendations, including the potential for targeting both specific recommendations and institutions with low baseline compliance, and to determine areas of care that would most benefit from additional recommendations.