Balancing quality improvement and unintended effects: The impact of implementing admission order sets for chronic obstructive pulmonary disease and heart failure at two teaching hospitals

Rationale, aims, and objectives Local health administrators implemented chronic obstructive pulmonary disease and heart failure admission order sets to increase guideline adherence. We explored the impact of these order sets on workflows and guideline adherence in the internal medicine specialty in two Canadian teaching hospitals. Methods A mixed methods study combined shadowing care providers (250 h), meeting observation and interviews (11 h), and patient medical chart audits for heart failure (n = 120) and chronic obstructive pulmonary disease (n = 120) patients. The chart audits analysed details of the admission process and 14 guideline elements associated with heart failure (nine) and chronic obstructive pulmonary disease (five). Results A subset (10/14) of the evaluated guideline elements were included in the heart failure or chronic obstructive pulmonary disease order sets. Order set use significantly increased adherence to some (4/10) of these elements. However, our qualitative work uncovered a perception that use of these two order sets increased order duplication. Our chart audits supported this perception. Order set use increased order duplication for heart failure (92% vs 43%) and chronic obstructive pulmonary disease (75% vs 43%). Conclusion It is unclear whether, for these two hospitals, the gains brought by implementation of chronic obstructive pulmonary disease and heart failure admission order sets were worth their associated organisational shortcomings. Problems with order set implementation appeared to stem from poor integration with pre‐existing complex organisational systems. Health administrators and clinicians interested in implementing order sets within their own hospitals need to remain cognizant of how these tools will fit into existing systems and practices.