Measuring Process Improvement

There has been much talk in the software industry regarding software process improvement. The emphasis has often been on passing various " tests, " such as the ISO certification and SEI CMM Levels. If you are taking one of these routes, you may be wondering if you are actually improving anything—or just learning to jump through new hoops for the purpose of an audit. Process improvement doesn't have to be academic, or solely focused on documentation. It can, and should, be used to solve real problems and make real gains. This article discusses how to track progress in your process improvement program, and offers four questions to consider as you measure your progress: Are we achieving our project goals, solving our development problems, and making progress on our improvement action plans? What are our savings in time and money? Are we making headway on our chosen process model or standard? What lessons have we learned? Answering these questions lets you know how well your improvement program is going, provides visibility early for detecting problems, and gives you data to make your future plans more effective. We'll also look at some examples of how companies track improvement; you can tailor these examples to fit your needs, or use them as a starting point to generate your own measurement ideas. Our intent is to stimulate you to think about the types of measures that would be useful in your process improvement environment. Almost all process improvement programs—ISO, CMM, or a homegrown hybrid—are built from similar components. For the purposes of this discussion, we'll use the Shewhart four-step improvement cycle for planning, executing, and managing improvement programs. It divides the process into four phases: PLAN (planning the improvement effort), DO (executing the plan), CHECK (measuring improvements), and ACT (acting on the data from the CHECK phase). The DO and ACT phases are subjects for other articles ; here our discussion will focus on the PLAN and CHECK components.