A unified verification system for operational models from R egional M eteorological Centres of C hina M eteorological A dministration

A new unified verification system was set up for evaluating operational models from R egional M eteorological C entres ( RMC ) of the C hina M eteorological A dministration ( CMA ) using traditional verification methods. The functionality of the system includes data transmission and processing, forecast verification, new product validation and operational monitoring. Eight limited‐area models from different regions of C hina were verified in this study, including W eather R esearch and F orecasting ( WRF ) models from four RMCs. Global/ R egional A ssimilation and P rediction S ystem ( GRAPES ) models from two RMCs , M esoscale M odel version 5 ( MM5 ) and A dvanced R egional E ta‐co‐ordinate M odel ( AREM ) from the remaining two RMCs . Real time ground observations and model analysis are used as truth for surface and upper‐air variables, respectively. The variables verified are 500 hPa geopotential height, wind and temperature at 850 hPa, wind at 250 hPa, 24 and 3 h accumulated precipitation, and 2 m temperature. The results of the RMCs ' models were also compared with those from a limited‐area version of the GRAPES model ( GRAPES‐MESO ) run operationally at the N umerical W eather P rediction C enter ( NWPC )/ CMA . A new score called ‘relative improvement ratio’ was defined for continuous variables in the comparison. The preliminary results for the year 2011 showed that forecast error varied from one RMC to another, e.g., performance is more stable with relatively lower error for the regional centres of Shanghai, Beijing, Guangzhou and Shenyang than others. These centres provide also more accurate predictions of the rain‐shine category and of precipitation amount, especially the moderate rain forecast in 3 h accumulation. Copyright © 2013 Royal Meteorological Society