Evaluating Resiliency Program Success – Playbook Review Part 10
In part nine, we examined the various methods of reporting your resiliency program’s progress and how this step is critical for demonstrating the success of the program. Now we will discuss evaluating program success against the original program objective. The objective of this step is to confirm the results of the resiliency program. This topic is covered more in-depth in chapter seven of PDi2’s Utility Infrastructure Resiliency Playbook.
Data Gathering & Reporting
Because resiliency programs are designed to reduce outage duration or frequency, this cannot be fully tested until an outage condition takes place. In addition, because this type of program is highly targeted geographically, the reviewing of overall system performance to observe the impact of a targeted resiliency program is often muted or invisible.
Given the likelihood that significant outages may not occur every year, the collection of routine implementation data is necessary to demonstrate forward progress. The type of routine data collection might include:
- Annual total spend versus budget or maximum allowable
- Line mileage addressed versus plan
- Number of lines addressed versus plan
- Cost per mile versus plan or maximum allowable
- Cost per customer versus plan
- Ratepayer impact per 1000 kWh
Discussing Resiliency Program Performance
There are three primary settings where overall resiliency program performance may be discussed. Each is described below with the focus on how to effectively report results.
In the early stages of program planning, it is critical to clearly determine and state what the utility is trying to accomplish and to select an appropriate resiliency metric to demonstrate the results of the program. Reporting to a regulatory body should focus on the pursuit and achievement of the program objective to utilize as few overall metrics as possible. Routine data may be required as a lack of storms or outages may make overall program success reporting impossible.
Industry reporting should utilize a format similar to a case study: clearly define the challenge, discuss and develop the solutions selected, and results achieved. Keep it simple and straightforward.
Media & Public
Media and public reporting should focus on individual impacts and societal benefits achieved. Societal benefits include increased property values, reduced vegetation management, avoided costs from vehicle accidents, reduced fire sparking risk, improved service reliability, and improved emergency ingress/egress routes. When communicating with the media and the public, think in terms of sound bites. For example a forecast reduction in total length of restoration by 40-50% which impacts and generates benefits for all customers in the event of an outage.
Download the Playbook
We strongly encourage interested readers to download a free copy of PDi2’s Utility Infrastructure Resiliency Playbook. Designed to help utilities address obstacles they might face when developing resiliency programs, this comprehensive resource includes details on each step of developing a program, case studies, and links to additional resources.