Measuring Performance in Networks

Submitted by on Fri, 12/29/2017 - 12:56
Tuesday, July 19, 2011
Two of the stumbling blocks to expanding the use of collaborative networks in government are: how do you figure out what works? And, how do you create accountability?
Two of the stumbling blocks to expanding the use of collaborative networks in government are: how do you figure out what works? And, how do you create accountability?
 

The IBM Center has sponsored a series of reports in different policy arenas over the past decade that look at the creation and use of collaborative networks to get results.  Reports exploring collaborative networks in emergency management, watershed management, international environmental issues, and traffic congestion describe the richness of the complexity of getting things done across agency and sectoral boundaries.  But in each case, the assessment of success focused on the ultimate end results.  This meant measuring the performance OF networks, not the performance IN networks.

But in many cases, achieving end results – such as cleaner water or reduced traffic congestion -- take years to demonstrate.  So, what happens in the interim? How do you measure the performance IN networks?  In the IBM Center case studies, the answer (roughly) was that the participants in the networks would hold each other jointly accountable. 

This may work in certain circumstances, but in a strongly hierarchical political system such as ours, that answer is not good enough.  With the passage of the GPRA Modernization Act, and its requirements to develop cross-agency goals (which implies cross-agency collaborative networks), there is now a stronger need to demonstrate how we measure the performance IN networks?  Figuring this out may be a key step to expanding their use in governmental settings.

This challenge was the focus of a series of articles in the June 2011 issue of Public Performance & Management Review, where various authors used the multi-sector governance network as their unit of analysis to examine the use of “performance management systems within complex networked governance arrangements.”  The authors identified three models:

Comparative case study analysis, which is “a systematic way to identify and describe performance management systems within complex, inter-jurisdictional networks.  It also discusses the role of federal agencies in building the capacity for such systems, using traffic congestion management as a model.

Social network analysis, which is used to “analyze the relationship between the kinds of network configurations” using emergency management response plans as its case study.

Complex adaptive systems approach, which is used to evaluate network performance in the third article, examining the deliberative processes of healthcare delivery networks.

The symposium editor, Christopher Koliba (University of Vermont) concludes: “All three articles reflect the growing use of computational power to assess performance and inform decision-making.”  Interestingly, this parallels similar research in the use of collaborative networks in the for-profit and non-profit worlds!