IBEC Framework for a White Paper on ITS Evaluation
Prepared for Sharing At the 21st World Congress on ITS
in Detroit, Michigan
September 7-11, 2014
What is IBEC?
The International Benefits, Evaluation and Costs (IBEC) Working Group was established in 1999 and is an internationally recognised cooperative working group of more than 500 transport professionals around the world helping to coordinate and expand efforts to exchange information and techniques, and evaluate benefits and costs of ITS. IBEC seeks to:
• promote the value of evaluating benefits and costs of Intelligent Transport Systems (ITS)
• coordinate and expand internationally these efforts, and
• exchange information and techniques on evaluation approaches in use or development.
IBEC brings together worldwide knowledge and experience and is the focal point for discussion and debate of interest to the international ITS evaluation community. IBEC encourages more effective use of ITS evaluation information so that decision-makers can make more informed ITS investments. IBEC also support ITS deployment and evaluation specialists in the development and incorporation of evaluation activities into ITS implementation projects from initial “before” evaluation to final “after” evaluations, which enhance the ability to measure success and derive recommendations for decision makers.
The IBEC Management Committee recently decided that IBEC would develop this “Framework for a White Paper on ITS Evaluation” as a means to promote the evaluation of benefits and costs of ITS.
This paper explains why we should evaluate ITS, introduces the basic aspects pertaining to what and how to evaluate ITS, and concludes with a proposed ensemble of next steps.
Why evaluate ITS?
IBEC and its members want to point out the important role of evaluation for the development and deployment of Intelligent Transportation Systems (ITS), and recommend ITS stakeholders — including policymakers, decision-makers — ensure ITS evaluation remains or becomes a standard practice by the relevant ITS stakeholders. The main motives for carrying out evaluation of ITS are listed below.
Justify use of taxpayers’ money.
In our modern times, we assume that public sector authorities are required to make best use of increasingly scarce public funds considering the demands of increasing costs for construction and maintenance of our transportation and ITS infrastructure, the need to justify expenditures in an independent manner for financial and audit reporting purposes. An independent evaluation study carried out according to generally accepted evaluation procedures and criteria will provide information to help justify ITS expenditures and decision-makers’ investments in ITS, including assisting in planning for future ITS programs.
Identify most effective and operational solutions for transport problems
ITS is one of the many tools to be used in order to help solve current and future transport problems. Evaluation provides information of the effectiveness and efficiency of ITS in solving such problems in a way enabling the incorporation of ITS evaluation results with other tools at the disposal of the decision-makers.
Demonstrate benefits of ITS
Many ITS services and applications have little or no evidence of their benefits to users or society. In such cases, ITS evaluation results provide tangible and often times statistically significant evidence of the impacts and benefits of ITS so that this information can be widely disseminated in the ITS and transportation arenas.
Find out if ITS works as intended
Evaluation is also needed to find out whether the ITS service, application or system works as intended. This could mean checking whether the concept or idea for an ITS system works in practice, whether the technical performance of the system is of sufficient quality, whether the application is accepted and works to the satisfaction of its users, or whether the service provides the expected revenue stream to the service provider, an ever-increasing important element due to falling fuel tax revenues in most states and countries. (…)
Download the paper here: