Initiatives Principle 4

 Initiatives Principle 4: A good initiative has an evaluation plan.

Whether the initiative is short-term or long-term, project managers should use an evaluation plan to identify and refine project goals, assess progress toward project goals, determine the quality of project results, measure the impact of the project, show accountability, and demonstrate the value of the project to funding agencies.

Evaluation can focus on the process and/or the outcome. Evaluation of process can involve assessment of a project’s operations—such as staffing and management, workflow, and procedures—and focuses on input measures. While output measures such as the number of items digitized can be useful, recent emphasis is on outcome assessment, which is concerned with how people, collections, organizations, and systems have been affected by the project. The evaluation plan should emphasize the importance of an ongoing two-way dialogue with key stakeholder communities. Outcomes should be closely related to project goals and objectives and should be measurable.

Output measures for a digital collection building initiative may focus on the digital collection’s size, quality, and usage. Other dimensions of the project, such as the functionality and usability of the collection’s website, and users’ experience with the collection and the service, are also output measures. The impact of a digital collection is the best indicator of a project’s value, but it is most challenging to measure because it often involves many factors that are hard to quantify, and it demands considerable input from users. Surveys, interviews, and transaction logs are good for measuring inputs and outputs, while focus groups, interviews, and case studies are good for outcome and impact assessment. It is often necessary to combine various research methods to obtain quality data on a project’s outcomes and impact.

Project managers should begin with clear evaluation objectives and have a plan for analyzing, reporting and implementing evaluation results. Results can be used to improve an ongoing project or to initiate follow-up efforts. A good evaluation plan will provide solid data to sustain a project over time.

Information on developing and implementing evaluation plans:

Case studies and examples:

 

Last updated: 04/17/2008