<previous page >

Evaluation and Certification Case Study

Our client was a professional organization comprised of therapeutic professionals interested learning about and promoting a certain therapeutic approach to brain-injured clients. As part of their mission, this association provides post-graduate training for certification.  However, there was no standardization in teaching or testing among the approximately 60 independent member instructors. Because the instructors had historically enjoyed their independence, the organization struggled to find a way to standardize their courses and provide meaningful certification.

They wanted answers to the following questions:

  How much standardization does the organization as a whole want to achieve?
  What processes can we use to facilitate problem solving and change management?
Once we decide on an optimal level of standardization, how can we achieve it?
How can we develop the type of certification testing that we can defend?

Tencza Designs helped the organization to find answers to these questions.  The most important role Tencza Designs played with this group was that of facilitator. We worked with both the entire instructor group as well as a small task force to gain consensus on goals and methods and to motivate the group.

Standardization involved a significant cultural shift for the instructors, and Tencza Designs helped the organization to plan for and implement that change. Over time, the association has developed standardized objectives, curricula outlines, and testing.

The criterion-referenced testing includes:

  Written tests, pulled from item banks which have been tested for reliability and content validity
  Work product submissions, scored against criteria that have been tested for cross-rater reliability
Practical demonstration of hands-on skills, scored against criteria that have been tested for cross-rater reliability
Instructions for test administration and scoring
A system of accountability requiring instructors to implement the testing system