Rubrics: the mechanics of effective evaluation

A rubric is a tool that is used in self assessment and effective evaluation.  "A rubric is an explicit set of criteria used for assessing a particular type of work or performance." (tltgroup.org)

What a rubric does is provide a multi-level framework for detailed assessment.  In the same way as a graph there is a X axis and also a Y axis.  Then at regular stages or intersects, a line is drawn and eventually a series of boxes beome apparent.

So a rubric uses multiple points of source data to create an overall picture of the subject.  Evaluation moves from a yes/no strategy to a multi faceted approach that is far more robust.

The way we apply the rubric for evaluation is by comparing hard data against soft data.  So on the X axis we apply a points scheme for quantitative data.  Where a measure has been reached a value is given to the outcome.  For example - if 30 sales are made within a month then that value may be 5, repeat sales equal 7 points and so on and so on.  When a total is reached then a point is plotted on the rubric.

On the Y axis a self assessment exercise takes place.  This is where reflective practice is carried out and the individual and their manager reflect on the qualitative data and create a value also.  One factor may be the measurement of customer satisfaction for any given sale.

Interestingly - you effective evaluation requires the application and submission of evidence for both the qualitative and the quantitative.

So when we combine the X axis and the Y axis data points we have a point of reference in the rubric.  Where rubrics differ from standard plot graphs is that the final outcome or result is dependant upon multiple factors and the final assessment or grade given falls into a described area rather than being a single data point.

For example - a rubric could contain quadrants.  Poor, Average, Good, Excellent.  Depending upon the X and Y scores the final data point will end up in one of those areas.  Once the rubric has been completed - then you have a starting point from which to start making changes.

For more detail on creating a rubric I recommend you check out this video -

The language and vocabulary of effective evaluation

The key to a successful evaluation depends upon the language that you invoke, and in turn the emotions that those words generate.  One does not have to be a literary giant or an English professor to have the right words.  Rather it is the way the words are strung together and the process used to ensure there are sharp outcomes.

So the words are not providing an answer but rather provide prompts and pricks that stimulate the mind to more deeply consider and reflect upon the matter or subject at hand.

Words that are used include - robust, well defined, appropriate, genuine,implement, critical, credible, accurate, valid, evidence, outcomes, analysis, authentic, confidence, thinking, reflection, relevant, practical, foundations.

"The self assessment is not an exercise in good writing. Rather, it is an opportunity for an employee to describe major contributions and how the work meets or exceeds the supervisor’s performance expectations." (Source: http://www.cpms.osd.mil/nsps/docs/selfassessmentfactsheet.pdf)

As far as we in education go the language focuses on the outcomes and successes of the learners.  The great thing about evaluation in education is that it allows educators to be assessed against hard data but also against the intangible outcomes and rewards that learners gain,

I certainly do not profess to be any sort of expert in this field of thinking as I have only just discovered the beauty of it.  I do however want to share my reflections on what I have learnt so far and so share my musings with you here.

For more information about evaluations I recommend you check out Jara Dean Coffey's website and blog.