Bundle scores for brilliant feedback with ratings
Ratings classify or group response scores in a way useful for delivering feedback. They can be used to set scoring bands for subsections, sections, segmentations, and the assessment as a whole. Ratings are then called on to run automated calculations for feedback text or charting - removing the need to generate complex formulas.
Ratings and the Assessment Hierarchy
Ratings in Brilliant Assessment can follow the assessment hierarchy or be based on segmentations and advanced combinations.
In a typical assessment hierarchy, ratings are more high-level than answer text. However, ratings can be detailed and nuanced depending on their definition. Factors include how focused sections, subsections, and segmentations are and the significance of scores in combination.
Assessment Ratings
Applying ratings at the overall assessment level comprehensively summarises a respondent’s performance.
Section Ratings
Applying ratings to sections for targeted feedback within a certain theme or question grouping.
Subsection Ratings
Apply ratings to subsections to offer even more detailed insights. Pinpoint specific competencies, providing a clearer picture of performance in each area.
Ratings and Segmentations
Define ratings for particular groups of questions or answers, regardless of where they appear in your assessments. Learn more about segmentations here.
Popular Rating Methods
You can define your ratings in any way you like. Each rating grade has a maximum score associated with it, represented as a percentage. This is used to define the thresholds for achieving a rating.
Pass or Fail
Set ratings for binary pass or fail results. This can also be applied only at the assessment level, with more detailed ratings at section levels to indicate areas of improvement.
Traffic Light
A classic rating method is the universally understood traffic light system. This method is popular in ratings directly connected to graphs, where rating colors can provide a useful reference point.
Maturity
Popular in skill, aptitude and organizational assessments, high to low competency ratings often have around five levels that measure the success and improvement areas of respondents or cohorts.
Graded
Another more direct method for banding scores is to, well, band the scores. This might be a rating based on a percentage point band, or grade levels ranging from A to F.
-
The rating name is generally internal to the system and a way of you finding your rating easily.
-
The maximum score is the most points a respondent can achieve before being pushed into the next rating threshold. The minimum score will be the score that proceeds the rating.
-
Rating Color is used on all graphics related to a rating. We recommend using highly contrasting colors if you want a particular rating or difference between ratings to stand out on a chart.
-
Rating Text is an option that only appears if you have selected "Show Alternate Report Texts" on the Settings form. You can have up to 5 versions of rating content, and while we call this rating text, it can also include images and videos. You can select different rating content on reports and results pages.
-
An override is used when a respondent may skip a section that doesn’t apply to them, but you may still want to pull particular text into your report where the section is. The respondent won’t see this as a missed section, and the report will still contain content in every space, even skipped sections or subsections.
-
This additional and optional field issues a certificate if the rating indicates a ‘pass’ - particularly helpful in assessments with a qualification element.
-
If you have a badge or something similar for different achievement ratings, you can upload it as a rating image. The image will be displayed in the Feedback Report or Results.
Bring ratings to life in your feedback
Ratings come to life in feedback. Typically they contain detailed text and links to additional resources. But ratings can also include tables, files, and videos to create a rich and informative feedback experience. It’s also to apply different rating options to different report formats
Rating colors are used in charting graphics. This visual representation helps respondents quickly identify their rating band.
Do More With Advanced Ratings
Advanced Rating types cater to complex rating needs where multiple ratings are calculated for each response.
A great use of Advanced Ratings is where different sections have different norms and bell curves, so what is considered a high, medium or low score may be a different score ranges.
This flexibility ensures that Ratings accurately represent the diverse range of assessment outcomes.
Advanced Ratings can also be used to assign different colors for feedback charts in different contexts.