The validation process
Validating the assessment events you've conducted, the decisions you've made and the tools you're using is like carrying out a quality control check. This process helps to ensure that you're using sound practices and making accurate and consistent decisions. It is also a requirement under the Standards for RTOs.
Validation methods
Feedback from candidates
At the end of each course, you should give the participants an evaluation form to complete. This allows them to rate various aspects of the training and assessment activities, and provide feedback on what they believed the good and bad points were.
Feedback from participants is very valuable, because it gives you an insight into how people respond to your presentation style and the activities you give them to do.
Personal reflection
Reflecting back over an assessment event you have conducted is another excellent way of reviewing your processes. Ask yourself which parts went well, and which parts didn't. Then ask yourself whether the procedure was fair on the candidate throughout the event. Once you've identified any weaknesses in the way you ran the assessment event, you can make changes to the way you carry it out next time.
Feedback from work colleagues
Work colleagues are an important source of feedback on your techniques and processes. For example, you can talk to the participants' supervisors or managers, to get their view on the relevance and accuracy of the assessment methods you use.
Moderation sessions with other assessors
Moderation sessions are meetings you hold with other assessors, where you compare assessment tools and decisions with each other.
These sessions are sometimes called validation sessions, because they help you to verify that the techniques and tools you're using are giving 'valid' results.
Some people make a distinction between 'moderation' and 'validation', as follows:
Moderation is a more informal process, allowing assessors to share their views, discuss problems and suggest changes to improve the 'reliability' of the assessment processes and tools - that is, working to ensure that all assessors would come to the same decision using these tools.
Validation is a formal process, like an audit, where assessment processes and tools are evaluated against set benchmarks to determine their effectiveness and 'validity'.
FAQs
the principles of fairness, flexibility, validity and reliability are met; the evidence used to make a decision about competence is valid, sufficient, authentic and current; assessors are familiar with the outcomes being assessed; assessors reach accurate and consistent decisions that inform assessment outcomes; and.
What is the validation of an assessment tool? ›
The validity of an assessment tool refers to how well the tool measures what it intends to measure. High reliability is not the only measure of efficacy for an assessment tool; other measures of validity are necessary to determine the integrity of the assessment approach.
What are the three components of an assessment tool that may be validated? ›
An assessment tool includes the following components—context and conditions of assessment, tasks to be administered to the student, an outline of the evidence to be gathered from the candidate and evidence criteria used to judge the quality of performance (i.e. the assessment decision-making rules).
What is the validation process of assessment? ›
Validation processes and activities include:
- gathering sufficient sample of completed assessment tools.
- testing how the tools and the systems in place, including assessment instructions and resources, impact the assessment findings.
- check whether assessments were conducted as intended.
We commonly classify process validation based on the timing of its execution relative to the production schedule. According to this description, there are four distinct types of process validation: prospective validation, retrospective validation, concurrent validation, and revalidation.
What is a process validation tool? ›
Process validation is the set of activities executed to establish scientific evidence affirming the consistent capability of a process to deliver products of high quality. It is characterized by the gathering and examination of data, spanning from the initial process design phase to full-scale commercial production.
How to evaluate an assessment tool? ›
Your assessment tools should match your learning objectives in terms of content, level, and type. For example, if your objective is to assess your students' ability to write a persuasive essay, your assessment tool should be a writing task that requires them to use appropriate arguments, evidence, and language.
What are the 4 assessment tools? ›
Assessment instruments can include:
- Oral and written questions.
- Observation/demonstration checklists.
- Projects, case studies and scenarios.
- Workplace portfolios.
Validation of an assessment tool requires several studies to ensure that it is valid for all individuals with whom it is to be used. It is therefore necessary to employ a continual process, where other users such as students and preceptors should also be involved.
What are the examples of validation process? ›
Examples of processes which should be validated include sterilization, aseptic filling, heat treating, plating, and plastic injection molding. In this pharmaceutical process validation example, a typical validation master plan for biotech processes contains: Validation Master Plan Approval.
Process validation is the analysis of data gathered throughout the design and manufacturing of a product in order to confirm that the process can reliably output products of a determined standard.
What is the characteristic of assessment validity? ›
Educational assessment should always have a clear purpose, making validity the most important attribute of a good test. The validity of an assessment tool is the extent to which it measures what it was designed to measure, without contamination from other characteristics.
What are the 5 principles of good assessment? ›
Clarify good performance
- Provide clear definitions of academic requirements before each learning task.
- Provide explicit marking criteria and performance level definitions. ...
- Provide opportunities for discussion and reflection about criteria and standards before learners engage in a learning task.
A validation schedule is a five-year plan. Each training product – qualification, accredited course, skill-set or explicit unit of competency must be reviewed at least once in that five-year period.
