Full Assessment Branch

• Education [MeSH IO2]
• Educational Measurement [MeSH IO2.399]
• College Admission Test [MeSH I02.399.272]
• Professional Competence [MeSH I02.399.630]
• Clinical Competence [MeSH I02.399.630.210]
• School Admission Criteria [MeSH I02.399.750]
• Self-Evaluation Programs [MeSH I02.399.780]
• Test Design
• Checklist, Tests
• Delivery Medium, Tests
• Aural Tests
• Computer Based Tests
• Oral Tests
• Written Tests
• Formative Assessment, Tests
• High Stake Tests
• Low Stake Tests
• Psychometrics [MeSH F04.711.780]
• Test Reliability
• Inter-Rater Reliability
• Test Retest Reliability
• Test Validity
• Concurrent Validity
• Construct Validity
• Content Validity
• Criterion Validity
• Predictive Validity
• Rating Scale, Tests
• Likert Scales
• Standard Setting, Tests
• Angoff Procedure
• Ebel
• Hofstee Method
• Summative Assessment, Tests
• Test Organisation
• Invigilation, Tests
• Special Requirements, Tests
• Station Design, Tests
• Test Methods
• Class Examination
• Closed Book Examination
• Continuous Assessment
• Defining Issues Test
• Diagnostic Thinking Inventory
• Dissertations, Academic [MeSH L01.178.682.389]
• Educational Appraisal
• End Of Term Assessment
• Exit Examination
• Free Response Question
• Essay Question
• Modified Essay Question
• Short Answer Question
• Key Feature Problem
• Multiple Choice Question
• Best Of Many Question
• Critical Reading Question
• Extended Matching Question
• True-False Question
• Objective Structured Clinical Examination
• Open Book Examination
• Patient Based Assessment
• Patient Simulation [MeSH I02.903.525]
• Simulated Surgery
• Standardised Patient
• Patient Management Problems
• Long Case Question
• Patient Record Review
• Short Case Question
• Peer Review [MeSH F01.829.316.549]
• Peer Assessment
• Portfolio
• Critical Incident Review
• Logbook
• Record Of Achievement
• Practice Observation, Tests
• Presentation of Work
• Conference Paper
• Poster Presentation
• Progress Test
• Project, Academic
• Self Assessment
• Stimulated Recall
• Structured Interviews
• Triple Jump Examination
• Viva
• Test Process
• Feedback, Educational
• Test Grading
• Double-Blind Marking
• Examiner
• Examiner Training
• External Examiner
• Internal Examiner
• Judgement, Examiner
• Scoring, Tests
• Negative Marking
• Percentage, Test Scoring
• Percentile, Test Scoring
• Pass, Test Scoring
• Failing, Test Scoring
• Student Preparation, Tests
• Mock Examination
• Test Coaching
• Studying (Revision)

Assessment Term Purgatory

This is a thread for METRO terms that were considered for inclusion in the assessment hierarchy, but were removed.

Do you think the terms should be given another chance? Please drop a comment and let it be known!

The METRO Purgatory Terms:

Delivery of Tests
Distinction, Test Scoring
Generalisability
Long Answer Question
Merit, Test Scoring
Peer Review, Academic
Student Rating Scale



"We are praying now for the repose of his soul. Hoping you're well and not in hell. Nice change of air. Out of the frying pan of life into the fire of purgatory." (James Joyce)

Suggest new terms

Use this discussion thread to suggest new terms that are not currently on the list.

We need to know:

1. The term

2. Its definition

3. A reference to show its usage in the literature

4. Where it best fits into the hierarchy

Angoff Procedure

Heading
Angoff Procedure

Tree Number (repeatable)


Annotation


Scope Note
The Angoff standard setting approach is a judgemental approach in which a group of expert judges makes estimates about how borderline candidates would perform on items in the examination, i.e. the proportion of borderline examinees who will answer an item correctly. Estimates are averaged over judges and summed over items to create a standard (cut off score).

(Refs: Cusimano MD. Rothman AI. The effect of incorporating normative data into a criterion-referenced standard setting in medical education. Academic Medicine. 78(10 Suppl):S88-90, 2003 Oct.

Ben-David MF. AMEE guide no. 18: Standard setting in student assessment. Medical Teacher. Vol. 22(2)(pp 120-130), 2000. )

See Also (repeatable)
Hofstee Method
Ebel

Entry Term (repeatable)
Modified Angoff

Allowable Qualifiers
ES, MT, OG, ST, SN, TD

Previous Indexing (repeatable)


History Note

Aural Tests

Heading
Aural Tests


Tree Number (repeatable)


Annotation


Scope Note
Educational test where the question involves the candidate listening to (aural) stimuli.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Best Of Many Question

Heading
Best Of Many Question

Tree Number (repeatable)


Annotation


Scope Note
Multiple choice test in which the candidate selects the single best option of the answer options presented and can be made up of “a stem (eg, a clinical case presentation) and a lead-in question, followed by a series of choices, typically one correct answer and four distractors.” National Board of Medical Examiners. Constructing Written Test Questions For the Basic and Clinical Sciences 3rd ed. 1998.

See Also (repeatable)


Entry Term (repeatable)
Best Of N
Best Of Five

Allowable Qualifiers
MT, ST

Previous Indexing (repeatable)


History Note

Case Note Review

Heading
Case Note Review

Tree Number (repeatable)


Annotation


Scope Note
A retrospective analysis of case notes, that can be used to determine how individual cases were evaluated and processed. It may include an analysis of documentation.

See Also (repeatable)



Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Checklist, Tests

Heading
Checklist, Tests

Tree Number (repeatable)


Annotation
Do not confuse with Rating Scales, Tests

Scope Note
Tests with multiple answers which involves the candidate giving a list of responses, which the examiner can tick off on a check-list.
“A checklist is basically a two-point rating scale. Evidence suggests that the reliability of a checklist decreases when there are more than four points on the scale. The assessor has to decide whether each component on the list is present/absent; adequate/inadequate; satisfactory/unsatisfactory. Only if each component is very clearly defined and readily observable can a checklist be reliable. They are particularly useful for assessing technical skills.” (Newble D and Cannon R. A Handbook for Medical Teachers. Dordrecht: Kluwer Academic Publishers, 2001)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note
Annotation note - Don

Class examination

Heading
Class Examination

Tree Number (repeatable)

Annotation

Scope Note
An examination that is entirely conducted in a classroom.

See Also (repeatable)

Entry Term (repeatable)
Class Exam, Class Test

Allowable Qualifiers
EC ES MA MT OG ST SN TD

Previous Indexing (repeatable)

History Note

Clinical Competence [MeSH]

MESH Heading
Clinical Competence

Tree Number (repeatable)
I02.399.630.210
N04.761.210

Annotation
Competence in professional activities directly related to patient care: differentiate from PROFESSIONAL COMPETENCE which refers to competence not necessarily related to patient care; DF: CLIN COMPETENCE

Scope Note
The capability to perform acceptably those duties directly related to patient care.

See Also (repeatable)


Entry Term (repeatable)
Clinical Skills
Competence, Clinical
Clinical Skill
Skill, Clinical
Skills, Clinical

Allowable Qualifiers
EC LJ SN ST

Previous Indexing (repeatable)
Educational Measurement (1966-1974)

History Note
75

Closed book examination

Heading
Closed Book Examination

Tree Number (repeatable)

Annotation
Exists in BET as BET – Closed Book Examinations.

Scope Note
Examinations conducted with the basis that students are not allowed to bring any written or otherwise prohibited material.

See Also (repeatable)
Open Book Examination

Entry Term (repeatable)
Closed Book Test, Closed Book Exam

Allowable Qualifiers
ES MT OG ST SN TD

Previous Indexing (repeatable)

History Note

College Admission Test [MeSH I02.399.272]

MESH Heading
College Admission Test [I02.399.272]

Tree Number (repeatable)
I02.399.272

Annotation


Scope Note
Test designed to identify students suitable for admission into a graduate or undergraduate curriculum

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
HI SN

Online Note
search EDUCATIONAL MEASUREMENT 1966-74

Previous Indexing (repeatable)


History Note
91(75); was see under EDUCATIONAL MEASUREMENT 1975-90

Computer based tests

Heading
Computer Based Tests

Tree Number (repeatable)


Annotation


Scope Note
Test where the question involves the candidate receiving the question(s) or other stimuli on computer-screen.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Concurrent Validity

Heading
Concurrent Validity

Tree Number (repeatable)


Annotation


Scope Note
Concurrent Validity’, a sub-type of ‘Criterion Validity’, is assessed by correlating the new scale with the criterion measure, both of which are given at the same time.

(Ref: Streiner, D.L. & Norman, G.R. (1995) Health measurement scales: a practical guide to their development and use. Second Edition. Oxford Medical Publications.)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Conference Paper

Heading
Conference Paper

Tree Number (repeatable)


Annotation
BET and ERIC - Conference Papers - Individual papers presented at conferences (Note: The previous term "Conference Reports" was not scoped and was frequently used for this concept -- do not confuse with "Conference Proceedings" -- corresponds to Pubtype code 150 -- do not use except as the subject of a document)

Scope Note
Presentation of a topic or project in oral or text or multimedia formats.

See Also (repeatable)
Congresses [Publication Type]
Clinical Conference [Publication Type]
Consensus Development Conference [Publication Type]
Consensus Development Conference, NIH [Publication Type]
Congresses

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Construct Validity

Heading
Construct Validity

Tree Number (repeatable)


Annotation


Scope Note
‘Construct Validity’ is assessed by testing mini-theories to explain the relationships between various behaviours or other phenomena.

(Ref: Streiner, D.L and Norman, G.R. Health measurement scales: a practical guide to their development and use 2nd ed. Oxford: Oxford Medical Publications, 1995)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Content Validity

Heading
Content Validity

Tree Number (repeatable)


Annotation


Scope Note
‘Content Validity’ is assessed by ensuring that the scale or measure contains a representative and comprehensive range of e.g. behaviours, attitudes or knowledge that we want to assess.

(Ref: Streiner, D.L and Norman, G.R. Health measurement scales: a practical guide to their development and use 2nd ed. Oxford: Oxford Medical Publications, 1995)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Continuous assessment

Heading
Continuous Assessment

Tree Number (repeatable)

Annotation
A BET term

Scope Note
Continuous assessment is normally conducted throughout the course of study, with students normally receiving feedback shortly after each event.

See Also (repeatable)
Record of Achievement

Entry Term (repeatable)

Allowable Qualifiers
EC ES MA MT OG ST SN TD

Previous Indexing (repeatable)

History Note

Criterion Validity

Heading
Criterion Validity

Tree Number (repeatable)


Annotation


Scope Note
The traditional definition of criterion validity is the correlation of a scale with some other measure of the trait or phenomenon under study, ideally, a ‘gold-standard’ which has been used and accepted in the field.

(Ref: Streiner, D.L and Norman, G.R. Health measurement scales: a practical guide to their development and use 2nd ed. Oxford: Oxford Medical Publications, 1995)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Critical Incident Review

Heading
Critical Incident Review

Tree Number (repeatable)


Annotation
Do not confuse with MEDICAL AUDIT

Scope Note
An assessment of significant, rather than routine, events that can involve mistakes or inappropriate behaviour as well as high-quality work (Newble DI. The critical incident technique: a new approach to the assessment of clinical performance. Medical Education 1983; 17: 401-3)

See Also (repeatable)


Entry Term (repeatable)
Critical Incident Audit

Allowable Qualifiers
ES LJ MT ST SN TD

Previous Indexing (repeatable)


History Note

Critical Reading Question

Heading
Critical Reading Question

Tree Number (repeatable)

Annotation
BET uses Critical Reading.

Scope Note
Critical Reading Questions involve a comprehensive reading, followed by a considered analysis of the evidence, ideas and language of the reading and the relationships between these.

See Also (repeatable)

Entry Term (repeatable)

Critical Reading

Allowable Qualifiers
ES MT OG ST TD

Previous Indexing (repeatable)

History Note

Defining Issues Test

Heading
Defining Issues Test

Tree Number (repeatable)

Annotation

Scope Note
A self-administrated validated test used to measure moral reasoning skills of students over the course of their training.

See Also (repeatable)

Entry Term (repeatable)
Ethics Test, Moral Issues Test

Allowable Qualifiers
CL EC ES LJ MA MT OG ST SN TD

Previous Indexing (repeatable)

History Note

Delivery Medium, Test

Heading
Delivery Medium, Test

Tree Number (repeatable)


Annotation


Scope Note
Medium in (by) which test questions are delivered e.g. oral, written, computer-screen.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Diagnostic Thinking Inventory

Heading
Diagnostic Thinking Inventory

Tree Number (repeatable)


Annotation


Scope Note
The DTI is a self-reporting questionnaire designed to evaluate reasoning style and is based on the assumption that this is related to diagnostic skill.

(Ref: Groves M. O'Rourke P. Alexander H. The clinical reasoning characteristics of diagnostic experts. Medical Teacher. 25(3):308-13, 2003 May. )

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
EC ES MA MT OG ST SN TD

Previous Indexing (repeatable)


History Note

Dissertations, Academic [MeSH L01.178.682.389]

MESH Heading
Dissertations, Academic

Tree Number (repeatable)
L01.178.682.389

Annotation
do not confuse with Publication Type ACADEMIC DISSERTATIONS; DF: DISSERTATIONS ACAD

Scope Note
Dissertations embodying results of original research and especially substantiating a specific view, e.g., substantial papers written by candidates for an academic degree under the individual direction of a professor or papers written by undergraduates desirous of achieving honors or distinction.

See Also (repeatable)


Entry Term (repeatable)
Theses
Academic Dissertation
Academic Dissertations
Dissertation, Academic
Thesis

Allowable Qualifiers
HI ST

Online Note
use DISSERTATIONS, ACADEMIC to search THESES 1966-78

Previous Indexing (repeatable)
THESES was see under DISSERTATIONS, ACADEMIC 1963-78

History Note

Double-Blind Marking

Heading
Double-Blind Marking

Tree Number (repeatable)


Annotation


Scope Note
A system of marking in which a second examiner is unaware of the annotations or marks given by a first examiner until they meet to compare marks and agree on a final mark.

(Ref: University of Manchester. Academic Standards Code of Practice: Double Marking http://www.man.ac.uk/policies/3G.htm)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
MT, OG, ST, TD

Previous Indexing (repeatable)


History Note

Ebel

Heading
Ebel

Tree Number (repeatable)


Annotation


Scope Note
Ebel’s standard setting requests judges to categorise the items in a test employing a number of categories according to levels of difficulty and levels of relevance to the decision to be made. After classifying the items into each category, judges then decide on the proportion of items in each category that a hypothetical group of examinees could respond to correctly.

(Refs: Cusimano MD. Rothman AI. The effect of incorporating normative data into a criterion-referenced standard setting in medical education. Academic Medicine. 78(10 Suppl):S88-90, 2003 Oct.

Ben-David MF. AMEE guide no. 18: Standard setting in student assessment. Medical Teacher. Vol. 22(2)(pp 120-130), 2000.)

See Also (repeatable)
Angoff Procedure
Hofstee Method

Entry Term (repeatable)

Allowable Qualifiers
ES, MT, OG, ST, SN, TD

Previous Indexing (repeatable)


History Note

Education [MeSH I02]

MESH Heading
Education

Tree Number (repeatable)
I02

Annotation
GEN only; prefer / educ

Scope Note
Acquisition of knowledge as a result of instruction in a formal course of study.

See Also (repeatable)
Learning
Research Support
Students
Teaching
Training Support

Entry Term (repeatable)
Literacy Programs
Training Programs
Activities, Educational
Education, Parenting
Educational Activities
Parenting Education
Workshops

Allowable Qualifiers
CL EC ES HI LJ MA MT OG SN ST TD

Previous Indexing (repeatable)


History Note

Educational Appraisal

Heading
Educational Appraisal

Tree Number (repeatable)


Annotation


Scope Note
An educational and developmental process by which an individual can, with an appraiser, discuss and obtain feedback on performance and assistance on career development by means of confidential, constructive and regular dialogue.

See Also (repeatable)
Employee Performance Appraisal

Entry Term (repeatable)
Appraisal, Educational

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Educational Measurement [MeSH IO2.399]

MESH Heading
Educational Measurement

Tree Number (repeatable)
I02.399

Annotation
DF: EDUC MEASUREMENT

Scope Note
The assessing of academic or educational achievement. It includes all aspects of testing and test construction

See Also (repeatable)
Aptitude Tests

Entry Term (repeatable)
Assessment, Educational
Graduate Records Examination
Educational Assessment
Examination, Graduate Records
Measurement, Educational

Allowable Qualifiers
EC HI MT SN ST

Previous Indexing (repeatable)


Online Note
use EDUCATIONAL MEASUREMENT to search GRADUATE RECORDS EXAMINATION 1966-82

History Note
66; GRADUATE RECORDS EXAMINATION was see under EDUCATIONAL MEASUREMENT 1966-82

End of Term Assessment

Heading
End Of Term Assessment

Tree Number (repeatable)


Annotation


Scope Note
An assessment that occurs at the end of a length of study.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
ES MT ST TD

Previous Indexing (repeatable)


History Note

Essay Question

Heading
Essay Question

Tree Number (repeatable)


Annotation


Scope Note
Tests in which respondents are asked to compose written statements, discussions, summaries, or descriptions that are to be used as measures of knowledge, understanding, or writing proficiency.

An assessment method, distinguished from short-answer questions by the scope, the length of required answers, and the relative lack of specific cues for recall. Students' answers should reflect both how much is known about a topic and how well organized knowledge of the subject is. Answers provide information about the respondent perceptions, reasoning abilities, attitudes, feelings, and experiences.

(Ref: Wojtczak A. AMEE occasional paper no. 3: glossary of medical education terms. Dundee: Association for Medical Education in Europe, 2003)

See Also (repeatable)


Entry Term (repeatable)
Essay Test
Essays

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Examiners

Heading
Examiners

Tree Number (repeatable)


Annotation


Scope Note
Individuals who administer tests or examinations (BET thesaurus)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Examiner training

Heading
Examiner Training

Tree Number (repeatable)


Annotation


Scope Note
Educational activities or programmes to provide staff with the knowledge of assessment methods and their use in assessment of competence and performance.

See Also (repeatable)


Entry Term (repeatable)
Training of Examiners

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Exit Examination

Heading
Exit Examination

Tree Number (repeatable)

Annotation

Scope Note
A test to demonstrate proficiency that must be passed in order to complete a course of study. (???)

See Also (repeatable)
End of Term Assessment.

Entry Term (repeatable)
Exit test

Allowable Qualifiers
ES MT ST TD

Previous Indexing (repeatable)


History Note

Extended Matching Question

Heading
Extended Matching Question

Tree Number (repeatable)


Annotation


Scope Note
“Extended Matching items are multiple-choice items organized into sets that use one list of options for all items in the set. A well-constructed Extended-Matching set includes four components: 1. a theme; 2. an option list; 3. a lead-in statement; and 4. at least two item stems.” National Board of Medical Examiners. Constructing Written Test Questions For the Basic and Clinical Sciences 3rd ed. 1998 (http://www.nbme.org/about/itemwriting.asp)

See Also (repeatable)


Entry Term (repeatable)
EMQ
Question, Extended Matching

Allowable Qualifiers
MT, ST

Previous Indexing (repeatable)


History Note

External Examiner

Heading
External Examiner

Tree Number (repeatable)


Annotation


Scope Note
An academic from another institution, most often involved in observing a summative assessment process for validation purposes.

See Also (repeatable)


Entry Term (repeatable)
Examiner, External

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Failing, Test Scoring

Heading
Failing, Test Scoring

Tree Number (repeatable)


Annotation


Scope Note
Rating of academic performance when a candidate does not demonstrate understanding, knowledge, or competence to the required level.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
ST, SN, TD

Previous Indexing (repeatable)


History Note

Feedback, Educational

Heading
Feedback, Educational

Tree Number (repeatable)


Annotation


Scope Note
Formal or informal direction or comment given to learners to allow them to understand how well they are performing and how they might improve their performance.

See Also (repeatable)
Knowledge of Results (Psychology) [MeSH F02.463.425.770.379]
Feedback [MeSH L01.143.283.425]

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Formative Assessment, Tests

Heading
Formative Assessment, Tests

Tree Number (repeatable)


Annotation


Scope Note
Formative assessments are usually more informal (than summative assessments) and undertaken on a continuous basis. Such assessments must be free of threat, as the aim is to get the students to reveal their strengths and weaknesses rather than to disguise them.
(Ref: Newble, D and Cannon R. A Handbook for Medical Teachers. Dordrecht: Kluwer Academic Publishers, 2001)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Free Response Question

Heading
Free Response Question

Tree Number (repeatable)


Annotation


Scope Note
Structured or unstructured written tests that leave wording of the response to the candidate, as distinct from multiple choice question tests. (Ref: Breland, Hunter M. Writing Skill Assessment: Problems and Prospects. Policy Issue Perspective Series. New Jersey: Educational Testing Service, Princeton, NJ. Policy Information Center, 1996)

See Also (repeatable)


Entry Term (repeatable)
Question, Free Response
Free Response Test
Free Response Writing Test


Allowable Qualifiers
MT, ST

Previous Indexing (repeatable)


History Note

Grade

Heading
Grade

Tree Number (repeatable)


Annotation


Scope Note


See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

High Stakes Tests

Heading
High Stake Tests

Tree Number (repeatable)


Annotation
ERIC/BET term: High Stakes Tests "Tests whose results are the chief determinants of significant consequences for individuals (e.g., graduation, grade promotion, or tracking) or institutions (e.g., accreditation, funding, or ranking)"

Scope Note
Performance results on high stakes tests have a major impact on students, teachers and institutions: students may proceed or qualify, or be required to repeat training; institutions and teachers may be audited or ranked in league tables.
(Ref: Amrein AL, Berliner DC. The Impact of High-Stakes Tests on Student Academic Performance. Tempe, AZ: Education Policy Studies Laboratory/University of Arizona, 2002.)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Hofstee Method

Heading
Hofstee Method

Tree Number (repeatable)


Annotation


Scope Note
A standard setting approach that incorporates the advantages of both relative and absolute standard setting procedures.

(Refs: Cusimano MD. Rothman AI. The effect of incorporating normative data into a criterion-referenced standard setting in medical education. Academic Medicine. 78(10 Suppl):S88-90, 2003 Oct.

Ben-David MF. AMEE guide no. 18: Standard setting in student assessment. Medical Teacher. Vol. 22(2)(pp 120-130), 2000. )

See Also (repeatable)
Objective Structured Clinical Examination

Entry Term (repeatable)
Eadie-Hofstee

Allowable Qualifiers
ES, MT, OG, ST, SN, TD

Previous Indexing (repeatable)


History Note

Internal Examiner

Heading
Internal Examiner

Tree Number (repeatable)


Annotation


Scope Note
An academic officer of the host institution involved in running, marking or observing a summative assessment process.

See Also (repeatable)


Entry Term (repeatable)
Examiner, Internal

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Inter-Rater Reliability

Heading
Inter-Rater Reliability

Tree Number (repeatable)


Annotation


Scope Note
Inter-rater reliability is one of the properties of a test (scale, instrument, questionnaire) which must be demonstrated by the scale developers, so usually forms part of the psychometric testing of a new scale. This aspect of reliability is important when an instrument/scale/questionnaire entails a degree of judgement on the part of the user. Sometimes potential users may need to go on a training course. It concerns whether the instrument/scale/questionnaire will give the same measurement no matter who uses it.
(Nunnally, J.C. & Bernstein, I.H. (1994) Psychometric Theory. Third edition. McGraw-Hill, Inc. 
Streiner, D.L. & Norman, G.R. (1995) Health measurement scales: a practical guide to their development and use. Second Edition. Oxford Medical Publications. )

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Invigilation, Test

Heading
Invigilation, Test

Tree Number (repeatable)


Annotation


Scope Note
The supervision of an examination while it is in progress and ensuring fair and proper conduct by all concerned.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Judgement, Examiner

Heading
Judgement, Examiner

Tree Number (repeatable)


Annotation


Scope Note
An academic or clinical arbitrator for contested summative assessment, either as a result of a candidate challenge or where there is disagreement between markers.

See Also (repeatable)


Entry Term (repeatable)
Examiner’s Judgement

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Key Feature Problem

Heading
Key Feature Problem

Tree Number (repeatable)


Annotation


Scope Note
A written test of clinical-decision making. Focuses on testing only the ‘key features’ that are essential to the resolution of a case.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Likert Scales

Heading
Likert Scales

Tree Number (repeatable)


Annotation


Scope Note
Measures in which subjects rate a series of attitudinal statements on a continuum, e.g., strongly agree, agree, undecided, disagree, strongly disagree - from a procedure originally developed by Rensis Likert (ERIC Thesaurus)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Logbook

Heading
Logbook

Tree Number (repeatable)


Annotation


Scope Note
At their simplest, logbooks are simple records of clinical experience. Basic logbooks can be modified however to specify levels of supervision, consecutive patient encounters or assesses’ confidence with regards to particular tasks (Patil NG. Lee P. Interactive logbooks for medical students: are they useful. Medical Education 2002;36: 672-7)

See Also (repeatable)
Portfolio

Entry Term (repeatable)
Record of Practice

Allowable Qualifiers
ES LJ MA MT ST SN TD

Previous Indexing (repeatable)


History Note

Long Case Question

Heading
Long Case Question

Tree Number (repeatable)


Annotation


Scope Note
A standard assessment procedure that attempts to create authentic clinical situations. Normally, it consists of an unobserved examination on a real or simulated patient, a subsequent interview with examiners to discuss all potential aspects of the patient examination and the grading of the assessed (which may or may not be based on pre-set criteria). Good Assessment Guide


See Also (repeatable)
Patient Based Assessment,
Short Case Question
Oral Test

Entry Term (repeatable)
Question, Long Case

Allowable Qualifiers
ES LJ MT ST SN TD

Previous Indexing (repeatable)


History Note

Low Stake Tests

Heading
Low Stake Tests

Tree Number (repeatable)


Annotation


Scope Note
Tests in context where the results do not have an impact on a student's progress or qualification.
(Ref O’Neil HF, Abedi J, Lee C, Miyoshi J, Mastergeorge A. Monetary Incentives for Low-Stakes Tests. Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing, University of California at Los Angeles, 2001.)

See Also (repeatable)
High Stake Tests

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Mock Examination

Heading
Mock Examination

Tree Number (repeatable)


Annotation


Scope Note
A simulated examination where most or all aspects of a full summative examination process are replicated in order to allow candidates to familiarise themselves with the logistics and format of the examination. This is to allow candidates to be able to concentrate on performance rather than be distracted by unfamiliar settings or activities.

See Also (repeatable)
Test Coaching
Practice (Psychology) [MeSH F02.463.425.674]

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Modified Essay Question

Heading
Modified Essay Question

Tree Number (repeatable)


Annotation


Scope Note
A series of linked short answer questions (clinical, diagnostic or management), following from a brief description of a clinical situation. Further information is added to test problem solving skills in subsequent questions.

(Ref: Knox JD 1989. What is ... a modified essay question?. Medical Teacher 1989; 11: 51-7)

See Also (repeatable)
Patient Management Problem

Entry Term (repeatable)
Question, Modified Essay

Allowable Qualifiers
CL ES LJ MT ST SN TD

Previous Indexing (repeatable)


History Note

Multiple Choice Question

Heading
Multiple Choice Question

Tree Number (repeatable)


Annotation


Scope Note
Tests in which two or more answers are offered as alternative responses to each item. Tests that have predetermined lists of correct answers so that subjective opinions or judgments are eliminated in scoring.

See Also (repeatable)


Entry Term (repeatable)
Question, Multiple Choice
MCQ

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Negative Marking

Heading
Negative Marking

Tree Number (repeatable)

Annotation
Muijtjens, A.M.M., van Mameren, H., Hoogenboom, R.J.I., Evers, J.L.H. and ven der Vleuten, C.P.M. (1999). The effect of a 'don't know' option on test scores: number-right and formula scoring compared. Medical Education, 33, pp. 267-275.

Scope Note
Grading (?) process where points are deducted from the entire total for incorrect answers.

See Also (repeatable)

Entry Term (repeatable)
Formula Scoring

Allowable Qualifiers
CL ES MT ST SN TD

Previous Indexing (repeatable)

History Note

Objective Structured Clinical Examination

Heading
Objective Structured Clinical Examination

Tree Number (repeatable)

Annotation
There are several subordinate types of OSCE (OSLER, OSPE, GOSCE, etc.).

Scope Note
The OSCE is a series of highly structured and focused clinical assessment tasks through which students rotate in a systematic fashion (Reference: Harden RM. Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Medical Education 1979; 13: 41-54).

See Also (repeatable)


Entry Term (repeatable)
OSCE
Standarised Patient Examinations
Standardised Pateint Tests

Allowable Qualifiers
ES LJ MT ST SN TD

Previous Indexing (repeatable)


History Note

Open Book Examination

Heading
Open Book Examination

Tree Number (repeatable)

Annotation
Exists in BET as BET – Open Book Examinations.

Scope Note
Examinations conducted where students are permitted to bring written or other authorised materials (e.g. calculator) into the examination.

See Also (repeatable)
Closed Book Examination

Entry Term (repeatable)
Open Book Test, Open Book Exam

Allowable Qualifiers
ES MT OG ST SN TD

Previous Indexing (repeatable)

History Note

Oral Tests

Heading
Oral Tests

Tree Number (repeatable)


Annotation


Scope Note
Test where the candidate is required to answer orally (in contrast to the written essay answer).

See Also (repeatable)
Structured Interviews

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Pass, Test Scoring

Heading
Pass, Test Scoring

Tree Number (repeatable)


Annotation


Scope Note
Rating of academic performance where the candidate demonstrates sufficient knowledge, understanding or competence.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
ST, SN, TD

Previous Indexing (repeatable)


History Note

Patient Based Assessment

Heading
Patient Based Assessment
 
Tree Number (repeatable)
 
 
Annotation
To be used in an educational context only. In clinical situation use OUTCOME ASSESSMENT (HEALTH CARE) and PATIENT SATISFACTION.
 
Scope Note
The use of real, simulated or standardised patients to assess or rate the clinical skills of students or health professionals. 
 
See Also (repeatable)
 
 
Entry Term (repeatable)
Assessment, Patient Based
Patient Centred Assessment
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Patient Management Problem

Heading
Patient Management Problem
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Patient management problems assess problem-solving abilities by simulating everyday working conditions. They can take on a variety of formats. (Gruppen LD and Wolf FM. Expertise, efficiency, and the construct validity of patient management problems.  Journal of Medical Education 1985; 60: 878-80).
 
See Also (repeatable)
Modified Essay Question
Problem Solving [MeSH F02.463.425.725]
 
Entry Term (repeatable)
Problem, Patient Management
 
Allowable Qualifiers
CL ES LJ MT ST SN TD  
 
Previous Indexing (repeatable)
 
 
History Note

Patient Simulation [MeSH I02.903.525]

MESH Heading
Patient Simulation
 
Tree Number (repeatable)
I02.903.525
 
Annotation
Actual persons (sometimes actors) "coached to feign symptoms or conditions of real diseases" as a technique in med educ; no qualif
 
Scope Note
The use of persons coached to feign symptoms or conditions of real diseases in a life-like manner in order to teach or evaluate medical personnel.
 
[METRO Scope Note – Simluated Patient] People who are healthy individuals trained to reliably reproduce the history and/or physical findings of typical clinical cases. Simulated Patients can also be trained to assess the proficiency of such clinical skills as history taking, physical medical examination and communication skills.
 
See Also (repeatable)
Standardised Patient
 
Entry Term (repeatable)
Patient Simulations
Simulation, Patient
Simulations, Patient
Simulated Patient
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note
92

Peer Assessment

Heading
Peer Review

Tree Number (repeatable)
F01.829.316.549
I01.880.604.640
N03.706.700

Annotation
BET has Peer Evaluation, lead term Peer Review.
Evans R. Elwyn G. Edwards A. Review of instruments for peer assessment of physicians.[see comment]. BMJ. 328(7450):1240, 2004 May 22.

Scope Note
Colleagues reviewing each other’s work and performance; peer assessment may involve grading, giving feedback or devising criteria for assessment, and can be formative or summative.

See Also (repeatable)

Entry Term (repeatable)
Peer Assessment, Peer Evaluation

Allowable Qualifiers
ES LJ MT ST TD

Previous Indexing (repeatable)

History Note   
 
(another) Scope Note
The use of peers who are requested to make judgements about structured tasks or to provide global impressions of colleagues. Peers can also be asked to make judgements about whether a certain actions were performed, the quality of those actions and whether they were appropriate for a given situation. (Norcini, J. Peer assessment of competence. Medical Education 2003; 37: 539-43) 
 

Peer Review [MeSH]

MESH Heading
Peer Review
 
Tree Number (repeatable)
F01.829.316.549
I01.880.604.640
N03.706.700
 
Annotation
Professionals evaluating professionals
 
Scope Note
An organized procedure carried out by a select committee of professionals in evaluating the performance of other professionals in meeting the standards of their specialty. Review by peers is used by editors in the evaluation of articles and other papers submitted for publication. Peer review is used also in the evaluation of grant applications. It is applied also in evaluating the quality of health care provided to patients.
 
See Also (repeatable)
Ethical Review
 
Entry Term (repeatable)
Review, Peer
 
Allowable Qualifiers
ES LJ MT ST TD
 
Previous Indexing (repeatable)
Medical Assistance (1968-1970)
Quality of Health Care (1968-1970)
 
History Note
71

Percentage, Test Scoring

Heading
Percentage, Test Scoring

Tree Number (repeatable)


Annotation


Scope Note
Scores awarded students for their performance in a test, marked out of 100.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Percentile, Test Scoring

Heading
Percentile, Test Scoring

Tree Number (repeatable)


Annotation


Scope Note
Percentiles are values that divide the distribution (of scores) into hundreds. For example, the 81st percentile is that point on the distribution below which 81% of the scores lie.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Portfolio

Heading
Portfolio
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Portfolios are comprised of a record of events, including learning contracts, evaluations, logbooks, research proposals, publications and clinical data. Significant themes are identified through reflective commentary and these themes then form the basis for critical review (Wilkinson TJ et al. The use of portfolios for assessment of the competence and performance of doctors in practice. Medical Education 2002; 36: 918-24)
 
 
See Also (repeatable) 
Logbook
 
Entry Term (repeatable)
Record of Practice 
 
Allowable Qualifiers 
ES LJ MT ST SN TD
 
Previous Indexing (repeatable)
 
 
History Note

Poster Presentation

MESH Heading
Poster Presentation

Tree Number (repeatable)


Annotation


Scope Note
Presentation of a topic or project in a poster format, in the style similar to that required by scientific conferences.
(Ref: Moneyham L. Ura D. Ellwood S. Bruno B. The poster presentation as an educational tool. Nurse Educator. 21(4):45-7, 1996 Jul-Aug.)

See Also (repeatable)


Entry Term (repeatable)
Presentation, Poster
Posters

Allowable Qualifiers
MT, OG, ST, TD

Previous Indexing (repeatable)


History Note

Practice Observation, Tests

Heading
Practice Observation, Tests
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Actions performed by faculty members, peers and/or patients to collect data to assess or rate the performance or competence of a health professional in the work environment. Observations need to be routine or covert to avoid an artificial test situation. (Norcini JJ. Work based assessment. BMJ 2003; 326: 753-5)
 
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note
 

Predictive Validity

Heading
Predictive Validity

Tree Number (repeatable)


Annotation


Scope Note
Predictive Validity, a sub-type of ‘Criterion Validity’, is assessed by correlating the new scale with the criterion measure, although the criterion will not be available for some time in the future. This is used in college admission tests, where the ultimate outcome is the person’s performance on graduation, several years hence.
(Ref: Streiner, D.L and Norman, G.R. Health measurement scales: a practical guide to their development and use 2nd ed. Oxford: Oxford Medical Publications, 1995)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Presentation of Work

Heading
Presentation of Work

Tree Number (repeatable)


Annotation


Scope Note
Delivering information, especially orally, but also in written or other multimedia format. In the context of assessment, used to demonstrate ability to gather, analyse and present appropriate information.
(Ref: Pasquale SJ. Pugnaire MP. Preparing medical students to teach. Academic Medicine. 77(11):1175-6, 2002 Nov.)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
MT, OG, ST, TD

Previous Indexing (repeatable)


History Note

Professional Competence [MeSH I02.399.630]

MESH Heading
Professional Competence
 
Tree Number (repeatable)
I02.399.630
 
Annotation
Competence in any profession or discipline: differentiate from CLINICAL COMPETENCE which is restricted to competence in professional activities directly related to patient care
 
Scope Note
The capability to perform the duties of one's profession generally, or to perform a particular professional task, with skill of an acceptable quality.
 
See Also (repeatable)
 
 
Entry Term (repeatable)
Competence, Professional
Generalization of Expertise
Technical Expertise
 
Allowable Qualifiers
EC LJ SN ST
 
Previous Indexing (repeatable)
 
 
History Note
79

Progress Test

Heading
Progress Test

Tree Number (repeatable)

Annotation
BET has Academic Progress – lacks assessment dimension

Scope Note
An evaluation of an individual’s improvement against an established set of criteria.

See Also (repeatable)

Entry Term (repeatable)
Progress Exam, Academic Progress

Allowable Qualifiers
ES MT OG ST TD

Previous Indexing (repeatable)

History Note

Project, Academic

Heading
Project, Academic
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Project work is used to teach and test higher cognitive skills, skills related to lifelong and self-directed learning, give the student a measure of responsibility and allows for the application of knowledge.
 
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Psychometrics [MeSH F04.711.780]

MESH Heading
Psychometrics

Tree Number (repeatable)
F04.711.780

Annotation
SPEC: SPEC qualif; NIM coord: no qualif; includes statist analysis of psychol tests, validation, applic of statist theory or formulae to psychol

Scope Note
Assessment of psychological variables by the application of mathematical procedures

See Also (repeatable)
CL EC ED ES HI IS LJ MA MT OG SN ST TD

Entry Term (repeatable)


Allowable Qualifiers
CL EC ED ES HI IS LJ MA MT OG SN ST TD

Previous Indexing (repeatable)


History Note

Rating Scale, Tests

Heading
Rating Scales, Test

Tree Number (repeatable)

Annotation
Term appears in BET "Rating Scales".

Scope Note
Rating scales give values to student performance; the scales can be descriptive or numerical.

See Also (repeatable)

Entry Term (repeatable)
Student Rating Scales

Allowable Qualifiers
CL EC ES MT OG ST SN TD

Previous Indexing (repeatable)

History Note

Record (case note) Review

MESH Heading
Record (Case Note) review 

 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
In a record review patient records are assessed on a variety of criteria (completeness, history and examination recording, test ordering and interpretation, etc.) with subsequent feedback. The assessed may be required to justify decisions and strategies. 

(McIntyre N. Medical record review form. Medical Teacher. Vol. 2(1)(pp 40-43), 1980.)
  
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers 
ES LJ MT ST SN TD
 
Previous Indexing (repeatable)
 
 
History Note

 

Record of Achievement

Heading
Record Of Achievement

Tree Number (repeatable)

Annotation
BET term.

Scope Note
A profile created at the end of a course of study that usually contains an assessment of accomplishments and skills, performance on examinations or other qualifications, and a summary of other relevant activities.

See Also (repeatable)
Continuous Assessment

Entry Term (repeatable)
Educational Records, Student Profiles, RoA

Allowable Qualifiers
EC ES MA MT OG ST SN TD

Previous Indexing (repeatable)

History Note

School Admission Criteria [MeSH I02.399.750]

Heading
School Admission Criteria [MeSH I02.399.750]
 
Tree Number (repeatable)
I02.399.750
 
Annotation
few qualif apply
 
Scope Note
Requirements for the selection of students for admission to academic institutions
 
See Also (repeatable)
 
 
Entry Term (repeatable)
Student Selection
 
Allowable Qualifiers
SN TD
 
Previous Indexing (repeatable)
 
 
History Note
91(75); was see under EDUCATIONAL MEASUREMENT 1975-90

Scoring, Tests

Heading
Scoring, Tests

Tree Number (repeatable)

Annotation


Scope Note
"Process of systematically assigning values (usually numerical but also including letter marks and verbal comments) to the results of tests, examinations, questionnaires, etc." Scope for Scoring from ERIC Thesaurus

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
ES MT ST TD

Previous Indexing (repeatable)

History Note

Self Assessment

Heading
Self Assessment

Tree Number (repeatable)

Annotation
BET uses Self Evaluations, Individuals - Should we be calling this Self-Evaluation?

Scope Note
Evaluation structured in such a manner that the participating professionals, physicians, or students develop an increased awareness of their own performance.

See Also (repeatable)
Self-Evaluation Programs (MeSH)

Entry Term (repeatable)
Self Evaluation, Self Measurement, Self Appraisal

Allowable Qualifiers
EC ES LJ MA MT OG ST SN TD

Previous Indexing (repeatable)

History Note

Self-Evaluation Programs [MeSH I02.399.780]

MESH Heading
Self-Evaluation Programs
 
Tree Number (repeatable)
I02.399.780
 
Annotation
Educational programs structured in such a manner that the participating professionals, physicians, or students develop an increased awareness of their performance, usually on the basis of self-evaluation questionnaires.
 
Scope Note
 
 
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
CL EC ES HI LJ MA MT OG SN ST TD
 
Previous Indexing (repeatable)
Educational Measurement (1974-1978)
 
History Note
91(79); was see under EDUCATIONAL MEASUREMENT 1979-90

Short Answer Question

Heading
Short Answer Question

Tree Number (repeatable)


Annotation


Scope Note
Test questions which require an answer of one word or a short paragraph.

“The method can be used to assess a knowledge base but is particularly useful to assess the reasoning that lies behind a decision making process… The length of answer will depend upon the skill being tested by the question.” Jolly B and Grant J. Good assessment guide. London: Joint Centre for Medical Education, 1997. pg 49

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
MT, OG, ST, TD

Previous Indexing (repeatable)


History Note

Short Case Question

MESH Heading
Short Case Question
 
Tree Number (repeatable)
 
 
Annotation
Similar to Patient Based Assessment, Long Case Question and Oral Test.
 
Scope Note
The short case question assesses within constructed clinical situations. The short case differs in that it concentrates on examining or observing specific or limited aspects of clinical practice (eg. a system, lesion or anatomical part), testing specific skills or areas of knowledge. Short case can be used in conjunction with long case.  (Jolly B and Grant J. Good assessment guide. London: Joint Centre for Medical Education, 1997.)
 
See Also (repeatable)
Patient Based Assessment,
Long Case Question
Oral Test
 
Entry Term (repeatable)
Question, Short Case
 
Allowable Qualifiers
ES LJ MT ST SN TD 
 
Previous Indexing (repeatable)
 
 
History Note

Simulated Surgery

Heading
Simulated Surgery
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Assessment of the consultation skills of a primary care physician or general practitioner in a simulated environment. A simulated surgery is usually recorded on film and submitted for assessment.
 
See Also (repeatable)
Patient Simulation
 
Entry Term (repeatable)
Surgery, Simulated
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Special Requirements, Tests

Heading
Special Requirements, Tests

Tree Number (repeatable)


Annotation


Scope Note
Adaptation or inclusion of educational aids and strategies to enable students with disabilities to undertake tests without sacrificing overall academic requirements.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Standard Setting, Tests

Heading
Standard Setting, Tests
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
 
 
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Standardised Patient

Heading
Standardised Patient
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
People trained to simulate medical and health conditions in a standardised, believable and reliable manner for educational purposes. Standardised Patients can also be trained to assess the proficiency of such clinical skills as history taking, physical medical examination and communication skills.
 
See Also (repeatable)
Patient Simulation
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Station Design, Tests

Heading
Station Design, Tests

Tree Number (repeatable)


Annotation


Scope Note
The design of a task and marking schedule to assess a clinical or practical skills during an objective structured clinical examination.

See Also (repeatable)
Objective Structured Clinical Examination
Test Design

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Stimulated Recall

Heading
Stimulated Recall
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Student interaction with a patient is recorded (usually on film) and later reviewed by student and faculty member to elicit or assess the clinical reasoning employed in thinking through the patient case. 
 
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Structured Interviews

Heading
Structured Interviews
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Oral assessment or evaluation method designed to eliminate bias and provide valid and reliable information in order to measure whether an individual has reached a pre-determined set of criteria. 
 
See Also (repeatable)
Oral Tests
 
Entry Term (repeatable)
Interviews, Structured
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Student Preparation, Tests

Heading
Student Preparation, Tests

Tree Number (repeatable)


Annotation


Scope Note
The preparation that a student does prior to, and specifically in preparation for, a test e.g. re-reading, revision.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Studying (Revision)

Heading
Studying (Revision)
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
An individual candidate’s preparation for an assessment event, usually involving revising material that has been accrued by the candidate over time.
 
See Also (repeatable)
 
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Summative Assessment, Tests

Heading
Summative Assessment, Tests

Tree Number (repeatable)


Annotation


Scope Note
With summative assessment, every effort must be made to ensure that all assessments are fair and based on appropriate criteria. Students should be fully informed of these criteria, on the assessment methods to be employed and on the weightings to be given to each component
(Ref: Newble, D and Cannon R. A Handbook for Medical Teachers. Dordrecht: Kluwer Academic Publishers, 2001)

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Test Coaching

Heading
Test Coaching
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
One or more events where a candidate’s tutor or peers work through test scenarios to both familiarise and comment on the candidate’s performance. This is an essentially social activity.
 
See Also (repeatable)Practice (Psychology)
Mock Examination
 
Entry Term (repeatable)
Coaching, Tests
Coaching For Tests
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note 
 

Test Design

Heading
Test Design

Tree Number (repeatable)


Annotation


Scope Note
Planning, assembling, writing, editing or otherwise preparing a test ot other educational measurement.

See Also (repeatable)


Entry Term (repeatable)
Test Construction
Design of Tests
Construction of Tests

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Test Grading

Heading
Test Grading

Tree Number (repeatable)


Annotation


Scope Note
The processes and methods of rating performance on a test.

See Also (repeatable)
Standard Setting


Entry Term (repeatable)


Allowable Qualifiers
ES, MT, OG, ST, TD

Previous Indexing (repeatable)


History Note

Test Methods

Heading
Test Methods
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Techniques, instruments or procedures used to measure progress, attainment, knowledge, skills, or attitudes.
 
See Also (repeatable)
 
 
Entry Term (repeatable)
Test Method
Methods, Test
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
Educational Measurement/methods
 
History Note

Test Organisation

Heading
Test Organisation

Tree Number (repeatable)


Annotation


Scope Note
The administrative structuring and arrangement of all related and connected aspects of an educational measurement activity.

See Also (repeatable)


Entry Term (repeatable)
Organisation of Tests

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Test Process

Heading
Test Process

Tree Number (repeatable)


Annotation


Scope Note
The procedures and methods involved in student examination.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers
CL EC ES HI MA MT OG ST SN TD

Previous Indexing (repeatable)


History Note

Test Reliability

Heading
Test Reliability
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
Test reliability concerns the accuracy of the measuring instrument (scale, questionnaire). One aspect of this is measurement error, and there is a large literature on the theory of measurement error within the wider literature on classical test theory. A second definition of “reliability” is stability over time.
 
(2-i) Test-retest reliability is one of the properties of a test (scale, instrument, questionnaire) which must be demonstrated by the scale developers, so usually forms part of the psychometric testing of a new scale. This aspect of reliability concerns whether the instrument/scale/questionnaire will give the same measurement on different occasions.  
 
(Nunnally, J.C. & Bernstein, I.H. (1994) Psychometric Theory. Third edition. McGraw-Hill, Inc.
 
Streiner, D.L. & Norman, G.R. (1995) Health measurement scales: a practical guide to their development and use. Second Edition. Oxford Medical Publications. )
 
See Also (repeatable)
Inter-Rater Reliability  
 
Entry Term (repeatable)
 
 
Allowable Qualifiers
 
 
Previous Indexing (repeatable)
 
 
History Note

Test Retest Reliability

Heading
Test Retest Reliability

Tree Number (repeatable)


Annotation


Scope Note

Test-retest reliability is one of the properties of a test (scale, instrument, questionnaire) which must be demonstrated by the scale developers, so usually forms part of the psychometric testing of a new scale. This aspect of reliability concerns whether the instrument/scale/questionnaire will give the same measurement on different occasions.

Refs:
Nunnally, J.C. & Bernstein, I.H. (1994) Psychometric Theory. Third edition. McGraw-Hill, Inc.
Streiner, D.L. & Norman, G.R. (1995) Health measurement scales: a practical guide to their development and use. Second Edition. Oxford Medical Publications.

See Also (repeatable)


Entry Term (repeatable)
Test-Retest Reliability

Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Test Validity

Heading
Test Validity

Tree Number (repeatable)


Annotation


Scope Note
Denotes the scientific utility of a test or measuring instrument, broadly statable in terms of how well it measures what it purports to measure. One stage of the development of a new test or scale is the psychometric testing, one component of which is to test the validity of the scale. Validity can be further divided into: (1) content validity, (2) criterion validity, which is further divided into two types: (2-i) concurrent validity and (2-ii) predictive validity, and (3) construct validity.
Ref:
Nunnally, J.C. & Bernstein, I.H. (1994) Psychometric Theory. Third edition. McGraw-Hill, Inc.

Streiner, D.L. & Norman, G.R. (1995) Health measurement scales: a practical guide to their development and use. Second Edition. Oxford Medical Publications.


See Also (repeatable)
Test Reliability
Inter-rater Reliability

Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

Triple Jump Examination

Heading
Triple Jump Examination
 
Tree Number (repeatable)
 
 
Annotation
 
 
Scope Note
An examination consisting of three components: a written or oral examination of a clinical situation, a period of independent study, and a continuation of the written or oral examination to assess the ability to apply the knowledge gained.
(Ref: Smith RM. The triple-jump examination as an assessment tool in the problem based medical curriculum at the University of Hawaii. Academic Medicine 1993; 685: 366-72).
 
See Also (repeatable)
 
 
Entry Term (repeatable)
TJ Examination
Examination, Triple Jump
 
Allowable Qualifiers
ES MT ST SN TD
 
Previous Indexing (repeatable)
 
 
History Note

True False Question

Heading
True False Question

Tree Number (repeatable)


Annotation


Scope Note
Multiple choice tests “that require the examinee to indicate all responses that are appropriate (true/false).” National Board of Medical Examiners. Constructing Written Test Questions For the Basic and Clinical Sciences 3rd ed. 1998

See Also (repeatable)


Entry Term (repeatable)
False True Question
Test, True False
Test, False True
Question, False True
Question, True False

Allowable Qualifiers
MT, ST

Previous Indexing (repeatable)


History Note

Viva

Heading

Tree Number (repeatable)

Annotation
BMJ 1995;311:931-935 (7 October)

Scope Note
An oral interview focused on a specific piece of work (eg. thesis) or around a record of work. Questions are often interrogative, requiring a verbal defence. Vivas may be structured or unstructured.

See Also (repeatable)
Oral Tests

Entry Term (repeatable)
Question Firing, Viva Voce

Allowable Qualifiers
ES LJ MT ST SN TD

Previous Indexing (repeatable)

History Note

Written Tests

Heading
Written Tests

Tree Number (repeatable)


Annotation


Scope Note
Test where the candidate is required to answer in writing, e.g. the essay answer.

See Also (repeatable)


Entry Term (repeatable)


Allowable Qualifiers


Previous Indexing (repeatable)


History Note

METRO at AMEE

This is to confirm that the METRO meeting at AMEE will be between 1030 and 1230, 6th September at the EICC. Don't know where yet, but AMEE has assured us a room somewhere.

Anyone wanting travel and hotels booked, just let Marshall or I know.

Alex

Shades of Green

Please confirm this template's shade of green is similar and putrid enough to represent METRO2.