Clinimetrics is the scientific discipline that aims to (1) develop methods of assessing the properties of health measurement instruments, (2) apply those methods to develop new, or evaluate existing, health measurement instruments, with the aim (3) to improve the quality of measurements. The choice of an appropriate measurement instrument is a key issue in all scientific research. Measurement instruments are required to assess outcomes (e.g. to evaluate the effectiveness of interventions), to diagnose, and to prognosticate. Approaches to gathering data vary widely, from physical examinations to laboratory tests, from imaging techniques to self-report questionnaires. Clinical and health researchers always need to find the best instruments for their particular research and, if none are available, develop new ones.

The course is on evaluation of the quality of measurement instruments and on the design and evaluation of the quality of clinimetric studies. The emphasis is on knowing “what to measure”, by a detailed definition of the construct of interest, based on conceptual models. We continue by discussing measurement theories such as classical test theory and item response theory. For multi item instruments, dimensionality (factor analysis) internal consistency are important issues. Specific sessions will focus on reliability (particularly the distinction between reliability and measurement error), validity (with the emphasis on content validity and hypotheses testing) and responsiveness. We will also pay attention to the interpretability of an instrument’s scores.

There will be lectures with working groups in between, to discuss the content of the lectures and to practice with assessment and interpretation of the various measurement properties. For one assignment, i.e. on the calculation and interpretation of measurement error and reliability, a computer with SPSS is required.

The course is offered online on six half days, spread over two weeks.

The online course roughly looks like this:

• The lectures of the course are pre-recorded. You can view them at a time of your choice via Canvas, our digital learning environment.
• The work groups take place online on Zoom, and are led by one of the teachers of the course. It is mandatory to have watched the lectures on Canvas before you participate in the corresponding work groups. Take into account 3-5 hours of preparation per day to watch the lectures and prepare the work groups.
• We will provide you with a timetable and an overview of which particular lecture must be studied for each work group.
• There are a total of 6 work groups (duration of each work group is 2 hrs).
  • Group 1- daily work group at 9.00 AM Amsterdam time,
  • Group 2– daily work group at 3.00 PM Amsterdam time
• There is also a SPSS practical during the course (not mandatory)
  • Groups 1 and 2: date unknown at this moment 1PM-2PM Amsterdam time

Note that the indicated times for the working groups are the local Amsterdam times. Amsterdam is located in the Central European Time zone (MET, GMT +1).

Group 1 is the best choice for students from Asia;
Groups 2 is the best choice for students from North and South America.

If you register for the course, please indicate in which group you want to participate. If a group is full, you can no longer choose it and we will remove it from the website. It is not possible to change groups afterwards. The groups have a maximum capacity of 11 people.
During the working groups, there will be opportunity to ask questions about the lectures.
All course materials are published on Canvas.

1. The student can describe the required steps for the evaluation of measurement instruments:
   • a. The student can define a construct of interest and place this in a conceptual model;
   • b. The student can explain the difference between reflective and formative measurement models;
   • c. The student can describe the basic principles of qualitative research methods that are being used in instrument development;
   • d. The student can describe the aim and methods of pilot-testing and field-testing.
2. The student can describe the terminology and definitions of all measurement properties and how they are related (COSMIN taxonomy).
3. The student can reflect on the most important design requirements for studies on measurement properties.
4. The student can describe the most appropriate statistical methods for evaluating measurement properties and criteria for good measurement properties.
5. The student is able to calculate the following statistical parameters: Intraclass Correlation Coefficients, Standard Error of Measurement, Smallest Detectable Change and Minimal Important Change.
6. The student is able to interpret change scores using the principles of Minimal Important Change and Smallest Detectable Change.
7. The student can explain the basic principles of Confirmatory Factor Analyses and why it is preferred over Exploratory Factor Analysis; can describe situations in which to apply Exploratory and Confirmatory Factor analysis and is able to interpret fit statistics for Confirmatory Factor Analysis.The student can explain the basic principles of Item Response Theory and its assumptions; can explain what is meant by differential item functioning, and can mention methods to assess differential item functioning.

Target audience

The course is designed for healthcare practitioners and researchers who are active in medical, allied health, psychological, or behavioural research and who deal with the development, evaluation, and interpretation of health measurements.

Course prerequisites

Attendants are expected to have at least basic knowledge of epidemiological and statistical methods.

Course material

The course materials (lectures, assignments, feedback of assignments, etc) are available on Canvas, our digital learning environment. The documents will remain available on Canvas for at least one year.

During the computer practicals, you will need:

SPSS; If you do not have SPSS installed yet, you can purchase it on Surfspot. Another option is to use IBM’s 30-day free trial: SPSS Software | IBM.

Literature

Henrica C. W. de Vet, Caroline B. Terwee, Lidwine B. Mokkink, Dirk L. Knol, Measurement in Medicine. 2011. Cambridge University Press. ISBN:9780521133852

Epidemiology Master’s students are required to do the exam in order to complete this course. For other students (not enrolled in Epidemiology Master), the exam is optional and costs €160,- per registration.

You can register for the exam on the Exams page. Registration will close 3 weeks prior to the exam.

Please note: the exam will be held at a location in Amsterdam. The exam is therefore NOT online.

Please note that you need to pass the exam in order to receive credits (EC).

A certificate of participation will be granted to all students who have attended at least 80% of the classes. The number of contact hours will be stated on the certificate.

Only for Dutch medical specialists!

On the final day of the course, you need to sign the attendance list if you wish to obtain accreditation credits (PE-points).

To qualify for these credits, there is an attendance requirement of 100%.