SYMPOSIUM: The assessement of cognitive abilities: critical approaches to validity and reliability: Session topic: Validity theory in testing, psychological assessment and surve research

Standardized tests, such as intelligence tests, are commonly used diagnostic tools. They play an important role in clinical decision making and allocation of education and healthcare. Research has however shown that important errors may occur despite the application of validation processes and adherence to quality criteria for psychometric tests.
In this symposium we will present a few critical approaches to validity and reliability in standardized testing. The interpretation of a test score relies on information gained from group data and, often, tests developed based on classical test theory. It will be argued that group data can´t provide justifiable information about the individual, and this may have consequences for the wellbeing of the individual. A shift in perspective arises when individuals are followed over time. Thus, differences in between-person data and within-person data will be discussed. We delve into the theoretical foundations of intelligence tests and the implications these have for validity and discuss objections from the professional field regarding the dominant role of IQ test scores in Dutch policy, based on a recent questionnaire among practitioners.
From another viewpoint, it will be discussed that test scores may be biased in relation with unsolved issues of multidimensionality that have to do with, among others, personality diversity and differential skills. From an interactionist and process-performance approach, pre-test methods, qualitative methods stemming from the field of survey methodology, will be proposed as a way to approach the problem of multidimensionality in tests.
Finally, Dynamic Assessment will be presented as an alternative to assess children, including a discussion of advantages and disadvantages and the challenges and opportunities DA can offer for health and school services. DA has shown to provide insights into the most appropriate instructional level and increases insights in capabilities of children and adults.

This symposium was part of the 2024 conference of the International Test Commission (https://www.itc2024granada.com/):
Session 2.9.
Session Topic: Validity theory in testing, psychological assessment and survey research
Chair: Dr. Vanessa Torres van Grinsven (Open Universiteit and University of Cologne)
The Response Process in Standardized Cognitive Ability Tests and Validity Dr. Vanessa Torres van Grinsven (Open Universiteit and University of Cologne)
The Test Tested Prof. Dr. Anna M.T. Bosman (Radboud University)
Intelligence and the Individual Anouk van Hoogdalem MSc (Radboud University, Graduate Student)
Dynamic assessment; An alternative to static testing? Dr. Maartje Radstaake (Radboud University)