Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov;76(3):623-645.
doi: 10.1111/bmsp.12302. Epub 2023 Feb 22.

Bayesian hierarchical response time modelling-A tutorial

Christoph Koenig  1 , Benjamin Becker  2 , Esther Ulitzsch  3
Affiliations

Bayesian hierarchical response time modelling-A tutorial

Christoph Koenig et al. Br J Math Stat Psychol. 2023 Nov.

Abstract

Response time modelling is developing rapidly in the field of psychometrics, and its use is growing in psychology. In most applications, component models for response times are modelled jointly with component models for responses, thereby stabilizing estimation of item response theory model parameters and enabling research on a variety of novel substantive research questions. Bayesian estimation techniques facilitate estimation of response time models. Implementations of these models in standard statistical software, however, are still sparse. In this accessible tutorial, we discuss one of the most common response time models-the lognormal response time model-embedded in the hierarchical framework by van der Linden (2007). We provide detailed guidance on how to specify and estimate this model in a Bayesian hierarchical context. One of the strengths of the presented model is its flexibility, which makes it possible to adapt and extend the model according to researchers' needs and hypotheses on response behaviour. We illustrate this based on three recent model extensions: (a) application to non-cognitive data incorporating the distance-difficulty hypothesis, (b) modelling conditional dependencies between response times and responses, and (c) identifying differences in response behaviour via mixture modelling. This tutorial aims to provide a better understanding of the use and utility of response time models, showcases how these models can easily be adapted and extended, and contributes to a growing need for these models to answer novel substantive research questions in both non-cognitive and cognitive contexts.

Keywords: Bayesian hierarchical modelling; cognitive and non-cognitive response time models; response times; tutorial.

PubMed Disclaimer

Similar articles

See all similar articles

References

REFERENCES

    1. Barnard, J., McCulloch, R., & Meng, X.-L. (2000). Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage. Statistica Sinica, 10(4), 1281-1311.
    1. Becker, B., Debeer, D., Weirich, S., & Goldhammer, F. (2021). On the speed sensitivity parameter in the lognormal model for response times and implications for high-stakes measurement practice. Applied Psychological Measurement, 45(6), 407-422.
    1. Becker, B., Ulitzsch, E., & König, C. (2020). pisaRT: Small example response and response time data from Pisa 2015 [R package version 1.0.0]. https://CRAN.R-project.org/package=pisaRT
    1. Betancourt, M. (2016). Diagnosing suboptimal cotangent disintegrations in Hamiltonian Monte Carlo. arXiv 1604.00695.
    1. Bezirhan, U., von Davier, M., & Grabovsky, I. (2021). Modeling item revisit behavior: The hierarchical speed-accuracy-revisits model. Educational and Psychological Measurement, 81(2), 363-387. https://doi.org/10.1177/0013164420950556

LinkOut - more resources