G-60JFQHSKJJG-60JFQHSKJJ
AI-psychometrics

Using AI in psychometrics

AI psychometrics is the application of artificial intelligence to the design, scoring, interpretation, and validation of psychological assessments.

This section will document my ongoing work in creating, refining, and extending psychometric assessments, with particular attention to how AI may assist in item writing and item analysis, scoring, and even validation. Much of this work builds on a long tradition of test development—from the WISC, WPPSI, BAS to the OBPI

Th elements included in this section are concerned with how psychological assessment evolves in a world where minds—digital or otherwise—are no longer passive subjects of evaluation. Rather, they are instruments of dialogue.

Current Limits to AI-Assisted Test Development

Rust, J. (2025) Working chapter draft, Modern Psychometrics (5th ed., in preparation). Available at: https://johnrust.website/reading/books/ai-assisted-test-development/

understanding-IRT

Item Response Theory and Computer Adaptive Testing

Rust, J. (2025) Working chapter draft, Modern Psychometrics (5th ed., in preparation). Available at: https://johnrust.website/reading/books/ai-assisted-test-development/

Persona Pod Framework

The Persona Pod framework was developed in mid-2025 at a time when GPT4 allowed persona (a form of personalised AI agent) to contribute, each to a separate aspect of the process.