Development of a Scoring Rubric to Assess Training in an Immersive Experience Environment

OpenAlex İngilizce

This research focuses on the development of a scoring rubric (SR) designed to assess occupational health and safety (OHS) training delivered through immersive experience environments. To this end, an immersive training module was implemented in the field of electrical safety, supported by immersive technologies. The participants were 30 students enrolled in the electrical program of a public university located in the Aegean region. The primary goal was to enhance participants’ awareness of occupational safety and to improve their practical skills in managing potentially hazardous situations. For performance assessment, each participant was independently evaluated by three raters using the developed rubric. The collected data were analyzed through Intraclass Correlation Coefficient (ICC), Generalizability Theory (G-Theory), and the Rasch Model. The ICC analysis yielded a coefficient of 0.936, indicating a strong level of inter-rater consistency. G-Theory results supported the high reliability of the evaluations, while the Rasch analysis proved effective in revealing the rating patterns and participant performance levels. Additionally, expert evaluations contributed to the validation process of the rubric. Overall, the findings indicate that the SR is a valid and reliable tool for evaluating learning performance in immersive OHS training contexts.