Background/Purpose The New York State Physical Education Profile (NYSPEP) was created in 2007 to address the issue of teacher and student accountability in physical education by providing rubrics for teachers to assess students. The NYSPEP also contains video clips demonstrating the different levels of proficiency to assist teachers in identifying their student's level of proficiency. However, there is little available research on the reliability of the NYSPEP assessment rubrics. Therefore, the purpose this following study is to determine the reliability the NYSPEP Basketball Skills rubric with and without the training videos.
Method Pre-service teachers (N=16) were divided into two groups randomly by the fishbowl method. The first group attended training using NYSPEP assessments using the videos provided with the assessment tools and the second group attended a presentation on general rubric development with no information on the NYSPEP assessments. After the ten-minute training, all 16 raters scored each player in a four v. four 15-minute basketball games using the NYSPEP Basketball Application of Skills rubric. Assessors were not allowed to discuss their scores.
Analysis/Results All scores were compiled into an excel spreadsheet and analyzed using the inter-observer agreement (agreements/agreements + disagreements). There was zero agreement in the group that received the general rubric training and a 25% percent agreement in-group that received the assessment specific video training.
Conclusions While the reliability was higher in the group that received training with the rubric specific video, it is still below what is considered acceptable. Before the NYSPEP is widely adopted more research is recommended.