Validation of IPMS for Korea Archery

Thursday, March 19, 2015
Exhibit Hall Poster Area 1 (Convention Center)
Sae-Hyung Kim1, Han-Byul Kim2, Tae-Gyu Kim3, Chang-Hwan Choi2, Min-Su Jeon2 and Minsoo Jeon2, (1)Chungbuk National University, Cheongju Chungbuk, South Korea, (2)Korea National Sport University, Seoul, South Korea, (3)Taeneung National Training Center of Korean Olympic Committee, Seoul, South Korea
Background/Purpose: The purposes of this study were to develop and calibrate the Importance of Performance   Measurement Scale (IPMS) for Korea archery using the Rasch model, and to validate the scale through known group difference approach. If the Experience of Archery (EOA) score is more than 10, independent coaching is generally possible (Korea Archery Association, 2012).

Method: Based on the literature review and consultation of content and measurement experts, the 27-item IPMS was generated. The scale was administered to 463 Korean elite archeries in Seoul universities. Rasch measurement computer program, WINSTEPS(Linacre, 2009), was used to analyze the data. Model data fit was determined by Infit and Outfit statistics (≥0.70 and ≤1.30). The unidimensionality of the scale was determined by Infit and Outfit (mean square) using Chi-square fit statistics. If the values of the Infit and Outfit are 1.00, the observed score perfectly fit the expected model. One-way ANOVA was used to establish the known group difference validity evidence of the IPMS through SPSS 21.0 statistical software. Alpha level was set at 0.05. A statistically significant mean difference in the archeries’ importance of performance between EOA score level(<10, ≥10) would provide known group difference validity evidence for the IPMS.

Analysis/Results: 22-item of the 27 items had good model-data fit with acceptable fit statistics. The five items were eliminated from the final estimation (the 5-item’s infit and outfit statistics index were over 1.30). Overall, a unidimensional model fits the data well and the 7 rating categories functioned well; threshold advanced with category. The item separation index (2.57) and separation reliability statistic (.98) provided evidence that the items had good variability with a high degree of confidence in replicating placement of the items from another sample. There was a statistically significant mean difference in the person's logits score between categorized the EOA group(<10, ≥10), F(1, 461) = 7.609, p < 0.006. This result supports the known group difference validity evidence of the IPMS.

Conclusions: Results provided support for using the IPMS. The scale can be used to assess the importance of performance of individuals and provide information to Korea Archeries. The newly developed IPMS for archer in Korea should be validated to another sample to increase external validity.

Handouts
  • 2015 SHAPE POSTER(Sae-Hyung Kim)1.pdf (443.4 kB)