Psychometric evaluation of the 'evidence based practice competencies questionnaire - cerebral palsy'

AIM: To understand whether knowledge translation activities are effective, good measurement of practice is required. This study investigated the psychometric properties of a self-report measure of allied health practitioner (AHP) evidence-based behaviors when working with children with cerebral palsy. METHODS: Construct validity and reliability studies were undertaken for the 12-item Evidence Based Practice Competency Questionnaire - Cerebral Palsy (EBP-CQ-CP) using the Consensus-based Standards of Measurement Instruments methods. Factor analysis tested construct validity. Weighted Kappa tested chance-corrected agreement for each item and intra-class correlation coefficients (ICC) the reliability of factors derived in the validity study. RESULTS: In the validity study 259 AHP completed the EBP-CQ-CP on occasion 1, and 228 on occasion 2. In the reliability study 46 AHP completed the questionnaire twice. Exploratory factor analysis determined the EBP-CQ-CP contained two scales: 'communicating evidence based expectations' and 'evidence based assessment practices'. Confirmatory factor analysis using data from the second occasion of assessment supported the findings. Excellent consistency in ratings across factor scores were obtained from 46 pairs of raters: Factor 1, ICC = 0.93 (95% Confidence Interval 0.88-0.96); Factor 2, ICC = 0.94 (95% Confidence Interval 0.88-0.97). CONCLUSIONS: This study supports the interpretation of the EBP-CQ-CP in a clinically meaningful and psychometrically robust manner.