Affectively-Align & Culturally Aware ABA Notebook

 

I chose “Using computer-based instruction to teach implementation of behavioral skills training: by Campanaro, Vladescu, DeBar, Deshais, and Manante (2002) from JABA because it focuses on training staff to implement a critical skill providing effective performance feedback through Behavioral Skills Training 

 What They Changed (IV) 

The study’s independent variable was a computer-based instruction (CBI) module designed to teach registered behavior technicians and other practitioners the precise implementation of Behavioral Skills Training. BST is an evidence-based package often used by supervisors to teach new skills to employees and consists of four core components: instructions, modeling, rehearsal, and feedback. The CBI module was self-paced, interactive program that included: 

• Instructional components detailing each step of the BST process 

• Video models demonstrating both correct and incorrect implementations of each BST step. 

• Embedded quizzes requiring trainees to identify whether each step was performed accurately or inaccurately, with immediate corrective feedback for incorrect responses. 

The researchers systematically implemented this CBI package to evaluate its effects on the trainees’ ability to correctly perform BST with a confederate colleague. 

What They Measured (DV) 

The dependent variable was the percentage of correctly implemented steps of a BST procedural checklist during role-play sessions with a confederate “employee”. The task analysis for BST included multiple critical components. Data were collected by trained observers using a standardized checklist during direct observation of 10-minute sessions where participants conducted BST. Each step of the procedure was scored as correct or incorrect based on specific operational definitions, providing an objective and direct measure of the staff’s acquired skill fidelity. 

How They Checked Agreement (IOA) 

The study reported top-notched IOA data to ensure the reliability of its measurements. IOA was collected by a second, independent observer for 33% of all sessions accross all experimental phases (baseline and post-training) and for all participants. The researchers reported a mean IOA score of 100% for the primary dependent variable (procedural fidelity of BST implementation). This perfect agreement indicates a flawless consistency between observers and provides exceptional confidence in the accuracy and reliability of the reported data, significantly strengthening the study’s internal validity. 

Calculation of IOA 

IOA was calculated using a trial-by-trial agreement method. Given that the dependent variable was measured using a procedural checklist, each step was treated as an individual opportunity for agreement. The specific calculation process was as follows: 

1. Two independent observers simultaneously but independently recorded data on the same sessions using the same checklist. 

2. For each session, the number of steps with an agreement (both observers scoring the step identically as either correct or incorrect) was summed. 

3. The number of agreements was then divided by the total number of steps (the sum of agreements plus disagreements). 

4. This ratio was multiplied by 100 to obtain a percentage of agreement for that specific session. 

formular was represented as:  

IOA= (Number of agreements / Total number of steps) x 100 

I like this study because it shows that computer-based training can be a good way to teach employees how to use BST correctly. The researchers used a clear ED where they tested the training and measured its effects carefully. I also like how they use straightforward measurements and high IOA. It makes it easier to understand how analysts ensure their data is accurate and their findings valid. 

Reference: 

Camparo, A.M., Vladescu, J.C., DeBar, R.M., Deshais, M.A., & Manante, C.J. (2022). Using computer-based instruction to teach implementation of behavioral skills training. Journal of Applied Behavior Analysis, 56(1), 241-257.