Why simulated practice matters
The research behind TherapyCoach — and the training gap it was built to close.
Therapists don't automatically improve with experience
One of the most uncomfortable findings in psychotherapy research is that therapists don't reliably get better over time. A landmark study tracking 6,591 patients across 170 therapists found that clinical outcomes actually declined slightly with increasing years of experience. More clients seen, more years practised — and outcomes got worse, not better.
Therapists, on average, did not improve over time — their patient outcomes actually worsened slightly as they gained more experience.
Goldberg et al. (2016), Journal of Counseling PsychologyThis isn't because clinicians stop caring. It's because passive experience — seeing clients, attending workshops, reading — doesn't produce the kind of learning that translates into measurable skill improvement. Something else is needed.
Workshops and lectures don't change practice
Most continuing professional development for therapists still relies on formats that research has consistently shown to be insufficient. One-off workshops, conference presentations, and didactic training may increase knowledge, but they rarely change what a clinician actually does in the room with a client.
A systematic review of CBT training approaches found that instructor-led and self-guided training produced only moderate increases in competence — and the gains were strongest when training targeted specific, highly structured skills rather than general theory. Broader reviews of therapist training have found that without structured follow-up, ongoing practice, and feedback, the effects of workshop-based training wash out within months.
Standard training formats lack five critical processes: observing your own work, receiving expert feedback, setting incremental goals, repetitive behavioural rehearsal, and continuous performance assessment.
Rousmaniere (2017), Deliberate Practice for PsychotherapistsDeliberate practice closes the gap
The concept of deliberate practice — originally developed by Ericsson to explain expert performance in fields like music and sport — has been increasingly applied to psychotherapy training. Unlike routine practice, deliberate practice involves focused, effortful rehearsal of specific skills with immediate feedback, pushing just beyond current ability.
When applied to clinical training, deliberate practice means repeatedly rehearsing therapeutic micro-skills (reflections, open questions, validation sequences, Socratic dialogue) in a structured way, with feedback on performance — not just thinking about them or watching someone else do them.
Early evidence for deliberate practice in psychotherapy is promising. Trainees who engaged in structured skill rehearsal with feedback showed faster skill development than those using traditional training alone. The challenge has always been access: deliberate practice requires a practice partner, a realistic scenario, and timely feedback — resources that are expensive, logistically difficult, and rarely available outside of formal training programmes.
Simulation fills the access gap
Simulation-based training has a long evidence base in medicine, nursing, and allied health. A meta-analysis of 50 studies on virtual patient simulations found large effect sizes on both knowledge and skill outcomes. In social work, 61% of students achieved mastery in targeted engagement and assessment skills through simulated practice.
More recently, research has explored AI-driven client simulation specifically for counselling skills. Standardised patient roleplays — whether human or AI-generated — are consistently rated as highly valuable learning experiences that build practitioner confidence and allow safe experimentation with technique. The combination of realistic practice with structured feedback produces better skill transfer than either element alone.
Roleplay simulations with feedback were perceived as highly valuable opportunities that build clinical confidence and enable safe skill experimentation.
Räuchle et al. (2025); Maurya (2024)The emergence of large language models now makes it possible to create client simulations that respond naturally and unpredictably — more closely approximating the experience of real human-to-human roleplay than the branching-logic simulations of the past.
What TherapyCoach does with this evidence
TherapyCoach was designed to bring together the components that research identifies as necessary for effective skill development: realistic practice scenarios, modality-specific coaching feedback, validated assessment scoring, and structured progression through skills of increasing difficulty.
It doesn't replace supervision. It fills the space between learning about therapy and doing therapy — the same space that flight simulators fill for pilots, and that simulation labs fill for surgeons. A space where you can practise, make mistakes, get feedback, and try again — without any risk to a real person.
Clinical fidelity frameworks
Coaching feedback and assessment scoring in TherapyCoach are calibrated against established clinical fidelity instruments — the same tools used in research and supervision to evaluate therapeutic competence.
Motivational Interviewing — feedback is informed by the Motivational Interviewing Treatment Integrity (MITI 4.2.1) coding manual, which evaluates global dimensions (cultivating change talk, softening sustain talk, partnership, empathy) and behavioural counts (reflections, questions, affirmations, seeking collaboration, persuade, confront). The MITI is the most widely used MI fidelity measure in research and clinical training.
Cognitive Behavioural Therapy — feedback is informed by the Revised Cognitive Therapy Scale (CTS-R), which assesses therapist competence across domains including agenda setting, guided discovery, conceptual integration, application of CBT methods, and homework setting. The CTS-R is used internationally as a training and supervision benchmark.
Dialectical Behaviour Therapy — feedback is informed by the DBT Adherence Coding Scale, which evaluates adherence to DBT strategies including dialectical strategies, core mindfulness, distress tolerance, emotion regulation, and interpersonal effectiveness, as well as structural elements like diary card review and behavioural chain analysis.
These instruments are used as reference frameworks for structuring feedback — TherapyCoach does not claim to produce validated fidelity scores. AI-generated scores are approximations intended to support learning, not to replace formal competency assessment or clinical supervision. For more on how TherapyCoach uses AI responsibly and aligns with Australian regulatory frameworks, see our AI & Compliance page.
References
- Goldberg, S.B., Rousmaniere, T., Miller, S.D., Whipple, J., Nielsen, S.L., Hoyt, W.T., & Wampold, B.E. (2016). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of Counseling Psychology, 63(1), 1–11. PubMed
- Rousmaniere, T. (2017). Deliberate Practice for Psychotherapists: A Guide to Improving Clinical Effectiveness. Routledge. Routledge
- Alfonsson, S., Parling, T., & Lundgren, T. (2023). Systematic review of training in cognitive-behavioral therapy: Summarizing effects, costs and techniques. Clinical Psychology Review, 100, 102237. ScienceDirect
- Magill, M., Mastroleo, N.R., & Martino, S. (2022). Technology-based methods for training counseling skills in behavioral health: A scoping review. Journal of Technology in Behavioral Science, 7, 294–318. Springer
- Maurya, R.K. (2024). A qualitative content analysis of ChatGPT's client simulation role-play for practising counselling skills. Counselling and Psychotherapy Research, 24(2), e12699. Wiley
- Räuchle, J. et al. (2025). Insights from roleplays with standardised patients and live supervision for psychotherapy and counselling training — a qualitative study. Counselling and Psychotherapy Research, 25(2), e70018. Wiley
- Westra, H.A., Norouzian, N., Gül, M., & Poulin, L. (2024). The influence of deliberate practice on skill performance in therapeutic practice: A systematic review. Psychotherapy Research. Taylor & Francis
- Herschell, A.D., Kolko, D.J., Baumann, B.L., & Davis, A.C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique. Clinical Psychology Review, 30(4), 448–466. PMC
Clinical fidelity instruments
- Moyers, T.B., Manuel, J.K., & Ernst, D. (2014). Motivational Interviewing Treatment Integrity Coding Manual 4.2.1. Unpublished manual. CASAA
- Blackburn, I.-M., James, I.A., Milne, D.L., Baker, C., Standart, S., Garland, A., & Reichelt, F.K. (2001). The Revised Cognitive Therapy Scale (CTS-R): Psychometric properties. Behavioural and Cognitive Psychotherapy, 29(4), 431–446. Cambridge
- Linehan, M.M., & Korslund, K.E. (2003). DBT Adherence Coding Scale. Unpublished manual, University of Washington.