Context-Aware Classification of Verbal Operants in Children with ASD Using Deep Learning

Article Sidebar

PDF
Published: 2026-02-27
Keywords:
verbal operants, autism spectrum disorder, natural language processing, context-aware classification

Main Article Content

Yaqing Bai
Human Development, University of Rochester, NY, USA

Abstract

Verbal operant assessment plays a critical role in autism spectrum disorder intervention planning, yet current manual evaluation methods suffer from subjectivity and time constraints. This study presents a context-aware deep learning framework for automatic classification of verbal operants (mand, tact, echoic, and intraverbal) in therapeutic speech recordings of children with ASD. The proposed multi-task learning architecture integrates contextual features including antecedent stimuli, functional consequences, and prosodic patterns through attention mechanisms. Experiments on 1,847 annotated speech samples from 52 children demonstrate classification accuracy of 83.7% for operant type identification and 89.2% for spontaneous versus prompted language discrimination. The framework successfully identifies atypical language patterns including delayed echolalia and scripted language with 81.4% precision. Results indicate that contextual feature integration improves classification performance by 12.3% compared to text-only baselines, providing objective support for language assessment and intervention planning in clinical practice.

Article Details

Issue

Vol. 2 No. 1 (2026)

Section

Articles

How to Cite

Context-Aware Classification of Verbal Operants in Children with ASD Using Deep Learning. (2026). Journal of Science, Innovation & Social Impact, 2(1), 232-243. https://sagespress.com/index.php/JSISI/article/view/99

References

1. N. Probol and M. Mieskes, “Autism detection in speech: A survey,” arXiv preprint arXiv:2402.12880, 2024.

2. A. C. Salem et al., “Evaluating atypical language in autism using automated language measures,” Scientific Reports, vol. 11, no. 1, Art. no. 10968, 2021, doi: 10.1038/s41598-021-90304-5.

3. M. Kohli et al., “Precision applied behavior analysis intervention for autism spectrum disorder using natural language processing and graph centrality,” Biomedical Signal Processing and Control, vol. 110, Art. no. 108034, 2025, doi: 10.1016/j.bspc.2025.108034.

4. Z. Dong and F. Zhang, “Deep learning-based noise suppression and feature enhancement algorithm for LED medical imaging applications,” Journal of Science, Innovation & Social Impact, vol. 1, no. 1, pp. 9–18, 2025.

5. G. Shang, A. Tixier, M. Vazirgiannis, and J.-P. Lorré, “Speaker-change aware CRF for dialogue act classification,” in Proc. 28th Int. Conf. Computational Linguistics (COLING), 2020, pp. 450–464, doi: 10.18653/v1/2020.coling-main.40.

6. C. K. Themistocleous, M. Andreou, and E. Peristeri, “Autism detection in children: Integrating machine learning and natural language processing in narrative analysis,” Behavioral Sciences, vol. 14, no. 6, Art. no. 459, 2024, doi: 10.3390/bs14060459.

7. R. Assaf, Z. Shehabeddine, and V. Ramesh, “Screening autism spectrum disorder in children using machine learning on speech transcripts,” Scientific Reports, vol. 15, no. 1, Art. no. 34134, 2025, doi: 10.1038/s41598-025-01500-6.

8. A. Roshanzamir, H. Aghajan, and M. S. Baghshah, “Transformer-based deep neural network language models for Alzheimer’s disease risk assessment from targeted speech,” BMC Medical Informatics and Decision Making, vol. 21, no. 1, Art. no. 92, 2021, doi: 10.1186/s12911-021-01456-3.

9. Z. Dong and R. Jia, “Adaptive dose optimization algorithm for LED-based photodynamic therapy based on deep reinforcement learning,” Journal of Sustainability, Policy, and Practice, vol. 1, no. 3, pp. 144–155, 2025.

10. S. Bae et al., “Multimodal AI for risk stratification in autism spectrum disorder: Integrating voice and screening tools,” npj Digital Medicine, vol. 8, no. 1, Art. no. 538, 2025, doi: 10.1038/s41746-025-01914-6.

11. R. Gale, L. Chen, J. K. Dolata, J. P. H. van Santen, and M. Asgari, “Improving ASR systems for children with autism and language impairment using domain-focused DNN transfer techniques,” in Proc. Interspeech, 2019, pp. 11–15, doi: 10.21437/Interspeech.2019-3161.

12. K. Sagae, “Tracking child language development with neural network language models,” Frontiers in Psychology, vol. 12, Art. no. 674402, 2021, doi: 10.3389/fpsyg.2021.674402.

13. M. Godel et al., “Prosodic signatures of ASD severity and developmental delay in preschoolers,” npj Digital Medicine, vol. 6, no. 1, Art. no. 99, 2023, doi: 10.1038/s41746-023-00845-4.

14. Z. Dong, “AI-driven reliability algorithms for medical LED devices: A research roadmap,” Artificial Intelligence and Machine Learning Review, vol. 5, no. 2, pp. 54–63, 2024, doi: 10.69987/AIMLR.2024.50205.

15. L. Peled-Cohen and R. Reichart, “A systematic review of NLP for dementia: Tasks, datasets, and opportunities,” Transactions of the Association for Computational Linguistics, vol. 13, pp. 1204–1244, 2025, doi: 10.1162/TACL.a.35.

16. M. Malgaroli et al., “Natural language processing for mental health interventions: A systematic review and research framework,” Translational Psychiatry, vol. 13, no. 1, Art. no. 309, 2023, doi: 10.1038/s41398-023-02592-2.

17. S. Rubio-Martín et al., “Enhancing ASD detection accuracy: A combined approach of machine learning and deep learning models with natural language processing,” Health Information Science and Systems, vol. 12, no. 1, Art. no. 20, 2024, doi: 10.1007/s13755-024-00281-y.

18. S. B. Goldberg et al., “Machine learning and natural language processing in psychotherapy research: Alliance as example use case,” Journal of Counseling Psychology, vol. 67, no. 4, pp. 438–448, 2020, doi: 10.1037/cou0000382.

19. Z. Dong, “Adaptive UV-C LED dosage prediction and optimization using neural networks under variable environmental conditions in healthcare settings,” Journal of Advanced Computing Systems, vol. 4, no. 3, pp. 47–56, 2024, doi: 10.69987/JACS.2024.40304.

20. Z. Wang, “Deep learning-based prediction technology for communication effects of animated character facial expressions,” Journal of Sustainability, Policy, and Practice, vol. 1, no. 4, pp. 105–116, 2025.