M3Stroke: MultiModal Mobile AI for Emergency Triage of Mild to Moderate Acute Strokes

Tongan Cai (1), Kelvin Wong (2), James Z. Wang (1), Sharon X Huang (1), Xiaohui Yu (2), John J. Volpi (3), Stephen T. C. Wong (2)

(1) The Pennsylvania State University, University Park, Pennsylvania, USA
(2) The T.T. and W.F. Chao Center for BRAIN & Systems Medicine and Bioengineering, Houston Methodist Hospital, Houston, Texas, USA
(3) Eddy Scurlock Comprehensive Stroke Center, Houston Methodist Hospital, Houston, Texas, USA
Abstract:

Over 22% of ischemic stroke patients are overlooked during triage in the emergency departments, particularly those with mild or moderate stroke which resembles stroke mimics in symptoms. While pronounced neurological conditions can be captured with existing AI solutions, identifying stroke patients with minor symptoms remains under-explored due to data scarcity, noise complexity, and feature subtlety. We propose M3Stroke, a MultiModal Mobile AI tool, to enhance the accuracy and efficiency of stroke triage for these patients. As the first stroke screening tool to integrate novel audio-visual multimodal AI into efficient mobile computing, M3Stroke runs seamlessly on common iOS devices and significantly outperforms prior methods. Trained and evaluated on a dataset of 269 patients suspected of stroke (191 stroke/78 non-stroke), M3Stroke model achieves 80.85% accuracy, 60.00% specificity, and 90.63% sensitivity, demonstrating 14.29% gain in specificity and 20.44% higher sensitivity compared with traditional stroke triage methods. The tool’s performance, robustness, and fairness across diverse demographics confirm its potential to improve ER triage, aiding tele-stroke detection and self-diagnosis, and enhancing life quality for elderly patients.

Full Paper
(PDF, 4.4MB)

More information


Citation: Tongan Cai, Kelvin Wong, James Z. Wang, Sharon X. Huang, Xiaohui Yu, John J. Volpi and Stephen T. C. Wong, ``M3Stroke: MultiModal Mobile AI for Emergency Triage of Mild to Moderate Acute Strokes,'' Proceedings of the IEEE-EMBS International Conference on Biomedical and Health Informatics, November 2024.

© 2024 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

Last Modified: October 22, 2024
© 2024