More than words: Visualizing AI-based analysis of human-to-human communication training in healthcare education

General

Art der Publikation: Conference Paper

Veröffentlicht auf / in: HCI International Posters 2024

Jahr: 2024

Seiten: 352–362

Veröffentlichungsort: Washington D. C.

Verlag (Publisher): Springer Verlag

DOI: https://doi.org/10.1007/978-3-031-61966-3_38

Authors

Fabian Samek

Markus Dresel

Nicole Jochems

Abstract

This paper presents the interface development of an AI-based analysis tool for communication training in healthcare contexts as part of higher education. The key functionality consists of a visualization of communication features for students and lecturers, which is based on audio recording and AI-based analyzing of roleplays. The output contains a transcription as well as charts showing each speaker’s speaking time, pitch, loudness, and speech rate. In terms of methodology, a human-centered approach was followed to construct the interface by designing usage scenarios and iteratively engaging stakeholders in the process. Formative evaluations significantly contributed to the emerging web-based system that visualizes communication analysis data to complement the retrospective discussion. The system also assists in pre-configuring and recording the communication training. First qualitative results based on preliminary use in practice indicate high user acceptance and positive interest. Skepticism and uncertainties have scarcely been observed. Moreover, users perceive the effort of usage to be in good proportion to the resulting benefit. This paper comprises the essence of the product’s evolution as well as its most recent version with its key features concerning visualization, and first evaluation results that point to its added value.

Downloads

Download Publication

Zitation kopiert