Emotional lines: Translating Facial Expressions into Affective Robotic Illustrations through a Geometric Feature-Based Method

Hareem Nadeem, Belinda J Dunstan

UNSW Creative Robotics Lab (CRL), Faculty of Arts, Design and Architecture, University of New South Wales, Sydney

2nd International Workshop on Cultural Robotics @ ACM/IEEE HRI 2025 · 2025

Poster: yellow header with the UNSW Sydney crest, title and authors; cream abstract box; two columns of white text panels. Figures: pencil sketches of joyful and angry faces with yellow and red line overlays, grey robot-arm trajectory plots, a marker drawing on paper, a wireframe head.
Poster as presented, 2500 × 3534 px. Select it to zoom and pan.

The names and text on this page were read from the poster image by machine and checked by a second reading. Is something wrong? Email a correction

From the poster

We present the design of a novel multidisciplinary workflow for the recognition, classification and robotic kinetic expression of human emotions, towards more inclusive human-robot interaction. Overcoming the obstacle of designing social robots to communicate in an emotionally engaged manner remains an active challenge in HRI, impeding the development of fluid and natural human-robot communication, and culturally sustainable interaction. Using an action research methodology, we adopted an existing facial recognition system, FACEOSC to initially detect, and Wekinator to algorithmically train facial expression data to ideate and visualise human emotions through robotic gestures and illustrations. A robot arm, Ufactory x-arm5 was kinematically trained to produce expressive gestures corresponding to the detected human emotions. The resultant movement of the robot can kinematically express and illustrate four primary emotions: anger, sadness, joy, and fear.

Cite this

cite --format=bibtex nadeem2025emotional

@misc{nadeem2025emotional, title = {Emotional lines: Translating Facial Expressions into Affective Robotic Illustrations through a Geometric Feature-Based Method}, author = {Hareem Nadeem and Belinda J Dunstan}, howpublished = {Poster, 2nd International Workshop on Cultural Robotics @ ACM/IEEE HRI 2025}, year = {2025}, url = {https://www.culturebots.org/publications/hri2025-poster-11/} }