Hey NOMI !

Type UX Design

Advisor Youge Xiao
(Head of HMI Design at NIO)

Time Aug - Oct 2023, 2 months

Teamwork Independent Project

Tools Arduino, Protopie, Figma

Design emotional companionship for NIO’s in-car AI assistant through multi-modal interaction

This is an interdisciplinary project that explores the emotional design of AI assistant through psychology, experience design and hardware prototyping.

By designing the interaction of NIO’s in-car robotic NOMI, this project seeks to create memorable moments for NIO’s users and reimagine our relationship with AI in an age of generative AI & large language model.

Background

Introducing NOMI - NIO’s in-car AI assistant

User Feedback

While NIO’s users enjoy NOMI’s emotional companionship, they still have pain points and expectations.

Trend Research

HMI trends suggest that NOMI's emotional design will play a significant role in future in-car experience, and emerging technologies bring innovation opportunities for NOMI’s conversation, emotion and interaction.

Identify Design Challenge

How to improve the emotional value of NOMI by multimodal interaction?

Psychology Theory

Use Emotion Typology in Psychology to understand human emotions and learn from the emotional design of electronic pets.

Experience Design Framework

Use experience design framework to ideate memorable moments of NOMI.

Concept 1- First encounter

Design a memorable “unboxing” experience for new NIO car owner

Prototype

Put on a hat to wake up NOMI at first encounter

Concept 2 - Pick up a friend

Create subtle surprises in everyday life for - pick up a friend

Prototype

Say goodbye to NOMI using hand gesture

Concept 3 Connection moment

Multi-person interaction with NOMI to create connections between people

Prototype

Make a heart with NOMI
(gesture recognition trained through ml5.js)

User Test

User feedbacks for NOMI’s emotional design and potential improvement in the future