Thoughts Pipeline

NVIDIA ACE

NVIDIA ACE offers a cloud-solution doing exactly what we are trying to achieve:

Real-time avatars, which understand and answer to user input with gestures, mimic and TTS.

NVIDIA ACE Product Page

NVIDIA ACE Overview

Animations are pre-made and then appropriatly chosen by the LLM.

An animation mixer is used to blend between them.