A new kind of
research lab

Phoenix-4.5: A New State of the Art in Real-Time Human Rendering

Phoenix-4.5 is the fastest and most expressive real-time human rendering model on the market, and the closest AI has ever come to passing the Turing test face to face. The whole PAL moves with every word, in 134 ms from audio to video.

Sparrow-2: Beyond Turn-Taking to Whole-Scene Conversational Understanding

Sparrow-2 is a real-time conversational understanding model that jointly models turn-taking, interruptions, backchannels, and the full acoustic scene as a single, unified system. It is an audio-native, streaming-first engine, rebuilt from the ground up, that goes beyond endpoint detection to transform the entire audio stream into decisions about when to listen, wait, or speak at a native 10 ms frame rate.

40 Years Later: Fulfilling Knowledge Navigator's Promises

Forty years ago, Apple imagined the Knowledge Navigator. Meet Dom, our real-life take on it, and the human computing interface from Tavus that powers him.

Phoenix-4: Real-Time Human Rendering with Emotional Intelligence

Phoenix-4 is the first real-time model to generate and control emotional states, active listening behavior, and continuous facial motion as a single, unified system. It is a real-time behavior generation engine, built from the ground up, that goes beyond photorealism to transform conversation data into emotionally responsive, context-aware facial expression and head motion with millisecond-level latency.

Raven-1: Bringing Emotional Intelligence to Artificial Intelligence

Introducing Raven-1. A multimodal perception system that captures not just what users say, but how they say it, how they look when they say it, and what that combination actually means. It interprets tone, expression, hesitation, and context in real time, enabling AI that can truly understand intent rather than simply respond to words.

Sparrow-1: Human-Level Conversational Timing in Real-Time Voice

Sparrow-1 is a specialized, multilingual audio model for real-time conversational flow and floor transfer. It predicts when a system should listen, wait, or speak, enabling response timing that mirrors human conversation rather than simply responding as fast as possible.

Introducing the evolution of Conversational Video Interface – now with Emotional Intelligence

Introducing our new family of state-of-the-art AI models: Phoenix-3, Raven-0, and Sparrow-0. Together they bring Conversational Video Interfaces (CVI) to the next level, and power Charlie, our new demo persona.

Phoenix-2: Advanced Techniques in Talking Head Generation — 3D Gaussian Splatting

This paper will cover the past, present and future of the talking-head generation research field. Specifically, we will dive deep into the trending 3D scene representations (NeRF -> 3DGS) and the benefits of employing 3DGS in avatar applications.

Sparrow-0: Advancing Conversational Responsiveness in Video Agents with Transformer-Based Turn-Taking

In this paper, we dive into the development and research behind Sparrow-0, exploring the innovative transformer-based approach for turn-taking and its integration alongside Raven and Phoenix models within our Conversational Video Interface (CVI), an end-to-end operating system designed for building responsive video agents.

Phoenix-1: Realistic Avatar Generation in the Wild

This research paper, written by the Tavus team, details the development of Phoenix, a groundbreaking generative model for realistic avatar creation and text-to-video generation. Phoenix leverages audio and text-driven 3D models, integrating volumetric rendering techniques and 2D Generative Adversarial Networks (GANs) to create lifelike replicas from short video clips.