Agora-1

NVIDIA Cosmos is a developer-first platform of state-of-the-art generative World Foundation Models (WFMs), advanced video tokenizers, guardrails, and an accelerated data processing and curation pipeline designed to supercharge physical AI development. It enables developers working on autonomous vehicles, robotics, and video analytics AI agents to generate photorealistic, physics-aware synthetic video data, trained on an immense dataset including 20 million hours of real-world and simulated video, to rapidly simulate future scenarios, train world models, and fine‑tune custom behaviors. It includes three core WFM types; Cosmos Predict, capable of generating up to 30 seconds of continuous video from multimodal inputs; Cosmos Transfer, which adapts simulations across environments and lighting for versatile domain augmentation; and Cosmos Reason, a vision-language model that applies structured reasoning to interpret spatial-temporal data for planning and decision-making.

Starchild-1 is the first real-time multimodal world model, built to simulate both the visuals and sounds of the world in real time. Unlike language models, which learn from text, world models learn directly from the world itself through pixels, motion, and actions encoded in large-scale video, becoming capable of understanding and simulating an approximation of the world as it evolves. Starchild-1 goes beyond traditional world models, which have mostly focused on visual generation alone, by autoregressively generating synchronized audio and video while continuously responding to streaming user input. Instead of producing a fixed offline clip, it predicts the next audio and video state of a world based on past observations and live inputs, enabling environments, conversations, ambient sound, and world dynamics to change interactively. Users can stream text, speech, and action inputs into the model during rollout, dynamically altering what is seen and heard in real time.