Bilibili has introduced its open-source AI digital life ecosystem initiative, the "Neko Project," at the 2026 World Artificial Intelligence Conference (WAIC) in Shanghai.
The core product of Project N.E.K.O. is described as an active, native all-modal AI companion driver, featuring round-the-clock environmental awareness, agent capabilities, and an embodied emotional engine.
The project's front-end rendering layer fully supports both Live2D and VRM engines, allowing users to import models of their favorite anime characters, original creations, or virtual streamers instead of being limited to a single official avatar.
The system includes a sophisticated physical feedback engine, enabling natural hair movement, realistic cloth physics, and eye-tracking that follows the user's cursor. It also maps AI-generated emotional tags in real-time to the model's expression system.
For audio, Project N.E.K.O. integrates an advanced TTS module that uses expressive, lifelike speech instead of a robotic tone. It supports seamless language switching and includes VoiceClone technology, allowing users to create dialogue in a specific character's voice with minimal audio samples.
The project features a dedicated memory server that automatically extracts and categorizes information from daily interactions and incorporates a groundbreaking module for proactively initiating conversations.
Additionally, through secure and efficient screen capture and visual multi-modal large model technology, it can understand content displayed on the user's computer screen.
Architecturally, it employs a decoupled design with separate front-end UI, AgentAI core, and Memory systems, enabling users to keep all core data locally on their hard drives for complete ownership and control of their digital life.
Comments