Awesome Digital Human Live2d

Main features

• Support Docker rapid deployment

• Ultra lightweight, configuration requirements are less than 2 cores and 2G

• Supports access to orchestration framework services such as Dify/FastGPT

• Support ASR, LLM, TTS, Agent modular expansion

• Support Live2d character model expansion and control methods

• Support PC and mobile web access

PC page preview:

Mobile page preview:

Design architecture

There are many manufacturers of large models and various tools. Building your own digital human requires a certain amount of coding ability and time investment. Sound application templates and orchestration frameworks based on Dify and other frameworks make everything easier

Version record

v1.0.0

Simple interface, focusing on module scalability

• v1.0.0 - 2024-06-25

  • Front-end architecture: react + antd

  • Backend architecture: fastapi

  • ASR has been connected: bauduAPI, googleAPI

  • LLMConnected: bauduAPI, openaiAPI

  • TTS has been connected: bauduAPI, edgeAPI

  • Agent supports: repeater (repeater), dialogue (dialogue)

  • Character type support: girlfriend (1), psychologist (1), amateur (11)

v2.0.0

Embrace the Dify ecosystem and create your own digital human soul (tested the latest dify version: 0.7.1)

• v2.0.0 - 2024-08-08

  • Comprehensive upgrade of the front-end page: nextjs + nextui + tailwind

  • The front-end page is compatible with mobile access

  • The front end supports three interaction modes: chat mode, digital human mode, and immersion mode

  • The front-end supports character model and background switching as well as personal customization extensions

  • Agent support:difyAgent (both ASR and TTS can access Dify)

Deployment & Development

部署说明 (Deploy Instruction)
开发说明 (Development Instruction)
常见问题 (FAQ)

B站视频教程-部署 (Bilibili Tutorial - Deploy)
B站视频教程-All-in-Dify部署 (Bilibili Tutorial - All in Dify Deploy)

Thanks

Dify
Live2D
All library authors involved in the source code

Love & Share

知乎板块 (Zhihu Section)
数字人-定义数字世界中的你 (Digital Human - Defining You in the Digital World)
RAG架构浅析 (A Brief Analysis of RAG Architecture)
dify源码解析-RAG (Dify Source Code Analysis - RAG)
RAG-索引之PDF文档解析 (RAG - PDF Document Analysis for Indexing)
Dify打造专属数字人灵魂 (Crafting Your Unique Digital Human Soul with Dify)
数字人的All in Dify (Digital Human's All in Dify)

微信公众号板块 (WeChat Official Account Section)
数字人-定义数字世界中的你 (Digital Human - Defining You in the Digital World)
RAG架构浅析 (A Brief Analysis of RAG Architecture)
dify源码解析-RAG (Dify Source Code Analysis - RAG)
RAG-索引之PDF文档解析 (RAG - PDF Document Analysis for Indexing)
Dify打造专属数字人灵魂 (Crafting Your Unique Digital Human Soul with Dify)
数字人的All in Dify (Digital Human's All in Dify)

产研板块 (Product Research Section)
数字人调研问卷（感谢 @plumixius 同学）
Digital Human Research Questionnaire (Thanks to @plumixius)

Interest Group (WeChat)