Reviving History Through AI: The Digital Human ‘Lady Xinzhui’

Lady xinzhui Avatar released in a subway station in Changsha city.

General Project Information:

  • Client Name: Hunan Museum

  • Project Time Length: July 2023 – Present

  • Budget: $100,0000

    "Lady Xinzhui" project represents a groundbreaking fusion of ancient history and modern technology to enhance educational experiences through interactive digital means. By creating a 3D real-time interactive AI avatar of a Han Dynasty noblewoman, this project seeks to breathe life into historical narratives and revolutionize their application in educational settings. Partnering with the Hunan Museum and the AI lab at Hong Kong University of Science and Technology, the project brings to life a noble lady from the Han Dynasty, complete with a historical mindset, to transform how history is taught and experienced, especially within the K-12 education framework.

Significance

This project is significant for its innovative use of generative AI to resurrect Lady Xinzhui, a figure from over 2,000 years ago, and the cultural context and mindset of her time. Combining archaeological insights with advanced AI creates an interactive avatar that offers immersive and engaging educational experiences. This is the first 3D real-time interactive avatar of a historical figure in China’s history, setting a new standard for integrating generative AI with cultural heritage. The project underscores the potential of AI in artistic education and aims to redefine traditional learning methods, making history more accessible, relatable, and inspiring for future generations. Imagine if this technology became a global standard for museums, providing interactive access to cultural relics and valuable historical insights that could shape the future of education.

As the project leader, I initiated this project by collaborating with Hunan Museum which is the top 3 national museum with hit traffic, and altogether with archaeologists, and AI experts from Hong Kong University of Science and Technology; This groundbreaking project brings to life a historical figure from the Han Dynasty using real-time 3D interactive AI technology. Led by an interdisciplinary team, the project aims to reshape museum learning experiences by making them more engaging, immersive, and educational, especially within informal education settings.

A Revolutionary Educational Experience

At the heart of the project is to make “Lady Xinzhui” alive, a noblewoman who lived over 2,000 years ago and whose tomb was uncovered in 1971, providing valuable insights into the Han Dynasty. Her remarkably preserved body, discovered in Changsha, China, has become a symbol of ancient Chinese culture, offering rich data on burial practices and elite life during that era. Now, through 3D reconstruction and AI resurrection, this project brings her persona back to life, transforming how we learn about the past.

It is worth noting that similar project was launched to New York MET by the time this article was published, which I had another piece of blog addressing the details. We can sense that there’s a trend emerging, and leveraging GenAI in informal educational settings like museum.

First-of-Its-Kind Informal Education in Museums

The Digital Human ‘Lady Xinzhui’ project marks a first-of-its-kind trial in using informal education within a museum context. Unlike traditional museum experiences that rely on static exhibits and passive observation, this initiative introduces a new model of interactive learning. By creating an AI avatar capable of real-time conversation, the project offers a dynamic platform where visitors can engage with historical content in a personalized and immersive manner.

This initiative signals a significant shift in museum education, turning passive learning environments into interactive educational spaces. For the first time, visitors can "meet" a historical figure, ask questions, and dive deeper into the cultural and historical significance of the Han Dynasty, all within a museum setting. By integrating AI and 3D modeling, this project encourages visitors to actively participate in the learning process, demonstrating how technology can enhance informal education.

Technological Implementation

Much of the technological backbone of the project involves a series of 3D scanning, AI-based learning， and real-time interaction features. High-resolution 3D scans and forensic artists recreated Lady Xinzhui’s facial features, while AI training models were developed using historical texts to enable contextual understanding. The avatar responds to visitors’ questions, offering insights into her life and the historical context of her era, creating a dialogue between past and present.

Significance and Impact

This project is not only significant for its technological innovation but also for its potential to transform how history is taught and preserved. By offering a real-time interactive experience, the Avatar of Xinzhui project makes history more engaging and accessible to a broader audience, especially for K-12 education and informal learning environments like museums. By providing interactive AI replicas, museums can protect fragile artifacts while still delivering immersive learning experiences.

Future Directions

The Digital Human project opens the door to numerous possibilities in education and cultural preservation.

Potential future developments include:

- interactive History Textbooks: Incorporating 3D models and AI to create engaging digital textbooks.

- Museum Exhibits: Expanding the use of interactive AI avatars across museums worldwide.

- Gamified Learning: Using VR/AR to gamify historical learning, making it more engaging for students.

- Distance Learning Programs: Offering online learning platforms where students worldwide can interact with historical figures like Lady Xinzhui.

The Digital Human ‘Lady Xinzhui’ project exemplifies how technology can revolutionize informal education within museum settings. By combining AI, 3D reconstruction, and real-time interaction, this project provides a groundbreaking approach to cultural education. It offers a glimpse into the future of interactive learning and cultural preservation, where history is no longer just a subject to study but an experience to live through.

Through this first-ever integration of AI avatars in a museum, the Digital Human project sets a new standard for how museums can use technology to engage visitors, preserve artifacts* and make history accessible to everyone, ensuring that the past remains vibrant for future generations.

Technological Implementation:

  • Avatar Reconstruction:

    • 3D Scanning: High-resolution scanners capture detailed measurements of Xinzhui’s skull and facial bones.

    • Facial Reconstruction: Forensic artists reconstruct facial features based on 3D scans, adding layers to create a lifelike appearance.

    • 3D Modeling: Detailed 3D models are created with texture and color for realism.

    • Rigging and Binding: The 3D model is rigged with a skeleton to allow movement and expressions.

  • AI-Based Learning and Database Creation:

    • AI Training: 3D models and metadata are used to train AI for recognition and contextual understanding.

    • Vector Database: Contains information from Han Dynasty literature to aid AI in generating relevant content.

  • Multimodal Interaction:

    • Dialogue Capability: The AI agent Xinzhui engages in dialogue, providing information and insights based on historical data and artifacts. This technology enhances visitor interactions in museums.

Visual Documentation:

  • Before and After Visuals: Show digital reconstruction of Lady Xinzhui.

  • Interactive AI Display: Screenshots or video clips of the AI in action within the museum.

  • Video Documentation: Include footage of the AI-agent in subway promotions and future design concepts.

ddd