Stellar Moments of Humankind

Orbstellar Series:

Music Video and 360° VR Metaverse, Unreal & Disguise Virtual Production, Unreal Web App

2022 / APAC

Inspired by the literature "Stellar Moments of Humankind", the song captures pivotal moments in the lives of great figures who changed humanity. We aimed to frame the project as more than a music video - an entire 360° VR universe where fans can recreate these "stellar moments".

Therefore, in this project, we have the music video itself under XR production to visualize the themes of the song, and the 360° VR part for fans and NFT owners to fully immerse themselves within the virtual worlds inspired by the lyrics.

Music Video & XR Production

Multiple environments were designed within Unreal Engine to represent themes from the song's lyrics, a starry night sky, floating nebulae, and shining planets, illuminating the 'truth' and 'love' at the core of existence. To prepare for the shoot, these scenes were optimized for real-time rendering on an LED wall.

During production, the artist performed inside an LED volume displaying real-time virtual environments. By managing Unreal Engine levels, controlling Blueprint parameters, and triggering sequences directly from Disguise, additional VFX layers were seamlessly augmented and composited in-camera.

Precision camera tracking synced the real-time graphics with the physical camera. The scenes were composited on set, producing ready-to-use footage for the music video.

The immersive 360° VR Metaverse gives fans and NFT owners alike a chance to fully experience Orbstellar's song "Stellar Moments of Humankind" from within a virtual world. The 360° VR experience acts as a metaverse for bringing together the artist's fanbase and creating a shared virtual space for community.

Motion Capture & Niagara Point Clouds

Full 3D scanning sensor array via RealSense is used to digitally reproduce the singer and other performers within the metaverse.

The singer's avatar fully mimics their likeness and movements in real time, allowing fans to experience an even more immersive and impactful performance.

360° VR Fan Metaverse - Interactive Web Experience

By integrating web technologies (REST/WebSocket, 360 Pixel Streaming, dynamic data pipelines) with engine-level scripting (Blueprint, Sequence, Widget), we powered an immersive, community-driven fan metaverse. This shared virtual ecosystem empowers fans to customize their own planets and avatars, inviting them to connect and journey together through the epic storyscapes of the music video universe.

They are also provided an avatar customization page to access their avatar's traits, aesthetic, and online identity.

Avatars can then travel through virtual storyscapes depicting pivotal moments in the lives of story characters, with dynamic, web-driven procedural assets and materials breathing life into the music video metaverse.

CLIENT

Music Nation

STARRINGS

Jer Lau

ROLES

Lead Designer — XR Design & Art Creation

Developer — Unreal-to-Disguise/Web Development

TEAMS

Creative Director Chris Cheung

Technical Director Jeff Wong

XR System / Hardware Jason Chan, Dicky Mok