House of Instagram Japan

House of Instagram Japan:

Immersive Branding through XR, Mocap Stage and Live Experience

XR Content Production for Events, Unreal Live Link Production

2024 / Shibuya Stream, Tokyo, Japan

House of Instagram Japan explores how immersive XR technologies and motion-capture–driven stage experiences can transform live events into participatory brand environments. By blending physical performance, real-time digital visuals, and audience interaction, the project reimagines the event as a dynamic space where creators, speakers, and guests actively shape and experience Instagram’s creative ecosystem.

A motion-capture–driven stage transforming live presentations into dynamic, real-time visuals, placing speakers at the center of an immersive Instagram storytelling environment.

A range of immersive experiences invited guests to participate, capture moments, and organically share their on-site interactions through Instagram Stories.

Core Presentation

The core keynote-led event format, structured around linear presentations and a clearly defined speaker–audience relationship.

XR-Enabled Speaker Entrance

An XR-enhanced presentation format that visualizes keynote themes in expressive, dynamic ways, amplifying each speaker’s ideas and on-stage presence.

By embedding Meta’s immersive technologies across both the live stage and XR experience, the project demonstrates how an event can operate as an Instagram brand experience—where motion capture performances, real-time 3D visuals, and XR interactions collectively drive participation, content creation, and social sharing within the platform.

Technical Pipeline - Mocap & Interaction

Overhead Camera Rigging - Deployed a multi-camera ceiling array optimized for low-light environments, ensuring comprehensive spatial coverage and high-fidelity motion capture accuracy.

Markerless Calibration - Executed spatial calibration and feature accumulation via Captury software. This markerless tracking approach eliminates wearable sensors, enabling intuitive and frictionless guest interaction.

Skeleton Retargeting - Dynamically mapped captured motion data onto 3D skeletal meshes to ensure fluid, low-latency avatar animation.

Live Link & Niagara VFX - Streamed mocap data into Unreal; Niagara particle systems bound to live skeletal movements, enabling real-time physics and dynamic collisions with virtual objects.

Backstage Show Control - live event execution managed through centralized monitoring interfaces, ensuring precise cue triggering and seamless technical operation during real-time keynote.

Real-Time Visual Feedback - Provided live on-stage visual feedback, allowing guests to instantly see their digital avatars and interact organically with generative particles and typography.

PARTNER

Instagram Japan

MY ROLES

AR Producer — Creative Direction / Spatial Storytelling

Lead Developer — XR Content / Unreal Development

TEAMS

Technical Producer Meta Offsite APAC Team

XR Stage Producer Ayaaki Osawa

Development Team TPGXR

Event Producer Monopo