Open Source Contributions
GitHub Repositories
We maintain open-source tools and hardware designs that enable reproducibility and community adoption.
🔗 Open4D
A modern library for 4D dynamic geomtry data processing.
🔗 Swift
An adaptive videos streaming system using neural codecs.
Open Spatial AI Datasets
Open datasets for advancing spatial intelligence, dynamic 3D scene understanding, neural rendering, world models, and immersive computing.
SceneHub4D
Dynamic 4D Scene Dataset
A multimodal dataset of dynamic indoor environments containing synchronized RGB-D video, camera trajectories, point clouds, textured meshes, and Gaussian splats.
Research areas: Spatial AI, world models, 4D reconstruction, neural rendering, robotics, and XR.
Explore SceneHub4DSpatial Video Dataset
Stereoscopic Spatial Video Dataset
A collection of stereoscopic spatial videos captured using consumer spatial-computing devices, including Apple Vision Pro and iPhone.
Research areas: Spatial video, stereo vision, depth estimation, immersive streaming, and AI-based 3D understanding.
Explore SVDLive Demos
RobotTwin: Human-Robot Collaboration in XR
This demo showcases a mixed reality-based digital twin system for human-robot collaboration in industrial environments. The XR interface enables intuitive visualization of robot tasks, enhancing safety and coordination in factory settings.
XRFab: XR Cleanroom Training Simulator
XRFab simulates cleanroom procedures for semiconductor manufacturing. Trainees interact with wafers and tools using hand tracking on Meta Quest 3, building procedural confidence in a safe, immersive environment.
Interactive XR Assistant for Interventional Radiologists
This demo features a context-aware assistant designed to support interventional radiologists using XR overlays. The system helps visualize anatomical landmarks, procedural steps, and real-time data in a minimally invasive clinical setting.
Outreach Activities
Hosting High School Students via SPLASH Program
As part of the NASA Space Suit Challenge Program under the Artemis mission, we hosted high school students via Northeastern’s SPLASH program. Students were introduced to cutting-edge XR technologies and participated in hands-on activities with state-of-the-art mixed reality headsets like Apple Vision Pro, Meta Quest, Microsoft Hololens, etc. This program aimed to inspire the next generation of scientists and engineers by providing them with immersive experiences and insights into XR technology.
Human Robot Collaboration Demo for Industrial Settings
Barath and Mayank demonstrating our mixed reality-based digital twin project for human robot collaboration in industrial and manufacturing environments.