EECE 5698: Networked XR Systems

Semesters: Spring 2024, Fall 2024

This is an interdisciplinary course covering the following topics from emerging multimedia, computer networks, vision, and graphics. In addition to the regular lectures, the class will also have experiential sessions with a variety of state-of-the-art XR headsets in the market.

• Fundamental problems of networked applications
• XR content representations
• 2D, Flat 360, 3D/Volumetric videos (RGB-D, point cloud, mesh, NeRF)
• Monocular, stereoscopic, and multiview videos
• Acquiring XR content for network delivery
• Compression algorithms for RGB, depth videos, point clouds, mesh sequences
• Streaming fundamentals
• Stored, live, and interactive streaming protocols
• Streaming XR content (videos, point clouds, meshes, holograms, spaces)
• Local streaming via WiFi, mmWave, and optical wireless links
• Remote and hybrid rendering
• Visual and wireless sensing for person tracking
• Networked XR platforms such as ARKit/Core, Unity, Open3D
• Building XR systems such as 3D telepresence (VR), Spatial Web (AR)
• Tracking fundamentals: Eyes, Hands, Face, Head, Body, etc.; Outside-in, Inside-out.

EECE 2540: Fundamentals of Computer Networks

Semester: Fall 2024