NextFin

Peripheral Labs Leverages Autonomous Vehicle Sensors to Revolutionize Sports Viewing with Photorealistic 3D Replays

NextFin News - On December 18, 2025, Canadian startup Peripheral Labs announced a groundbreaking development that repurposes sensor technology originally designed for autonomous vehicles to enhance live sports viewing experiences. Founded by former University of Toronto autonomous driving engineers Kelvin Cui and Mustafa Khan, the company revealed it can produce photorealistic 3D replays of sports events using just 32 off-the-shelf cameras, a stark contrast to legacy volumetric systems requiring over 100 specialized cameras. The solution, combining synchronized multi-view video with advanced AI models such as learned depth estimation and neural scene representations, enables fans, broadcasters, and coaches to manipulate virtual views in near real-time—from freezing plays and rotating camera angles to following individual athletes across the field.

This innovation is taking place amid North American talks with sports organizations, aiming to address rising fan demand for interactive and customizable viewing amid a shifting sports media landscape. Peripheral Labs’ platform not only offers cinematic-quality replays but also captures biomechanical data such as joint positions and finger movements without wearable sensors. This dual capability empowers both enriched fan experiences and coaching-grade analytics, promising more precise player performance insights and injury risk assessments.

By drastically cutting down on bespoke hardware and expensive stadium retrofits required by previous technologies like Intel’s True View or Canon’s Free Viewpoint, Peripheral Labs seeks to reshape the economics of sports broadcasting. The company recently raised $3.6 million in seed funding led by Khosla Ventures to enhance latency, resolution, and scalability, intending to offer multi-year platform contracts to sports leagues and broadcasters.

The timing is strategic. Advances in AI-driven 3D reconstruction paired with growing consumer preferences for highlight-driven, interactive content are reshaping viewing habits, especially among younger audiences. Peripheral Labs competes in a heated market with players such as Arcturus Studios, Canon, and Sony’s Hawk-Eye, but its unique use of autonomous vehicle perception technology differentiates it by requiring fewer cameras and delivering more granular kinematic data.

The firm faces challenges including edge compute demands, integration with existing broadcast workflows, and compliance with increasingly stringent data privacy and player biometric use regulations enforced by player unions and leagues. Nevertheless, the promise of transforming passive sports watching into an interactive, game-engine-powered experience could revitalize live sports’ relevance, especially as digital fragmentation and short-form preferences continue to challenge traditional broadcasts.

Looking ahead, Peripheral Labs’ technology could enable fans to scrub back seconds, switch between perspectives including referees, and overlay live performance metrics such as speed bursts and heat maps. Coaches may also rapidly produce biomechanical teaching clips for skill development, potentially ushering in a new era of data-driven player management and fan engagement. If successful, this model could stimulate more premium content offerings and companion apps, converging cinematic storytelling with immersive interactivity.

The company’s approach exemplifies a larger trend of cross-industry technology transfer—from autonomous driving to sports media—highlighting the role of AI and edge computing in transforming traditional industries. As U.S. President Trump’s administration has prioritized American innovation in AI and digital infrastructure throughout 2025, such startups stand to benefit from a more favorable ecosystem for tech entrepreneurship.

Ultimately, Peripheral Labs’ work signals a paradigm shift in sports media by refashioning costly volumetric capture into an agile, scalable platform. As the sports industry battles declining traditional viewership, AI-powered interactive replay technology could become indispensable, repositioning live games as “must-watch” events customized to individual fan preferences and performance insights. This innovation will likely inspire competitors and broadcasters to accelerate adoption of AI-driven immersive technologies, reshaping the economics and culture of sports consumption over the next decade.

Explore more exclusive insights at nextfin.ai.

Open NextFin App