Microsoft shows SuperResolution in Teams with mixed results

Microsoft Teams is continuously evolving to provide users with an optimal virtual communication experience. A significant recent enhancement is the introduction of Super Resolution (SR) technology, first announced at Microsoft Ignite 2024 and now available in public preview, with a general release scheduled for March.

This advanced feature initially rolled out for Snapdragon X-based Copilot+ PCs, focusing on improving video quality, particularly when network conditions are less than ideal. Poor network connectivity can often lead to blurry and pixelated video feeds, significantly diminishing the quality of virtual interactions.

The Challenge of Network Degradation in Video Conferencing

During busy Teams meetings, network performance can fluctuate, impacting the clarity of video streams. When bandwidth becomes limited, the system may resort to transmitting lower-resolution videos to maintain a stable connection, but this often results in a subpar user experience.

Traditional video upscaling methods have historically struggled to effectively restore detail and sharpness. These conventional techniques, which essentially enlarge existing pixels, frequently introduce artifacts, leading to visuals that appear blurred or blocky.

The Super Resolution feature in Microsoft Teams aims to address these very issues by leveraging the power of artificial intelligence. Unlike older methods, SR employs sophisticated machine learning algorithms to analyze and reconstruct video frames, aiming to deliver significantly clearer and more detailed imagery.

How Super Resolution Enhances Teams Video

Super Resolution operates by intelligently upscaling low-resolution video feeds when network conditions are suboptimal. This AI-powered upscaling process reconstructs video frames, effectively adding detail and sharpness that would otherwise be lost.

The enhancement happens in real-time, ensuring that there is no perceptible delay between the original video stream and the improved output. This seamless integration is crucial for maintaining the natural flow of conversations during video calls.

The effectiveness of Super Resolution is adaptive, meaning it provides the most noticeable improvements in situations where video quality is severely degraded due to poor network conditions. Even minor degradations can benefit from subtle, yet impactful, enhancements.

User Experience and Performance Metrics

Microsoft conducted user testing to validate the impact of Super Resolution on perceived video quality. Participants rated the visual clarity on a scale from -3 (Much Worse) to +3 (Much Better) when comparing videos with and without SR enabled.

The results demonstrated a tangible improvement, with an average increase of +0.6 on the Comparative Mean Opinion Score (CMOS). Furthermore, a significant majority, 68% of users, reported that the Super Resolution results were superior.

In one specific test involving a two-participant call with 360p incoming video viewed at a 720p viewport size, the SR feature demonstrably improved the clarity. This highlights the practical benefits for users experiencing bandwidth limitations.

Technical Implementation and Availability

Super Resolution is powered by the AI capabilities of Copilot+ PCs, initially requiring devices with Snapdragon X processors. This ensures that the computationally intensive AI processing happens locally on the device, rather than relying solely on cloud resources.

The feature is designed to activate automatically when bandwidth is insufficient to meet the receiver’s viewing requirements. This ensures that users benefit from improved quality precisely when they need it most, without manual intervention.

Currently, Super Resolution is available for the Teams Windows app on Snapdragon X-based Copilot+ PCs from various manufacturers, including Surface, Dell, HP, Asus, Acer, Samsung, and Lenovo. Microsoft plans to extend support to other devices with capable Neural Processing Units (NPUs), including Intel and AMD Copilot+ PCs, aiming to make it a standard feature for all users.

Energy Efficiency and User Control

Recognizing the importance of battery life for mobile users, Microsoft has implemented energy-saving measures for Super Resolution. The feature is enabled by default when devices are plugged into a power source.

When a device is running on battery power, Super Resolution is automatically disabled to conserve energy. This proactive approach ensures that users can maintain productivity without compromising their device’s battery life during extended calls.

Users also have the flexibility to manually control the feature through the “Video Settings” menu. This allows for personalized preferences, giving users full autonomy over their video conferencing experience.

The Role of AI in Modern Video Enhancement

Super Resolution represents a significant advancement in AI-driven video enhancement. Unlike traditional methods that merely enlarge pixels, AI models can intelligently reconstruct missing details and textures, leading to sharper, more lifelike images.

This technology is not unique to Teams; similar AI-powered Super Resolution techniques are being developed and implemented across various platforms and applications. These advancements are crucial for improving the quality of streamed content, gaming, and general video communication.

The continuous development in AI, particularly in deep learning and neural networks, is enabling more sophisticated video processing. This includes denoising, deblurring, and more accurate upscaling, all contributing to a better visual experience.

Future Outlook for Super Resolution in Video Conferencing

Microsoft’s commitment to enhancing virtual communication through AI is evident with the rollout of Super Resolution. The company’s vision is to make this feature a standard offering across a wider range of devices and platforms.

As AI technology progresses, we can anticipate even more refined video enhancement capabilities in future versions of Teams and other communication tools. This could include real-time stabilization, improved low-light performance, and even more nuanced detail reconstruction.

The ongoing research and development in video super-resolution, including efforts in grand challenges focused on video conferencing, indicate a strong industry push towards higher quality and more efficient visual communication, even under challenging network conditions.