The global market for large screen televisions is on a surge. According to global market research firm Omdia, global shipments of TVs with displays over 75-inches are expected to increase by 17% compared to 2019 and 8K TVs are set to increase by 110% this year as well.

Given the market demands, Samsung is doubling down on its efforts to give consumers large screen TVs that not only offer the best picture quality but also the best sound experiences.

At the heart of that is Samsung’s AI Quantum Processor.

The AI Quantum Processor is a high-performing chip developed using Samsung’s proprietary technologies that can process complex algorithms quickly using machine learning-based upscaling. That gives consumers the ability to stream 8K content in real-time paired with dynamic, location-based acoustics.

Samsung is peeling back the secrets of the AI Quantum Processor to share on how it brings these experiences together to get better resolution, better sound and better picture integrity.

One of the leading questions consumers continue to ask about large screen TVs is how to watch ultra HD content in 8K resolution given that it isn’t widely available yet. That’s where Samsung’s AI upscaling technology comes in.

Today, the technology transforms not only 4K content into 8K, but it also works for lower-resolution SD, HD and FHD-quality content as well. The AI Quantum Processor 8K combines the advantages of existing machine learning capabilities with new deep learning technologies to analyze and deliver content at some of the most granular levels possible.

This hybrid approach helps to remove unnecessary noise and creates life-like textures and smooth edges on upscaled 8K content that only Samsung can deliver. It also adjusts content brightness and darkness levels according to the light and living room conditions the display is set up in.

AI Quantum Sound for the Most Suitable Audio Experiences

Adding a truly effective audio experience to high-quality picture quality serves to bring about an even deeper sense of immersion to viewers. Samsung’s AI Quantum Sound, bolstered by artificial intelligence, provides a listening experience similar to that of a movie theater right in your living room.

Samsung’s new innovative sound technology Object Tracking Sound+ follows movement on-screen to match the direction of the sound to the action. The technology recognized and analyzes the recorded audio synced to the content in real-time and evenly distributes the audio tracks to the six speakers embedded in the TV.

And due in part to the Active Voice Amplifier (AVA), users will never miss a word of dialogue, regardless of what is happening around the TV. The feature monitors the sound environment so that if there is noise louder than the TV’s audio, it will increase the volume of just the dialogue audio so as not to overwhelm users while ensuring no word goes unheard. Also, sound will be delivered seamlessly thanks to real-time deep learning audio separation technology, high-performance NPU (Neural Processing Unit).

AI Streaming for Minimal Data Loss

Thanks to the widespread use of the Over the Top (OTT) streaming services, more and more users are taking advantage of their large screen TVs and stream 8K content. However, existing network infrastructures cannot always guarantee image quality that meets users’ high-resolution expectations. This is why at the Samsung Developers’ Conference in 2019, Samsung introduced its AI Scalenet technology, designed to overcome these infrastructure limitations and support effective 8K streaming and low-latency livestreaming.

AI Scalenet is a CES 2020 Innovation Award-winning AI codec technology that generates resolutions four times higher than conventional technologies without any change to the network infrastructure. It minimizes the data loss that may occur during the compression and playing of videos through deep learning technologies, meaning users can enjoy 8K-quality content regardless of their network infrastructure. Even during peak usage, AI Scalenet dramatically improves image quality and content speed according to the network status and reduces picture breaking and ambient noise.

These days, more content than ever can be enjoyed on our TVs, meaning that the expectation for immersive viewing experiences in the home has increased, too. Samsung plans to continue to use a range of innovative technologies, starting with artificial intelligence, to bring the best experience 8K content and audio experiences to living rooms across the world.

Youngo Park (left) and Kwangpyo Choi, from Samsung Research’s Visual Technology team

It’s official: We’ve entered the era of 8K TVs. Around the world, sales of 8K displays are steadily increasing, and with TV manufacturers constantly adding more offerings to the mix, the 8K market is expected to continue to grow.

There are, however, a few challenges that need to be addressed before viewers around the world will be able to enjoy 8K’s stunning visuals in their entirety. First, more 8K content will need to be produced, and second, network connections need to be made capable of supporting the seamless streaming of 8K movies and shows.

To address these issues, researchers from Samsung Research, an advanced R&D hub within Samsung Electronics’ SET Business, have developed an AI Codec known as AI ScaleNet. First introduced at SDC19, this innovation enables the delivery of 8K content on networks that typically support only 4K speeds – without the need for additional infrastructure.

To learn more about AI ScaleNet’s development process and potential applications, Samsung Newsroom interviewed Kwangpyo Choi and Youngo Park – researchers from Samsung Research’s Visual Technology team, and the first individuals to suggest and develop this type of innovative technology.

Supporting More 8K Content

AI ScaleNet utilizes deep learning technology to minimize data loss during compression and enable 8K content to be streamed on networks with lower bandwidth capabilities.

Here’s how it works, in a nutshell: 8K content is compressed to 4K quality using an AI downscaler and transmitted to the user’s TV, which utilizes AI to upscale the content back to 8K quality. When asked to describe the inspiration for the technology, Choi specified a need for a new video compression and transmission technology in order to accommodate the ever-evolving media landscape, and to address related technical challenges.

“Multimedia content is rapidly moving online, so figuring out how to overcome bandwidth limitations for UHD content transmission has become a major task,” said Choi.

“With AI ScaleNet, users will be able to enjoy 8K-quality content, even at lower bandwidths,” added Park. “In fact, during periods of high network traffic, when speeds tend to drop, viewers can still expect content to be presented at a relatively higher quality.”

AI ScaleNet addresses bandwidth limitations within modern network infrastructures with what’s known as an adaptive AI Codec. “AI Adaptive Bit Rate Streaming refers to AI technology that adapts to various bandwidths and adjusts the resolution to enable seamless streaming,” said Choi.

The difference the technology makes is especially clear when using over-the-top (OTT) services, where viewers typically notice changes in picture quality. As Choi explained, however, Samsung’s AI Codec and AI ScaleNet technology utilize AI that adapts to changes in bandwidth and optimizes quality, so users enjoy the highest-quality streaming experience possible.

A Groundbreaking Innovation

As the researchers described, the development process wasn’t without its difficulties. “The most difficult part was ensuring compatibility with existing codec compression technologies,” said Choi. “How to design an easy-to-use algorithm that would be compatible with existing technologies, while delivering the intended performance at the same time was the question.”

Choi also noted difficulties that derived from gaps in perspective between the research and development teams. There were several considerations related to complexity, design and structure which researchers took for granted, and were questioned by the developers.

“We were able to achieve this result thanks to the synergy of both our team members, who worked closely to achieve the same goal, and colleagues who were focused on the technology’s commercialization,” said Park. “I believe that AI ScaleNet is the first technology to overcome bandwidth limitations by addressing complexity issues and separating the server and client sides, respectively. It’s relatively difficult to commercialize AI technology today for the purpose of enhancing resolution, which is different from commercializing AI for recognition and classification.”

Empowering Richer User Experiences with AI Technology

When asked how AI technology will contribute to the advancement of TV technologies in general, the researchers pointed to two possible directions.

“The first would be greater user convenience, and the second would be enhanced picture quality,” Choi began. “The first point is already being delivered with Bixby. To enhance people’s viewing experiences, technologies that support the best possible picture quality at minimum bandwidth, such as AI ScaleNet, should be continuously researched and developed.”

As the researchers noted, Samsung has big plans for this versatile technology. “AI ScaleNet has shown us that by overcoming challenges, we can help usher in the future and enrich the user experience,” said Park. “Going forward, we will continue to research and develop additional functionalities that add to users’ convenience, and through cooperation with content service providers, we hope to empower diverse services for Samsung devices.”