“Together with AMD, Samsung has been revolutionizing mobile graphics, including our recent collaboration that brought ray tracing capability to mobile processors for the first time in the industry,” said Seogjun Lee, Executive Vice President of Application Processor (AP) Development at Samsung Electronics. “Drawing on our technological know-how in designing ultra-low-power solutions, we will continue to drive ongoing innovation in the mobile graphics space.”

“We are excited Samsung selected multiple generations of our leadership high-performance Radeon graphics to advance the next generation of Samsung Exynos solutions,” said David Wang, Senior Vice President of the Radeon Technologies Group at AMD. “The extension of our work with Samsung is a testament to our strong technology partnership and commitment to bring the best experiences possible to mobile users.”

Samsung and AMD first announced their partnership to license AMD RDNA graphics architecture in 2019, leading to the co-development of Samsung Xclipse, a mobile graphics processing unit (GPU) based on the AMD RDNA 2 architecture in 2022. Xclipse was the industry’s first mobile GPU with hardware-accelerated ray tracing and variable rate shading features for console-like gameplay on mobile devices.

Exynos: The Technology Intensive System Semiconductor

In the first installment of this series, Samsung Newsroom shares the importance of the graphics processing unit (GPU) and image signal processor (ISP) in the Exynos mobile processor (SoC). Before meeting with the seven IP development leaders, Samsung Newsroom first met with the SoC Development Head and Senior Vice President Mingoo Kim, who oversees system-on-chip (SoC) design in the System LSI Business.

Kim first explained the fundamental reason behind the concept of SoC, in which various features are all incorporated into a single chip. “When chips are divided, it becomes difficult to manage their power consumption completely,” Kim said. “When each feature consumes power separately, the battery efficiency also decreases. In addition, the bandwidth limit and transfer time latency will affect data transmission between chips, which can lead to reduction in performance.” Consuming minimal power is very important for smartphones because, unlike desktop computers, smartphones are not continuously supplied with power.

“SoC has high efficiency due to comprehensive power control. And as a single chip, it also takes up less space within a smartphone,” Kim explained. “When all functions are performed by a single chip, performance is significantly improved.” Modern mobile phones go beyond simply sending and receiving calls and texts and have evolved to perform a multitude of advanced functions, including taking videos, mobile gaming and accessing financial services. The SoC, which is smaller than a thumb nail, has played a big role in making this possible.

As the SoC is the epitome of all main types of information technology that exist today, Kim described it as the “flower of system semiconductors.” “SoC is not an easy field to work in, but it’s an optimistic field that any engineer would aspire to become a part of,” Kim said. “The role of SoC will be limitless in future industries, such as the metaverse, autonomous driving and 6G.”

Samsung will continue to focus on developing proprietary IP, including GPUs, NPUs, ISPs, modems, RF and more. Samsung strives to take another step forward in chip design to become a platform solution company. “With our competitiveness in SoC, we aim to see Exynos recognized as the best mobile processor brand available,” Kim said. “Through this feature series, we hope the role and importance of SoC, the characteristics and advantages of Exynos as well as its developmental direction will be shared with more people.”

Expanding the Possibilities of Mobile Gaming: GPU for More Enhanced Graphics

In general, graphics processing requires large-scale computation, and it is faster and more efficient if processed in parallel (parallel processing). However, the structure of a central processing unit (CPU) is specialized for fast, serial processing. As such, graphics processing with a CPU would cause important computations to be delayed due to this constant computational performance by CPU. One example of this can be seen when playing a game. It’s possible that your character may not be able to avoid an enemy due to the touch input being delayed while graphics are being rendered on the display.

To address these issues, GPU was developed. Before there were GPUs, CPUs took care of everything. However, GPU was conceived to increase efficiency as a separate accelerator for similar computations that are frequently used. In short, CPU is like a general-purpose calculator while GPU is a large-scale parallel calculator specializing in graphics processing. This is how GPU came to be, and it is one of the key components in graphics processing. It receives commands from CPU and displays an object’s shape, location, color and texture on the monitor.

The Xclipse 920 equipped in the Exynos 2200 is the first mobile GPU Samsung jointly developed with AMD, a U.S. based global company that specializes in semiconductor products like GPU for PC and consoles. The name ‘Xclipse’ is a combination of the ‘X’ from Exynos and the word ‘eclipse.’ The name represents Samsung’s goal to go beyond the limits of mobile gaming and carry out performance on the level of console games, ushering in a new era of gaming.

▲Vice President Sungboem Park, a mobile processor design expert who oversees GPU development

In line with this, Samsung collaborated with AMD to develop a power efficient, console-level GPU for mobile devices. AMD’s GPUs are designed specifically for PCs or consoles, meaning they had to be redesigned to fit the mobile environment. Specifically, it was redesigned to accommodate the memory bandwidth of mobile, which is relatively limited, in addition to managing heat dissipation. “Based on our rich knowledge of low-power design, acquired from developing mobile SoCs, we were able to successfully achieve power efficiency and miniaturization in the first-generation product,” said Vice President Sungboem Park, a mobile processor design expert who oversees GPU development. “We focused heavily on minimizing heat, because mobile devices do not have fans like gaming consoles, while also maintaining performance so that the frames do not lag.”

The main role of the GPU in Exynos is to display objects in a 3D virtual space on a 2D smartphone screen, a role that is especially important when playing graphically demanding games on mobile devices. In particular, the Xclipse 920 is the first mobile GPU to support hardware-accelerated ray tracing (RT). Ray tracing is a technology which produces realistic lighting effects by simulating light rays reflected from 3D objects. By being accelerated by hardware rather than software, Xclipse 920 is able to perform real-time computations faster. In addition, variable rate shading (VRS) technology adjusts the amount of GPU computation depending on changes in color, shade, movement and other variables of the objects on screen to reduce GPU overload.

▲The Xclipse 920 has its own hardware support for ray tracing (RT) technology, which produces realistic lighting effects by simulating light rays reflected from 3D objects.

As the number of game users grows and graphics become more detailed, the development direction of GPU is becoming increasingly more important. This includes increasing the performance level to that of high-performance consoles while lowering battery consumption. By improving these two crucial areas, users are able to experience high fidelity graphics on mobile devices similarly to how they are experienced on consoles. “In general, mobile tends to lag around five years or so behind consoles when it comes to graphics technology, however, we were able to incorporate the latest console technologies in the Exynos 2200 mobile processor quickly through our collaboration with AMD. The SoC is applied to the Galaxy S22,” Park said. “We plan to continue to implement other features in the RDNA series by working closely with AMD going forward.”

“As the performance of smartphones has become enhanced overall, it’s true that it’s not easy to create a performance edge that is significant enough for consumers to notice,” Park answered when asked about the future direction of mobile GPUs. “From now on, the reason for flagship smartphone users to purchase the latest smartphones will most likely be dependent on gaming performance,” he said. This means that the possibility of the further advancement of GPUs, which determines a smartphone’s gaming performance, is high.

He also predicted that mobile GPUs will become even more important in the fields of AR and VR as well. “For AR, GPUs will need to be equipped in lightweight devices, such as glasses, so a low-power design is very important,” Park said. “Performance requirements are much more demanding in the field of VR, as the entire visible virtual world needs to be rendered instantly. As such, we need to satisfy various development requirements while also generating more realistic images at a much faster rate than we currently can. So, the advancement of mobile GPU is crucial going ahead and will have limitless applications,” he emphasized.

Elevating the Level of Satisfaction in Camera Performance: ISP for More Natural and Vivid Images

An ISP corrects raw data transferred from an image sensor and creates a photo or video to a form preferred by the user. ISP also corrects the potential physical limitations of a camera module — comprised of an optical system and an image sensor — interpolates red, green and blue (R/G/B) and removes noise. In addition, it carries out post processing, such as adjusting the brightness of a video and emphasizing detailed areas. Simply put, through fine tuning and post processing, ISP generates the picture or video that is most desirable by the users.

▲ Whole process of ISP in Mobile Camera

In earlier smartphone models, ISP was equipped as a separate chip. However, due to market demand, embedded ISP soon became the norm. “At first, we cooperated with research institutes overseas to develop a high-performing ISP that can be used for digital cameras,” said Jongseong Choi, a project leader (PL) in the Multimedia Development Team who has been working in the video processing field for more than 20 years. “As a result, our first embedded ISP solution was utilized in the Galaxy S4’s main camera.” Since 2012, the Exynos mobile processor has been contributing to a substantial advancement in smartphone cameras’ video image quality through the internalization of ISP, enabling performance at the level of digital single-lens reflex (DSLR) cameras.

▲Jongseong Choi, Project Leader of the Multimedia Development Team, has been working in the video processing field for more than 20 years.

With a high-performing ISP, consumers are able to enjoy higher video image quality as well as faster processing speeds. “It’s difficult to explain in specific numbers how great a photo is because photography is subjective, but we are conducting various research studies such as video evaluation using deep learning and ISP tuning technique to create natural and sharp photos and videos,” Choi explained. In addition, ISP also determines the speed of the burst rate in continuous shooting and is responsible for the fast-processing of high-resolution photos and videos.

The high-performing ISP equipped in the latest Exynos can process up to 200 million pixels. Up to seven image sensors are supported, and videos and images from up to four image sensors can be processed simultaneously. Also included is the ability to apply different parameters per each element, such as sky, bushes, skin and so on by incorporating semantic segmentation technology that recognizes the scenes being captured with the help of NPU. The AI feature detects and marks a person’s face and adjusts the brightness, focus and color of the video based on the face’s coordinates.

▲ Example of contents aware image processing using semantic segmentation

When asked about the future direction of ISP, Choi answered that development will be focused on maintaining low-power usage and improving video image quality. “The data transferred from the image sensor is processed in real-time by ISP, but the amount of data is increasing exponentially,” Choi said. “So, a significant amount of power is consumed in writing the data into memory and then in retrieving it later. ISP in Exynos, however, is designed to save data in memory only once, thereby minimizing power consumption,” he emphasized.

“The era of videos has arrived faster than expected and, because of this, we’re focusing on improving the video image quality,” Choi said. “In particular, we’re making efforts to increase our competitiveness by improving the video image quality, even those taken in dark, low-light environments.”

* All images shown are provided for illustrative purposes only and may not be an exact representation of the product or images captured with the product. All images are digitally edited, modified or enhanced.

“Built on the most advanced 4-nanometer (nm) EUV (extreme ultraviolet lithography) process, and combined with cutting-edge mobile, GPU and NPU technology, Samsung has crafted the Exynos 2200 to provide the finest experience for smartphone users. With the Xclipse, our new mobile GPU built with RDNA 2 graphics technology from the industry leader AMD, the Exynos 2200 will redefine mobile gaming experience, aided by enhanced graphics and AI performance,” said Yongin Park, President of System LSI Business at Samsung Electronics. “As well as bringing the best mobile experience to the users, Samsung will continue its efforts to lead the journey in logic chip innovation.”

The Industry’s First Hardware-Accelerated Ray Tracing on Mobile for the Ultimate Gaming Experience

The Xclipse GPU is a one-of-a-kind hybrid graphic processor that is positioned between the console and the mobile graphic processor. Xclipse is the combination of ‘X’ that represents Exynos, and the word ‘eclipse’. Like an eclipse, the Xclipse GPU will bring an end to the old era of mobile gaming and mark the start of an exciting new chapter.

With the high-performance AMD RDNA 2 architecture as its backbone, the Xclipse inherits advanced graphic features such as hardware accelerated ray tracing (RT) and variable rate shading (VRS) that were previously only available on PCs, laptops and consoles.

Ray tracing is a revolutionary technology that closely simulates how light physically behaves in the real world. By calculating the movement and the color characteristic of light rays as they bounce off the surface, ray tracing produces realistic lighting effects for graphically rendered scenes. To offer the most immersive graphics and user experiences even on mobile, Samsung has collaborated with AMD to realize the industry’s first ever hardware-accelerated ray tracing on mobile GPU.

Variable rate shading is a technique that optimizes GPU workload by allowing developers to apply lower shading rate in areas where overall quality will not be affected. This gives GPU more room to work on areas that matter most to the gamers and improve frame-rate for smoother gameplay.

In addition, the Xclipse GPU comes with various technologies such as advanced multi-IP governor (AMIGO) that enhance overall performance and efficiency.

“AMD RDNA 2 graphics architecture extends power-efficient, advanced graphics solutions to PCs, laptops, consoles, automobiles and now to mobile phones. Samsung’s Xclipse GPU is the first result of multiple planned generations of AMD RDNA graphics in Exynos SoCs,” said David Wang, Senior Vice President of Radeon Technologies Group at AMD. “We can’t wait for mobile phone customers to experience the great gaming experiences based on our technology collaboration.”

Enhanced 5G Connectivity and Ironclad Security Features

The Exynos 2200 is one of the first in the market to integrate Arm’s latest Armv9 CPU cores which offer a substantial improvement over Armv8 in terms of security and performance, the two areas that are becoming critically important in today’s mobile communications devices.

The octa-core CPU of Exynos 2200 is designed in a tri-cluster structure made up of a single powerful Arm Cortex^®-X2 flagship-core, three performance and efficiency balanced Cortex-A710 big-cores and four power-efficient Cortex-A510 little-cores.

“The digital experiences of tomorrow require new levels of performance, security and efficiency,” said Rene Haas, President of IP Products Group (IPG) at Arm. “As one of the first processors to incorporate the new Armv9 CPU cores, Samsung’s Exynos 2200 takes advantage of Arm’s Total Compute strategy and key security features, like Memory Tagging Extension (MTE), to deliver the purpose-built compute and specialized processing needed to power future mobile experiences.”

The Exynos 2200 offers more powerful on-device artificial intelligence (AI) with an upgraded NPU. The NPU’s performance has doubled compared to its predecessor, allowing more calculations in parallel and enhancing the AI performance. The NPU now offers much higher precision with FP16 (16bit floating point) support in addition to power efficient INT8 (8bit integer) and INT16.

Also, the Exynos 2200 integrates a fast 3GPP Release 16 5G modem supporting both sub-6GHz and mmWave (millimeter Wave) spectrum bands. With E-UTRAN New Radio – Dual Connectivity (EN-DC), which utilizes both 4G LTE and 5G NR signals, the modem can boost the speed up to 10Gbps.

For safekeeping, the Exynos 2200 comes with Integrated Secure Element (iSE) to store private cryptographic keys as well as to play a role as RoT (Root of Trust). Also, an inline encryption HW for UFS and DRAM has been reinforced to have user data encryption safely shared only within the secure domain.

Providing Enhanced Visual Experience and Professional-Level Quality Images

The Exynos 2200’s image signal processor (ISP) architecture has been redesigned to support the latest image sensors for ultra-high resolution of up to 200 megapixel (MP). At 30 frames-per-second (fps), the ISP supports up to 108 MP in single camera mode, and 64+36 MP in dual camera mode. It can also connect up to seven individual image sensors and drive four concurrently for advanced multi-camera setups. For video recording, the ISP supports up to 4K HDR (or 8K) resolution.

Together with the NPU, the ISP utilizes an advanced content-aware AI camera for more refined and realistic results. When taking a photograph, the machine learning based AI camera recognizes multiple objects, the environment and faces within the scene. It then applies optimal settings for color, white balance, exposure, dynamic range and more to produce professional-level quality images.

With 8K resolution support, the Exynos 2200’s advanced multi-format codec (MFC) makes videos truly come to life. It decodes videos up to 4K at 240fps or 8K at 60fps and encodes up to 4K at 120fps or 8K at 30fps. In addition, the MFC integrates power efficient AV1 decoder enabling longer playback time. The advanced display solution features HDR10+ adding more dynamic range and depth to the picture and offers refresh rates of up to 144Hz for a more responsive and smoother transitioning experience when scrolling or playing games.

The Exynos 2200 is currently in mass production. Click here to learn more about the Exynos 2200.

For more information about Samsung’s Exynos products, please visit http://www.samsung.com/exynos.

^* Actual performance may vary depending on device and user environment.