Zoom in and Track on Any Subject, No Matter the Location

Samsung’s latest video feature, ISOCELL Zoom Anyplace, gives users more freedom and creativity while filming with their smartphones. With the new solution for 200MP image sensors, users can select the desired subject and the camera will automatically track and film it. Until now, users have had to focus on a moving subject when shooting a video themselves. But with ISOCELL Zoom Anyplace and Qualcomm AI engine, the camera quickly finds a moving subject and tracks and follows it, ensuring that it is not missed during filming. Even fast-moving subjects are prevented from going off-screen. Additionally, videos can be shot with less screen shake.

This feature applies to zoomed-in areas with high resolution, as well, thanks to real-time remosaic[1] capabilities. ISOCELL Zoom Anyplace takes charge of tasks involved in tracking moving subjects while shooting video, and users can simply enjoy the scene in front of them with their own eyes.

This ability to take full-screen and close-up shots at the same time unlocks creative potential by providing the versatility to record one scene in many ways. As a result, creators can film from more angles, and they can do so more freely and dynamically. Even if the chosen subject is on the edge of the screen, users can zoom in on it without modifying the angle of their full-scope filming. In other words, users can zoom just about however they like. If they want to start a shot zoomed in on a subject and then zoom out, they can. If they want to do the inverse, they can do that, as well. Functions allow for a broader range of artistic choices to be made while filming, which enhances the overall user experience.

Thanks to in-sensor zoom by Tetra²pixel, users don’t need to be selective because of zoom limitations, either. Previously, with digital zoom, if the center region of interest (ROI) area was zoomed in 4x at a 12.5MP sum mode, it theoretically resulted in 0.78MP (12.5MP/16) image resolution. With in-sensor zoom, however, the selected area to be zoomed in on is selected from the entire scope and remosaiced, which allows the sensor to maintain the original 12.5MP resolution and enable video to be shot much more vividly. Cameras used to switch from wide to tele when zooming in at 3x or more, which caused the image quality and the angle to change. However, the 200MP wide camera can seamlessly zoom in at 2x or even 4x with no drop off in resolution. Because of this consistent quality, users can now enjoy a true-to-life filming experience.

E2E AI Remosaic for Image Capture

In addition to Zoom Anyplace as a video solution, Samsung is introducing End-to-End (E2E) AI Remosaic for image capture. Currently, the steps the 200MP image sensor follows for processing images after shooting are: raw data output occurs before a remosaic, which then leads to image signal processing (ISP) before finishing with JPEG image output. In this process, all of the steps occur in sequence.

E2E AI Remosaic improves the process by enabling the remosaic and ISP to take place simultaneously. In other words, E2E AI Remosaic takes a process that occurs in sequence and makes it occur in parallel, thereby reducing remosaic latency by up to half. The end result is an overall faster image processing time, which reduces the shooting time of 200MP images and improves image quality. Users will be able to take and check photos more quickly, and image quality will deteriorate on account of data loss from latency less often. Because of this, photos taken will have richer details and colors.

Continued Efforts to Improving User Experience

Based on the progress made with ISOCELL Zoom Anyplace for video and E2E AI Remosaic for image capture, Samsung Electronics is making major advancements in transforming the video and photo experiences. Because of solutions such as these, the 2021 release of the 200MP image sensor seems like a long time ago. However, advancements such as these are part of a long-term plan, as the company is continuing to work on solutions that will improve the user experience even further. We hope that users will keep looking forward to capturing the moment with Samsung’s ultra-high resolution ISOCELL image sensor. 

* The images shown are not taken with ISOCELL Zoom Anyplace or E2E AI Remosaic, and are provided for illustrative purposes only for the expected capabilities of a technology still in development.

[1] Remosaic: array conversion processing

Samsung Electronics Co., Ltd., a world leader in advanced semiconductor technology, today introduced its latest 200-megapixel (MP) image sensor, the ISOCELL HP2, with improved pixel technology and full-well capacity for stunning mobile images in tomorrow’s premium smartphones.

“The Samsung ISOCELL HP2 harnesses Samsung’s high-resolution image sensor technologies and know-how at the cutting edge for epic details,” said JoonSeo Yim, Executive Vice President of Sensor Business Team at Samsung Electronics. “Our leadership comes from innovative pixel technologies that allow our sensors to go beyond the number and size of pixels. We will continue to open new horizons and solidify our presence in the expanding ultra-high-resolution sensor market.”

The ISOCELL HP2 packs 200-million 0.6-micrometer (μm) pixels in a 1/1.3” optical format, a sensor size that is widely used in 108MP main smartphone cameras. This enables consumers to enjoy even higher resolutions in the latest high-end smartphones without larger camera bumps in their devices.

With Samsung’s advanced pixel-binning technology, Tetra²pixel, the HP2 adds more versatility to the camera as it simulates different pixel sizes to accommodate varying lighting levels. When in low-lit environments, the sensor transforms either into a 1.2μm 50MP or 2.4μm 12.5MP image sensor by binding four to 16 neighboring pixels. For fuller 8K video, approximately at 33MP, the HP2 switches to 1.2μm 50MP mode to minimize cropping and capture more of the scene. Filming 8K at 30 frames-per-second (fps), a wide field of view along with bigger pixel size can produce sharp cinematic videos.

Washed out pictures from brightly lit environments can be significantly reduced with the HP2, thanks to Samsung’s new Dual Vertical Transfer Gate (D-VTG) technology. In a photo diode within each pixel, a voltage transfer gate is placed on the bottom to transport electrons from the pixels to the logic layer. With high precision, D-VTG adds a second transfer gate in the pixel, boosting the pixel’s full-well capacity by more than 33 percent. With more electrons stored and efficient signal transfers, this method can reduce overexposure and enhance color reproduction, especially in bright light conditions

In low-lit settings, the HP2’s auto-focusing is taken to the next level with Super QPD, which allows the sensor to use all its 200-million pixels for focusing agents. The ample amount of focusing agents are grouped by four adjacent pixels to recognize both horizontal and vertical pattern changes that delivers faster and more accurate auto-focusing. Utilizing the rich pattern data along with the sheer number of reference points, the new sensor is capable of fast auto-focusing, even in a dimly lit environment.

For superb HDR performance, Samsung is introducing the DSG feature for the first time in 50MP mode which applies two separate conversion values to the analog signal received at the pixel level. In addition, the Smart-ISO Pro, an HDR solution that merges different levels of ISO readouts from a single exposure, allows the camera to take 12.5MP images and 4K at 60fps video in HDR.

The Samsung ISOCELL HP2 has entered mass production.

Samsung Electronics will hold an in-person Unpacked event in San Francisco, on February 2, at 02:00AM Malaysian Time. Join us as one of the first to see the new premium Galaxy innovations. The event will be streamed live Samsung Malaysia YouTube, Samsung Malaysia Official Website, Samsung Malaysia Facebook and Samsung Malaysia Newsroom.

From now until February 2, register your interest at www.samsung.com/my/unpacked/ to receive first hand updates on Samsung’s newest innovations and also a RM200 Samsung e-voucher[1].

Stay tuned to our official channels for all the upcoming teasers, trailers, and news about Galaxy Unpacked 2023.

[1] The redemption of RM200 e-voucher is only available to pre-orders of the next Galaxy by registered customers. Limited to one redemption per customer. First come, first served basis and subject to availability. The redemption of RM200 is limited to selected channels only. Terms and conditions apply.

Samsung Electronics Co., Ltd., a world leader in advanced semiconductor technology, today introduced the 200MP ISOCELL HP3, the image sensor with the industry’s smallest 0.56-micrometer (μm)-pixels.

“Samsung has continuously led the image sensor market trend through its technology leadership in high resolution sensors with the smallest pixels,” said JoonSeo Yim, executive vice president of sensor business team at Samsung Electronics. “With our latest and upgraded 0.56μm 200MP ISOCELL HP3, Samsung will push on to deliver epic resolutions beyond professional levels for smartphone camera users.”

Epic Resolution Beyond Pro Levels

Since its first 108MP image sensor roll-out in 2019, Samsung has been leading the trend of next-generation, ultra-high-resolution camera development. Through the steady launch of new image sensors and advancements in performance, the company is once again forging ahead with the 0.56μm 200MP ISOCELL HP3.

The ISOCELL HP3, with a 12 percent smaller pixel size than the predecessor’s 0.64μm, packs 200 million pixels in a 1/1.4” optical format, which is the diameter of the area that is captured through the camera lens. This means that the ISOCELL HP3 can enable an approximately 20 percent reduction in camera module surface area, allowing smartphone manufacturers to keep their premium devices slim.

The ISOCELL HP3 comes with a Super QPD auto-focusing solution, meaning that all of the sensor’s pixels are equipped with auto-focusing capabilities. In addition, Super QPD uses a single lens over four-adjacent pixels to detect the phase differences in both horizontal and vertical directions. This paves way for a more accurate and quicker auto focusing for smartphone camera users.

The sensor also allows users to take videos in 8K at 30 frames-per-second (fps) or 4K at 120fps, with minimal loss in the field of view when taking 8K videos. Combined with the Super QPD solution, users can take movie-like cinematic footage with their mobile devices.

Ultimate Low Light Experience through ‘Tetra²pixel’

The ISOCELL HP3 also provides an ultimate low-light experience, with the Tetra²pixel technology that combines four pixels into one to transform the 0.56μm 200MP sensor into a 1.12μm 50MP sensor, or a 12.5MP sensor with 2.24μm-pixels by combining 16 pixels into one. The technology enables the sensor to simulate a large-sized pixel sensor to take brighter and more vibrant shots even in dimmed environments, like in-doors or during nighttime.

To maximize the dynamic range of the mobile image sensor, the ISOCELL HP3 adopts an improved Smart-ISO Pro feature. The technology merges image information made from the two conversion gains of Low and High ISO mode to create HDR images. The upgraded version of the technology comes with a triple ISO mode – Low, Mid, and High – that further widens the sensor’s dynamic range. In addition, the improved Smart-ISO Pro enables the sensor to express images in over 4- trillion colors (14-bit color depth), 64 times more colors than the predecessor’s 68 billion (12-bit). Furthermore, by supporting staggered HDR along with Smart-ISO Pro, the ISOCELL HP3 can switch between the two solutions depending on the filming environment to produce high-quality HDR images.

Samples of the Samsung ISOCELL HP3 are currently available, and mass production is set to begin this year.

Keep reading to learn how the 28-meter-wide, 22-meter-high photograph (about one and a half times the size of a basketball court) came out.

“Our desire to truly test the limits of the high-performance 200MP image sensor and its image quality is what brought this challenge about,” said Changwan Kim, project manager from the Global Marcom Team of Device Solutions Division at Samsung Electronics.

“I have always wondered just how big you could go when it comes to printing out a 200MP image,” said Minhyuk Lee, an engineer from the Sensor Solutions Team at Samsung’s System LSI Business. “As exciting as it was, the challenge was a demanding one, as this was our first time showcasing the quality of an image sensor that has yet to be adopted in smartphones.”

Taking a picture with an image sensor still under development, for a camera module that is not yet fully optimized, is a very tricky task. Nonetheless, the team decided to push themselves by working with a living, moving subject rather than going with an inanimate object.

“Choosing a cat as our subject was a difficult decision. It gave us a lot of obstacles to overcome, such as capturing such an active subject with a test board,” said Minhyuk Lee. “However, the team concluded that the subject should be something that would show off a high level of detail and that was a popular photography subject at the same time.”

The team calculated several variables while preparing to shoot in an unstable environment. They even built a custom adaptor to allow them to attach various DSLR camera lenses to a test board. “In the end, we thought it was most important to capture the scene in the same conditions that smartphone users would be in,” said Kaeul Lee of the Sensor Solutions Team. “Because of this, we went with a smartphone camera module with no other aids. The results were very satisfying.”

Since the photo was taken using a test board, the photographer first checked the screen and adjusted the composition. Then, the engineers modified the settings to optimize exposure and focus. After observing the cat’s movements, the film crew then used different methods to take a series of pictures. Photographer Hyunjoong Kim was curious to see the result since 200MP resolution is not easy to come by, even in DSLR cameras. “I couldn’t believe my eyes when I saw the raw image enlarged to 100%,” said Hyunjoong Kim. “I was truly astonished by the degree of detail. In that moment, I knew any prejudices I previously had regarding smartphone photography had been proven wrong.”

The printing process was far from easy, as obviously, a 616 square-meter image cannot be printed all at once. The picture had to be printed on twelve separate 2.3-meter-long pieces of fabric and then stitched together. The printout was then transported over on a truck and installed on the wall of a building using a crane.

“When the picture was unfurled for the big reveal, the true enormousness of it really struck me, and not just because of its actual size,” said Changwan Kim. “The moment I witnessed the 200 million pixels depicting the stunning detail of the cat’s eyes and fur, I was overwhelmed by all of the efforts that had gone into developing this final product.”

For the team, the challenge of truly visualizing the next-level capabilities of 200MP technology was a thrilling one. Going forward, Samsung will continue to expand its leadership in the high-resolution market.

“The ultimate benefit of the 200MP image sensor is to allow users to capture an image that can be zoomed in and cropped without compromising on image quality,” said Kaeul Lee and Minhyuk Lee in a final comment. “The 200MP image sensor will soon become the optimal solution for 8K video recording.”

In the future, keep an eye out for new experiences the thumbnail-sized ISOCELL mobile image sensor will deliver next by following Samsung Newsroom Malaysia.