As smartphone cameras became the primary go-to camera for many, the technology powering them has become an integral part of the way we share our lives with each other. Samsung has been at the forefront of this change, building a strong heritage of camera technology that has evolved the way people use the camera — from clear night photography, to professional-grade portraits, smooth video stabilization, and selfies.

Samsung Newsroom talked with Joshua Sungdae Cho, VP and Head of Visual SW R&D at Samsung Mobile, to discuss Samsung’s camera philosophy and legacy of imaging technology.

Joshua Sungdae Cho, VP and Head of Visual SW R&D at Samsung Electronics

What is the driving philosophy behind the features and specs for cameras on Galaxy devices?

Our goal is to satisfy two very different needs. First, we help general users by democratizing the experience of professional photography, making it easy for them to create high-quality photos and videos with nothing but their smartphone. Secondly, we aim to bring a more customized shooting experience for pros who want to use their Galaxy smartphone as a professional tool. To do that, we focus on three key areas: the best shooting and viewing experience, ease of use, and controllability.

Our aim with the shooting and viewing experience is to ensure that users get crisp, vivid results every time they capture images and videos. This is why we have focused on high-resolution images, best-in-class image sensors, and other features like High Dynamic Range (HDR) and Optical Image Stabilization (OIS). For ease of use, we focus on creating features that make getting the best results as simple as possible. Single Take, for example, makes it easy to take multiple pictures and videos all at the same time, then recommends the best shots of the series. Finally, controllability is emphasized in our Pro Photo and Pro Video modes, giving users more control over their final results. Underpinning all of these features is AI, which ensures users get the most optimal results.

(Left) Super steady OFF l (Right) Super steady ON

Can you expand on these three pillars? How do you ensure users get the best shooting and viewing experience?

We take a lot of things into consideration for delivering the best shooting and viewing experience for both photos and video. First, we consider portraits our top priority. With warm tones, but a natural brightness and color, our cameras capture your emotions and expressions in vivid detail. We are continuing to make this a key focus area with upgrades that improve details such as skin texture and hair. Improving the resolution of the images from our cameras is one way we accomplish this.

Higher resolution images contain more pixels, and therefore, more information.  We try to find ways to get more pixels into our sensors, as well as improved optics, so that users produce sharp images and videos even when they crop or zoom. Ensuring users get great results no matter the lighting condition is also a key focus for the shooting experience on Galaxy devices.

Our advanced High Dynamic Range (HDR), for example, makes it possible to shoot in mixed lighting and still get great results. This is possible thanks to the AI in our camera, which takes three images at different exposure levels simultaneously and then combines them into one final image. This same approach is used for low-light photography. To deliver more bright, crisp images in low-light conditions, we use nona-binning technology, which uses AI to merge nine pixels into one larger pixel so it absorbs more light and creates clear, vivid images.

Last but not least, we also adopt best-in-class hardware to deliver superior viewing and sharing experiences and improve image quality. Samsung’s cutting-edge sensor technology, such as our 108MP sensors and 50x Space Zoom on the Note20 Ultra, make it possible to capture ultra-high-resolution images and even 8K video. We combine this sensor technology with other strengths of Galaxy devices, such as world-class displays to view the results and fast Wi-Fi connectivity and 5G that make sharing large files easy, to create the best all-around smartphone camera experience.

That sounds like a lot of features to pack into a smartphone camera. How do you make sure they are intuitive and easy to use?

Ease of use is particularly important for our camera philosophy. We aim to create an optimal auto-shooting mode that delivers professional looking images and video. The only thing our users need when shooting with a Galaxy device is a good subject and a memorable moment. We also pack our cameras with features that enable greater creativity while still making it easy to get great results.

Scene optimizer is a great example of how we make it easy to get professional level results. Users just have to point and shoot, and the camera delivers an image optimized for color and brightness based on the scene. We use AI to help deliver these optimizations, ensuring that every cloud, sunset, and smile is captured just as you remember.

Ease of use is also at the heart of features like Single Take. With just a single click, the camera takes multiple pictures and videos with dynamic effects simultaneously, allowing users to capture the moment in a variety of ways and choose their favorite. Features like My Filter also make it easy for users to customize their images. With My Filter, users can create a custom filter, save it, then apply it to all of the photos they shoot.

On the opposite end of this ease of use and auto-shooting, you mentioned that customization and control are an important part of the Galaxy camera experience. How do you implement those control features?

Both Pro Photo and Pro Video mode offer users more control over their final results. In Pro Photo mode, users can tweak all aspects of the photo including the ISO, shutter speed, white balance, and exposure levels. It also gives them the power to save RAW images, which they can later edit on their own. With the enhanced Pro Video mode on the Galaxy Note20 series, we’ve given users more creative control over the fine details in their videos.

In addition to manual adjustment of exposure settings, Pro Video mode introduces features such as Zoom control, allowing users to adjust the speed of their zoom for more dramatic footage. In Pro Video mode, users can also adjust the direction of the microphone to get the best sound. To top it off, we’ve also given users the power to record 8K video at 24fps on the Galaxy Note20 for high-quality results with a cinematic feel.

Many of these features seem to be powered or enhanced by AI. Why is AI such an important component of Galaxy cameras?

AI is one of the core technologies in Samsung’s camera technology because it allows us to do a lot of the heavy lifting for the user. We use AI to improve image resolution, optimize new technology for mobile, and provide better experiences for our customers.

Auto Framing on the Galaxy Z Fold2, for example, automatically shifts the view to stay centered and in focus depending on how many people are in view.  When there is only one person, it can follow their motion and keep them centered – ideal for vloggers and creatives that are using their smartphone to create content.

In the future we will continue to implement these advancements to learn, adapt, and develop new technology that improves the overall camera experience.

In addition to improvements in AI, the trend in smartphone photography has been to add more cameras on flagship devices year over year. Is this a trend you believe will continue?

We keep trying to find a balance between the best AI technology and the optimal number of cameras on our devices. Our AI technology is continuously improving thanks to the image training technology we have developed at Samsung. At the same time, we are also working to deliver the best camera hardware for our devices. If we are able to achieve the same results from multiple cameras with just a single AI-powered camera, then we will merge the technologies. Although we are not at that point yet, we are able to deliver stunning results with features like the Ultra-Wide camera that capture landscapes from a whole different perspective, and 50x zoom on the Galaxy Note20 Ultra.

The Galaxy Note20 series is a prime example of how our philosophy is reflected in our devices. We know that video usage has been steadily increasing, and has led to greater demand for better video features. So, for the Galaxy Note20 series, we improved on Super Steady, delivered 8K recording, and added increased functionality with Pro Video mode to enhance the user experience.

Ultimately, whatever we do is in service of consumer needs, to ensure every feature, experience and design choice offers increased functionality and quality.

Camera: Realize Your Cinematic Vision

Capturing jaw dropping footage just got easier. Pro Video mode lets you produce high-fidelity videos with just the Galaxy S20 series alone.

• If you want to give your videos a cinematic look, all you need to do is shoot in 8K with 24fps frame rate. With the option to record footage in 21:9 aspect ratio, you can capture more of your experiences.

• To produce pro-grade videos, audio quality is as important as the visuals. Pro Video mode on the Galaxy S20 series gives you the ability to control the smartphone’s mic direction, so you can pick up specific sounds when you shoot. When paired with the Galaxy Buds line-up, you can use the earbuds as a pro-style lavalier microphone to minimize background noise and record crystal-clear audio.

Samsung Notes: Experience Next-Level Productivity

The latest Galaxy S20 update is bringing even more powerful features to Samsung Notes to help you get more done faster.

• With Audio Bookmark, you can synchronize your notes with audio recordings of lectures or meetings. When you review your notes, you can simply select a section of what you wrote to play back the corresponding audio. Alternatively, you can scroll through audio recordings to see the matching notes.

• The updated Samsung Notes also lets you import and write on PDF files, making it simpler for you to review and revise documents on-the-go.

• When you are working with multiple devices, Samsung Notes’ Auto save & sync function keeps you in the flow by letting you quickly access notes across your Galaxy S20, tablet, and PC. With new template and background color options available, as well as the ability to add handwritten text to typed documents, Samsung Notes can help you work more efficiently, no matter your style.

Samsung DeX: A Smarter Way to Multitask

• When it comes to multitasking, two screens are better than one. By tapping on the Samsung DeX icon in the quick panel, you can now connect your Galaxy S20 to a Smart TV wirelessly and instantly enjoy more space to work and play.²

• Samsung DeX also lets you use the Galaxy S20 as a touch pad to control the second display with multi-finger gestures. Simply swipe up with three fingers to see recently opened apps, down to return to home screen, or left or right to switch between apps.

Seamless Connectivity and More

• Enjoy advanced Wi-Fi connectivity with the latest Galaxy S20 update. You can easily share the password of the Wi-Fi you are connected to with nearby Galaxy devices that are in your contact list. The new Wi-Fi feature will also show you the speed of the connections in your surroundings, so you can quickly find the one that suits your needs.

• With the updated Reminder app, you can preset time and location for upcoming meetings and tasks.

¹ Updates available on following devices: Galaxy S20 Ultra 5G, S20 Ultra, S20+ 5G, S20+, S20 5G, S20/S10 5G, S10+, S10, S10e, S10 Lite, S9, S9+/Note10+ 5G, Note10+, Note10 5G, Note10, Note10 Lite, Note9/Z Flip 5G, Z Flip, Fold 5G, Fold. For other Galaxy devices, Samsung is committed to providing the latest update until the hardware specifications allow to provide the optimized mobile experience for our users. Supported features may vary by devices.

² Samsung DeX wireless connection is available on smart TVs that support Phone Screen mirroring only. For the optimal experience, use the feature with Samsung Smart TVs launched 2019 or later.

By allowing you to record content in 8K quality, and by offering unprecedented control over your footage with enhanced Pro Video mode, the newest additions to the Note family make creating professional-grade videos nice and simple.

Click on the video below to watch Samsung explain the ins and outs of the cameras’ most exciting upgrades.