“Samsung is applying AI across our operations to develop foundational technologies that make AI more intuitive and seamless,” said Young Hyun Jun, Vice Chairman and CEO of Samsung Electronics, in his opening remarks. “This year’s Samsung AI Forum brings together leading experts from industry and academia to discuss how AI is transforming society and industry, and to share insights in what we expect will be a meaningful exchange of ideas.”

This year’s forum features keynote lectures from world-renowned AI scholars; including Yoshua Bengio, Professor at the University of Montreal and a pioneer in deep learning; as well as Stefano Ermon, Professor at Stanford University and Co-founder of the startup Inception, who spearheaded the development of diffusion-based language model (DLM).

Day One: Global Scholars Explore the AI Semiconductor Future

Samsung’s Device Solutions (DS) Division hosted the first day of the forum under the theme “Vertical AI Strategies and Vision for the Semiconductor Industry,” near Samsung’s semiconductor site in Yongin, Korea.

Professor Bengio delivered a keynote address outlining the far-reaching risks of today’s AI models, including their ability to bypass human control and the potential for misuse. As a safeguard, he introduced Scientist AI, a new model designed to help mitigate such concerns.

“Unlike models built to mimic or please humans, Scientist AI focuses on providing truthful answers grounded in verified facts and data,” said Professor Bengio, highlighting the model’s potential to enhance AI safety and accelerate scientific discovery. He also shared his latest research findings on AI for materials development in the keynote.

Amit Gupta, Senior Vice President of Siemens EDA, led a session titled, “The Future of AI-Driven Electronic Design.” During his presentation, he emphasized the importance of integrating AI into electronic design automation (EDA) tools and noted that end-to-end systems spanning the entire workflow will be key to unlocking AI’s full potential.

Technical sessions featuring Yong Ho Song, Executive Vice President and Head of the DS Division’s AI Center, Professor Seokhyung Kang of Pohang University of Science and Technology (POSTECH) and Professor Il-Chul Moon of Korea Advanced Institute of Science and Technology (KAIST) followed. Each speaker shared recent research developments in AI applications for semiconductor design and manufacturing, while also offering perspectives on how the field is evolving.

“AI is already an essential tool in chip design and software development,” said EVP Song. “As semiconductor manufacturing grows more complex, we expect AI to help address the technical challenges that arise.”

The forum also recognized three winners of the Samsung AI Researcher of the Year award: Professor Nicolas Papernot of the University of Toronto, Professor Rose Yu of the University of California San Diego and Professor Lerrel Pinto of New York University. All the award recipients were invited to present their work and share insights from their latest research.

Day Two: Focusing on the Era of Agentic AI and Boosting Productivity

Day two of the forum will be held online by Samsung’s Device eXperience (DX) Division and streamed live on Samsung Developer’s YouTube channel under the theme “Generative to Agentic AI.”¹

“Generative AI has already become an essential tool across daily life and industries,” said Paul (Kyungwhoon) Cheun, CTO of the DX Division at Samsung Electronics and Head of Samsung Research. “As we enter the era of Agentic AI, Samsung will continue to focus on developing AI technologies that provide users with tangible benefits.”

The second day includes keynote speeches from Joseph E. Gonzalez, Professor at UC Berkeley and a leading researcher in language models and AI agents; Subbarao Kambhampati, Professor at Arizona State University and a world authority in AI planning and decision-making; and Stefano Ermon, Professor at Stanford University and Co-founder of Inception.

Professor Gonzalez will present his research on enhancing the agentic capabilities of large language model (LLM)-based systems. In particular, he will introduce the sleep-time compute paradigm, which enables agents to use idle interaction intervals to reason, learn and plan.

Professor Kambhampati will share his research on large reasoning models (LRMs) aimed at addressing the limitations of LLMs. He will point out that while current models excel at text generation, they remain limited in factual accuracy, planning and complex reasoning — highlighting key challenges such as ensuring answer guarantees, enabling context-adaptive computation, and providing interpretations of intermediate reasoning steps.

Professor Ermon will introduce diffusion language model, which applies diffusion models — widely used for image, video, and audio generation — into the language domain. This approach aims to overcome the limitations of traditional sequential text generation methods and propose a more efficient paradigm for language models.

In the technical sessions, Samsung Research representatives will present their latest developments, including:

• Camera AI technology for automatic color temperature adjustment
• Knowledge distillation-based methods for more efficient training of LLMs and their applications
• On-device AI technologies designed to bring LLMs to consumer electronics such as smartphones and TVs
• Automatic dubbing technology that generates voiceovers in the original speaker’s voice
• Deep dive technology that uses multi-agent systems to analyze and automatically generate various reports
• Document AI technologies that automatically convert diverse document formats into structure data for LLMs and agent systems
• An on-device AI studio for developers that shortens the development cycle of generative AI models

¹ Intelligent systems capable of making autonomous decisions and carrying out tasks on their own.

Samsung Electronics today unveiled Vision AI Companion at IFA 2025, introducing the next evolution of AI-powered displays across Samsung TVs and monitors. With a smarter Bixby voice assistant, Vision AI Companion delivers a more natural and conversational interaction as it integrates Samsung’s most advanced AI features into a single, intuitive AI experience that effortlessly helps users discover content and get contextualized answers to any question.

With consumers around the world seeking devices that do more than just stream content, Vision AI Companion reflects the increasingly central nature of TVs in the connected home. By integrating AI into the heart of the viewing experience, Samsung is enabling personalized recommendations, smarter multi-device interactions and intuitive support for your daily life.

“At Samsung, we’re investing in technology that makes experiences more personal, more intuitive, and built for the future,” said Kevin Lee, Executive Vice President of the Customer Experience Team at the Visual Display Business of Samsung Electronics. “With Vision AI Companion, we are redefining what a TV can do, going beyond picture quality and sound to deliver an experience that understands you, interacts with you and evolves with you over time.”

Conversational and Visual Intelligence

What sets Vision AI Companion apart is its ability to answer questions and requests with visualized, intelligent responses through multiple AI agent by simply pressing the AI button on your remote control.

Powered by Generative AI, Vision AI Companion delivers a more natural and conversational experience. That understands context and follow-up questions, enabling more fluid interactions that feel like a real conversation – no commands, no menus, no typing.

Vision AI Companion enables users to ask their Samsung TV about anything that’s on the screen, such as film details, the name of a piece of artwork or travel destination recommendations. Getting answers from an AI companion has never been more visualized and comprehensive. Contextualized answers to all your questions with related video/image options to choose from makes your discovery richer and more immersive than any other AI assistant.

Vision AI Companion not only responds but also understands context and follow-up interactions, displaying all relevant information directly on the screen. Content and information spanning movies, dramas, art, food, sports and travel are presented in conversational form, creating a more fluid and natural interaction with the TV.

Vision AI Companion integrates Samsung’s key AI innovations into one experience, making them easier than ever for consumers to access:

• Live Translate provides real-time translation for conversations and on-screen dialogue.
• Generative Wallpaper offers dynamic visuals customized to the user’s preferences.
• AI Picture, Active Voice Amplifier Pro and AI Upscaling Pro automatically adjust picture and sound to optimize the viewing environment across content sources.
• AI Gaming Mode delivers responsive, immersive gameplay with AI-powered optimization
• Copilot by Microsoft and Perplexity, available as standalone AI agent apps, enable task support and productivity directly from the TV to extend Vision AI Companion’s functionality.

By unifying these functions, Vision AI Companion eliminates the need to switch between multiple apps or menus, becoming a central hub for entertainment, productivity and connected experiences.

From Concept to Reality

The concept of Samsung’s Vision AI was first introduced at CES 2025, where Samsung outlined its ambition to enhance the home screen experience across TVs, monitors and other displays. At its core, Vision AI enhances display and audio quality, enables seamless communication between Samsung devices and delivers tailored content through advanced AI agents. Vision AI is backed by Samsung’s long-term commitment to consumers, offering seven years of free software upgrades through the One UI Tizen platform. This ensures that supported models will always have the latest updates and AI features as well as the latest security updates from Samsung Knox.

With the launch of Vision AI Companion, those ideas now take shape with a new level of personalization, device integration and user support. Vision AI Companion will begin rolling out as a software update in late September, starting in Korea, North America and select European markets, with additional regions to follow. To learn more, visit www.samsung.com

Samsung Electronics has led the evolution of the Galaxy camera under three development principles:

• Delivering the best picture quality for anyone, anywhere, anytime
• Offering features that satisfy even professional users
• Providing the ability to create content with easy and simple editing

The Galaxy S25 series is the culmination of these innovations, delivering a camera experience that pushes the limits of smartphones with high-pixel sensors, high-performance APs and powerful AI models.

So how did the Galaxy S25 series’ revolutionary camera experience come together? Samsung Newsroom sat down with camera developers from the Visual Solution Team of the MX Business at Samsung to hear the story directly from them.

▲ (From left) Jihye Kim, Pyojae Kim, Yunju Bae and Wonchul Choi from the MX Business’ Visual Solution Team

From Landscapes to Portraits, Every Moment Is Crystal Clear

The Galaxy S25 Ultra is equipped with a 50MP ultra-wide-angle camera, the first in the Galaxy series. “This means that photos with a wide angle of view can be taken with greater clarity and detail,” said Wonchul Choi, who led the development of camera quality. “We optimized not only hardware upgrades such as high-pixel sensors and lenses, but also software technology by building a system that enables AI models to operate organically,” Choi explained. As a tip for getting the most out of the feature, he added, “The ultra-wide-angle camera is ideal for capturing vast landscapes, but it can also be used for close-up shots to create a unique sense of depth.”

▲ Wonchul Choi

The ProVisual Engine, which uses AI-powered technology to enhance the camera experience, has also evolved. “We analyzed a full range of skin tones and preferences, and worked to use AI technology to present options for a broader variety of users. For better results, developers of various age groups took portraits themselves in different environments,” said Choi, explaining the improved portrait experience compared to previous models. “AI recognition and processing technologies analyze elements such as the person, clothing and background in the photo and optimizes each area to bring out the finer details, such as hair texture and even the subject’s pupils.”

The Nightography feature for shooting in low-light conditions has been improved as well. “For the Galaxy S25 series’ Nightography, we focused a lot on video shooting,” said Choi. “We applied 10-bit HDR video as the default for videos to achieve more realistic and richer picture quality, and applied a solution that separates the subject from the background and analyzes movement to remove noise with precision,” he said.

Shooting and Editing With DSLR Quality Like a Pro

Is it possible to get DSLR-quality results with a smartphone camera? The new Virtual Aperture feature in the Expert RAW app does by creating depths of field and aperture effects similar to those of a DSLR camera, delivering high-quality results that look like they were shot by a professional.

“We applied an interface that recreates the effect of changing the aperture of a lens on a DSLR camera, allowing users to flexibly select deep or shallow depths of field,” said Pyojae Kim, who led the development of the Virtual Aperture feature, before proudly adding that the AI-powered innovation overcomes the physical limitations of smartphones.

▲ Pyojae Kim

Achieving the depths of field and bokeh effects unique to DSLR cameras was no easy task. The training image database was built using more than 200,000 photos taken simultaneously with both Galaxy and DSLR cameras. “We had to manually control both the focus and exposure of the DSLR camera, and there were some nerve-wracking moments of having to dispose of our hard work because the photos were out of focus or taken with the wrong exposure,” said Kim. “We learned how difficult of a task it is to obtain data.”

While photos have a DSLR-like quality, videos can now be filmed in Log Video mode, a feature normally found in digital cameras that professionals use. Log video is a recording format that makes it easier to color-correct in post-production and create high-quality videos. To make log videos accessible to the average user, the Galaxy S25 series also comes with the Color Correction feature, which allows users to easily correct their video footage in the Gallery app with the click of a button.

Fun and Easy AI Editing With Just a Few Taps

First introduced in the Galaxy S24 series, Generative Edit has evolved by leaps and bounds in the Galaxy S25 series. “We focused on enhancing the fun and useful features that only generative AI can deliver,” said Jihye Kim. “We’ve improved the AI models so that they can now accurately recognize areas of the photo with only a simple touch and seamlessly erase those areas or add onto them. We also made improvements to each of the component technologies involved in generative editing.”

▲ Jihye Kim

The AI models used for Generative Edit and other generative AI features were developed through continuous collaboration with Google. “My team members and I took turns traveling to Google’s San Francisco Campus for a month at a time,” Jihye Kim said. “I remember staying up late at night, sharing ideas with the developers to improve the model.”

The nature of generative AI, which produces different results each time, often posed challenges during development. “We constantly mulled over how to quantitatively evaluate the results in a situation where they change every time. We also had to anticipate a wide range of edge cases to prevent the AI from producing inappropriate images,” she explained.

New to the Galaxy S25 series and the Galaxy lineup as a whole is the Best Face feature. This feature selects the best facial expressions of up to five people from multiple Motion Photos and composites them into a single picture-perfect group shot. “The Best Face feature can not only change a closed-eyed face to an open-eyed face, but can also turn a face from looking to the side to looking straight ahead,” Kim said. “My mom kept closing her eyes every time we took family photos, so we often had to retake them several times. It’s very useful in that kind of situation,” she added with a laugh.

An Unrivaled AI Filter Experience That Captures the User’s Unique Vibe

With Filters, the Galaxy S25 series also offers a variety of filters that intuitively capture each user’s unique aesthetic.

“We have enhanced the AI-powered feature to make it easier for anyone to capture the color or mood of their favorite photos while also improving the overall user experience to make it more user-friendly,” said Yunju Bae, who led the development of Filters. “We went through detailed tuning and repeated evaluations to balance technology and aesthetics to perfect filter quality.”

▲ Yunju Bae

Filters let users choose a photo they like and utilize AI to analyze the color and style of the photo to produce a personalized filter. “I often look at a photo and think, ‘I want to take a photo with this kind of vibe,’ so I wanted to make it easy to recreate the style I like without going through complicated editing,” Bae said as she explained the background behind the feature’s development.

Filters’ new film-style filters naturally capture the aesthetic unique to analog film. “The look and feel of analog film is a subjective area, so we went through a lot of trial and error to quantify it for digital reproduction,” Bae said. “We analyzed a lot of actual film, and through constant experiments and adjustments, we made meaningful progress in numerical representation to adequately reproduce the aesthetic of analog film,” she said. Bae also expressed her gratitude for the various experiments and analyses done in collaboration with Samsung Research, which played an integral role in enhancing the technical reliability of Filters.

The Future of the Galaxy Camera Visual Experience

The Galaxy S25 series has set a new standard for mobile cameras — but the Visual Solution Team is just getting started. The developers are already working on even bigger innovations to shape the future of smartphone imaging.

Asked about the team’s plans and ambitions for the future, Wonchul Choi replied, “Our goal is to further strengthen the camera’s picture quality fundamentals, all while maximizing convenience and accessibility so that it can perform at its best no matter where or when it’s used.”

“We plan to analyze the market’s response to Virtual Aperture and incorporate it into Portrait mode. By continuing to expand the features, we’ll ensure that the photo quality of the best DSLR cameras out there can be fully experienced on mobile devices,” added Pyojae Kim.

“We’ve put forth our best effort to continuously improve quality and introduce new generative AI features to users, but there’s always room to do better We’ll make these features more accessible so that users can more easily and comfortably utilize the powers of generative AI,” said Jihye Kim.

Sharing her bold aspirations, Yunju Bae concluded with, “We want to expand the shooting experience to the point where artistic sensibilities and technology naturally blend together through AI. We aim to deliver an experience that’s good enough to replace different types of hardware.”

Smartphone cameras are no longer just a technical feature. They’ve become iconic, indispensable items that capture and share life’s stories. The Galaxy camera is constantly evolving to make it easier for anyone to create high-quality photos and videos, and to personalize their content. As it evolves, so too will the ways users see, share and shape the moments that matter most.

Samsung Electronics and Google Cloud today announced an expanded partnership to bring Google Cloud’s generative AI technology to Ballie, a new home AI companion robot from Samsung. Available to consumers this Summer, Ballie will be able to engage in natural, conversational interactions to help users manage home environments, including adjusting lighting, greeting people at the door, personalizing schedules, setting reminders and more.

“Through this partnership, Samsung and Google Cloud are redefining the role of AI in the home,” said Yongjae Kim, Executive Vice President of the Visual Display Business at Samsung Electronics. “By pairing Gemini’s powerful multimodal reasoning with Samsung’s AI capabilities in Ballie, we’re leveraging the power of open collaboration to unlock a new era of personalized AI companion — one that moves with users, anticipates their needs and interacts in more dynamic and meaningful ways than ever before.”

Ballie will use Gemini’s multimodal capabilities along with proprietary Samsung language models to process and understand a variety of inputs, including audio and voice, visual data from its camera and sensor data from its environment. This will allow it to adapt its behaviors and responses in real-time. For instance, if you’re not sure what to wear to work in the morning, you can turn to Ballie for advice. Users could ask, “Hey Ballie, how do I look?” and Ballie can respond with styling recommendations, such as trying new accessories or adding a colorful shirt.

With enhanced reasoning enabled by Gemini, Ballie will be able to help users manage not only their home, but also their health and wellbeing. For example, a user could tell Ballie, “I feel tired today.” Ballie could then use Gemini’s grounding in Google Search to give tailored advice on how to improve their energy levels, including sharing recommendations from trusted sources on how to get more exercise, optimize their sleeping environment or monitor their sleep patterns.

This partnership announcement builds on the successful integration last year of Gemini on Google Cloud into Samsung’s Galaxy S24 smartphone series. With Ballie, Samsung and Google Cloud are exploring how to bring their generative AI collaboration to a wider range of devices.

“With Gemini on Google Cloud, Samsung is demonstrating how to deploy generative AI at scale, integrating it directly into the heart of their popular products,” said Thomas Kurian, CEO, Google Cloud. “This expanded partnership with Samsung underscores our commitment to delivering reliable, enterprise-grade AI that drives lasting value for our customers – and their customers.”

To learn more about Ballie Home AI Companion, visit here.

About Google Cloud
Google Cloud is the new way to the cloud, providing AI, infrastructure, developer, data, security and collaboration tools built for today and tomorrow. Google Cloud offers a powerful, fully integrated and optimized AI stack with its own planet-scale infrastructure, custom-built chips, generative AI models and development platform, as well as AI-powered applications, to help organizations transform. Customers in more than 200 countries and territories turn to Google Cloud as their trusted technology partner.

In this final installment of Samsung’s AI Leadership series, Samsung Newsroom explores how Samsung’s technological expertise and research initiatives aim to refine AI-driven user interactions across its expansive portfolio.

Prioritizing Customer Experiences

Samsung utilizes on-device and cloud-based AI solutions in its offerings. This strategy is further reinforced by the pursuit of hybrid AI, which integrates the strengths of both technologies to provide context-aware, tailored solutions for diverse user needs. The decision on which type or combination of technologies to employ is anchored by this ultimate goal — “How can we best serve the consumer?”

On-device AI delivers secure and efficient AI experiences in devices such as smartphones and TVs by utilizing only the data and resources on the device itself. Because on-device AI doesn’t communicate with the cloud, responses are virtually instantaneous. Since data doesn’t leave the device, the technology is often considered safer for sensitive procedures such as those that involve personal information.

Similarly, edge AI operates independently of cloud infrastructure and relies solely on specific local resources to perform AI functions. In interconnected home environments where appliances and IoT devices work in tandem, data processing in edge AI can be handled by either devices with higher performance specifications or devices nearby — without depending on the cloud. Thus, edge AI offers speed and security benefits akin to on-device AI.

While on-device and edge AI rely on technologies that use smaller models and fewer computations in constrained hardware environments, experiences that require access to extensive online information or high-performance computing are supported by cloud-based AI. The technology utilizes vast datasets and large-scale AI models hosted on servers to deliver a range of advanced capabilities. To achieve high performance while maintaining efficiency and security, Samsung conducts extensive research in areas including minimizing data latency, optimizing model efficiency and implementing data anonymization and encryption.

With expertise in all these different forms of AI — on-device, edge and cloud-based — Samsung takes a step further and combines different formats as necessary to best serve the needs of each use case. In hybrid AI, sensitive and quick-response data can be processed using on-device AI models while the cloud can manage processing that requires external resources like up-to-date information or high-performance models. Galaxy AI, for instance, uses both on-device AI and cloud AI — operating either independently or simultaneously as needed — to deliver optimized solutions for users.

▲ Daehyun Kim, Head of Global AI Center, Samsung Research explains Samsung’s AI Strategy.

Generative AI Integrated Into Everyday Life

Samsung continues to drive innovation in the realm of generative AI, further enhancing the versatility of its products and services. For instance, Galaxy AI offers a suite of features¹ including Chat Assist, which supports translation and interpretation in select messaging apps; Note Assist, which helps summarize notes and generates note covers; and Photo Assist, which edits images with generative AI.

Generative AI is also supported on select Samsung TVs and home appliances through the Generative Wallpaper feature.² Users can enjoy 4K wallpapers that fit their tastes on the 2024 Neo QLED TV or transform their kitchens with AI-generated cover screens on the Family Hub refrigerator.

▲ Generative Wallpaper on Samsung’s AI TV

To offer the best generative AI experience on its devices, Samsung not only collaborates with partners but also develops its own AI models. From fundamental technologies beginning with initial research — including foundation model development — to data collection and training as well as lightweight AI model development, Samsung leverages its vast expertise across the AI R&D board to optimize solutions and meet each product’s specific needs.

For example, Samsung developed proprietary foundation models specifically for image generation, editing and transformation to support a wide range of visual creation experiences. This was a challenge because unlike text data — which is composed of discrete values — image data consists of continuous values, offering nearly limitless possibilities for generation. To address this complexity, the company applied specialized training techniques to the image models while reducing their size for efficient on-device operation. Developers refined deep learning algorithms and data augmentation techniques to allow for rapid computation and seamless image creation with minimal processing requirements.

These foundation models were then fine-tuned for specific applications. For instance, the Photo Ambient wallpaper in Samsung’s latest smartphones integrates the image model with real-time data to create dynamic wallpapers that visually reflect current conditions such as snowfall or a starlit night depending on the time and weather.

Samsung Gauss2: Samsung’s Proprietary Generative AI

The application of generative AI is rapidly expanding beyond personal daily use into enterprise environments. Samsung has developed a proprietary generative AI model to strengthen its competitiveness in AI technology, securely manage sensitive internal information and optimize performance and scalability for specific purposes. Proprietary generative AI allows the company to establish models tailored to a wide range of products and services while improving internal productivity in a more secure environment.

Samsung recently unveiled its upgraded proprietary generative AI model, Samsung Gauss2 with better performance and efficiency compared to its predecessor, Samsung Gauss1, introduced last year. Samsung Gauss2 is a multimodal³ model capable of simultaneously processing and understanding various data types.

Samsung Gauss2 is available in three models tailored to specific use cases — Compact, Balanced and Supreme. The Compact model is a lightweight variant optimized for on-device AI. The Balanced model, a medium-sized cloud-based variant, is designed for tasks such as text and code generation. The Supreme model, a large cloud-based variant, is built to support high-performance services with a particular focus on improving workplace productivity.

▲ Samsung unveiled its upgraded proprietary generative AI model, Samsung Gauss2.

To efficiently implement large models like the Supreme variant, Samsung has incorporated the Mixture of Experts (MoE) technique to selectively activate only the “expert models” most suitable for specific tasks within a large-scale neural network.

MoE significantly reduces the number of computations during training and inference by activating only the necessary components, rather than running all expert models simultaneously in response to each query. This selective activation not only enhances efficiency but also facilitates the expansion of the model to address increasingly complex problems by adding more expert models. Samsung has meticulously trained these expert models to operate accurately and without interference.

▲ MoE optimizes computation to implement large AI models more efficiently.

Samsung Gauss2 is already being applied across multiple areas within Samsung. For instance, the Device eXperience (DX) Division employs Samsung Gauss2’s coding assistant service to support research and development activities. This service leverages a specialized model — trained on Samsung’s proprietary data, code and processes — to generate code needed for product and service development. Fully integrated into the company’s internal software development environment, the coding assistant supports natural language interactions and various programming languages to streamline developer workflows.

The Samsung Gauss Portal, a conversational AI service, is widely used for workplace tasks such as document summarization and translation, email drafting and more. Future updates aim to enhance the portal’s natural language question-and-answer capabilities and expand its multimodal features to include interpreting tables and charts and generating images.

Strengthening AI Capabilities Through Consumer Engagement

Leveraging its extensive product lines, Samsung is developing technologies that support on-device, cloud and generative AI to deliver a distinct competitive edge in AI capabilities.

By connecting with consumers through its products, the company gains valuable insights into user behaviors and needs to enable the development of practical AI solutions. This creates a virtuous cycle — whereby user data informs AI advancements, which in turn deliver value back to consumers.

Samsung couples this understanding of products with in-house advancements and strategic partnerships to implement optimal AI technologies. For instance, neural processing units (NPUs) — specialized accelerators for AI computation — must be tailored to meet the specific requirements of individual products, rather than applied uniformly across all devices. Samsung not only designs NPUs in-house for its own products but also applies software optimizations to partner chipsets, ensuring support for AI functions and peak performance in Samsung devices.

In addition, the company draws on the expertise and perspectives of product-specific specialists to address security issues and facilitate the immediate application of solutions to products while driving continuous technological improvement. The blockchain-based, multi-device security solution Knox Matrix is a notable example of how this collaborative approach can create an environment in which connected devices check each other for threats to enhance security.

▲ Samsung is leading in AI thanks to consumer insights gained from various products.

Through the implementation of customized AI technologies, Samsung continues to unlock new possibilities for users. Looking ahead, the company plans to deliver more differentiated AI experiences that empower users through meaningful and enriching interactions.

¹ Availability of Galaxy AI features may vary by region, country, OS or One UI version, model and carrier.
² Generative Wallpaper feature may vary by region and model.
³ Capable of simultaneously understanding and processing various types of data (modalities) including text, images, audio and video.

Samsung Electronics today hosted the Samsung Developer Conference Korea 2024 (SDC24 Korea), a virtual event that showcased the company’s latest software innovations and vision for the future.

Since 2014, Samsung Electronics has held this annual event to engage and collaborate with software developers, making SDC24 Korea the 11th iteration. This year’s conference highlighted research related to software embedded in products such as generative AI, software platforms, IoT, healthcare, communications and data. It also delved into the culture of open-source development.

During the keynote address, the company unveiled Samsung Gauss2, the second generation of its proprietary AI model, and highlighted its improved performance, efficiency and various application possibilities.

“Samsung Electronics is committed to developing cutting-edge software, including AI and data analytics, to enhance user experiences,” said Paul Kyungwhoon Cheun, President, CTO of the Device eXperience (DX) Division and Head of Samsung Research. “With three distinct models, Samsung Gauss2 is already boosting our internal productivity, and we plan to integrate it into products to deliver higher levels of convenience and personalization.”

Samsung Gauss2: A Multimodal Language Model Catering to Diverse Needs

Samsung Gauss2 is the follow-up to the company’s internal generative AI model unveiled last year, and it offers improved performance and efficiency in simultaneously handling various data types as a multimodal model integrating language, code and images. It is available in three distinct models catered to different purposes: Compact, Balanced and Supreme.

The Compact model is a small-sized model specifically designed to work efficiently, even in limited computing environments. It delivers optimized performance for on-device usage by maximizing the utilization of the device’s computing resources. On the other hand, the Balanced model focuses on achieving balance between performance, speed and efficiency, providing consistent performance across diverse tasks. Finally, the Supreme model aims for top-notch performance by leveraging Mixture of Experts technology¹ atop the Balanced model, allowing significant reductions in computational costs during training and inference processes while maintaining high levels of both performance and efficiency.

Samsung Gauss2 supports 9 to 14 languages as well as various programming languages, depending on the model. Samsung has developed and incorporated its own stabilization techniques for training large language models (LLMs) and designed a custom tokenizer² to ensure maximum efficiency for these supported languages.

The Balanced and Supreme models offer equal or superior performance in key metrics such as generating responses in various languages including English and Korean, and coding capabilities compared to leading open-source generative AI models currently available. Additionally, their processing speed per hour is 1.5 to 3 times faster, enabling quicker AI response generation, reduced user wait times and more efficient task handling.

Customizable for Various Productivity Tasks and Product Development

Having an internal generative AI model allows easier customization so that optimal performance can be achieved for specific goals and applications. Samsung Gauss is already being used in various tasks for Samsung’s employees, leveraging its customizable development capabilities.

With the power of Samsung Gauss, the in-house coding assistant ‘code.i’ assists the company’s software developers. Now upgraded to Samsung Gauss2, it is being utilized by business units within the Device eXperience (DX) Division and overseas research institutes.

Since its launch last December, the monthly usage of code.i has quadrupled, with about 60% of all software developers in the DX Division are now using it. Additionally, Samsung Gauss Portal is a conversational AI service powered by Samsung Gauss that assists employees within the DX Division as they handle various office tasks — such as document summarization, translation and email composition. The service was expanded to overseas subsidiaries in April. In addition, starting from August, Samsung is using Samsung Gauss to call center staff to automatically categorize and summarize customer calls.

Moving forward, Samsung aims to continuously increase productivity within the company by applying Samsung Gauss2, to improve the performance of the code.i service, enhance the natural language question-and-answer function of the Samsung Gauss Portal, and support multi-modal functions like understanding tables and charts and creating images.

Moreover, under the AI vision of “AI for All,” Samsung will continue to expand the reach of its AI-based services across all product lines so that users can experience more convenient and enjoyable daily lives. And by integrating knowledge graph technology with AI, Samsung expects to provide even more enhanced personalization services.

Presentations on Topics Including Software Platforms, IoT, Healthcare, Communications and Data

Following the announcement of Samsung Gauss2, there were presentations on the customer experience with Samsung’s platforms, which included relevant insights on the SmartThings experience and improvements to various software platforms.

Subsequently, 29 diverse technical sessions were conducted, including the following:

• The Future of Healthcare and Samsung’s Health Ecosystem Strategy
• SmartThings Customer VOC Experience Improvement with Generative AI
• code.i: Understanding Samsung Electronics’ AI Coding Assistant
• TV-based Lifestyle Content Hub To Enrich Your Everyday Experience
• AI Solution for Samsung Home Appliances Through AI Vision Technology and Data Utilization

For more detailed information about SDC24 Korea, visit the official website (https://www.sdc-korea.com/).

¹ An approach where only the most suitable expert models are selected and activated for specific tasks, allowing efficient performance enhancement through the conservation of necessary computational resources.
² A tool that converts inputs such as letters into data formats that can be processed by computers.

By leveraging Samsung’s leading-edge foundry and advanced packaging products, Preferred Networks aims to develop powerful AI accelerators that meet the ever-growing demand for computing power driven by generative AI.

Since starting mass production of the industry’s first 3nm process node applying Gate-All-Around (GAA) transistor architecture, Samsung has strengthened its GAA technology leadership by successfully winning orders for the 2nm process with further upgrades in performance and power efficiency.

The cooperation with Preferred Networks marks the first achievement for Japanese companies in the field of large-sized heterogeneous integrated package technologies and Samsung plans to accelerate its leading global advanced package market offensive.¹

The 2.5D Advanced Package I-Cube S technology included in the turnkey solutions, is a heterogeneous integration package technology, with multiple chips in one package to enhance inter-connection speed and reduce package size. The use of the silicon interposer (Si-interposer) is crucial in achieving ultra-fine redistribution layer (RDL) and stabilizing power integrity for optimal semiconductor performance. GAONCHIPS, a specialized system semiconductor development company, designed the chip.

“We are excited to lead in AI accelerator technology with Samsung Electronics’ 2nm GAA process. This solution will significantly support Preferred Networks’ ongoing efforts to build highly energy-efficient, high-performance computing hardware that meets the ever-growing computing demands from generative AI technologies, especially large language models.,” said Junichiro Makino, VP and Chief Technology Officer (CTO) of Computing Architecture at Preferred Networks.

“This order is pivotal as it validates Samsung’s 2nm GAA process technology and Advanced Package technology as an ideal solution for next-generation AI accelerators,” said Taejoong Song, Corporate VP and the head of Foundry Business Development Team at Samsung Electronics. “We are committed to closely collaborating with our customers ensuring that the high performance and low power characteristics of our products are fully realized.”

Preferred Networks, headquartered in Tokyo, develops advanced software and hardware technologies by vertically integrating the AI value chain from chips to supercomputers and generative AI foundation models. It provides solutions and products for various industries such as manufacturing, transportation, healthcare, entertainment and education. The company is one of the major players in the global AI market, achieving first place three times in the past five years on the Green500² list of supercomputers.

Based on this collaboration, Samsung and Preferred Networks plan to showcase groundbreaking AI chiplet solutions for the next-generation data center and generative AI computing market in the future.³

¹ Heterogeneous integration packaging technology integrates different types of chips – such as memory, logic and sensors – in a single package.
² Green500: the ranking of the TOP500 supercomputers in the world based on their performance-per-watt efficiency
³ Chiplet Solution: A technology of assembling into a single package with other different chips performing different fuctions through the packaging technologies

Samsung Electronics today showcases its latest home appliance lineup at the press conference held in the global launch event, ‘Welcome to ‘BESPOKE AI,’¹ which takes place in three locations — Seoul, Paris and New York City. Samsung shares its vision for how connectivity amongst them can improve the overall experience at home and how artificial intelligence (AI) enhances the performance of appliances.

Jong-Hee (JH) Han, Vice Chairman, CEO and Head of Device eXperience (DX) Division at Samsung Electronics, kicked off the marathon of events by opening the media event at the Seoul ‘Welcome to BESPOKE AI’ by describing how Samsung home appliances not only perform well with the usual tasks but can do more than previously imagined with AI applied. Especially with screens added to the refrigerator, induction range and laundry machine, Bespoke appliances become a platform for entertainment, as well as an easy-to-access control hub for other connected Samsung appliances through SmartThings.

“Since the first introduction of BESPOKE in 2019, Samsung Electronics has presented to the market on how appliances can be customized to best fit each user’s home and lifestyle,” said JH Han. “Five years later, we now share our vision for AI in appliances with the products that expand the Bespoke legacy through enhanced connectivity and AI capabilities that will take the consumer experience to the next level.”

Bespoke AI Appliances Sync To Create New Experiences in Various Home Spaces

With built-in Wi-Fi, internal cameras, AI chips and compatibility with the SmartThings application, Samsung’s latest Bespoke AI appliances come with enhanced features and connectivity to lay the foundation for a truly smart home. Also, the new AI Home, a connected 7-inch LCD display that has been added to multiple products, provides intuitive, easy access and control over the whole connected ecosystem.

The AI Home includes 3D Map View, a feature that provides users with a full 3D view of the house, allowing them to easily locate all the appliances that are connected and control them. When users are cooking in the kitchen and feel that the temperature is too hot, for instance, they could turn on the air conditioner in other rooms through the AI Home on the induction range² without leaving the pots and pans unattended. While doing laundry, they could also start the robot vacuum cleaner in the living room from the AI Home on the washing machine, without having to make the journey back and forth. Also, users can receive calls coming to their phones through the AI Home, allowing them to answer timely while also continuing the housework they were doing. Moreover, the AI Home not only makes housework easier, but more enjoyable as well. Users can play their favorite songs, watch videos on the Internet app or refer to recipes on the screen while they are cooking.

Considering how people have mobile phones with them most of the time, Mobile Smart Connect is a new feature that pushes an alert to the phone when it is at close range with registered appliances. The pop-up notification includes quick control menu to execute key functions for the appliance directly from the phone, so users no longer have to search the house, looking for the actual remote control.³ This eliminates even the few steps and clicks⁴ that were required to access same features in the SmartThings application.

At the BESPOKE AI event, Samsung also showcases the new feature ‘Calm Onboarding,’ which makes it easier for users to join Samsung’s connected life. It frees users from having to go through the hassle of product registration, as it directly registers products purchased under a Samsung account at Samsung.com on to the SmartThings app with the same account.

To provide assurance to users as they step into the era of hyper-connected home appliances driven by technological advancement, Samsung also highlighted its comprehensive Knox security platform that protects all user data located on the connected appliances. In fact, the 4-Door French Door Refrigerator with AI Family Hub⁵ became the first product in the industry to be verified to level ‘Diamond’ for its IoT security capabilities by UL Solutions, a leading global safety science company that evaluates hundreds of marketing claims each year. Other Family Hub models⁶ applying the same technology, and the Bespoke Jet Bot Combo AI have also achieved the same verification.

AI Expands Spectrum of Features to Samsung Home Appliances

The most distinctive difference between the three events, other than the location, is the product lineup unveiled during the respective press conferences, which reflects the actual appliances that will launch in each market.

The Seoul ‘BESPOKE AI’ event started off with the biggest lineup among the three locations with 14 new products including: the Bespoke French Door Refrigerator with AI Family Hub+, Bespoke Infinite Induction Line, Bespoke AI Laundry Combo, Bespoke Jet Bot Combo AI, Bespoke Jet AI, Bespoke Cube Air Infinite Line, the new 2024 4-Door refrigerator incorporating peltier technology and more.

The 4-Door French Door Refrigerator with AI Family Hub⁷ is the primary control center for all things food, connecting the refrigerator to other appliances in the home. The AI Family Hub+,⁸ which is the large LCD screen in the front right panel of the refrigerator, is the key to intuitive AI experiences, where users can view recommended recipes and play music and videos for kitchen entertainment. The 4-Door French Door Refrigerator with AI Family Hub comes with AI Vision Inside⁹ which uses an internal camera to identify 33 fresh food items that go in and out of the fridge. The recognized food items are listed and managed on the Family Hub display and can also be checked on the SmartThings app.¹⁰

Another key product is the Bespoke Jet Bot Combo AI, a robot vacuum and mop cleaner with AI-enhanced features including intelligent AI Recognition. The intelligent AI Recognition performs in different ways. The AI Object Recognition uses the AI Deep Neural Network (DNN) model and camera to recognize various objects¹¹ including humans,¹² pets¹³ and hard-to-see items like thin phone cables and rugs or mats. The AI Floor Detect senses the type of floor to clean, and when carpets are detected, the robot vacuum decides whether to lift up its mop or to go and leave the mop at its station to avoid contaminating the carpet with its wet mop. It also comes with the Clean Station Steam+ which brings a range of features for automatically maintaining the device, such as emptying the dust bag, refilling the water tank, washing and intensively steam cleaning¹⁴ the mop. The Clean Station Steam+ even sprays high-temperature steam¹⁵ onto the mop’s surface, reducing 99.99% of harmful bacteria.¹⁶

As energy-saving is an important criteria in the European market, the Paris ‘BESPOKE AI’¹⁷ event additionally introduced the new energy-efficient, extra wide fridge freezer¹⁸ and the washer lineup. The extra wide fridge freezer has received “A” grade according to European energy standards thanks to Samsung’s new AI Inverter Compressor. The new washer lineup includes various models from A-10%, A-20% and even an A-40% extra energy saving model. Especially, the A-40% extra energy efficient model is equipped with Bubble Shot Technology, which saves water and cycle time by pumping up the water inside the drum and spraying it on top of the clothes.

The Bespoke AI Laundry Combo, presented at both Seoul and NYC events, is the All-in-One washer and dryer, providing the advantages of two separate appliances while freeing up valuable space. It comes with various AI features, such as remembering the periodic and seasonal needs of users and recommending the optimal cycle for the wash.¹⁹ With AI Opti Wash & Dry, the Bespoke AI Laundry Combo intelligently adjusts the washing and drying performance for each load and senses the weight of the laundry to dispense the appropriate amount of water and detergent. It also detects the fabric²⁰ and monitors the level of soiling during a cycle. If necessary, it adds more detergent and varies the washing time. It then adjusts the drying process to suit the weight and fabric type of users’ laundry. After finishing the cycle, users can monitor how much energy and water were consumed through the report provided on the SmartThings App.²¹

A unique appliance introduced only at the New York event held in Samsung 837 was the Bespoke Slide-in Range with AI Home. This product is a multi-functional induction range that also comes with various fun factors. It comes with an Internal Oven Camera that lets users see inside the oven from remote places, like on the TV²² from the living room, or even from outside the home through SmartThings on their mobile phones. With this, users can even get a short time-lapse video clip²³ with the highlight of the cooking process that they can share on social media.

Furthermore, Samsung is showcasing its vision of implementing generative AI to home appliances within this year. Especially, Bixby, Samsung’s voice assistant, will be a key in this. Generative AI will allow Bixby to go one step further from the current ability of being able to execute one order at a time, comprehending complex sentences and engaging in natural conversations. First of all, it will be able to understand compound demands like “Turn on the air conditioner to Wind Free mode, and let me know how the weather is.” It can also retain context from previous interactions for continuity, so if the user instructs Bixby to turn off the air purifier and then add, “Oh, and the TV, too,” Bixby can assist both requests. Users will also be able to rely on Bixby to come up with solutions, simply saying “the living room feels humid,” and ask “what should I do with all the potatoes I bought yesterday?” Bixby will interpret these multi-layered tasks and respond naturally to users’ prompts.

Advancing the Future of Appliances

Samsung is not only dedicated to presenting a better home experience, but also committed to creating more innovative and efficient products. The event was especially meaningful in the context that it not only introduced the new product lineups and features Samsung is launching, but also announced globally how all Wi-Fi connected appliances including those that customers already own, can change.

Samsung continues to upgrade Wi-fi connected appliances in the market and already in users’ homes through software updates and the development of SmartThings. Users can enjoy new features even with old models, and more energy saving features with products that were already bought. Smart Forward,²⁴ announced for the first time at the event, is a service that provides the newest features, security patches and upgrades through regular software updates. Users will be able to check available update information and receive notifications from the SmartThings App.²⁵ This ensures users with peace of mind and also contributes to reducing the frequency of appliance replacements.

SmartThings also continues to evolve, allowing users to save additionally on their energy usage after purchasing a product. Features such as Optimal Charging,²⁶ for example, are added so users can strategically plan out their energy use. SmartThings Energy allows users to easily monitor and control the amount of energy consumed by the connected Samsung appliances. Samsung also plans to launch its new Samsung Rewards program in the near future, which will allow users to get stamps each day if they save a certain amount of energy using AI Energy mode. Accumulated stamps can be converted and used at Samsung.com, Samsung Galaxy store and other Samsung purchase platforms.

To make efforts more impactful, Samsung introduces collaborations it made to implement solutions resulting in tangible reductions of energy use, while also making lives more convenient for users. Through a partnership with British Gas, linking SmartThings Energy’s Auto Demand Response feature with British Gas’ PeakSave, Samsung allows users to easily enjoy economic benefits through saving energy.

As a crucial player in the home appliance industry, Samsung revealed a goal to utilize next generation technologies for purposes beyond creating innovative products. It is about using engineering solutions that prolong product lifecycles, and reduce the frequency of replacements. Some of the methods introduced in the press conference include: Hybrid Cooling, newly incorporating the newly installed high-power ‘Peltier’ thermoelectric components in addition to the compressor resulting in improved cooling efficiency and performance, and low-maintenance filters for air purifiers obliterating the need for filter purchases or replacements.

Product safety is also an important factor that Samsung prioritizes, and Samsung strives to achieve and expand certifications to prove its product liability across all appliance categories, including reduced fire risk (RFR) certification for new products. This will assure that the certified appliances²⁷ are designed to effectively prevent fire incidents caused by the product.

At the end of the event, Samsung also revealed that it is collaborating with Disney and Pixar’s “Inside Out 2” (coming to theaters June 14²⁸), to communicate the features of the new Bespoke AI Laundry Combo. A new co-branded teaser video was shown that featured Inside Out 2 clips and showcased how, with the new washing machine, you can take the stressful emotions out of laundry with AI Bubble.

* Some features may not be available yet
¹ AI based features available on select appliances
² Available in the U.S.
³ Available for the Jet Bot Combo AI
⁴ Users can set ‘Show on Lock screen’ or check through the quick panel on Samsung Galaxy phones
⁵ This is global name, naming is different by region. (North America) Bespoke 4-Door Flex Refrigerator with AI Family Hub+, (Latin America) Bespoke 4-Door French Door Refrigerator with AI Family Hub+
⁶ RF**DB99****, RF**DB95****, RF**DG9H****, available in North and South America, Europe, Middle East, Southeast Asia, India, Australia, Korea
⁷ Does not mean all services available on the Bespoke 4-Door Flex Refrigerator with AI Family Hub+ are AI or generate information or outcome using AI. The services/features that use deep learning models are limited to 1) AI Vision Inside and 2) the recipe recommendation feature available on Samsung Food
⁸ (North America, Latin America) AI Family Hub+, 32”, (Europe) AI Family Hub, 21.5”
⁹ As of April 2024, AI Vision Inside can recognize 33 food items like fresh fruits and veggies. If the food is not recognizable, it may be listed as unknown item. AI Vision Inside cannot identify or list any food items in the fridge door bins or freezer. It recognizes food items based on deep learning models, which may be updated periodically to improve accuracy
¹⁰ The SmartThings App is available on Android and iOS devices. A Wi-Fi connection and a Samsung account are required. Users are required to utilize a single log-in account between the devices
¹¹ Object recognition may be affected by an object’s shape or the environmental conditions. Only certain object types can be recognized. Example items: air conditioner (stand type), refrigerator, BESPOKE (refrigerator/dishwasher), TV, washing machine/dryer, air purifier, AirDresser, sofa, bed, bookshelf, table, pet excrement, electrical cable, towel/socks, cup, glass, bottle, bowl, vase, floor mat, rug, coat rack, shoes, pedestal, scales, power extension, furniture with a crossbar, furniture legs, wheeled chair, pet fur ball, smartphone cable, stain, bathroom, door step and doorway. A Wi-Fi connection and Samsung account are required
¹² It only recognizes a human presence based on generic visual indicators, and cannot identify individual people. The recognition capabilities may be limited when a person’s entire body cannot be seen. A Wi-Fi connection and Samsung account are required
¹³ Only dogs and cats can be recognized. It only recognizes a pet presence based on generic visual indicators, and cannot identify individual pets. A Wi-Fi connection and Samsung account are required. The recognition capabilities may be limited by the posture or position of a pet. The ability to recognize your pet may vary depending on the type of animal and the living environment
¹⁴ After cleaning, the station washes the mop pads with water and steam ranging from 50 to 60°C, and after that sprays high temperature steam measured 100°C
¹⁵ The measured temperature of the steam is 100°C
¹⁶ Based on testing by Intertek. Using the Wash the Mop cycle eliminates 99.99% of Staphylococcus aureus, Escherichia coli and Pseudomonas aeruginosa. Not supported in the U.S. Results may vary depending on the actual usage conditions.
¹⁷ AI based features available on select appliances
¹⁸ Stands for a large capacity bottom mount freezer (“BMF”) refrigerator with a width of 70cm or more
¹⁹ Messages with cycle suggestions are displayed on the control panel or a smartphone with the SmartThings App.
²⁰ To prevent wear, wash like fabrics together. Based on AI-based algorithm
²¹ The SmartThings App is available on Android and iOS devices. A Wi-Fi connection and a Samsung account are required.
²² Available on certain Samsung Smart TV models, which must also be connected to the range via the SmartThings App and using the same Samsung account. A notification is displayed on the TV screen 5 minutes before the end of your cooking. When you select the notification, you can see your food and check its progress using the streaming video
²³ A 10 second time-lapse video is created and saved for 24 hours. Video is only recorded when the door is closed. After the cooking process ends, it takes about 20 seconds to encode the video
²⁴ Update period and applicable features may vary by region and model
²⁵ The SmartThings App is available on Android and iOS devices. A Wi-Fi connection and a Samsung account are required
²⁶ Available on VR7M*97**** only
²⁷ Available on Bespoke AI Laundry Combo only
²⁸ In the U.S. Release date varies by country

Until now.

With the Galaxy S24, Samsung continues leading camera innovation to make these limitations a thing of the past for Galaxy users. Thanks to Galaxy’s ProVisual Engine — a suite of AI-powered tools — photographers can maximize their creative freedom every step of the way, from shot to setup to backend editing. Fueled by enhanced NPU performance and bolstered by an extensive library of more than 400 million image datasets, the Galaxy S24 ensures you can snap the best shot every time, no matter your experience level.

Never Miss a Moment, Regardless of Capture Mode

With Galaxy S24, gone is the need to tinker with camera modes or look for the best settings to capture a great shot:

• First up, the Quad Tele System ensures you get optical quality zoom at 2x, 3x, 5x, 10x and every step in between. This feature allows you to effortlessly capture every detail of a performance, wedding or even graduation ceremony, no matter how far away you’re sitting.

• Nighttime is often a memory-making time with friends and family, especially in the warmer months, but dim lighting conditions can make capturing these moments a challenge. Galaxy S24 Ultra’s powerful Nightography capabilities mitigate this very struggle even from a distance. Compared to the previous model, its sensor has nearly doubled in size from 12.52 square millimeters to approximately 24.47 square millimeters, helping Galaxy S24 Ultra capture details with even more precision. It also has bigger pixels — nearly 60% larger and measuring 1.4μm on each side of the pixel at 5x zoom.¹ Combined with enhanced AI ISP, this means the Galaxy S24 Ultra can capture more light and create brighter, less noisy images. What’s more, the photo shutter speed is 30% faster and the telephoto camera’s optical image stabilization angle is wider. That means you’ll capture clearer images more quickly, even if your hands are a little shaky.

• Or maybe you’ve already captured your shot, but it’s not quite right. This is where Generative Edit takes the stage, harnessing generative AI to adjust objects and generate a perfectly blended background in their place. You can perfect the moment you captured, creating the ideal memory to look back on. Generative AI enables edits such as straightening and resizing, then harnesses in-painting and out-painting techniques to fill any gaps in the image. AI then determines the suitability of the results and handles any necessary post-processing.

Capture Expert-Level Results With Precision Tools

For amateur and expert photographers alike, Expert RAW enables the creation of professional-quality images. Using AI, Galaxy S24 features 24MP fusion, which combines images to get the most out of different resolutions. High resolution 50MP images provide more detail, while 12MP images provide multi-frame synthesis, which improves noise and dynamic range. Put together, they create the most incredible photo in any scenario. Add in HDR, which offers a more balanced range of brightness, color and contrast, and these tools let you edit like a pro to capture your best image yet.

Pro-Grade Editing for Amateurs and Experts Alike

Finally, for those wanting to take their photography chops to the next level, Enhance-X, Galaxy’s companion editing app, gives you even more creative control.

The latest version of Enhance-X arms you with a new feature: Camera Shift. Moments are fleeting and sometimes you only have a second to take your shot, which can leave the final result less compelling than you intended. Shooting from above can have the effect of making a subject seem smaller, while shooting from below can make it seem bigger or more powerful, and a straight-on angle makes a subject seem more relatable. Camera Shift lets you shift your photo’s perspective after you take your shot. Now you can focus on capturing the moment without worrying about having the perfect angle or camera position. Once you’ve taken your photo, Camera Shift lets you achieve the effect you want by using AI to adjust the angle and perspective.

¹ Size comparison of the Galaxy S23 Ultra 10x and Galaxy S24 Ultra 5x’s sensor and pixel capabilities. Dimensions are measured to the nearest integer.

To break down the barrier between complicated technology and daily life, designers at Samsung Electronics reviewed and redefined user touchpoints to create an accessible user experience (UX) for the Galaxy S24 series.

The result — Intelligence UX, an interface that empowers users with AI-based mobile features that are intuitive, easy to use and highly applicable to work and life alike.

Bringing Mobile AI Into Daily Living

▲ (From left) Samsung Intelligence UX designers Scott Jeonggun Choi and Heri Na

Can you tell us about how Intelligence UX came to be?

Choi: Even before entering the phase of generative AI,¹ research on how to create new mobile experiences with AI technology was already underway. We analyzed the apps we frequently use and carefully developed functions and features that could be enhanced through AI. The goal for Intelligence UX was to lower the barrier to entry for mobile AI by improving commonly used apps.

One example is the Gallery app. Previously, functions for modifying images included brightness and color correction, horizontal adjustment, and crop. With Generative edit, users can do all of this and more, such as moving objects within an image and altering backgrounds.

What are Intelligence UX’s features?

Na: Intelligence UX makes it easier to reach your goals by streamlining tasks in four main areas. Productivity is improved through apps that can summarize content or convert it into the preferred format, helping you save time and get the most out of each day. For creative tasks, features like Generative edit give you the tools to retouch photos like a pro by moving around objects in a photo or filling in empty spaces. Communication features break down language barriers when calling or messaging for improved communication. Lastly, you can personalize your phone with wallpapers created using generative AI or have your lock screen reflect changes in the weather or time.

What was the process of creating Intelligence UX?

Na: It would be ideal if the output appeared immediately after pressing a button, but AI generation can take time. To make the process feel magical, we added visual and interactive effects as well as text. Designers from all fields — including user interface (UI), graphic user interface (GUI) and visual interaction (VI) — and UX writers collaborated to overcome any limitations encountered during the creation of Intelligence UX.

How have you responded to issues with hallucinations² in generative AI?

Na: We have been collaborating with the developer team for a while now to prevent hallucinations. Tests to determine the minimum number of characters needed for an accurate summary or how many degrees a photo can be tilted to produce enhanced images helped us establish standards to minimize false results and bad user experiences.

What are your thoughts on the concerns over privacy and security since processing is based on information entered by the user?

Choi: Early on, both the developer and UX teams agreed that personal conversations contain highly sensitive user information. Therefore, apps that support phone calls or messages were made to handle on-device³ processing. Data protection is non-negotiable — and since the main purpose of communication is to facilitate conversation, we decided to stick with on-device processing even if it means users need to download language packages first.

If there is data that needs to be processed through a server, we notify users that nothing will be stored or used for learning purposes to improve AI functions before securing their consent. Additionally, we added a setting to block data processing through a server, so users know their data won’t leave their devices.

▲ The Galaxy S24 series processes data for advanced intelligence features solely on the device for increased security.

How have users responded to the Galaxy S24 series since its launch?

Na: Many people have said the Galaxy S24 series is helpful when traveling abroad or ordering products from overseas which used to be difficult due to language barriers. The team feels rewarded when we hear positive feedback from acquaintances.

Life Is Easier and More Efficient With Intelligence UX

Communication Without Borders

Say goodbye to language barriers with the Galaxy S24 series. When Live Translate is used on a call, the conversation is translated in real time for seamless communication in different languages. The Interpreter button in the Quick panel can be used to aid real-time translation during face-to-face conversations. Meanwhile, the AI built into the Samsung Keyboard allows for real-time translation of text messages as well as spelling corrections, grammar assistance and writing style changes.

Creativity, Simplified

Generative edit can help create the perfect shot. With this feature, people or objects can be moved, the horizon can be adjusted and any empty spaces left behind will be filled in automatically.

▲ (From left) Generative edit allows users to move the subject within a photo and adjust the horizon. With the press of a button, users can summarize long texts into bullet points.

 

Enhance Your Everyday

The Galaxy S24 series helps save time and effort. Transcript Assist converts audio from classes or meetings into text, differentiates between speakers, provides summaries, and even offers translations. Websites can also be summarized and translated.

Samsung Notes is great for jotting down ideas. Users can convert their handwritten notes into text and organize them into useful formats. Once a note is saved, the feature recommends apt titles and cover designs based on the content, making note creation simple and fun.

* Supported languages and features may vary by country, region and model.

Samsung’s designers strived to develop a product that captures today’s innovative technology for a better tomorrow. The Galaxy S24 series is the fruition of their efforts and the launchpad for a brighter, more accessible future.

For more information about Samsung Electronics’ design, please visit the Design Samsung website.

* Content images simulated for illustrative purposes. Sequences shortened and simulated. Actual UI may be different. Release-product specifications may vary by country, region, model, and carrier.

¹ AI technology that can produce new content (text, images, videos, audio, code and other media) based on data.
² An error that occurs when AI processes information and generates inaccurate or false results.
³ A method of collecting and calculating information through the device. Since the data is not sent to the cloud, processing may be faster.

This collaboration sets the stage for a series of announcements and planned innovation between Samsung and Arm. The companies have bold plans to reinvent 2-nanometer (nm) GAA for next-generation data center and infrastructure custom silicon, as well as a groundbreaking AI chiplet solution that will revolutionize the future generative artificial intelligence (AI) mobile computing market.

“As we continue into the Gen AI era, we are excited to extend our partnership with Arm to deliver the next generation Cortex-X CPU, enabling our mutual customers to create innovative products,” said Jongwook Kye, Executive Vice President and Head of Foundry Design Platform Development at Samsung Electronics. “Both Samsung and Arm have built a solid foundation from many years of collaboration. This unprecedented level of deep design technology co-optimization has resulted in a groundbreaking accomplishment, providing access to the newest Cortex-CPU on the latest GAA process node.”

“Our longstanding collaboration with Samsung has delivered multi-generation, leading-edge innovation,” said Chris Bergey, SVP and GM, Client Business at Arm Inc. “Optimizing Cortex-X and Cortex-A processors on the latest Samsung process node underscores our shared vision to redefine what’s possible in mobile computing, and we look forward to continuing to push boundaries to meet the relentless performance and efficiency demands of the AI era.”

Samsung announced its initial production of 3nm Multi-Bridge-Channel FET (MBCFET), based on Samsung’s GAA technology in 2022. GAA technology allows further device scaling beyond the FinFET generation, improving power efficiency with reduced supply voltage level and enhanced performance with higher drive current capability. The GAA implementation approach with nanosheets structure delivers maximum design flexibility and scalability.

Designed with Samsung’s next generation GAA process node, Arm delivered the optimized newest Cortex-X CPU with additional performance and efficiency improvements to take the user experience to the next level.

With continuous pressure to have products delivered on time, it is paramount to ensure first-time-right silicon with the most competitive power, performance and area (PPA) attributes. Design and manufacturing can no longer be optimized separately. From the very beginning, both the Samsung and Arm teams embraced design-technology co-optimization (DTCO), which has been a critical factor to maximize the PPA benefits for both the next generation Cortex-X CPU design architecture and GAA process technology.

Generative AI is a key growth driver for a new wave of products that offer a superior user experience. Through this collaboration, Samsung and Arm are accelerating access to the optimized implementation of the next generation Cortex-X CPU on Samsung’s latest GAA process technology, enabling the next generation of product innovations with industry-leading performance.