Whether exploring new places or sightseeing occasionally, AI is opening new opportunities to experience the world like never before while removing common communication barriers. With Samsung’s advanced Interpreter² feature, language barriers are no longer an issue, while Composer³ and Suggested replies⁴ facilitate quick, easy communication on-the-go — making Galaxy AI on the latest Galaxy Z series your perfect travel companion.

Let’s take a little trip to see exactly how this comes to life.

Seamless Live Translation No Matter the Situation

Visiting a museum is a great way to learn about the local history and culture, but language barriers can stop you being fully immersed in a new experience. Interpreter transforms your Galaxy Z series device into a real-time translation tool and maximizes the dual screen capability.

In Listening Mode, you can join a museum tour in another language and see the transcript, so you don’t miss any must-see parts of the exhibition. Plus, if you’re wearing Galaxy Buds3,⁵ you’ll hear an audio translation of the tour so you can go hands-free and really focus on what’s on show while walking around some of the most iconic venues on earth.

While on your travels, ordering food and drink means you interact with locals regularly. Conversation Mode in Interpreter enables easy conversations with someone in another language and thanks to the dual screen functionality of the Galaxy Z series, you can switch your device into FlexMode⁶ so both parties can see the conversation translated in a more natural way.

Interpreter translates every interaction so you can communicate seamlessly in 16 languages — with 20 supported languages expected by the end of this year.

Effortless Messaging Without Language Barriers

Our smartphones are a tool for sharing our thoughts and when traveling we don’t just interact by voice, but via text too. Writing emails in another language can be difficult and when writing something quickly on-the-go, formatting and accuracy can be impacted too. With Chat Assist,⁷ generating emails becomes effortless meaning you just need to input a few simple keywords and Galaxy AI will generate a suitable message in no time for you to review, edit if needed and send while on the move.

Imagine you check out of your hotel but while on your way to the airport, you realize you’ve left something in your room. You need to contact the hotel for assistance and the Composer feature can help. Easily compose an email asking the hotel staff to go and look for the item you left behind and have it shipped back to you with just a few simple inputs. No matter that situation you are in, Composer makes communicating effortless and more efficient.

Chat Assist⁸ enhances sentence structure, refines expressions, corrects grammatical errors and even generates complete sentences to save time while adjusting the tone to match your personal style. Plus, it overcomes language barriers by supporting multiple languages⁹ so you can effortlessly communicate with someone that you might not otherwise be able to understand.

And if you want to post the latest pictures from your travels to keep friends and family up to date, Chat Assist can even draft a social media post based on your previous posts so you can quickly upload and keep going on your travels.

Responses on the Go

When running late to meet a friend for dinner in an unfamiliar neighborhood, you can leverage Suggested replies to make the conversation go smoothly while on the move. The feature creates tailored responses based on an analysis of your latest replies to help arrange a new time for dinner — right from the Galaxy Z Flip6’s FlexWindow without even opening the device.

Our mobile devices go everywhere we go and shouldn’t just be there but be helpful too. The Suggested replies feature for Chat Assist is perfectly suited for the Galaxy Z Flip6, making the most of the FlexWindow so you can reply on-the-go, right from your pocket. You can communicate with friends, family, colleagues or others all without compromising your own tone and style.

Galaxy AI is no longer just potential. It has become a practical, everyday tool that enhances the daily lives of users. Samsung is committed to breaking down barriers and empowering users to make the most of new and existing experiences, including while traveling. No matter where you are or who you are communicating with, you can interact in all new ways thanks to Galaxy AI on the latest Galaxy Z series. A powerful communication tool that fits perfectly in both your palm and pocket — allowing you to explore and engage like never before.

Stay tuned for the next article in the ‘Unfolding Galaxy AI’ series showing how Galaxy AI can uplevel creativity on Samsung’s latest foldables.

¹ Samsung Account login may be required to use certain Samsung AI features. Samsung does not make any promises, assurances or guarantees as to the accuracy, completeness or reliability of the output provided by AI features. Availability of Galaxy AI features may vary depending on the region/country, OS/One UI version, device model and phone carrier. Some function availability may vary by device model. Galaxy AI service may be limited for minors in certain regions with age restrictions over AI usage. Galaxy AI features will be provided for free until the end of 2025 on supported Samsung Galaxy devices. Different terms may apply for AI features provided by third parties.
² Interpreter requires Samsung Account login. Certain languages may require language pack download. Service availability may vary by language. Accuracy of results is not guaranteed. Availability and supported features may vary by country, region or carrier.
³ Composer requires a network connection and Samsung Account login. This feature is activated when a certain number of characters is met. Service availability may vary by language. Accuracy of results is not guaranteed.
⁴ Suggested Replies feature for Chat Assist requires network connection to receive messages. It can suggest replies with or without network connection once the messages are received by the device. Samsung Account login required. Only supported from the FlexWindow of Galaxy Z Flip6. Service availability may vary by language and app. Accuracy of results is not guaranteed.
⁵ Audio interpretation is only available when wearing Buds and connected to a Samsung Galaxy smartphone. Interpreter feature is not directly provided by Buds themselves. If Buds are unavailable, the interpreted content is provided on the screen of your Samsung Galaxy smartphone. Certain languages may require language pack download. Service availability may vary by language, country, region or carrier. Samsung Galaxy devices may require the latest software update to properly support Galaxy AI features.
⁶ Flex Mode supported at angles between 75° and 115°.
⁷ Composer requires a network connection and Samsung Account login. This feature is activated when a certain number of characters is met. Service availability may vary by language. Accuracy of results is not guaranteed.
⁸ Tone suggesting feature in Chat Assist requires a network connection and Samsung Account login. Must meet length requirements to activate feature. Service availability may vary by language. Accuracy of results is not guaranteed.
⁹ Translating feature in Chat Assist may require Samsung Account login. Some chat applications may not support this feature. Certain languages may require language pack download. Service availability may vary by language. This feature is activated when a translatable language is detected. Accuracy of results is not guaranteed.

Samsung Research combined data and cutting-edge technology. Together with the Mobile eXperience (MX) Business R&D Office, they further honed this technology to develop the translation features powered by on-device AI — which can be used for real-time translation during calls and across various applications. Samsung Newsroom met with Yoonjung Choi and Yonghyun Ryu from Samsung Research’s Global AI Center to learn more about these ambitious features.

▲ (From left) Yoonjung Choi and Yonghyun Ryu of Samsung Research’s Global AI Center

Smooth Communication and Strong Security With On-Device AI

On-device AI is the key differentiator to Galaxy AI’s Interpreter and Live Translate features — introduced to users through the release of the Galaxy S24 series earlier this year. Leveraging the advanced computing resources built into the devices themselves, smartphones with on-device AI can provide services without relying on servers or the cloud. Users can be assured that their data will remain private and secure since information is not shared with external sources.

Samsung Research’s Global AI Center contributed to integrating proprietary technology into its AI translation model to commercialize these features for widespread use.

Envisioning a wide range of applications, the Samsung Research team and MX R&D Office obtained an expansive amount of data. “We collected colloquial data for real-time translation during calls in Live Translate and travel-related data for Interpreter,” explained Yoonjung Choi, who led the project. “To provide the most accurate translation, we studied and incorporated casual language used in chatrooms and HTML tags used in web browsers.”

▲ Use cases for on-device AI translation include ① Live Translate, ② text message and conversation translation, ③ translation in Samsung Notes and ④ web browser translation.

How Samsung Research Trained Its AI Model

The Samsung Research team’s AI translation model is based on deep learning technology that learns from its own data. Yonghyun Ryu, who is in charge of AI research and development, likened this process to raising a child. “Similar to how a child needs excellent educational resources and caregivers to grow and thrive, good language data and talented researchers are required when developing a high-performance AI translation model,” he described.

Samsung Research has both — since 2013, the company has been providing in-house translation services, conducting R&D related to AI translation and accumulating high-quality data.

Samsung Research’s team of deep learning experts played an important role in training the AI model. “If incorrect translations occur during the research and development process, it is necessary to identify the problem and make improvements. However, this can be challenging and time-consuming for researchers without sufficient capabilities and experience,” he explained. “Our researchers used their expertise and know-how to quickly analyze the cause of the issue and come up with a solution to enhance the AI translation model.”

▲ Yonghyun Ryu from Samsung Research’s Global AI Center

To assess the performance of Galaxy AI’s translations, the Samsung Research team used quantitative metrics based on test sets as well as qualitative evaluations by human translators and the MX R&D Office.

In addition, the team gained credibility by competing in global machine translation competitions. “Although participation requires time and effort, good performance in competitions provides momentum for research and development,” Ryu emphasized. “We were able to achieve strong results because our team members could freely discuss new ideas and put them to the test.”

Politeness and Punctuation: Understanding the Quirks of Each Language

Each language has characteristics that are unique to its culture — these can include honorifics, tonal inflections and distinct punctuation symbols. To make translations as accurate as possible, the AI translation model considers all these linguistic idiosyncrasies. For example, in Korean and Japanese, honorifics are translated to maintain a respectful tone.

Samsung collaborated with regional R&D centers to fully understand languages in their cultural context. “By working closely with researchers and linguists in other countries, we were able to offer a more accurate and complete translation,” said Choi.

At the same time, dealing with different languages often involves trial and error. “Vietnamese, for instance, is a tonal language. However, we realized during the research process that Vietnamese users often omit tones in casual conversations when chatting,” she explained. “We needed additional data to help the features translate sentences without tones.” For Thai, Samsung Research developed a special sentence separator because the language does not use punctuation.

Why Lightweight Technology Is the Key to Effective On-Device AI Models

Samsung Research began developing its on-device AI translation model in 2019. “Unlike server-based AI models, on-device AI models must be driven only using users’ devices,” stated Ryu. “Developing lightweight technology that uses minimal resources is key.” To make the model lighter, the team used “knowledge distillation” and “quantization” technology.

Knowledge distillation is a method that extracts knowledge from a large, high-performing teacher model and delivers it to a smaller student model. This is similar to how a teacher summarizes a topic so that a student can digest the information more easily and efficiently.

Quantization simplifies AI algorithms to reduce model size and streamlines the process to increase response speed.

Ryu compared quantization to drawing strawberries. “You need a wide range of colors to paint lifelike strawberries — but strawberries can also be made with just red and green,” he explained. “Quantization is the process of minimizing the number of colors needed to draw strawberries while trying to make it as close as possible to the real thing.”

▲ Yoonjung Choi from Samsung Research’s Global AI Center

In the AI field, knowledge distillation and quantization are well-known approaches to making models lighter. Yet, implementing them on a commercial scale is not easy due to differences in each researcher’s detailed experimental methods and factors. Samsung Research developed proprietary technology by discovering an efficient quantization technique and creating a accelerated algorithm based on it. “Through constant experimentation, we found an optimal way to make the model lighter,” commented Choi.

By combining the high-quality AI translation model with algorithms that make models lighter and speed up response time, lightweight and fast on-device AI features were born.

The Culture Behind the Language: What Would the Perfect AI Translation Model Look Like?

The researchers at Samsung Research’s Global AI Center have bright goals as they lead the field of on-device AI. “My ultimate goal is to help users communicate smoothly and conveniently with people who speak other languages,” said Choi. Ryu revealed his vision to build the perfect translator. “One day, we want to create a translator that truly understands the cultures behind the languages it is translating, equipped with an extensive pool of knowledge,” he expressed. “I want to challenge myself to develop a translator the world has never seen before.”

▲ Samsung Research’s Global AI Center team developed the on-device AI translation feature.

Samsung’s on-device AI translation features allow anyone with an enabled mobile device to communicate freely — without worrying about internet connection or information leakage. Going forward, the Samsung Research team will continue to spearhead innovations in the rapidly evolving field of AI and bring new levels of convenience to users.

It’s AI that tags along throughout your workday. On your subway commute, it suggests an eloquent response to your boss’s email. In the afternoon, it live translates a call with your global team and provides a summary and transcript immediately after. At night, it helps you archive all the resources and materials you gathered during another dizzying day of multitasking – in seconds.

For all the talk about AI transforming work, the game changer for the workforce is AI that goes everywhere you go. In other words, AI that’s as mobile as your mobile device.

Enter Galaxy S24, the first AI-powered phone.

With Galaxy S24, Samsung is harnessing AI to deliver new dimensions of personal convenience, productivity and communication into our daily lives. The impact will be profound in the world of work, where being productive on the go has become part of the job.

Here’s how several of the device’s features, powered by Galaxy AI, transform how we work:

Removing Communications Barriers

Businesses today routinely link up across borders and time zones to pursue new market opportunities. Accuracy and speed are a must, but international communication can create misunderstanding, swirl and delays. Galaxy S24 helps professionals collaborate more effectively whether they’re at the office, working from home or somewhere in between.

Real-time, two-way translation on conference calls: You’re setting up a conference call with a potential business partner in an overseas company. You want it to go as smoothly as possible, but you’re concerned about the language barriers.

Galaxy S24’s Live Translate translates phone conversations in real time, ensuring you’ll be as clear, creative and professional with overseas colleagues or clients as you’d be in your own language. Offered in 13 languages at launch, Live Translate provides two-way translation on both devices, even if one party isn’t using a Galaxy – or even a smartphone.

Translated and tailored tone for professional emails or texts: It’s your first day in a new job, and you want to make a good impression in your first email to your colleagues. With Galaxy S24’s Chat Assist, you’re offered different AI-generated options on how to restructure your message and writing style, so you get the tone just right. Whether it’s drafting a catchy social media post or a formal email to your boss, this feature is accessible right from the Samsung Keyboard, so you can use it on any application and make sure you hit the appropriate note every time. And if you’re working with a colleague overseas, Chat Assist’s availability in 13 languages allows you to do all this in a language you don’t even speak.

Converse face-to-face without language barriers: As a small business owner attending an expo on emerging market trends, you spot a renowned expert in your niche from a popular YouTube business page. You want to pick her brain, but you know from the show that she speaks Italian, and you don’t.

Interpreter takes live translation out of the call app and into the physical world. With this feature, Galaxy S24 becomes a real-time, in-person translator. Because the tool splits the phone screen into two horizontally, each person can show instantly translated text to the other, along with accompanying audio. It also lets you select the language you need and communicate smoothly and professionally with anyone around you.

Organize Your Phone and Your Thoughts

Although our phones provide a handy way to capture ideas, research projects and arrange meetings, organizing all that on a handheld device can be a challenge. Using responsive Galaxy AI capabilities, however, Galaxy S24 intelligently organizes your phone, so you stay focused on the big picture.

Keep your documents and plans organized: Deep into a work project, you realize the relevant resources you need are scattered everywhere: long emails, detailed articles, PDFs and more. If you could pull everything together into one cohesive format, it would save you hours of laborious notetaking and file conversion.

Thanks to the Note Assist feature, you can generate, read and save abridged versions of all your materials in a few taps of your finger, transforming the daily churn of documents into a well-structured archive. By pulling up a document, Note Assist prompts you to save its content straight to your Samsung Notes app. Once there, the feature can auto format the text and correct spelling mistakes before creating a simple or detailed bullet point summary of the whole document above the main text so you can see all the key points at a glance whenever you need to.

The feature can also extract and summarize text straight from physical books and papers and can translate notes into other languages, while its Browsing Assist capabilities can turn long, detailed articles into succinct summaries.

Accurately document everything: It’s a classic dilemma: You’re in an important work meeting, and you need to take detailed notes while at the same time staying focused and making contributions. With Galaxy S24, you can have it both ways.

Transcript Assist creates full, accurate records of meetings and conversations. Simply record the meeting using the native Samsung voice recording app, and afterwards Transcript Assist will offer to convert it to text, with sentences separated according to individual speakers. Once you’ve got your transcript, you can share it with your colleagues as is, or send it to Samsung Notes and add an AI-generated bullet summary to it using Note Assist.

If you have preexisting audio files recorded without Transcript Assist, the feature can convert these files to notes using Text to Audio.

When it comes to work, the power of having AI on our mobile devices goes beyond automating mundane tasks. Galaxy S24 illustrates how technology can dramatically improve how we work, think and create – by being indispensable, mobile and close at hand.