But the Galaxy S9/S9+ is taking it up a notch with an all-new variety of intelligent and personalized emojis, which means you may never want to send plain text messages again. AR Emoji is designed to bring your unique facial expressions and add more fun to the emoji experience. But how did this AR-based feature come to life? Get a look behind Samsung’s lab doors for a close-up view.

01. The Problem

Regular emojis add more color to the conversation and are a fun way to communicate, but we recognized there are a lot of times when the existing set of emojis just don’t cut it. These lack personality – one smile looks no different from another. So we started looking for ways to bring out more character and personality in emojis.

02. The Goal

We thought in an ideal world, you would be able to teleport yourself and share how you feel with others then and there. So we wanted to come up with a way to replicate that experience but with the simplest tools possible, having seen so many people use messaging apps to communicate even with people right next to them and rely heavily on emojis rather than text. The focus quickly became how to create an image of the user and deliver multiple facial expressions and emotions along with that.

03. The Idea

To accomplish this, we decided to leverage the Galaxy S9/S9+’s camera technology. We thought, if users could take a selfie and transform it into a custom avatar and emoji, it would add something unique to the fun of communicating. In addition, we wanted to find a way to track people’s actual expressions so that they would have at their fingertips emojis that actually felt like their own. It was also important that we give users the best tools to express themselves however they want to look.

04. The Solution

The first step toward this was to use augmented reality to generate an avatar. With facial recognition technology, the Galaxy S9/S9+’s camera starts by producing an initial 3D rendering, using a data-based machine learning algorithm. Next, the camera analyzes the 2D image of the user and pulls information from its deep learning database to create the user’s facial features on the final 3D AR Emoji. To bring people’s unique expressions to life, we decided to include Face Tracking Technology, which tracks over 100 facial features and allows us to capture individual emotions on the spot.

In addition to this, Blend Shape technology helps deliver an even greater range of different facial expressions. Based on 75 basic facial expressions, Blend Shape allows us to reflect a wider set of user emotions by blending multiple expressions together. This is also the technology that has made our Disney emoji offerings possible. Another major step we took was to go through numerous sampling tests. From our labs, we conducted at least 100 tests on a weekly basis to make sure the new feature included enough data to appeal to users regardless of their tastes.

05. The Result

The end product of this is AR Emoji, which among other features offers a realistic or cartoon-like option for creating your own personalized My Emoji. These can be transformed into a set of 18 different expressions – gradually to expand to 54 – which were carefully created as universal visual representations of human emotions like joy, anger, sorrow, and pleasure. We wanted to offer emojis that would be able to deliver the same emotions across the world and went through a lot of research to understand how certain emotions are categorized and expressed on a fundamental level. In addition to the variety of emotions, AR Emoji also comes with a lot of versatility, allowing you to create the 3D avatars, either as a GIF, video or PNG file. Through updates and other developments, we’re continually looking for ways to help you simply be you. Check out some of the latest changes we made on April 23* and keep an eye out for additional improvements throughout the year that will include more hairstyles and other options.

06. A Simple How-to Guide

*Software update availability, functionality, features and schedule may differ by each market and its conditions, and are subject to change without notice or obligation.

Lock Screen and AOD

The lock screen is the part of the smartphone we interact with the most. It’s often one of the first things we see when we wake up and check throughout the day. Galaxy S9 and S9+’s lock screen features give you the best platform to tell your own story every day. With the video wallpaper function, you can customize the lock screen to play your favorite images to keep you inspired all day long. The feature even lets you transform your treasured Super Slow-mo videos into lock screen wallpapers. You can also try making the notification bars on the lock screen transparent to see all the things that matter to you more clearly.

Whenever you need to read the time precisely, simply tap the clock on the lock screen and it will tell you the seconds as well as minutes and hours.

Want to keep something that makes you smile close by? Pin one of 20 pre-loaded animated GIFs on your Always on Display so you can be greeted with a dash of delight whenever you check your phone.

Edge

There’s nothing more frustrating than trying to find an app quickly only to forget which folder it’s in. The Edge function on the Galaxy S9 and S9+ solves this problem by giving you the option to store your favorite apps and contacts on the side of the Super AMOLED screen. Samsung has improved the function to facilitate quicker access. Simply drag and drop an icon from Apps Edge to a designated box for a pop-up view. The Edge function on Galaxy S9 and S9+ also allows you to quickly reply to messages in a pop-up window.

You can now switch between Apps Edge, People Edge and Smart Select with a simple swipe. People Edge allows you to easily call or message your frequent contacts, while Smart Select lets you capture an area of your screen as an image or animation.

App Pair

We’ve all been there. Switching back and forth between different documents and apps to gather all the information while writing an email on the go. The time spent navigating multiple apps could make writing a simple message feel like running a marathon. With App Pair on Galaxy S9 and S9+, you’ll never find yourself in such a situation again. With just one touch, the function launches two apps simultaneously in Multi-Window mode. You can even place the customized App Pair icon on the home screen to ensure easy access all the time.

Landscape Mode

Most multimedia contents are best experienced in landscape on the smartphone. Using the entirety of the screen, the experience becomes more immersive. But switching from a video stream to other tasks can be cumbersome at times, as the home screen is usually fixed in portrait – until now. The home screen of Galaxy S9 and S9+ can rotate to landscape automatically, which means you don’t have to physically change the phone’s position whenever you transition between multimedia contents and other tasks.

Dedicated Fingerprint

Our phones often hold highly personal information. While it’s important to have such data locked away securely, efficient authentication is equally crucial. Galaxy S9 and S9+ strike the perfect balance between security and usability with Dedicated Fingerprint. The function lets you register two fingerprints to unlock the phone. Your normal fingerprint takes you to the home screen while your dedicated fingerprint gives you access to the Secure Folder directly from the lock screen.