Take a look at Bixby, Samsung’s intelligent assistant. Voice recognition technology has drawn big crowds at recent home appliance and electronics exhibitions such as CES and IFA, but Bixby stands out in its ability to control appliances and TVs in optimized ways that fit users’ lifestyle. It’s natively embedded into some of the most important electronics or home appliances such as the TV and fridge, and it uses AI to be context-aware. In addition, an entire array of smart home gadgets, not just those made by Samsung, can be connected to the same connected network with just one click of an app. It has created a new way to experience and interact with the home.

No More Hassle in Front of the TV

The TV is one area that Bixby innovates and enhances entertainment. The boredom of channel surfing is banished once and for all. Many will already be familiar with searching for channels or shows with their voice. Bixby goes further by using the power of AI to recommend shows based on previous viewing habits and searching based on additional parameters beyond just the title or channel.

Bixby draws on information from set-top boxes and real-time TV channels Samsung Electronics has accumulated, thus recommending content that exactly meets users’ demand. It analyzes users’ voice commands to hear whether the commands include genre, cast, or title, thereby drawing accurate results. When a user plugs a set-top box into a TV, the TV automatically detects the brand of the set-top box and provides the user with customized content and channel information. So the user doesn’t have to command specifically by saying, “Find Suits.” Instead, if the user says, “Play TV series starring Meghan Markle,” Bixby analyzes the content and channels to deliver the desired result.

Bixby also gives information associated with the content while watching TV. When watching television, users are often curious about background music (BGM) or program details. If the user says “What is this song,” he or she can know right away. Searching information on BGM is possible in Samsung smart TVs, thanks to the collaboration with Shazam.

The viewer’s voice can also control a wide range of TV menu options, not just changing channels, but making sure everything is just right when sitting down to watch a movie.

Users can not only search content but also adjust TV settings using only their voices. Without having to fumble with the remote control several times over, users can change settings to fit their needs through voice commands such as “Make screen sharper,” and “Turn on Game Mode.” Samsung TVs went through the most rigorous tests to make sure TV use is made easy through Bixby.

Do More with Your TV

Viewers in the mood for a movie, or a particular show, may also want their TV to help them set the mood for a perfect night in. A simple command is enough to control the entire smart home, with the TV as the interface. For example, a viewer watching TV can see the contents of the fridge right on the TV screen through a simple voice command, and if it’s empty, can also order food on the spot, all without leaving the couch.

Bixby can also bring up weather information, favorite photos and play music on-screen without the need to open a standalone app. It’s an integrated way to use voice with the TV as the heart of the smart home. Now, commands such as “Show me photos from yesterday,” and “What’s the weather forecast in NY this week,” can become commonplace in the living room thanks to Bixby. These new features all come together in the 2018 premium smart TV. Through its most recent TV line, Samsung Electronics has focused on delivering the most optimal experience to TV viewers via Bixby.

Bixby Becomes Expert Home Assistant in Your Fridge

Taking into account that the kitchen is the ‘heart’ of the home where families and friends share warmth and social interactions, as opposed to just being a place for food and drink, Samsung installed Bixby in the 2018 Family Hub, the company’s smart refrigerator.

While other voice recognition platforms merely control refrigerator functions, Bixby in Family Hub learns and interacts with multiple users of the fridge and helps to manage the food inside. Bixby is an excellent home assistant that can even lend a hand when users’ hands are full with food or kitchen utensils.

Organizing the fridge inventory and preparing meals is easy and practical with Bixby. For example, after coming home with groceries, users can simply put everything away in the fridge and tell Bixby, “Move all items on Shopping List to the fridge.” With the list saved in the interface, Bixby can also help users find optimized recipes that work with the ingredients on hand while taking into consideration users’ dietary preferences. Users will then be guided on how to prepare the dish.

Another noteworthy function of the 2018 Family Hub is that it recognizes individual voices, so everyone gets the information they need. When a user asks, “Hi Bixby, what’s new today?” it will provide a readout of the news, weather and calendar updates specifically tailored to the user. Bixby’s role as a home assistant will continue to grow as it provides better, more personalized solutions in the future.

Bixby Connects the Home More Tightly than Ever

Bixby communicates with various appliances in the home. In fact, thanks to Samsung’s SmartThings IoT platform, all Samsung devices can be connected easily. Bixby handles simple voice commands to control devices and provide solutions based on what users need. It’s like having a normal conversation.

Samsung Electronics’ plan to upgrade Bixby is based on the company’s vision to maximize the usability of home appliances and is rooted in a deep understanding of consumer needs. Rather than simply executing the user’s commands on behalf of the remote control, Bixby will constantly evolve based on user experience so that it can understand and perform with more precision.

What’s more, as Bixby continues to evolve, users will be able to access and control various home appliances at once, all by simply talking to Bixby. For example, by telling Bixby “I’m going to bed,” users can automatically turn off the TV, dim the lights, and switch the air conditioner to sleep mode—all thanks to the fact that home appliances are becoming easily customizable through a connected learning system. Samsung Electronics plans to continue expanding Bixby to various home appliances in the near future.

^*Specific features and availability may vary by region and market

Why Does the Family Hub Evolve to be Personalized?

The refrigerator is the most frequently used appliance in many households. However, as the refrigerator evolves into a smart device, each family member may also want different functions and information that suit their individual tastes. So the 2018 Family Hub uses AI to offer ‘personalized’ services.

The new Family Hub that will be introduced this year has a new feature called Meal Planner. It suggests optimal recipes for the user based on their food ingredient preferences and the expiry date of the ingredients in the fridge. Previous models of the Family Hub had a voice recognition feature. The 2018 Family Hub builds on that with a new VOICE ID feature that can identify a user by his or her voice. No other refrigerator on the market today supports these functions.

Catering to the Needs of Every Member in the Family

VOICE ID does more than just recognize what the user says. Previously, you had to manually enter information into the Family Hub to call up your personalized calendar or weather. Now, because it can determine who is actually speaking, it can call up user-specific information with just your voice.

After registering the sound of each family member’s voice, Family Hub analyzes the voice data to distinguish the speaker’s voice from other family members who have registered their voices. When you say, “Hi Bixby,” the Family Hub determines whose voice it is based on information stored in the cloud. ”Hi Bixby” is a trigger phrase that gets the fridge ready to recognize the user’s voice and reverts to the custom settings and features for that person.

Family Hub has three functions that can be personalized: Morning Brief, Calendar, and To-do List. If you say, “What’s new today?” after saying “Hi Bixby” to make the fridge recognize you, the Family Hub shows a personalized schedule.

Meal Planner’s Smart Algorithm Suggests the Optimal Diet

Not everyone in the family has the same eating habits or preferences. The 2018 Family Hub combines data from individual food preferences and shelf life for ingredients in the fridge to provide each family member with a personalized diet.

The 2018 Family Hub can hold information about the food preferences of each family member, and keep track of the expiry date of your ingredients based on the average shelf life. You can add the expiry date by entering the type of ingredients into your Family Hub or smartphone app, or just by saying out loud, “I’m going to put in an apple.”

Family Hub features a sophisticated algorithm that automatically suggests appropriate menus from a variety of recipes.

Personalized Recipe Recommendations Based on Data Analysis

The 2018 Family Hub employs AI-based technologies so that it can analyze data on each family member and selectively utilize the information. The refrigerator offers recipes that meet the needs of all family members, or provides family member A and B, or B and C, with personalized recipes. The fridge can provide a user with enough number of recipes so that the user can plan a whole week of meals. The user can select a recipe and register it to the calendar to arrange a healthy and optimized meal plan.

Let’s say the mother likes beef and hates carrots, and kids don’t enjoy salmon. This information is entered into the Family Hub and the Meal Planner function proposes menu options to keep everyone happy, while minimizing food waste. The Family Hub finds ingredients close to their expiry dates first. And it rules out carrots and salmon as ingredients and offers recipes for food that includes beef.

The 2018 Family Hub, which will be sequentially released in the first half of this year, will support VOICE ID. Meal Planner will be added in the second half of this year, and it will also be available on the 2017 Family Hub via software update. Samsung plans to expand the use of AI technology in other home appliances in the future, further tailoring services to fit users’ lifestyles.

The 2018 Family Hub helps family members stay connected with each other and serves as a personalized device that makes our lives more convenient. The Family Hub will make a difference in the kitchen and in our daily lives thanks to AI-based technologies that help the fridge deeply understand and relate to users. Stay tuned to see how Family Hub continues to evolve.