Samsung’s ‘AI for All’ Vision Unveiled at CES 2024

Samsung outlines strategy for using AI technology to make the connected device experience safer, more inclusive, and more energy-efficient

LAS VEGAS, Nevada – Jan. 8, 2024 – Samsung Electronics Co., Ltd. today shared its vision for how artificial intelligence (AI) technology will enable people to experience their devices more intuitively and conveniently than ever before. Presenting these ideas at a press conference at CES® 2024, Samsung teamed up with key partners to outline the technology behind this vision and how new products and services use AI capabilities to make life easier.

Jong-Hee (JH) Han, Vice Chairman, CEO and Head of Samsung’s Device eXperience (DX) Division, opened the press conference by describing how AI will enable connected technologies to improve people’s daily lives while always remaining nonintrusive and “in the background.” The strategy that he and others outlined focused on the role of AI in enhancing connected experiences that are both simple and useful. Throughout the press conference, Samsung presented a number of products and services that help achieve these aims.

“With the emergence of artificial intelligence, smarter, better experiences will redefine how we live,” Han said. “Samsung’s broad portfolio of powerful devices, along with the pursuit of open collaboration, will help bring AI and hyper-connectivity to all.”

AI-Enabled Visual Display Products and Digital Appliances Bring New Experiences to the Home

During the CES press conference, Jonathan Gabrio, Head of Connected Experience Center at Samsung Electronics America, outlined the ways in which AI technology is transforming how Visual Display products and Digital Appliances are used. For example, Samsung Neo QLED 8K QN900D boasts a built-in AI Processor, NQ8 AI Gen 3, equipped with an 8 times greater AI neural network and a two times faster NPU than its predecessor. Thanks to the NQ8 AI Gen3 processor, Samsung Neo QLED 8K automatically upscales low-resolution content to provide users with up to 8K quality viewing experience and sharpens fast-moving images via AI Motion Enhancer Pro. The Samsung Neo QLED 8K also features Active Voice Amplifier Pro, which analyzes voice and background noise by AI to optimize your TV listening experience so you can enjoy various content as if you are in the front row of a stadium or movie theater. Samsung Neo QLED 8K also features Tizen OS Home, which offers the latest apps, services, personalized content, and service recommendations to upscale your entertainment experience.

As for viewers with different needs, Samsung also provides innovative accessibility features. A sign language feature in Samsung Neo QLED can be easily controlled with gestures for the hearing impaired, and an Audio Subtitle feature turns text subtitles into spoken words in real-time for those with low vision.

Furthermore, Samsung is introducing the new The Premiere 8K, a projector that features not only a 150-inch display, but also the world’s first wireless 8K transmission for a projector. With The Premiere 8K, users will be able to enjoy a full-scale viewing experience like that of the cinema in the comfort of their own homes.

As for sound, Samsung also introduced Music Frame, a speaker with a customizable cover that integrates seamlessly into users’ homes. Via Q-Symphony, the Music Frame syncs with Samsung TVs and soundbars, bringing enriched bass and surround sound of dual built-in woofers to the home with minimal effort.

Samsung has also made major upgrades to Ballie, the rolling AI robot first introduced at CES 2020. Ballie has now evolved into your AI companion capable of interacting with other smart devices to provide customized services such as taking care of bothersome tasks or projecting images and videos on walls so that users can view key information for their daily lives such as weather or other relevant content wherever they are.

Better Connecting Users and Devices through Spatial Intelligence

Jaeyeon Jung, Executive Vice President and Head of SmartThings, highlighted the exciting new ways in which AI technology is impacting the relationship between users and their devices, including Samsung’s vision for SmartThings: The more Samsung devices a customer uses, the smarter those devices become and the better they can understand and support daily life.

Spatial AI is the key to enabling this vision, by helping devices understand the living space and routines of the user, thus enabling more a personalized home management experience. In March, SmartThings will roll out the upgraded 3D Map View for a more detailed experience on Samsung smartphones and TVs. Furthermore, a simple QR code will allow users to add family and friends to their SmartThings ecosystem, so that every member of the household can create their own routines.

Using smart sensors and AI, SmartThings will be able to detect unusual circumstances, such as a fall, and send alerts to designated family and caregivers¹. Also, thanks to the Galaxy SmartTag2, users can track their pets’ activities and digitally store identifying information by attaching the tag to a collar or harness².

Another point EVP Jung discussed was how the Bixby voice assistant is allowing smart homes to become more dynamic with its enhanced AI capabilities. Bixby can now automatically route commands to the most appropriate devices based on an understanding of the user’s location and activities.  Key technologies like Multi Device Wakeup combined with a shared communication protocol, enable Bixby to listen to commands with all the devices in a room but then only perform the requested action on the most relevant device. So if a user is in the kitchen watching a recipe video on their Family Hub™, and they can call out, “Hey, Bixby! Play music!”  At that point, music will play from the user’s smart speaker, but the recipe video will continue to play on the Family Hub™, uninterrupted.

The TV, with the Samsung Daily+ service, will increasingly become a central hub for much of this smart home functionality, while also granting access to a variety of additional services. These include video calls through ConnecTime, video veterinary consultation services⁴, and Workout Tracker — through which workout data can be transferred to Samsung’s smart watches. Samsung also announced the new Daily Board⁵ service, which displays useful information about users’ homes, such as the weather or a live security camera feed from a home security system without the TV even being turned on.  As is the case with SmartThings features, users can also access this information via voice command.

Bringing the Home and Car Closer Together With Home-to-Car Capabilities

Samsung also announced developments in the automotive industry, starting with a partnership with Hyundai Motor Group.  Samsung and Hyundai have signed a memorandum of understanding (MOU), which was announced ahead of CES 2024. Under the agreement, users will have access to Home-to-Car and Car-to-Home services, courtesy of SmartThings connectivity. Haeyoung Kwon, Head of Infotainment Development Center and SDV[5] Execution Sub-Division at Hyundai Motor Group, delivered remarks regarding the partnership.

“Using Hyundai Motor Group’s software-defined vehicle, SmartThings will now work with Hyundai, Kia, and Genesis vehicles through the app,” Kwon said. “All of us at Hyundai Motor Group appreciate our partnership with Samsung, and we’re excited about the new features we’re bringing to your vehicles through smarter connectivity.”

Through SmartThings, users will be able to utilize voice commands to remotely perform functions in their car, such as heating it up in advance or opening and closing windows. SmartThings connectivity goes the other way, too, with users able to control home functions from their vehicle. Users will be able to automatically open and close garage doors based on the location of the car, as well as regulate home temperature. All of these actions can be carried out via voice commands.

Additionally, Samsung has further deepened the longstanding partnership with HARMAN to elevate the way users experience driving. Michelle Gattuso, Vice President of Product Management at HARMAN, discussed how the two companies are building new technologies to elevate the driving experience.

“Samsung’s leadership in consumer technology — together with HARMAN’s automotive expertise — has opened the door to game-changing experiences like HARMAN Ready Care, Ready Vision and Ready Display,” Gattuso said. “But now, the work we do with Samsung is getting even more integrated. Samsung and HARMAN are working in lockstep to bring even more impactful experiences to the entire in-cabin ecosystem.”

HARMAN’s Ready Care, which focuses on driver safety, implements deep learning neural networking techniques to monitor the driver’s movement and cognitive alertness, and can provide personalized reminders and alerts. Additionally, Ready Care can now identify whether passengers are adults or children, and adjust airbag deployment settings accordingly.

Furthermore, Ready Vision brings an intuitive display directly to windshields — courtesy of augmented reality — in drivers’ line of sight, right when they need it. For example, drivers have access to a map that updates according to routes in real time, as well as recommendations for the fastest route or where to stop for coffee. Another HARMAN product, Ready Upgrade, allows automakers to frequently update their vehicle’s hardware and software. This keeps vehicles relevant, modern and efficient for longer.

Samsung Focuses on Security and Privacy Across Devices

In this future of AI-enabled, deeply interconnected devices, Samsung recognizes that security and privacy are paramount. Shin Baik from the Mobile eXperience Security Team discussed the company’s security solutions as a foundation for the hyper-connected era.

One such solution is Samsung Knox Matrix, which now provides end-to-end encryption across many Samsung Galaxy smartphones and smart TVs. The technology will allow devices to monitor each other to identify and isolate security threats. Knox Vault, which helps keep user data safe on some of Samsung’s most popular devices, has been expanded to cover more devices connected by SmartThings, such as Samsung Neo QLED 8K TVs. Additionally, Samsung’s partnerships with major tech companies allow users to experience security and privacy in a way that is tailored to their specific needs.

Samsung Makes Strides in Responsible Materials, Energy Management, and Accessibility

Meanwhile, Inhee Chung, Vice President of the Samsung Corporate Sustainability Center, highlighted Samsung’s plans for a more circular economy. As part of these plans, Samsung increasingly incorporates recycled materials into its products — including recycled plastic sourced from discarded fishing nets in Galaxy devices[5], recycled plastic in TVs, and recycled aluminum in Bespoke refrigerators[6]. Additionally, the company’s Certified ReNewed program — available in the U.S. and select European countries — offers affordable refurbished phones, while Galaxy Upcycling allows consumers to reuse or repurpose their old phones in creative ways. The company plans to scale up recycling and upcycling, as well.

As for the ways Samsung’s technology contributes to sustainability efforts, the company is utilizing AI to make the use of its products more energy-efficient through features like SmartThings AI Energy Mode, which automatically optimizes energy usage to help users save electricity. These features are yet another example of how AI technology will not only make lives easier, but also allow consumers to live in a way that is more environmentally and economically responsible.

Thanks to a new collaboration with Tesla, SmartThings Energy is becoming even more useful both inside and outside of the home. The collaboration has integrated SmartThings Energy with Tesla products, including electric vehicles (EVs), the Powerwall home battery, Solar Inverter and Wall Connector EV charging solution.  Another benefit is that SmartThings Energy users can take advantage of the Tesla app’s Powerwall “Storm Watch” function, which flags severe weather through SmartThings not only on the Tesla app, but also on users’ connected Samsung TVs and mobile phones. SmartThings can also help users prepare for power outages by activating AI Energy Mode to extend the usage time of backup energy stored in their Tesla Powerwalls.

Samsung is adding new features to increase device accessibility, such as digital appliances responding to hands-free gestures. Additionally, mobile devices provide auto-generated captions during calls, and TVs and displays offer a new, AI-enabled text-to-speech feature that converts subtitles into spoken audio. To further aid those with low vision, Relumino Together is a new viewing mode on Samsung TVs that enables users of all abilities to watch TV together, with or without visual adjustments. Now, everyone can enjoy home entertainment together at the same time.

¹ SmartThings will be able to inform the designated person(s) of a possible emergency if it detects indications of a fall through partners’ presence sensors with fall detection function or the Galaxy watch. Fall detection service expected to be available within this year.

² Contact information and message shown on Lost Mode must be registered beforehand on the SmartThings application, along with user registration by email.  The SmartTag2 finder’s device must support NFC reading and be connected to the internet.

³ Samsung Daily+ offers access to 3^rd party veterinary consultation services such as Dr. Tail.

⁴ Official name of the service was updated at launch in March, 2024

⁵ Software Defined Vehicle

⁶ Recycled plastic sourced from discarded fishing nets are incorporated into the Samsung Galaxy S22 series, Galaxy S23 series, Galaxy S23 FE, Galaxy Z Flip4, Galaxy Z Fold4, Galaxy Z Flip5, Galaxy Z Fold5, Galaxy Tab S9 Series, Galaxy Tab S9 FE series, Galaxy Book3 series, Galaxy Book4 series, Galaxy Buds2 Pro, Galaxy Buds FE and more.

⁷ Recycled Aluminum is incorporated into BESPOKE refrigerator door panels for models including RQ38B9981APG, RR40B9971APG, RR40B99C5AP/**, RW33B99*****, RW33B99C5TF/**, RZ38B98*****, and RZ38B98C5AP/**