Recognizing Achievement in Telecommunications Technology

Zhang was acknowledged with the Industrial Innovation Award by the IEEE Communications Society (ComSoc). Recipients were recognized at an award ceremony on December 9 at the 2024 IEEE Global Communications (GLOBECOM) conference in Cape Town, South Africa.

An expert in mobile communications technology, Zhang was recognized for his groundbreaking contributions to the development and standardization of Massive MIMO systems — a technology crucial to network coverage and capacity. Introduced in 2009, the Industrial Innovation Award was presented for the first time in five years.

From 2009 to 2013, Zhang served as vice chair of the Radio Access Network Working Group 1 (RAN WG1) at the 3rd Generation Partnership Project (3GPP) — a global mobile communications standardization organization — during which he led the standard development of LTE and LTE-Advanced technologies. In 2015, he was named an IEEE Fellow — the highest honor for IEEE members. Currently, Zhang leads Samsung Electronics’ global 6G strategy and technology innovation efforts at Samsung Research.

“As a researcher in the field of telecommunications, I am honored to receive this meaningful award,” said Zhang. “We will continue to research and develop innovative telecommunications technologies for a better user experience.”

A Legacy of Excellence at IEEE ComSoc Awards

Founded in 1963, IEEE is the world’s largest organization of technical professionals in the fields of electronics, communications and computers — with over 460,000 members in more than 190 countries. The IEEE ComSoc annually recognizes individuals who have demonstrated excellence in leadership and made significant advances in information and communications through a rigorous selection process.

Samsung has a history of being recognized for its outstanding achievements at the IEEE ComSoc Career Awards — a reflection of the company’s contributions to the standardization of communication technology and the development of mobile phones.

Former Samsung Vice Chairman Ki-tae Lee, who played a pivotal role in developing Samsung’s Anycall mobile phone series, received the IEEE ComSoc Distinguished Industry Leader Award in 2004. Former Samsung Vice Chairman Jong-kyun Shin, who played a key role in developing the world’s first color phone, received the same award in 2016. More recently, Samsung Research Fellow Juho Lee, who successfully helped lead 4G and 5G standardization, received the IEEE ComSoc Excellence in Supporting Standardization for Communications Award in 2023.

Continuing Next-Generation Communication Research

Samsung is working to standardize and integrate AI technology in next-generation communication.

The company currently holds two chairmanships and four vice chairmanships within 3GPP. This year, the company further engaged in standardization activities by adding a chair to the Radio Communication Sector of the International Telecommunication Union (ITU-R), a United Nations specialized agency for information and communication technologies (ICT).

Samsung is a founding member of the AI-RAN Alliance, a global organization dedicated to advancing telecommunications technology. Recently, the company has also been reappointed as vice chair of the Next G Alliance — an initiative dedicated to advancing North American wireless technology leadership — further strengthening its leadership in the convergence of AI and wireless communication technologies.

– Bill Mandel, VP, Samsung Research America

HDR (high dynamic range) technology has been revolutionizing visual quality in movies and TV shows for several years. Now, with Samsung championing HDR10+ GAMING, the same visual transformation is making its way to the video game industry. It’s beneficial for game makers and players alike, and truly makes it possible to get the most visual impact out of gaming’s modern graphics and realism.

Samsung Newsroom sat down with Bill Mandel, Vice President, and Steve Larson, Senior Manager at Digital Media Solutions, Samsung Research America, to discuss HDR10+ GAMING and how the technology is changing the gaming industry.

▲ Steve Larson (left), Senior Manager and Bill Mandel, VP, Digital Media Solutions, Samsung Research America

Gamers and Game Creators Deserve HDR, Too

While HDR dramatically heightened the visual experience for television and film, its application in video games has been limited. Game engines have built-in color management systems that help the connected TV or monitor know what colors to show. However, a lack of communication between screens and game engines requires users to manually calibrate their displays.

“HDR10+ GAMING establishes a direct line of communication between the screen and the game engine”

– Steve Larson, Samsung Research America

In search of a solution, SRA started to develop HDR10+ GAMING. By automatically adjusting HDR settings based on the screen’s capabilities, HDR10+ GAMING unlocks a premium visual experience through accurate color, contrast and brightness.

“HDR10+ GAMING establishes a direct line of communication between the screen and the game engine,” said Larson. “The screen can now understand what the game engine is doing, and the game engine knows what the screen can display. That produces a much better visual output.”

“It’s all about making colors truer to the vision of video game creators,” said Mandel.

Engineering a Simple Solution for the Artists

Game developers were the first to call for new technology that addressed the limitations of HDR.

“The initial need came from game developers themselves who want the games they build to look the best they possibly can,” said Mandel. “They were struggling to get colors to look the way they hoped across monitors.”

▲ Bill Mandel, VP, Digital Media Solutions, Samsung Research America, explains how HDR10+ GAMING was introduced to bring better visual experience to all gamers

“We wanted the specs we published to be simple for game developers to use, without a heavy burden,” said Larson. “Once they integrate our specs into their game engine, they can use it across any game built in that engine. This significantly simplifies adoption across the industry because it doesn’t rely on certain configurations or devices. It’s easy.”

Making It Simple for the Players

With HDR10+ GAMING, gamers no longer need to deal with dials and test patterns to calibrate their monitors.

“HDR10+ GAMING simplifies the process by automatically adjusting settings for games, just like it does for movies,” said Mandel. “This ensures gamers get the best picture quality without any hassle — just turn on the game and go.”

▲ Bill Mandel (top), VP, and Steve Larson, Senior Manager, Digital Media Solutions, Samsung Research America demonstrate how HDR10+ GAMING automatically elevates the gaming experience

Because HDR10+ GAMING works both on TVs and gaming monitors, gamers can now enjoy a consistent visual experience with immersive graphics across platforms without setting anything up. This standard is especially important as today’s gamers expect photorealistic graphics in gaming today.

“When activated, your device automatically identifies that HDR10+ GAMING is an available option in any compatible game and takes advantage of it,” said Larson. “There’s no need to navigate a hidden menu or adjust settings.”

Lowering the Threshold for the Gaming Industry

For game developers, one major advantage of HDR10+ GAMING is that it is free to implement. With the right application programming interface (APIs), they can integrate HDR10+ GAMING into their existing game engines without any specialized training.

“It’s simple. Once developers integrate our specs into their game engine, they can use it across any game built in that engine”

– Steve Larson, Samsung Research America

Putting these standards into action, Samsung partnered with NEXON in September 2023 to launch the world’s first HDR10+ GAMING title, “The First Descendant.”

At Summer Game Fest this past June, the company showcased its latest Odyssey OLED gaming monitors with HDR10+ GAMING capabilities. The combination of HDR10+ GAMING and Samsung’s Odyssey OLED gaming monitors demonstrates how advanced display technology can elevate the gaming experience in video games like “Red Dead Redemption 2.”

Moreover, Samsung has worked with partners such as CD PROJEKT RED on “Cyberpunk 2077” — bringing the game’s fictitious Night City, California, to life like never before. The copy was a great hit, selling over 25,000,000 copies worldwide.

“We designed the system to be incredibly simple to implement,” said Larson. “In fact, CD PROJEKT RED told us that they knew HDR10+ GAMING was something they wanted to use. They were impressed with how fast and easy it was to implement. Their team was actually able to get it up and running in about half a day.”

“This is a free license technology. We’ll see a lot more games and platforms adopting the technology”

– Bill Mandel, VP, Samsung Research America

A Radiant Future Ahead for HDR10+ GAMING

Samsung is looking to expand HDR10+ GAMING to include additional game engines, particularly those that are more niche. The company is already working with major studios and developers to add into their proprietary engines and some of the more widely adopted ones.

“Through collaborations with game companies, we will expand the HDR10+ GAMING ecosystem — ensuring broader adoption and richer gaming experiences,” said Mandel.

This wide network will provide game developers with a versatile and powerful set of tools to create visually stunning games more efficiently.

▲Steve Larson (left), Senior Manager, and Bill Mandel, VP, Digital Media Solutions, Samsung Research America

“As this is a free license technology, we’ll see a lot more games and platforms adopting the technology,” Mandel continued. “For consumers, it means a consistent and immersive gaming experience across a range of devices — with minimal setup and maximum visual impact.”

Mandel and Larson anticipate a notable increase in the number of developers, games and users leveraging HDR10+ GAMING soon.

“Expect big things to come!” said Mandel.

Helping users say goodnight to washed-out, blurry night images was a group effort driven by Samsung’s experts. To learn more about this groundbreaking camera feature for the Galaxy S23 series, Samsung Newsroom spoke with the experts at Samsung Research’s¹ global R&D centers, who collaborated on the technology.

Read on to see what John Seok-Jun Lee, Head of Computational Camera Part at Samsung Research America (SRA), and Narasimha Gopalakrishna Pai, Head of AI Computational Imaging Part at Samsung R&D Institute India-Bangalore (SRI-B), had to say about their joint development of Nightography, the best way to take crisp photos and videos from dusk until dawn.

¹ Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s Device eXperience (DX) Division.

▲ (From left) Dr. Daniel Ahn, EVP and Head of Mobile Platform Center, MX Business and Dr. Michael Polley, SVP and Head of MPI Lab at SRA

The highest grade awarded by the IEEE, the “Fellow” title is conferred by the institute’s Board of Directors when a person demonstrates an outstanding record of accomplishment in any of the IEEE’s fields of interest. The total number of fellows selected in any one year cannot exceed 0.1 percent of the organization’s total voting membership.

Other members of Samsung Electronics who have been named as IEEE Fellows in the past include: Chairman of the Samsung Advanced Institute of Technology Kinam Kim, Executive Vice President and Samsung Research AI Center head Daniel Lee, Executive Vice President and Head of the Advanced Communications Research Center Sunghyun Choi, Senior Vice President Charlie Zhang of Samsung Research America, Vice President Xue (Steve) Liu of the Samsung AI Center (SAIC) in Montreal and Fellow Juho Lee of Samsung Research.

Dr. Ahn is Executive Vice President and Head of the MX Business’ Mobile Platform Center. His contributions include providing users with differentiated mobile experiences through the development of innovative security solutions for Galaxy smartphones, artificial intelligence (AI), Internet of Things (IoT) and cloud-based mobile platform function expansion and enhancement.

“I am both honored and humbled being elevated to IEEE Fellow,” said Dr. Ahn. “I will continuously devote myself to achieve technological advancements that would eventually help improve our products and provide better and meaningful experiences to our valued customers.”

Dr. Polley is Senior Vice President and Head of the Mobile Processor Innovation (MPI) Lab at SRA, where he leads a team of world-class algorithm and system designers focused on creating advanced technologies for Samsung’s Galaxy smartphones as well as next-generation mobile devices.

“I feel honored to be elected as an IEEE Fellow,” said Dr. Polley, “I am pleased that the innovative camera technology research that the MPI Lab at SRA, R&D team at MX Business and Samsung Research India-Bangalore Research Institute have worked closely together on to achieve is being recognized.”

¹ Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s Device eXperience (DX) Division.

The Samsung HeartWise¹ home-based cardiac rehabilitation project represents one solution in this challenge. A collaboration between Samsung Research² America, Samsung Electronics America and health care organization Kaiser Permanente, the HeartWise program pioneered a home-based alternative to traditional, healthcare center-based cardiac rehabilitation assisted by Samsung wearable devices. This year the Journal of the American Medical Association, a leading peer-reviewed medical journal, published an article³ showing that the HeartWise program yielded results that not only matched the effectiveness of center-based approaches but actually surpassed them.

To explore the impact that programs like HeartWise could exercise on modern health care systems, Samsung Newsroom has met with Ricky Y. Choi and Matthew Wiggins at the Samsung Research America campus in Mountain View, California. Choi is the Head of Digital Health at Samsung Electronics America and a clinical professor at Stanford, and Wiggins is the Head of Samsung Research America’s Health Solutions Lab.

▲ (From left) Matthew Wiggins, Head of Samsung Research America’s Health Solutions Lab and Ricky Y. Choi, Head of Digital Health at Samsung Electronics America

Q: Before we get into the details of the study results, can you give us some idea of how this home-based cardiac rehabilitation model is different from traditional models? And how does it work in step with established systems?

[Ricky Y. Choi] At Samsung, we believe our role is to technologically enable a standard of care without necessarily being the direct primary care provider. So, we are adding another tool for health care providers to use. It is a tool that allows patients to participate in care from their homes, in a high-engagement and comfortable manner that doesn’t bypass the health care system but adds scalability to the number of patients that care can be delivered to.

In practice, patients do the program from home and then check in with their care manager. Our goal is to find the technology layer that can enable patients to do certain things on their own, at home, with periodic check-ins with their case manager.

Q: The study showed that the at-home recovery patients⁴ had an 18.2% improvement in readmissions in the 12 months following recovery. The Samsung HeartWise program has shown that cardiac recovery can, with the right support, be more effective using this home-based model than in the rehab centers you mentioned. Can you put the significance of this discovery in context for readers?

[Choi] The study confirms the idea that patients, with the right support, are more successful at following through with cardiac rehabilitation within the comfort of their home. Furthermore, that success bears out in traditional health care outcome measures like an associated decline in readmission rate, which is one of the most important health and economic outcome measures and indicators of health care quality. It is extremely meaningful that this is the case across diverse populations.

[Matthew Wiggins] Another significant thing about the study is that it proves this can work. Previously people have said, “This sounds great, but there needs to be evidence that problems will not occur down the line. It needs to be studied and proven.” However, now we are starting to see that this method comes out well compared to traditional models. In fact, in this case it came out better.

Q: A previous study in the New England Journal of Medicine also showed positive results for home-based programs for cardiac recovery. What were your expectations going into the study?

[Wiggins] Kaiser Permanente’s patients in the program were doing very well and were very happy. All the information that we had pointed to this program, pairing Kaiser Permanente’s clinical workflows with Samsung’s wearable technology, would help those in the home-based cardiac rehab program just as much as those in the center-based programs. We were happy to see that the study proved what we had believed all along.

[Choi] We were all pleased by the results. The standard of care is clear: Patients with certain cardiac conditions and procedures should go through a cardiac rehabilitation program. However, very few do. Part of the reason is that for many of these patients, it can be difficult to get to a center-based program. Many center-based programs have physical and staffing capacity constraints. A highly engaging program that patients can undergo at home resolves those problems. So patients can focus more on their health.

Q: This study involved the use of Galaxy smartwatches including features which are available commercially on the latest line of Galaxy smartwatches. What role did these devices play in the research and which features are used in the process?

[Choi] Our home-based program is based on a digital solution that includes a Samsung smartwatch, a smartwatch app and an app that patients download to their personal phone. The smartwatches collect biosensor data, guide patients on activities and collect key patient-entered information or patient-reported outcomes.

[Wiggins] The Samsung smartwatches used in the program provide step count, heart rate and exercise duration feedback to the user to facilitate appropriate exertion level and duration for their rehabilitation program assignment. They also allow patients to report how they felt during their exercise session. It then provides this information to their care team to keep them on track during periodic check-ins.

Another benefit of home-based cardiac rehabilitation is the convenience for the patient, and the smartwatches play a big role in that convenience. Patients can perform their exercise sessions on their own schedule at the location of their choosing with a Samsung smartwatch on their wrist, instead of at a facility that needs to be scheduled and traveled to, sometimes over great distance. This leads to greater participation and rehab compliance.

Q: The HeartWise program tracked the recovery of over 13,000 patients. This study alone has seen participation from over 2,500 people. From a research perspective, what are the benefits of such a large number of participants?

[Wiggins] The large sample size lends further confidence to the results, but in my opinion, the sample’s inclusion of higher risk cardiac patients than were involved in previous studies is important as well. In addition, the diversity of the subject pool is encouraging as it represents a broader demographic sample of the U.S. population and the situations that the program will need to operate under to be successful at a national level.

Q: Ricky, you are a medical doctor who works in business strategy, and Matthew, you are the Head of Samsung’s Health Solutions Lab. What was it like to bring your respective areas of interest and expertise to this project?

[Choi] I am a clinical professor at Stanford and a practicing doctor with nearly 15 years of practice experience. I came to Samsung because I wanted to move the needle in health through innovative solutions at scale. HeartWise is a great example of what the power of Samsung innovation could do in health. It has been a privilege to work with such bright and mission-minded colleagues in research and development.

[Wiggins] Bridging the gap between what wearable technology can do and how it can be integrated into real-world clinical workflows is a critical piece of enabling the future of digital health. It is my honor to be a part of this innovative and collaborative partnership that is successfully working through all these challenges.

¹ Samsung HeartWise is intended to track or encourage general health, healthy activity and health choices, which, as part of a healthy lifestyle, may help improve the lives of those living with certain chronic diseases or conditions. Samsung HeartWise is not a medical application and as such is not intended for use in the diagnosis of acute or chronic disease or other conditions, or in the cure, mitigation, treatment, or prevention of acute or chronic disease or other conditions. You should seek medical advice from a physician before starting any new lifestyle or fitness regimen. Your use of Samsung HeartWise does not constitute medical advice. Samsung HeartWise application is available on the App Store for download, but a username and password provided by Kaiser Permanente when under the care of a physician is required.

² Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s Device eXperience (DX) Division.

³ Comparison of Home-Based vs Center-Based Cardiac Rehabilitation in Hospitalization, Medication Adherence and Risk Factor Control Among Patients With Cardiovascular Disease

⁴ This retrospective cohort study was conducted among patients in Kaiser Permanente Southern California (KPSC), an integrated health care system serving approximately 4.7 million patients, who participated in CR between April 1, 2018 and April 30, 2019, and with follow-up through April 30, 2020. Data were analyzed from January 2021 to January 2022.

Like so many great innovations, the latest UDC was a group effort — driven by Samsung’s experts and consumers’ valuable feedback. To learn more about the enhanced UDC for Galaxy Z Fold4, Samsung Newsroom spoke with the experts at Samsung Research,¹ who collaborated on the technology.

Read on to see what John Seok-Jun Lee, Head of Computational Camera Part at Samsung Research America (SRA), and Alok Shukla, Head of AI Vision Solutions Part at Samsung R&D Institute India-Bangalore (SRI-B), had to say about their collaboration behind bringing enhanced UDC technology.

Q: What is an Under Display Camera (UDC)?

Seok-Jun: An Under Display Camera (UDC) is an innovative camera solution that enables an uninterrupted viewing experience on a mobile device by hiding the camera under the display and dedicating the whole screen to users while applications are running. It not only requires hardware innovation by placing a camera under a display panel but also requires algorithm innovation for restoring image quality — one of the most complex image restoration problems.

Q: How does the UDC work?

Alok: In UDC, a front-facing camera sits underneath the display. The screen pixel density is reduced in this area, allowing the screen to display imagery unhindered — but at the same time, not block light from reaching the camera when it’s in use. As the camera is placed underneath the display, UDC can suffer from poor image quality caused by diffraction artifacts, which results in flare, saturation, blur and haze. Therefore, while the UDC brings a better display experience, it also affects camera image quality and other downstream vision tasks. These complex and diverse distortions make restoring UDC images extremely challenging.

Q: Why is the UDC an important technology when it comes to Galaxy Z Fold4? What value does it provide to customers?

Seok-Jun: Samsung’s foldables are designed to be new and different, combining smartphone and immersive viewing experiences into one mobile device via breakthrough display technology. When folded, it provides smartphone-like use, and when unfolded, the display provides a more immersive and productive experience. Our consumer research showed that Galaxy Z Fold series users prefer the Cover Screen camera for capturing photos and selfies and the immersive Main Display for more productive tasks like watching videos, playing games and working on documents. Therefore, we thought UDC technology would be the perfect fit to meet their needs for an uninterrupted screen while still being capable of tasks like opening video calls. Samsung has launched the first-ever foldable UDC solution in Galaxy Z Fold3 and enhanced its quality further in the Galaxy Z Fold4.

Alok: Galaxy Z Fold4 truly unfolds a world of immersive display. UDC technology is at the core of the pursuit of a true full-screen display. By combining the leading innovation in display technology with advanced AI techniques for image restoration, Galaxy Z Fold4 provides the perfect balance between screen quality and camera image quality.

Q: How has the camera’s image quality improved since Galaxy Z Fold3?

Alok: Samsung Galaxy Z Fold3 showcased the world’s first UDC on a foldable. After the market release of Galaxy Z Fold3, one of the key feedbacks from consumers was to make the UDC less visible. On the Galaxy Z Fold4, sub-pixel arrangement was optimized to further hide the UDC.

As mentioned previously, when the camera is placed underneath the display, this can result in poor image quality caused by diffraction artifacts, which cause flare, saturation, blur and haze.

That’s why, in Galaxy Z Fold4, we have leveraged the power of AI, backed with multi-frame processing, to develop a novel computational imaging pipeline for UDC image restoration.

SRI-B, along with Visual SW R&D Group at MX Business, focused on developing AI Image Restoration for photo capture and preview to compensate for optical diffraction in UDC. At the same time, SRA’s Mobile Processor Innovation (MPI) Lab improved the multi-frame computational photography algorithm. Galaxy Z Fold4’s UDC solves key technical challenges in image quality to bring a unique experience to end customers.

Q: Walk us through the journey of the SRA-SRI partnership project. Why did your two teams collaborate?

Seok-Jun: The SRA MPI Lab has been working with SRI-B throughout MPI’s entire history at Samsung, from 2014’s Galaxy Note4 camera commercialization all the way to 2022’s Galaxy Z Fold4 and Z Flip4. SRA MPI has been leading MX multi-frame processing (MFP) technology R&D for UDC, Night Mode, Expert RAW and other technology. SRI-B has contributed to all commercialized SRA MPI’s MFP by providing amazing camera software, image quality tuning and resources toward commercialization as well as AI camera R&D. Our 3-way collaboration with MX R&D group, SRA MPI and SRI-B has been a success — especially when the worldwide team used time zone differences effectively to complete milestones on time for such a complicated project. It’s always a pleasure to work with them and deliver Galaxy devices’ camera successes together to accomplish our mutual goal of being the world’s best smartphone camera experience.

Q: Please explain your job role and your team’s contributions to the UDC. How did you contribute to making the best possible user experience?

Alok: Samsung Galaxy Z Fold4 UDC was a complex R&D project, and SRI-B’s role was to think in terms of end-to-end for the best consumer experience. This required multi-domain expertise and deep collaboration among multiple teams. Experts from SRI-B, SRA-MPI Lab and MX Visual SW R&D Group worked seamlessly to realize an end-to-end UDC experience.

SRI-B also played a key role in utilizing a Neural Processing Unit (NPU) to execute the AI model, achieving real-time performance in previews and significantly faster capture processing time than in Samsung Galaxy Z Fold3 UDC. Camera previews, video recordings and video calling scenarios need real-time performance without losing any frames. AI-based UDC restoration accelerated with NPU for preview processing was applied for the first time in Samsung Galaxy Z Fold4. Although real-time processing was not required, as camera capture requires higher image quality than a preview, achieving better image quality with less processing time was desired for user experience.

Q: What were some challenges you faced while developing this technology, and how did you overcome them?

Seok-Jun: Low light transmittance and light diffraction are the main challenges for UDC camera technology. Still, one more challenge, which is different from a punch hole camera image pipeline, is that UDC capture quality is affected by not only the camera module but also the display panel. SRA MPI’s AI-based 3D ISP algorithm was designed with the needed flexibility to tune the output image quality with the different display characteristics. Having such flexibility in 3D ISP helped to overcome such challenges.

Alok: SRI-B’s key focus was developing an AI image restoration module for Samsung Galaxy Z Fold4 UDC. These restorations are required for photo capture mode as well as video mode. Video recording and video calling scenarios have strict requirements for real-time processing within the constraints of current consumption.

AI-based UDC restoration was applied for the first time in Samsung Galaxy Z Fold4 UDC for video. To achieve a better video quality experience than Galaxy Z Fold3, we had to make the AI model lighter while still achieving good restoration quality. Multiple experiments were conducted in network design and training to achieve good quality in real-time. SRI-B extensively utilized NPU and advanced quantization techniques to prepare a lighter, highly optimized AI model that achieves real-time performance with low current consumption.

Q: What is your vision for future UDC iterations at Samsung?

Alok: Samsung Galaxy Z Fold4’s UDC has opened up a new dimension to the smartphone camera form factor. UDCs in the future will enable placing larger camera sensors and multiple cameras at flexible positions without compromising the viewing experience. Another big challenge is towards mass adoption of UDC technology in more products as the main front camera. For this to happen, there will need to be a significant improvement in camera image quality, processing time and display experience.

Seok-Jun: Since the Galaxy Z Fold4 UDC provides a much better experience in terms of hiding the camera under the display and improving image quality, the R&D direction for the upcoming flagship devices will work towards making the UDC completely invisible. This will provide the best uninterrupted immersive mobile display experience while achieving the same image quality as a punch-hole camera.

¹ Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s Device eXperience (DX) Division.

Following the release of the HW-S800B Ultra Slim Soundbar for Samsung’s QLED TV line-up, which was unveiled earlier this year at CES, Samsung Newsroom spoke to Ema Souza Blanes at Audio Lab of Samsung Research America. She is the person behind the process for product validation and research that includes countless listening tests, all of which are conducted to deliver the best possible immersive viewing experiences with the finest sound.

▲ Ema Souza Blanes at Audio Lab of Samsung Research America

Q: Briefly tell us about yourself and your role in the Samsung Audio Lab.

I am a French audio engineer, and after graduating from the engineering school Arts et Métiers ParisTech (ENSAM) and the Paris-Saclay University, I joined the Samsung Research America’s Audio Lab in Valencia, California. My role with the Audio Lab is to run listening tests for product validation and overall research purposes.

Q: What is a new or recent trend happening in the soundbar industry?

Immersion is a topical subject in soundbar development, with the inclusion of more advanced audio technologies such as Dolby Atmos in home audio. Soundbars have also naturally followed the TV design trend with the intent of blending into the home décor with a sleek and discreet build. Though, despite these new slim designs, sound quality and immersion yet remain at the heart of soundbar development.

Q: Samsung has recently released the ultra-slim soundbar HW-S800B. What were some of the primary objectives for this model?

The design process of the HW-S800B was dedicated to combining all aspects of these recent trends into one product. We aimed to develop a soundbar that blends seamlessly with discreet screens such as The Frame, which challenged us when it came to customization and optimization due to its slim design.

▲ HW-S800B

Q:. The soundbar’s depth and height are 1.6” x 1.5”, which is a difficult size in which to include all amplifiers and multi-channel speakers. Can you describe some of the challenges you faced during the development process?

Most soundbars in the market that are designed to be slim or small typically have a weaker integration of the subwoofer to the soundbar. The result is a colored sound, especially when it comes to voices. The challenge was to avoid this effect and to ensure that voices are maintained in the center of the sound field. This required custom soundbar transducers and a design capable of low crossover frequency to the subwoofer.

Q: We noticed that the subwoofer appears different from past models. Can you elaborate on this difference?

Most subwoofers feature a port to enhance the bass response. Since the HW-S800B’s subwoofer has a smaller enclosure which limits the port size, we recognized that this would cause turbulent air motion, resulting in distortion and less bass. This constraint was addressed by designing a custom passive radiator in place of a port and a long-excursion 6.5” woofer that is able to displace as much air as a larger woofer.

Q: Similar to other premium Samsung soundbars, this model features a wireless connection between the soundbar and TV along with Dolby Atmos sound technology. Why should consumers want these capabilities?

Samsung’s 2022 soundbars come with Wireless Dolby Atmos connectivity, a wireless Smart TV-to-soundbar connection in which both the screen and soundbar speakers deliver an incredible audio experience with no distracting cables. It allows for smoother on-wall mounting setups by minimizing the number of visible cables. Nobody wants their homes cluttered or disorganized, and we are living in a time, in which more consumers are eyeing products that perfectly blend their sophisticated, personal style in and out of the home with technological innovation for a better, connected experience. I believe our soundbars exemplify this desire that we’re seeing in the consumer electronics industry.

Q: Samsung’s Q-Symphony sound technology has also significantly improved in the past year. What are some of the upgrades over the previous version?

In the 2021 TV models, Q-Symphony combined the power of the top speakers and the soundbar. The new Q-Symphony enhances the surround sound and feeling of immersion through channel separation technology. This enables the soundbar and TV speakers to work together with all the speakers on the TVs, including the top, bottom and side speakers, providing for an expansive, powerful soundscape.

Q: Is there anything else we should know about the Audio Lab and your work?

Running listening tests is crucial to ensure the quality of our products. At Samsung, we work closely with our skilled listeners in various and rigorous listening tests where they give their opinion on our products including the comparison between our previous models. The HW-S800B is no exception and showed compelling results while also competing with much larger soundbars.

▲ Samsung Research America’s Audio Lab

¹ Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s Device eXperience (DX) Division.

This year’s recipient of the Bernard J. Lechner Outstanding Contributor Award is Dr. Youngkwon Lim from Samsung Research¹ America’s Standards and Mobility Innovation Lab, marking the first time ever a Samsung Electronics employee has received the award since its inception.

▲ Dr. Youngkwon Lim, Standards and Mobility Innovation Lab at Samsung Research America

The ATSC is made up of over 103 member organizations, together whom represent the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite and semiconductor industries worldwide. The Bernard J. Lechner Outstanding Contributor Award is bestowed once a year to an individual representative of the membership whose technical and leadership contributions to ATSC have been invaluable and exemplary. The ATSC’s latest development, ATSC 3.0, is being deployed now in the U.S. and Korea, and is being adopted by Brazil and Jamaica as the next generation broadcasting standard.

SRA’s Dr. Youngkwon Lim has been actively contributing IP-based low-latency multimedia delivery technology including MPEG Media Transport, MMT, to ATSC 3.0 development, and has served as Chair of Specialist Group on Management and Protocols, S33, from its inception.

“We are grateful for Dr. Lim’s leadership in this critical piece of the ATSC 3.0 standard,” noted Madeleine Noland, President of the ATSC at the award-presenting ceremony that took place during the ATSC’s annual conference. “His experience in other standards development organizations allows him to quickly align ATSC documents with external documents for a cohesive set of standards. His valuable knowledge has helped ATSC move forward with signaling solutions, and I appreciate his expert guidance of S33.”

The recognition Dr. Youngkwon Lim has attained through receiving this award demonstrates Samsung’s continuous support for the development of next generation standards for the constant growth of the broadcast industry, as well as the company’s industry leadership.

¹ Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s Device eXperience (DX) Division.

Like so many great inventions, Expert RAW was a group effort — driven by Samsung’s experts and Galaxy users’ valuable feedback. To learn more about the Expert RAW experience, Samsung Newsroom spoke with the experts at Samsung Research² who collaborated on the app.

Read on to see what Hamid Sheikh, Head of the Intelligent Imaging Team at Samsung Research America’s (SRA) Mobile Processor Innovation (MPI) Lab, and Girish Kulkarni, Head of the Camera Solutions Group at the Samsung R&D Institute India-Bangalore (SRI-B), had to say about this innovative camera collaboration.

Q: What does the Expert RAW app do? What are the main benefits for users?

Hamid: Expert RAW really gives users the ability to take full control of their mobile photography experience much like a professional photographer would. The app captures much more comprehensive data for each image, which can be used to both improve photos and artistically enhance them with editing software like Adobe Lightroom — the go-to app for professional photographers.

To improve the overall camera experience, we worked closely with Adobe to tightly couple Expert RAW with Lightroom. The result is that photographers have full control over their creative experience. Novice photographers can also utilize automatic set points for camera controls, and then use the Samsung-specific default values in Lightroom. In both cases, the tight integration of the two apps makes for an enjoyable experience.

Girish: Expert RAW is an epic leap forward for photography. It essentially places a professional studio in your pocket. Whether you are a pro photographer or you’re just a user who wants to capture amazing content, anyone can take full advantage of the Galaxy S22’s pro-grade camera with Expert RAW. It captures high-quality, high dynamic range pictures in the multi-frame RAW format that enables precise post-capture editing and professional results.

With Expert RAW, people can capture much more information in a single picture — from dark details to bright highlights. It also drastically reduces noise and increases sharpness and detail. If you’re looking for the ultimate creative controls, you can choose your own settings for aspects like ISO, shutter speed, white balance, EV and focus, and even choose which lenses you want to use for the subject and the scene. Finally, because both JPEG and DNG files are saved when shooting, you can hop right into the Adobe Lightroom app on your smartphone or PC and edit with ease.

Q: What was the original inspiration for Expert RAW?

Hamid: Samsung camera technologies have always relied on sophisticated computational photography algorithms to produce the best picture quality. However, the standard camera app makes many decisions about how the image will be rendered in terms of color, tone, detail and noise. The user has very limited say in these decisions.

Our inspiration came from the confluence of user experience limitations and the leaps in computational and AI capabilities of today’s mobile processors. We asked ourselves, “How can we make the photography experience more inspiring for users?” So really, our inspiration came from the expert and enthusiast photography community, which yearned for an easier mobile photography experience, without sacrificing the creative control that DSLR and post-capture editing allows. Expert RAW was born out of a desire to transform that inspiration into reality.

Girish: As we heard the input of professional photographers who were mostly utilizing DSLR cameras, they wanted to achieve a pro-grade experience with smartphones. Our consumer research also showed that after using their smartphone’s auto camera for a long time, typical users were very passionate about exploring Samsung’s pro-grade camera capabilities in-depth to become better photographers.

The more we talked to professional and amateur photographers, the more we understood their needs in terms of RAW image capturing, camera controls, the post-editing experience, creative capabilities and more. That’s when we set out to create a new pro-grade experience based around RAW capturing so that every level of photographer could merge our camera controls and their creativity to enjoy professional-looking photos.

Q: What makes Expert RAW such an important release for mobile photography in general?

Hamid: The camera experience is one of the most important experiences that a user has with his or her smartphone. Samsung has been at the cutting edge of camera quality, and the gap between consumers and professional/enthusiast photographers has always been a tempting one to bridge.

I think with the release of Expert RAW, users will find that their photography experience will take a quantum leap in terms of creative control and artistic expression. I expect more and more people will find this new experience rewarding because it lets them personalize their camera based on their tastes — exactly how they want them — and not based on what some other engineers chose for them.

Girish: As an app, this platform has simplified the RAW capturing process with precise camera and lens controls and post-editing with Adobe Lightroom. It’s for every user who is willing to go beyond — to unleash the true power of an Expert RAW camera, and explore their creative side.

Q: What role did the MPI Lab play in Expert RAW’s development?

Hamid: Any time we are creating a brand-new user experience, we have to consider and overcome many tough engineering challenges. The MPI Lab developed the main idea behind Expert RAW and its technologies, and we knew it was challenge worth pursuing.

We developed a brand-new computational photography pipeline that can produce both DNG as well as processed JPEG files. Developing a complex computational photography pipeline from scratch was not easy. We no longer had the benefit of an older, mature technology base to build upon. But our team successfully developed this new, AI-based 3DISP technology to produce raw data that looks very natural when users load it in editing apps like Adobe Lightroom.

Q: What role did SRI-B play in Expert RAW’s development? What were the team’s main areas of focus?

Girish: Expert RAW was a complex R&D project, and SRI-B’s role was to think in terms of end-to-end for the best consumer experience. This required multi-domain expertise and deep collaboration among multiple teams.

SRI-B is equipped with strong multi-domain expertise teams, so we formed a task force of talented experts. They all worked together as a single team within SRI-B and also worked with a larger team of experts based in Korea and at the MPI Lab.

The multi-domain expertise and close collaboration with all key stakeholders helped SRI-B continuously focus on improving Expert RAW’s product experience, end-to-end pipeline, etc.

Q: Could you offer more details on your collaboration with one another?

Hamid: The MPI Lab has been working with SRI-B throughout our entire history at Samsung. SRI-B contributed its amazing skillset and resources towards the development of the software technologies, as well as key AI blocks for the Expert RAW pipeline. They also owned the UI piece of the Expert RAW application and provided many innovation points on the Expert RAW experience. It’s always fun working with them.

Girish: The MPI Lab has world-class expertise in computational imaging domain, and has a proven record of developing successful IPs for Samsung flagship products. That expertise was one of the key requirements for Expert RAW’s development. The MPI Lab came up with the multi-frame pipeline building blocks implementation, which helped SRI-B integrate and enhance the same for the end-to-end architecture and pipeline.

One of the major expectations for Expert RAW was that it would enable the best image quality in different lighting conditions, which requires the tuning of the multi-frame processing pipeline. MPI’s strong expertise in this area helped us continuously improve image quality before the commercial launch. In summary, MPI’s expertise in computational imaging and SRI-B’s breadth of knowledge in multiple subdomains helped SRI-B prepare Expert RAW’s end-to-end experience for commercial launch.

SRI-B and the MPI Lab used their 12-hour time zone difference effectively to plan and collaborate on Expert RAW. SRI-B’s day was MPI’s night, and vice versa. It helped to have 24/7 development to finish this complex feature in record time. We are proud of Samsung’s culture that enables respectful collaboration among different overseas R&D centers and we always enjoy working with MPI Lab.

Q: How do the MPI Lab and SRI-B plan to build on this collaboration to develop even more innovative camera technologies?

Hamid: Our journey with the new RAW camera experience is just beginning. I am excited to think about what new improvements and enhancements we can make. One of the best parts of the Expert RAW experience is that the photographer is front and center. We’ll preserve that as we actively look into the experiences of different users and continuously implement improvements to make Expert RAW even better than before.

Girish: The MPI Lab and SRI-B have been working together for the last few years developing the world’s best night mode for Samsung flagship smartphones. This collaboration helped lead us to the success story that is Expert RAW on the Galaxy S22. We’re excited to continue that momentum for the next innovative products to come.

In the future, we would like to continuously enhance Expert RAW with a focus on creating a new ecosystem for pro photography that fully utilizes pro-grade camera capabilities.

Collaborating for Creativity 

Features like Expert RAW underline Samsung’s commitment to developing tools that empower users to unleash their creativity.

Going forward, the company will continue to strengthen collaborations that leverage the knowledge and capabilities of its world-class network of R&D centers. Doing so will help unlock technologies that change the way we live, work and create.

¹ Expert RAW must be downloaded separately from the Galaxy Store, for free, before use. Expert RAW app availability is currently limited to the Galaxy S21 Ultra and S22 series. Samsung Members notified Expert RAW will become available on Galaxy Z Fold3 in April 2022 and Galaxy S20 Ultra, Galaxy Note20 Ultra and Galaxy Z Fold2 later this year.

² Samsung Electronics’ advanced R&D hub, which leads the development of future technologies for its Device eXperience division

Under the theme of ‘The Next Hyper-Connected Experience for All.’, the Samsung 6G Forum will bring together leading global experts from academia and industry in the area of next-generation communications technologies to discuss in-depth about future of the technologies that will drive significant changes across the board by 2030.

The forum will be divided into two sessions and broadcast live online via Samsung’s YouTube channel. Each session will consist of talks by the participating experts, followed by a panel discussion.

Anyone interested in the forum is encouraged to visit the event website (https://Samsung6gForum.com) to register online from April 13 to May 13. Email notifications will be sent out for event schedule updates, and registered participants may leave questions on the website prior to each session.

“We are excited to host our first forum solely dedicated to sharing knowledge and insights on the 6G technology and to spreading our vision,” said Sebastian Seung, President and Head of Samsung Research. “In addition to the Samsung AI Forum and the Samsung Security Tech Forum we hold every year as ‘Samsung Tech Forum’, this new Samsung 6G Forum will further strengthen our position within the field. We look forward to discussing related key topics with colleagues, experts, and anyone interested in the next-generation communications technology.”

Samsung Research, acting as Samsung Electronics’ advanced R&D hub, leads the development of future technologies for the company’s DX (Device eXperience) Division.

Samsung 6G Forum Schedule

Morning Session – 6G Air Interface (09:00am-12:10pm KST)

The morning session will begin with opening remarks by Sebastian Seung, President and Head of Samsung Research. In-depth expert talks, under the theme ‘6G Air Interface,’ will be delivered by Jeffrey Andrews, Professor at the University of Texas at Austin; Charlie Zhang, Senior Vice President at Samsung Research America; Takehiro Nakamura, Senior Vice President and General Manager of the 6G Laboratories at NTT DOCOMO; and John Smee, Senior Vice President of Engineering at Qualcomm Technologies, Inc. A panel discussion led by Juho Lee, Fellow at Samsung Research, will follow afterward.

Afternoon Session – Intelligent Network for 6G (1:10pm-4:20 PM KST)

The afternoon session, under the theme ‘Intelligent Network for 6G,’ will invite Tarik Taleb, Professor at University of Oulu, Finland; SeungJoo Maeng, Master at Networks Business, Samsung Electronics; Byonghyo Shim, Professor at Seoul National University; and Shi Jin, Professor at Southeast University, China to give talks on Intelligent Network for 6G. This compelling talk session will be followed by a panel discussion led by Sunghyun Choi, Executive Vice President and Head of the Advanced Communications Research Center at Samsung Research.

For more information on ‘Samsung Tech Forum,’ please visit Samsung Research website at https://research.samsung.com/events.

The five papers selected for AES’ esteemed ‘Top 10’ list this year were submitted by the Samsung Research (SR) ¹ Visual Technology Team and Samsung Research America (SRA)’s Audio Lab.

Read on to learn more about the industry-leading papers submitted by Samsung to have received the Top 10 accolade this year.

① A Study in AI for Bass Extension and Distortion Reduction in Loudspeakers (SRA)

The most downloaded paper from this Fall’s AES conference, SRA’s paper entitled ‘Application of AI Techniques for Nonlinear Control of Loudspeakers’, continues the team’s work into bass extension and distortion reduction.

The paper posits that, in order to obtain high loudness that features good bass extension, low distortion and mechanical protection, the motion of the loudspeaker’s diaphragm needs to be accurately controlled.

SRA’s study presents a novel approach to solving these issues that harnesses a neural network to directly map the loudspeaker’s diaphragm displacement to the input voltage, allowing for the loudspeaker to be ‘inverted’. This technique not only allows control and linearization of the loudspeaker without theoretical assumptions, but it is also simpler to implement.

② Developing a Method To Measure Multiple Loudspeakers Simultaneously (SRA)

SRA’s second Top 10 paper, titled ‘Deconvolution of Room Impulse Responses From Simultaneous Excitation of Loudspeakers’, presents a method that allows for the measuring of several loudspeakers in a room simultaneously that reduces the measurement time, compared with typical immersive audio systems, by a factor of ten.

Traditional room-equalization involves exciting one loudspeaker at a time and then de-convolving the loudspeaker-room response from the recording. As the number of loudspeakers and positions within a room increases, the time required to measure loudspeaker-room responses therefore also increases. Therefore, SRA’s paper presents a technique to deconvolve impulse responses after exciting all loudspeakers at the same time.

③ Optimizing the Integration of Audio Systems Into Slim TVs (SRA)

Along with the development of new space-efficient display technologies in recent years has come the trend to decrease the overall size of consumer electronics, including televisions. In order to combat the physical limitations for audio technology development brought about by these designs, SRA has produced their AES Top 10-certified paper titled ‘Transducer Design Considerations for Slim TV Applications’.

The slim TV form factor brought about by industry trends creates a challenge for the design of integrated audio systems as it severely limits the physical performance possibilities of any acoustic transducer. For the most part, modern DSP (Digital Signal Processor) and amplifier technologies have been able to utilize the transducer up to its performance limits and thus maintain audio quality. However, if further thickness reduction of the TV is desired, these technologies will no longer be enough. SRA’s paper discusses the physical limits of current designs and suggests a new layout of a moving coil-transducer for ultra-slim device applications.

④ Discovering the Best Audio Codec for HDR10+ (SRA)

As we move into the HDR10+ era, SRA has been conducting research into the preferred audio codec for HDR10+, resulting in this accolade-winning paper, ‘Bitrate Requirements for an Audio Codec for Stereo, Surround and Immersive Formats’.

The paper shows that the Opus codec would be an excellent choice as the preferred audio codec for HDR10+. The team conducted three listening tests on Opus encoded stereo, 5.1 and 7.1.4 channel content taken from music, cinematic and EBU files encoded at bitrates of 32, 48 and 64 kbps per channel. Current Opus encapsulation in Ogg does not support 7.1.4 with stereo pairing. Therefore, the paper proposes a new stereo pairing schema to accommodate 7.1.4 content in Opus with joint stereo encoding. The results of the study conducted indicate that a bit rate of 64 kbps per channel or higher is required for transparency in stereo, but 48 kbps per channel may be sufficient for 5.1 and 7.1.4 audio formats.

⑤ Developing AI-Based 3D Audio Codec for High-Immersion in OTT Service Environment (SR)

As growing trends indicate that users’ preferred media consumption platform has shifted from cinema or broadcast channels to over-the-top (OTT) services, SR’s paper, titled ‘AI 3D Immersive Audio Codec Based on Content-Adaptive Dynamic Down-Mixing and Up-Mixing Framework’, proposes new 3D immersive audio codec that can support various spatial audio formats for multiple loudspeaker layouts accessible in OTT service environments.

Unlike conventional technologies that use a fixed mixing profile regardless of content type and characteristics, SR proposes a framework that variably applies the determined mixing/de-mixing profile by dynamically performing audio scene classification and spatial energy distribution characteristics analysis based on AI technology. It was also shown through a listening evaluation that the proposed one can provide a higher immersion than the conventional method even in a home entertainment OTT service environment.

¹ Samsung Electronics’ advanced R&D hub, which leads the development of future technologies for its Device eXperience division

In this relay series, Samsung Newsroom is introducing tech experts from Samsung’s R&D centers around the globe to hear more about the work they do and the ways in which it is directly improving the lives of consumers.

The sixth and final expert in the series is Brian Harms, a Research Engineer at Samsung Research America (SRA). Following 8 years of exploration into advanced robotics research at SRA, Harms and his team now employ an innovative array of methods in order to work towards changing the way robots are made and perceived. Read on to learn more about the fascinating research Harms and his team are undertaking at SRA.

Q. Can you please briefly introduce the kind of work you undertake at Samsung Research America?

In addition to developing innovative technologies, SRA is conducting research into various fields including AI, 5G/6G communication, Digital Health, AR and Robotics for Samsung’s future innovation.

When I joined SRA, I was drawn to one in particular of my team’s key areas of focus, which was imagining how robots will affect the future of our homes and everyday lives. A lot of my work at SRA focuses on prototyping experiences as rapidly as possible so that we can make decisions about how certain devices or products should or shouldn’t work.

Our projects usually start very organically, and individuals are encouraged to pursue their ideas and then bring them to the team for feedback and creative input. Thanks to our strong relationships with different divisions within Samsung, our team is empowered to think about a really wide variety of ways we can improve people’s lives, and that freedom and support is a really cool aspect of what we do in the Think Tank Team at SRA.

Q. Following the recent accolades you have received for your work in advanced robotics, what are you and your team working on at the moment?

At any one time we may have approximately 10 to 20 projects that are happening simultaneously, but that operate on different time scales and with different resources. In past years our team’s goal was to have the majority of those projects aim to be ‘productizable’ within 3 to 5 years if successful, but in more recent years we have shifted our goal towards 1 to 3 years, as we are striving to make a strong impact on the user-facing market as quickly as possible.

In order to achieve this, we are working on several projects within the umbrella of practical robotics whose scopes are mindfully constrained so that we can work with different teams to transform these prototypes into products. Our goal is to find a balance where we provide a great deal of user value while still constraining the problem space within realistic bounds. We also pride ourselves in being optimistic about finding room for innovation, even in products that have largely remained the same over many years.

Our team is also currently working on many projects that are outside the realm of robotics, including new apps, phone features, connectivity devices and improved appliances with the goal of empowering users and keeping them connected.

Q. Practical robotics is a field that provides innovative and convenient user experiences and is primed to change the way we think about robots. Can you elaborate on this further?

I think that it is important for people to rethink what they consider to be “robots” because the way they are defined tends to vary greatly. Many common definitions might clash with each other or reject some actual robotic devices from the category. Personally, I lean towards an extremely inclusive definition along the lines of: if a machine actuates automatically in response to stimuli, you might as well call it a robot.

The reason I think it is important for people to take a moment to consider what robots really are is that so-called “practical robots” are all around us and affect us every day of our lives in impactful ways. Consider a mattress with sensors that measure sleep quality or temperature, adjust the mattress’ position with actuators and cool the user by pumping fluid through a network of tubes. I think by almost any definition of robot, this is a robot – but perhaps the owner of such a mattress might not actively consider it one.

From automatic doors at grocery stores to cars that measure their distance to other cars and adjust speed accordingly and even to coffee makers that brew a fresh pot of coffee for you in the morning through sensor detection – these are all robots, and if you were to accept this idea of what a robot is, you’ll start seeing them much more frequently in your day-to-day life.

Q. What do you see as the main user benefits brought about by the implementation of novel robot capabilities into consumer-facing technological devices?

The main user benefit brought by the inclusion of robotic technologies in a device will of course vary by device and the problem it solves for the user, but if I had to generalize, I think that the benefits boil down to making an activity or experience faster, easier, safer or more rewarding. Automation is a powerful mechanism in affecting these four criteria, whether it is in an industrial manufacturing plant or someone’s living room.

Q. Your team is made up of a unique range of researchers from a diverse range of backgrounds. Can you give an example of a time when this ability to ideate in an interdisciplinary manner resulted in the development of an innovative new robotics approach or technology?

Occasionally we hold brainstorming sessions where 1 or 2 people have an idea they want to turn into a project. Those people come up with a series of questions or prompts for the participants, and then every person in the room takes a stack of sticky notes and fills as many as they can with ideas and sketches for the new project and puts them all up on the wall. The cool thing about this is that when the prompts are about potential industrial design ideas, for example, we have not only industrial designers, but also programmers, scientists, electrical engineers and more, all responding to the same prompts in different ways.

Through this kind of multidisciplinary collaboration, designers on our team benefit from developing an improved understanding of what is technically possible, and engineers get a better understanding of what constraints good design might add to the project. What this results in is a team made up of designers who speak the language of engineering, and engineers that can speak the language of design. This kind of collaboration was critical for a project like Samsung Bot Chef, where both the aesthetic and engineering elements were highly dependent on one another.

Q. What would you designate as the latest trends in robotics technology right now? How are you incorporating them into your research at SRA?

Automation and robotics are evergreen fields that are growing exponentially at the moment. The main way we approach projects is to first identify a need or possible method of improving some aspect of daily life, and then consider the mechanisms for executing the idea. Fortunately, automation and robotics are effective tools that lend themselves well to addressing and solving some of these problems.

Our future product concept Samsung Bot Chef was one result of us monitoring the latest trends. Our then-team head noticed that there was a huge gap between the kinds of low-cost, low-performance robot arms you might see on crowdfunding platforms and the high-cost, high-performance of industrial robot arms, and had a strong intuition that there was opportunity in the consumer market for a robot offering in between the two. The goal there was to minimize end user cost while maximizing performance and capability, which took us down a long road towards designing our own servo mechanisms from scratch. What we created is one of the best-looking robot arms that I’ve seen on or off the market, that is tailor made for interacting with the same everyday objects that we use at home.

Q. When you envisage a future powered by innovative robotics technologies, what does it look like?

When I picture the future, I try to imagine “what might a typical day look like for me.” I would hope that, in the future, robotics and automation provide opportunities for me to preserve more time for myself to do the activities that I love. Between maintaining relationships, work, hobbies, errands, finding time to rest and unexpected events in life, I constantly feel that I lack the time or energy to engage with each of these activities in balance. I believe that automation might be one mechanism that will help me preserve more of my time so that I can spend it in ways that I choose in order to feel more fulfilled.

Q. What has been your most important achievement at SRA so far, or the one that you are most proud of?

I was really proud of our team achieving our Samsung Bot Chef demonstration in Berlin, Germany at IFA 2019. It truly took a monumental amount of effort for us to design, manufacture and assemble completely new versions of Samsung Bot Chef from the ground up, by hand. We also had to plan a complex demo, program all of the interactions, and test everything repeatedly, not to mention transport our demo robots to Germany, work around the construction of the demo kitchen and collaborate with the host chefs. It was a really challenging but rewarding experience that not only brought our team closer together, but also reminded us that when we are united in pursuit of a single goal we can achieve amazing things.

In this series, Samsung Newsroom has introduced six tech leaders from Samsung R&D Institutes around the world who are actively involved in advanced technology development. Through the consolidation of the research and development capabilities of experts in Samsung’s R&D institutes, just a few of whom have been showcased in this series, Samsung is able to bring next-level technologies and experiences to users in their devices. Samsung Research currently sees collaboration between the experts in its 14 R&D institutes in 12 different countries around the world.

In the future, collaboration will be a key factor towards advancing research into advanced technology. Samsung will continue to work towards a better future powered by innovation, inspired by daily routines and designed for users.

The paper is derived from the Digital Health Lab’s Lung Health project, where the team is developing innovative technologies to help patients with chronic respiratory diseases such as Chronic Obstructive Pulmonary Disease (COPD) or Asthma. The paper particularly focuses on algorithms that allow users to evaluate their lung function on their own without clinical supervision, simply by recording breathing sounds on their smartphones.

“Winning the Best Paper Award at such a competitive venue as the IEEE PerCom testifies to the recognition of our research from leading experts in pervasive computing. I feel fortunate to work in a lung health project that has potential to have an impact on respiratory patients, to support the control over their illness and improve the quality of life,” said Mahbubur Rahman, the first author of the paper who is working as Research Engineer in Digital Health Lab.

Acknowledging the Best Paper Award, PerCom 2020 General Chair and the University of Texas at Austin Professor Christine Julien shared an encouraging note emphasizing the potential impact of the Digital Health Lab’s work on real-world patients. She commented, “Having much more accessible tools for treating this [respiratory] disease would be so incredible. I love that there is this real-world impact of what you’re working on.”

The Digital Health Lab at SRA is partnering with world-leading physicians and advanced health research institutions to develop novel algorithms to make the health monitoring tools accessible anywhere, anytime through smartphones and smartwatches. The Digital Health Lab’s papers have also previously received the Best Poster Award at the IEEE Body Sensor Network (BSN) 2019 conference.

Allan Devantier, Audio Lab Head, Samsung Research America

Devantier started working for Samsung in October of 2013. By January of 2014, Samsung had acquired lab space and recruited four staff members, and by October of that year the staff had grown to number 10 engineers and research scientists and the Audio Lab had been made fully functional. From there, the lab was ready to begin working towards its mandate of ‘taking Samsung’s audio technology to the top of the industry.’

Devantier says that “The first product we worked on was the Radiant 360 loudspeaker – it was actually the first mass-market speaker to feature 360-degree sound. We were the industry leader, and now 360-degree speakers have grown very popular in the market.”

Evolutionary Change

Cut to the present, when Samsung’s LA Audio Lab is staffed by more than 20 people with over 300 collective years of experience in the audio field between them. Eleven members of the team hold Master’s or Ph.D. degrees in audio technology, while eight are both engineers and musicians who continue to play in bands. The lab also collaborates extensively with Samsung’s audio engineering teams in Korea.

“Our focus starts at the ear of the listener,” Devantier explains, “then expands out to the listening environment – the transducers (woofers and tweeters), amplifiers, and digital signal processors (DSPs).” And this emphasis has led to a steady stream of important contributions coming out of the lab. Whereas, in 2014, industry publications awarded Samsung’s Soundbar solutions a rating of three-and-a-half stars out of five, by 2019 the average score for Samsung Soundbars had been lifted to four-and-a-half stars. What’s more, in 2019 the HW-Q90R premium Soundbar model received a perfect five-star rating from a number of industry publications. In addition to improvements in the pure audio sphere, the Samsung Audio Lab has contributed to remarkable advancements in TV sound quality as well.

The Samsung Audio Lab has proven its ability to discern changes in the audio market and act upon them swiftly, as is demonstrated by the nature of its recent innovations. The Q-Symphony solution announced at this year’s CES enables a TV equipped with a Soundbar to provide surround sound that closely reproduces the spatial feeling of original sound fields. Devantier explains that Q-Symphony “uses the top-firing speakers in the TV to improve envelopment and immersion.”

Another example of this cutting-edge innovation is Samsung’s OTS (Object Tracking Sound) technology. To improve upon Soundbar technology that allows sound to be delivered in fixed directions, the lab developed TVs that incorporate speakers not just on the bottom and sides of the screen, but in the top left and right sections as well. This allows OTS technology to make use of deep learning that can recognize what kind of content is being displayed on the screen and deliver multichannel sound accordingly. Thus, users can enjoy actual, physical surround sound that is not only immersive but is specifically tailored to whatever they are watching at the time.

What’s more, in 2020 Samsung’s Q-Symphony and OTS technologies are coming together to truly maximize the potential of both solutions. While OTS delivers multichannel surround sound through the TV speakers, Q-Symphony makes the TV-speaker-Soundbar combination possible, enabling the TV’s speakers to provide rich, lively surround sound while the Soundbar delivers powerful, absorbing bass.

Taking Audio into the Future

The inception of AI is set to reshape the audio industry, and Samsung is working to anticipate the changes it will bring about. Asked to outline what he sees as AI’s role in the audio industry, Devantier says, “I think we can use AI to help our loudspeakers play louder, with more perceived bass and less perceived distortion. AI will also help make old recordings sound better and allow our loudspeakers to adapt to different listening environments.”

Another way in which AI is empowering future solutions is by enabling features like Active Voice Amplifier (AVA). Samsung’s AVA feature makes it possible for the TV to recognize the audiovisual space environment and provide sound that is optimized not only for the content being displayed on the screen, but also for the viewing space that the consumer is in. In 2020, sensors embedded in QLED solutions will make optimized viewing possible, even in rooms with high levels of noise. For instance, if a user is watching something and a member of their family switches a blender on in the adjoining kitchen, the system will adjust to ensure that the dialogue remains audible to the viewer in real-time despite the unexpected peripheral noise.

As far as how his lab will contribute to delivering better audio going forward, Devantier reports that it will continue to meet the needs of customers who are looking for “high quality and portable sound” while improving and expanding its OTS technology. “Maybe one day we will develop a loudspeaker that sounds great, plays very loud and is nearly invisible or exceptionally small and portable,” Devantier concludes, “Until that time, we will continue to produce solutions that make incremental improvements to sound quality.

Samsung Audio Lab

Located in Toronto’s downtown core at MaRS Discovery District, the new Samsung AI Centre will contribute to building the connected future by accelerating the adoption of intelligence on multiple devices ranging from household appliances to cars. The Toronto AI Centre is a part of a network of research Centres dedicated to research and development in the field of AI. The Centre is the second Samsung AI Centre to be established in North America, with the other in Mountain View, California. The North America AI Centres are led by senior vice president, Dr. Larry Heck, a renowned expert in machine learning for spoken and text language processing, who also co-leads the expansion of Samsung’s AI Centres around the globe.

“Toronto and the GTA are epi-centres of machine learning and one of the world’s foremost hubs for AI research and development. Home to not only world-class talent, but also some of the most innovative start-ups in the artificial intelligence field,” said Dr. Larry Heck, Co-Head of Global Artificial Intelligence Research. “We are looking forward to contributing to this vibrant AI community and to help push the field forward as we move towards our goal of making all Samsung connected devices intelligent by 2020.”

With a rich history in innovation and discovery, Toronto serves as an ideal place for research and development for speech recognition, where machine-learning technology was applied many years before it was widely applied to other fields. The vision is that the Samsung AI Centre will now serve an important role in the advancement of AI with a focus on language understanding and computer vision technologies that will ultimately reduce the friction between the user and the device/service, whether it be mobile phones, TVs, appliances, or cars.

The Toronto centre will be led by Dr. Sven Dickinson, newly appointed as the head of the Toronto lab, professor on leave and past chair of the Department of Computer Science at the University of Toronto. Dr. Dickinson is an expert in computer vision technologies, especially in the field of object recognition. He will play an integral part in Samsung’s research of core AI technologies that entail language, vision and other multi-modal interactions.

Hyun-suk Kim, President and Head of Samsung Research (front row, third from left), and Dr. Sven Dickinson, Head of Samsung’s new, Toronto-based AI Centre (front row, far right), pose for a photo with guests at the facility’s opening ceremony on May 24.

Samsung will officially celebrate today’s announcement of the Toronto AI Centre with an opening ceremony and presentations at MaRS Discovery District from key Samsung business leaders and special guests including Samsung’s CEO of Consumer Electronics,  Hyun-suk Kim, the Honourable.

François-Philippe Champagne, Minister of International Trade, Dr. Larry Heck, Senior Vice President of Samsung Research America, and key stakeholders and partners from major universities in Canada.

“Canadian ingenuity and innovation are getting noticed and together with our investments in skills and superclusters focused on next generation products like artificial intelligence, the world’s investors are choosing Canada. Congratulations to Toronto and to Samsung for recognizing Canada is the place to be!” said Honourable François-Philippe Champagne, Minister of International Trade.

Key contributing factors for the location selection include the availability of key AI talent, including leading AI researchers at the University of Toronto and the University of Waterloo who have had longstanding relationships with Samsung. Establishing an AI Centre in Southern Ontario also enables Samsung to better collaborate with regional start-ups and expand the current ecosystem. As one of the world’s largest urban innovation hubs, MaRS Discovery district supports promising innovators and ventures tackling key challenges in the sectors of cleantech, finance & commerce, and work & learning. In addition, and importantly, the vast MaRS community fosters cross-disciplinary collaboration which drives breakthrough discoveries and a new solution for global audiences.

“We are proud to welcome Samsung to MaRS,” said Yung Wu, CEO, MaRS Discovery District. “We both recognize the important role Toronto – and Canada – play as a destination for innovation talent, research, and start-ups. We look forward to collaborating and connecting with the Samsung team on a variety of exciting opportunities as this project comes to life.”

Today’s announcement compliments earlier 2018 news of plans to launch additional AI centres in North America. Dr. Darin Graham will spearhead the opening of new labs in Canada as the head of Samsung’s Canadian AI Operations. Until recently, Dr. Graham helped lead the creation and formation of the Vector Institute – the renowned Canadian AI research institute, as a member of the founding team. The opening of AI centres in Canada will allow Samsung to expand its outpost for industry collaboration and talent recruitment in the major AI hubs in North America.

“Investments like this are proof that Canada is truly a world-leader in artificial intelligence. Our talent and innovation ecosystem make us an attractive place for companies to grow and create well-paying jobs for Canadians. Our government is proud to partner with companies like Samsung, as we continue advancing our machine learning knowledge and further establish our place on the world stage as an AI leader,” said the Honourable Navdeep Bains, Minister of Innovation, Science and Economic Development.

To date, Samsung has had great success in leveraging Canada’s unique R&D talents for global impact. The Company’s Vancouver-based R&D centre has contributed to a number of in-market innovations and more than doubled its workforce, since opening with over 100 employees. With the addition of the AI centre in Toronto, the company plans to increase the R&D in Canada from current 100 to 200 in the near future. Additional developments and talent in Canada have been recognized through Samsung Electronics Canada subsidiaries, AdGear Technologies Inc. in Montreal and SigMast Communications Inc. in Halifax, Nova Scotia.

This is the fourth time an employee of Samsung received the prestigious award. On this occasion, it was presented to Aris Papasakellariou, a Senior Director of Standards at Samsung Research America, in recognition of his contributions in the field of radio access technology for 5G.

Each year, the award is presented to four individuals who have made outstanding technical contributions to the development of next generation mobile broadband standards in 3GPP. An estimated 1,500 researchers are participating in the 3GPP working group.

“Beyond an individual recognition, this is a validation of the proactive participation taken by Samsung in bringing about future network standards,” said Aris Papasakellariou. “Samsung’s team of engineers will continue its contribution to mobile broadband standardizations and help provide the platform for 3GPP NR (New Radio) and 5G connectivity.”

Samsung has made big strides to making 5G a reality, unveiling the world’s first 5G Fixed Wireless Access (FWA) commercial solutions at MWC 2018 while announcing its collaboration with global network providers. Samsung was selected to supply Verizon with commercial 5G FWA network solutions. The two companies will begin by launching commercial 5G services in Sacramento, California in the second half of 2018. Samsung is collaborating with Charter Communications on 5G trials in the U.S. while Sprint announced that it would deploy Samsung’s 5G solutions to increase Gigabit speeds and capacity.

“AI and machine learning are major strategic imperatives for Samsung. There’s no doubt that, in the coming years, these technologies will completely change the way people interact with every device in their lives, from phones and wearables to home appliances and cars,” said Young Sohn, President and Chief Strategy Officer at Samsung Electronics, and Chairman of the Board at HARMAN. “For this to happen, we believe AI must be open—so we can harness the talent and expertise of a vast ecosystem of companies, and ultimately give consumers smarter, simpler, more meaningful interactions with the devices they love. This Summit underscores our commitment to an open, collaborative AI ecosystem, and serves as a call to action for all researchers and entrepreneurs who share our vision for a more connected world.”

Samsung’s AI Summit opened with a keynote by the company’s Senior Vice President of AI Research, Dr. Larry Heck, a world-renowned leader in AI and voice recognition who has led AI teams at Microsoft, Google and Nuance. During his talk, Dr. Heck outlined the need for increased industry collaboration to drive broader adoption and consumer confidence in AI technology. He also advocated for the importance of making AI open to 3^rd parties.

“This is an incredible time in our industry. Artificial Intelligence and machine learning are becoming mainstream, used by millions each year. Yet, we need more collaboration in the industry—from companies to academics and researchers—to let AI flourish,” said Dr. Heck. “It’s time for us to find new ways to work together to ensure AI serves the needs of people first and foremost.” As a part of this collaborative effort, Samsung plans to host many more AI-related events around the globe this year.

Dr. Heck also shared Samsung’s plans to tap its massive device ecosystem to learn user preferences and needs. “Under a common architecture, Samsung’s AI platform will not only scale quickly, but will also provide the deepest understanding of usage context and behaviors, making AI more relevant and useful,” he said. Attendees at the event also heard from experts at Google, MIT, Carnegie Mellon and the University of California at Berkeley.

In November 2017, Samsung announced the creation of a new AI Research Center dedicated to applied research and development in the space. Samsung’s new AI research center plans to open additional AI research labs in Canada, the UK and Russia in 2018 to strengthen the company’s AI research efforts.

Dr. Larry Heck (pictured second from the left), Senior Vice President of AI Research at SRA, Dick Lyon (pictured second from the right), a Director at Google Research, and Ian Lane (pictured on the far right), a Assistant Professor at Carnegie Mellon University, discuss open collaboration in the AI industry at the Artificial Intelligence (AI) Summit on January 16, hosted by Samsung Research America at Mountain View.

Nestled among more than 20,000 various types of vegetation across 8.5 acres, the new state-of-the-art research and development center is home to many of the top thought leaders in Silicon Valley. With more than 250 doctorate recipients from some of the best schools around the globe, the campus is a hotbed for creativity and innovation. Collaborating with respected universities such as Stanford, MIT and the University of California, Berkeley, boosts SRA’s recruitment efforts by enabling them to scout fresh prospects before they graduate.

This may make the new campus sound somewhat stuffy in terms of atmosphere, but this is far from accurate. The laid-back California vibe can typically be experienced throughout the entire campus. On any given day, it’s possible to see employees engaged in a friendly game of soccer on the Great Lawn, dogs roaming around the offices or colleagues enjoying lunch on the veranda just outside the cafeteria. These aspects of life on the Mountain View campus show why SRA is a leader in providing a collaborative work environment.

The campus also features a number of environmentally friendly touches. There are 48 electric vehicle charging stations on the campus—more than any other Samsung campus in the United States—which are in use close to 100 percent of normal business hours. Employees are also offered composting options, which helps SRA in its efforts to minimize its impact on the environment.

But to fully understand the role the new campus plays in SRA’s tale, one must understand research – the element that lies at the core of everything the campus strives to accomplish. The Mountain View campus serves as the SRA headquarters, but houses many employees from other Samsung groups such as Samsung Electronics America and the Global Innovation Center. The primary focus areas of employees here are software and design, but the group spans more than 15 research labs—each with different missions—from Silicon Valley to Dallas. The great successes of these labs benefit Samsung’s vast portfolio of mobile, visual display, home appliance, wearable and audio and stereo products.

All of this innovation begins at the new Mountain View campus—where advanced research is the key to the next generation of discovery.