One of the most exciting things about the times we live in is the fact that we stand on the precipice of several major technological shifts. What’s more, the individual innovations that make up these seismic changes are not happening independently, but rather are interweaving to inform and empower one another. As we stand here at the edge, no two innovations are enlivening and empowering the tech industry more than those of AI and 5G.

While AI is making technology smarter across the board, 5G is ensuring that connection speeds are fast enough to allow platforms to interface in real-time. So how exactly do AI and 5G work hand-in-hand to make each other, and the entire tech industry, stronger? Dr. Gregory Dudek, Head of the Samsung AI Center in Montreal, extrapolates on the interplay between the two innovations, and how they stand to change things for consumers.

AI for 5G and Beyond

The Montreal AI Center’s primary area of focus is ‘AI-for-5G’, as Dudek explains. “Bringing the strength of AI to bear in order to make use of the full potential of 5G is the key focus of our research in Montreal,” he relates, “The area is a natural fit for our center, since Montreal is one of the world’s hotbeds for AI research, as well as having a telecommunications research community that has a decades-long history.”

Dudek relates that 5G (and beyond 5G) telecommunications systems are very flexible, and can outperform older systems such as 4G, but that extensive configuration is required to take full advantage of them. “In order to exploit 5G networks’ full potential, and make them applicable for a wide range of users, devices and needs, extensive automated reconfigurability is required,” Dudek says, “And that is where AI comes into the picture.”

The impact that AI stands to have on almost every aspect of our lives, and on our technologies as a whole, is immense – there are few areas of the industry that aren’t expected to be revamped by the introduction of artificial intelligence. “Telecommunication systems have been getting steadily more complex since they were first developed,” Dudek says, “In almost all areas of digital communication, complex optimization problems arise and are solved by increasingly sophisticated solutions that I would often call AI.” According to Dudek, the main thing that AI allows devices to do is “adapt to changing conditions”, and this can lead to those devices being optimized in ways that have rarely been seen before. He says that 5G’s “richer protocols and abundance of cells” provide an opportunity to enhance performance with learning-based AI algorithms, and claims that using AI for 5G is likely to prove “more of a fundamental requirement for state-of-the-art performance than just an opportunity.”

5G Underpins the Future

Just as AI can be used to optimize 5G networks, the enhanced performance characteristics of 5G will be important for many key applications of AI in our daily lives.

Dudek outlines that 5G will be an essential component in many of the key applications of AI. Among those applications, Dudek highlights the automotive, edge computing, robotics and medicine sectors, among others.

“One of the clearest needs is in the domain of autonomous cars and delivery vehicles,” he expands, “Efficient coordination of automotive vehicles will depend on the reduced latency that 5G networks offer.”

Dudek also touches on the area of ‘edge computing’, which is additionally set to empower and be empowered by the introduction of 5G. Edge computing means computing that is done very close to data sources, so that relays back and forth from the cloud are minimized. 5G will accelerate communication speeds between ‘the edge’ and the public cloud, while edge computing, in turn, will improve cybersecurity on 5G networks, reduce the burden on the public cloud and lead to savings on storage and processing costs. Eventually, edge computing is expected to prove helpful in realizing AI’s potential because it will allow computation to be distributed across more devices. 5G is also expected to contribute in this area by accommodating a potentially very large number of edge clients and allowing them to do real-time processing with low latency.

Dudek says that robotics will be another important application of 5G, pointing out that areas such as robotic vision, reasoning and action will all depend on the high-quality connectivity it provides. “Many of the most exciting applications of robotics will combine edge computing, sensing, big data in the cloud and interactions between multiple devices,” Dudek reports, “The combination of bandwidth and low-latency will be critical for things like robotic telemedicine solutions as well.”

Touching on other sectors that 5G connectivity is set to empower, Dudek highlights those of medicine (telemedicine, smart diagnostic capabilities and therapeutic technologies), leisure (multiple streams and viewpoints for sports events and rich, multi-person VR), public transportation and factory automation. “In fact,” Dudek concludes, “if we see 5G and AI as a combined package, then there are very few areas of human activity where there will not be some impact.”

Samsung’s Position

The versatility and power of 5G networks will allow for new kinds of connectivity and the emergence of an all-new family of devices. And, as the dual rise of AI and 5G expands capabilities, the degree to which companies and individuals will be able to take advantage of the resulting solutions will depend on their access. That is why Samsung’s position is such a promising one.

“Samsung has successfully exploited successive waves of the most modern and rapidly-changing technologies,” Dudek imparts, “When it comes to these upcoming innovations – not just AI and 5G, but edge computing, multi-device interactions, machine learning, robotics and personalized devices, – a fluid combination of hardware and software will be crucial. The company’s extensive experience in creating individual devices that can talk to one another and have overlapping functions means that Samsung is in an exceptional position to lead this family of emerging technologies.”

Touching on other areas that are expected to change things for consumers, Dudek says that he also expects Samsung to be instrumental in the sphere of robotics, as well as when it comes to innovations regarding original technologies such as AI and 5G. “It cannot be overlooked that robotics is expected to have a huge influence on our lives,” Dudek says, “And, as robotics is a synthesis of AI and mechatronics, this area is very well-matched to Samsung’s strengths as well.”

What AI and 5G Will Bring to Consumers

For most of us, our devices have already become crucial to going through our daily routines, but the dual inception of 5G and AI is set to make our devices even more complementary to our day to day lives.

“In the near term, AI will make our home lives healthier, safer and more fun,” Dudek says, “But AI also has the potential to help people communicate more easily across linguistic and geographic boundaries.”

“A world where 5G-dependent smart devices become woven into our lives is much closer than most people expect,” Dudek continues, “I expect this embedded, interconnected intelligence to start playing a role in our lives in the near future.”

When one considers the entirety of the picture that Dudek paints, it is hard not to start seeing AI and 5G as more of a necessity than a luxury. Asked how he envisions the combined inception of 5G and AI will change our lives, he says “One of my goals as a researcher is to have a positive impact on the world, and to play a role in bringing important new technologies to life.” He also says that he expects the introduction of 5G and AI to progressively take away more and more of the mundane tasks that people deal with day-to-day. “People will expect much more from the objects around them,” he says, “and this will allow them to focus more on the aspects of their lives that they find more rewarding.”

There is much anticipation these days around the field of robotics with its immense potential and promising future applications. However, a large gap exists between public expectations and what is actually deemed technically feasible by scientists and engineers today. Fortunately, Samsung’s New York AI Center is buoyed by the presence of a team of highly skilled researchers, led by robotics and AI expert Dr. Daniel D. Lee, who are working to close this gap. Samsung Newsroom spoke with Dr. Lee about the work being done at the center, as well as the facility’s ability to foster collaboration in a range of areas and attract top talent.

Challenges to Overcome

Asked about his center’s mandate, Lee explains that the New York AI Center focuses on “fundamental research at the intersection of AI, robotics and neuroscience.” The center’s objective is to “solve challenging problems” at this intersection, and one good example is the problem of robotic manipulation¹.

Put simply, robots need to become far more skillful before they are ready to help humans with physical tasks in their daily lives. The first step involves endowing robots with the intelligence to perceive and understand their surroundings. Next, they must be able to make swift decisions in unpredictable situations. Finally, robots should be dexterous and nimble enough to perform the appropriate actions. However, it is impossible for robot designers to anticipate every contingency robots will encounter in real world environments. Thus, robots need to be able to learn from experience just as humans do.

At this time, most common machine learning methods are not suitable for teaching robots since enormous amounts of training data are required. Lee explained that there are several challenges that need to be addressed regarding machine learning for robotics.

“Dealing with the physical world is much more difficult for AI than playing video games or Go,” he explains, “We are currently developing AI learning methods that can deal with the uncertainty and diversity of the physical world so that robots become more prevalent in homes and workplaces. I would compare the state of robots today to computers in the 1980’s during the transformation from mainframes to personal computers.”

The New York AI Center is addressing such challenges to provide a richer AI and robotics experience. For instance, the center has recently developed novel AI methods that are able to efficiently teach robots using limited data. One recently-developed method trains a neural network to generate motion trajectories for a robot arm directly from camera images.

Getting a Handle on Robotic Manipulation

In order to allow robots to handle things for people, robots need to learn how to touch, grasp, and move a variety of everyday objects. Lee explains how the problem of dexterous robotic manipulation is an area of focus for the New York AI Center.

Lee comments that “the ability of humans and some animals to manipulate household objects is currently unmatched by machines. That’s why we are investigating how AI-based solutions can be applied to make breakthroughs in this area.” Extrapolating further, Lee explains that ‘dexterous’ robotic manipulation “requires the ability to precisely and robustly handle objects exhibiting uncertain material properties.”

“Manipulation is relatively easy if the objects and environments are carefully controlled, such as on a factory floor,” Lee reports, “But it becomes much more difficult in unknown, cluttered environments when faced with a diverse array of objects.”

By way of an example, Lee lays out the capabilities that would be required for a robot to serve a chilled glass of wine in a restaurant. “How heavy is the glass, and how slippery is it due to condensation?” He adds, “It’s impossible to completely model all the possible physical characteristics of the glass of wine, so machine learning is critical in training robots to handle the difficult situations.”

Collaborative Innovation

As the AI sector has grown more sophisticated, it has become increasingly clear that collaborative solutions are critical for researchers to overcome the challenges they face. In an area as complex and multi-faceted as robotic manipulation, contributions from and collaborations with “the world’s best and brightest” will be instrumental, comments Lee. He highlights the value of working with both other Samsung AI Centers and academic institutions, saying that, “solving fundamental problems in AI to positively impact society requires drawing upon the ability and skills of numerous experts globally.”

He added, “The Samsung AI Centers invite collaborations with researchers who can help address these difficult challenges. We currently have a number of faculty from leading academic institutions who are collaborating with us in New York.”

Attracting Talent

Lee highlights just how beneficial being located in New York has been for his team, saying that “certainly, New York City is one of the greatest and most diverse cities in the world. It is a magnet for world-class research and engineering talent.”

Attracting the very best in talent is extremely important to remain on the bleeding edge of future AI advancements, and Lee reports that the center has been fortunate in this area, saying, “We have benefited from being able to attract and recruit some outstanding researchers since we started the Center.”

“Our team is composed of expert scientists and engineers who are creating innovative theories and algorithms and state-of-the-art technological developments,” Lee adds, “It’s been great working with them to publish in leading academic conferences and journals as well.”

How Robotics Could Revolutionize Our Lives

Speaking about how he envisions robots will fit into society in the future, Lee points out that, in their infancy, some robots drew attention because they were cute and fun, but that people tended to use them less as the novelty wore off. In order for people to see robots as valuable and relevant, new systems need to have enough intelligence that they become indispensable in our daily lives.

“Intelligent robotic systems have the potential to completely revolutionize how people go about their activities in the future,” Lee extrapolates, “In the near term, we will see modest improvements on simple tasks in constrained environments. But more complete systems that can handle a variety of chores and complex tasks will require further research breakthroughs. The Samsung AI Centers are helping to generate those new advances.”

Asked to outline what he sees as the ultimate vision for AI and robotic intelligence, Lee says, “I grew up reading and watching science fiction stories that envisaged amazing robots helping humans. It would be incredible to see some of those positive visions actually come to life.”

¹ The ability for robots to interact with and move physical objects in a range of environments.

As technology has evolved, it has changed our lives dramatically. It’s truly startling to think just how different life was before the invention of innovations like smartphones, the internet and PCs.

Recently, AI has emerged as a hot topic in this regard based on its potential impact both on technology and on society. Especially with on-device AI¹, AI will be embedded in devices that we use in everyday lives without necessarily connecting to processors in the cloud. To learn more about this exciting subject, Samsung Newsroom met with the head of the Samsung AI Center Cambridge, Dr. Andrew Blake.

Dr. Blake was formerly the Director of both the Alan Turing Institute (which he also helped found) and, before that, Microsoft’s Cambridge Research Laboratory. As a pioneer in the development of the theory and algorithms that make it possible for computers to behave as seeing machines, he explained how Samsung’s AI and hardware innovations will enrich people’s lives in fundamental ways.

Taking IoT to the Next Level

“AI is what is going to breathe life into IoT,” begins Blake.

On-device AI realizes AI functions by processing AI algorithms on the device itself, without necessarily connecting to the cloud, and that is advantageous for privacy and personal information protection, as well as for security.

Unlocking AI-powered smart devices’ true potential will require a combination of two factors: seamlessly connected hardware and an approach to AI that is human-centric above all else.

“One key area is health and fitness – for example, linking exercise, food and mental wellbeing. Another is communication and memories – especially via photography and video. For that, we have to move past the academic world of prototypes working on high-powered computer systems, and get AI working in a leaner fashion – on the everyday devices that people are using.”

The Right Tools

As Blake notes, Samsung’s wide-ranging device portfolio makes it uniquely qualified to deliver this human-centric future for AI.

“This is a great time to be adding new dimensions to Samsung’s AI capabilities, given the company’s leading market position in devices of all sorts,” says Blake. “On-device AI begins with hardware, and this is why working for Samsung is such a fabulous opportunity for AI researchers.”

“Hardware is the channel that moves us beyond simply smart algorithms, to put those algorithms in everyone’s pockets and homes. The big challenge that Cambridge is addressing is moving high-quality embedded AI beyond specialists’ research labs, where people with PhDs in machine learning and in systems work for several months to implement a new embedded system. We envisage a world where advanced tools enable the world’s software developers to move their AI models, simply and effectively, onto Samsung devices, and we are working hard on those tools.”

As Blake explains, on-device AI, in which AI algorithms are processed on a device itself, rather than sent to the cloud, offers significant advantages here by providing a safe and reliable means to protect users’ privacy and data. “We also need to do that in a way that holds the data close, to reassure people that their data is being held safely and privately”, he added.

A Multi-Disciplinary Approach

When it comes to AI, what exactly does the Cambridge AI center want to bring to consumers? The answer to that question is what Samsung has described as a human-centric approach to AI innovation, which Blake describes in further detail.

“Human-centric AI is about homing in on the areas of life that people really care about,” says Blake. “I believe this will require a multi-disciplinary approach. I am not so excited about a future designed solely by engineers. Instead, we need to collaborate with other disciplines, especially design – hardware, user interfaces, and above all, system design – and with human disciplines such as psychology, to achieve a technological future that really helps people live better.”

Taking this multi-disciplinary approach, the Cambridge AI center endeavors to better understand human behavior by exploring areas like communication of emotion, and further expand the boundaries of user-centric communication.²

Drawing from a Diverse Team

Samsung AI Center Cambridge employs a team of experts of various disciplines, and emphasizes collaboration between them.

“We work together a lot as a team,” says Blake. “Our two Program Directors, Maja Pantic and Nic Lane, are world-experts in non-verbal human behavior and in embedded AI, respectively. We also have quite a few senior specialists in machine learning, in machine vision, in networks and devices, and in computing and cognition. We now have a team of very talented people, and new ideas are flowing freely!” says Blake.

As Blake notes, what makes the Cambridge AI center unique is not just its team’s wide-ranging expertise, but its location as well.

“Cambridge is a very special place,” begins Blake. “The university is one of the strongest in the world in research, and that is coupled with an extraordinary culture of research ventures, and a whole constellation of startups in robotics, medicine, AI, self-driving, and many other areas.”

“Being in this environment is important to us for several reasons. It is a stimulating ecosystem and an extraordinary network; it is a rich source of expert talent; it is well connected to the ‘Golden Triangle’ with London and Oxford.”

Of course, in addition to taking full advantage of the benefits that come with its location, the Cambridge center draws strength from its connections to other AI centers in Samsung Research’s global network.

“I am especially pleased to be connected with Samsung’s other AI centers around the world, where I know some of their internationally renowned scientists well,” says Blake. “I believe that, as we begin to work together, we can bring something special to consumers.”

Having more than 40 years of experience working in the field of AI, Blake added, “I was born in the same year as AI – 1956 – the year the Dartmouth conference famously coined the term AI – and I have been studying AI vision for 40 years. I have been lucky to have such an extraordinary career.”

¹ AI that processes information on a device itself, rather than sending that information to the cloud. Because on-device AI does not rely on outside networks, it is regarded as safer and more reliable than cloud-based AI.

² https://internetofbusiness.com/samsung-uk-to-open-new-ai-centre/