Gary Geunbae Lee, Head of Samsung Research AI Center, Samsung Electronics

Nowadays, artificial intelligence (AI) has emerged as a leading global future technology trend. AI is so much at the center of the current technological revolution that it is expected to fundamentally alter not only the IT industry, but also the automobile, banking, and medical sectors. As a result, companies are making efforts to hire AI experts and are investing in research and other related business fields to ensure that they are fully prepared to integrate AI into products and services that can benefit people’s lives.

Samsung Electronics has long recognized the significance of AI and has been actively investing in the area. The company currently maintains seven AI centers in five different countries; South Korea (Seoul), the U.S. (Silicon Valley and New York), the U.K. (Cambridge), Canada (Toronto and Montreal) and Russia (Moscow). But the question remains – what is behind AI’s rapid evolution, and what forms is the technology expected to take going forward?

In a series of interviews, Samsung Newsroom sat down with leading experts from each of the AI centers around the world about the latest AI trends and what they believe the future holds for the technology. The first interviewee is Gary Geunbae Lee, Senior Vice President and Head of Samsung Research’s AI Center in Seoul. We asked him for his insights regarding AI development, and enquired about what makes Samsung’s approach to AI distinctive.

What is AI to Samsung?

AI is the realization of implementing the human capabilities of seeing, listening, decision making, moving and learning into computers,” said Gary Lee. “To think about it another way, AI is a combination of A (algorithms), B (big data), and C (computing power). These are the three key components that allow us to construct well-rounded artificial intelligence.”

Lee explained that Samsung Research’s AI Centers around the world conduct research that covers the full gamut of AI development, including computer vision, language understanding, data analytics, robotics and machine learning. Their research aims to bring the capabilities of AI closer to that of the human brain. “Compared to the time it took humanity to evolve to its current state, the history of AI is very short – only about 60 years,” noted Lee. “AI still isn’t quite there as far as fully realizing human actions, but I believe the technology will continue to improve quickly.”

Each of Samsung’s seven AI Centers spread across the world has its own specific fields of research. For example, the Cambridge AI Center is focused on On-Device AI and AI technology related to next-generation telecommunication networks, the Moscow Center is the Moscow Center is focusing on AI core technology such as data generation for machine learning and advanced deep learning, and the New York Center’s focus is centered on advanced research fields such as robotic manipulation. The Seoul Center works on language understanding, speech processing and big data and also coordinates the other centers, fostering collaboration and efficiency between them.

Samsung Seoul R&D Campus

Once AI products and services are ready for release, they are made available to consumers through various services, including Bixby. The majority of recent Samsung products come with Bixby already incorporated into the device, and Samsung is working hard to make all Samsung products AI-ready in the near future. “Once Samsung’s AI speaker is launched, it will enable seamless interconnection between smart devices,” affirmed Lee. “This will enable us to achieve our goal of implementing AI on all of our products to the goal of fostering environments led by connectivity.”

In 2018 the company revealed a software development kit (SDK) for Bixby and currently Bixby supports voice commands and translations in English, Chinese (Mandarin), German, Italian and Spanish. The diversity and global versatility of Samsung’s product portfolio is one of its key strengths, and Bixby will enable users around the world to connect their devices seamlessly.

When Samsung Products and AI Meet

“Samsung Electronics sells 500 million products every year. We strive each and every day to provide new services and features that are a fit for our devices in order to closely match our customers’ lifestyles,” noted Lee. One of the greatest strengths of the Samsung AI offering is the device integration; Lee highlighted the added value Samsung brings to users by assimilating a wide range of AI capabilities into the devices that have already become staples in users’ lives.

“For example, AI can recognize the ingredients in your refrigerator and automatically recommend recipes which it then displays on the refrigerator’s screen,” said Lee. “After you put the food in the oven, the AI-powered software sets the temperature and cooking time intelligently, according to the recipe.”

Samsung’s AI centers around the world focus on developing original technology such as natural language processing for Bixby and advanced research areas such as robotics; R&D teams at each business unit then work on merging and applying the new innovations to the products.

Teaching AI to Think for Itself

Despite its recent origin date, AI recognition technology has evolved considerably over time; in some areas, even, AI has proven to be more advanced when compared with the abilities of humans. Nevertheless, there are still some areas that AI needs to improve to become the ultimate assistance tool: performance and accuracy.

While current AI technology is capable of understanding spoken languages, there is still a long way to go until AI is able to fully process words within their context as a human does. In other words, what AI needs to develop is the comprehension of hypothetical reasoning, or the ability to read between the lines, of a user’s command or statement. There is also a need for more development regarding AI’s capability to taking different approaches to solve problems based on individual, or unpredictable, situations and daily scenarios. Future AI development currently rests on how fast improvements are made in these areas.

Samsung’s AI Philosophy

AI can provide a significant competitive edge for businesses – but if abused or mishandled, it can cause a social problem when not kept under control. Therefore, sustained ethical compliance is critical when conducting AI research. Samsung takes this responsibility very seriously and is constantly formulating ways to improve its practices and increase accountability.

“Although AI is meant to improve people’ lives, the possibility of its abuse cannot be ignored, so ethical compliance is very important,” stressed Lee. “There are three ethics that Samsung follows in regards to AI.” These are fairness, accountability and transparency. The development or use of AI must not lead to discrimination or prejudice, and the company assumes total responsibility for the technology and maintains transparency in its data collection and management process. In order to ensure that it keeps developing AI products and services that are worthy of consumers’ trust, Samsung became a member of the Partnership on AI (PAI) last year.

Privacy is another important part of Samsung’s AI policy. Since the more data an AI service is able to utilize, the more helpful it can be, all data harnessed must be processed transparently so that consumers feel safe when using Samsung products and services. “Samsung Electronics greatly prioritizes data security and privacy,” noted Lee. “We adhere to all the related laws and regulations on data security, including the GDPR¹ in Europe. We are working towards implementing technology that detects security vulnerabilities in our AI codes to ensure our customers can use AI-enabled products and services safely. At the same time, we are incorporating AI into our security software to develop identification capabilities that will provide further peace of mind for users.”

So, what is the final goal Samsung has in mind when pursuing an AI-enabled future? From Lee’s perspective, it is totally consumer centric. “For me, AI is about adding value to consumers’ lives thanks to the integration of AI into their everyday products and services. Which this in mind, Samsung Research operates, and will continue to operate, under the conviction that user-based AI is always there, must be helpful, must be safe, must be user-centric, and, finally, must always be learning.”

“At Samsung, we always keep our AI principles front of mind,” Lee emphasized. “Firstly, all of our AI-based products and services continuously learn by themselves and become smarter over time, improving performance and usability while interacting with consumers. Secondly, Samsung AI is always there across a range of devices for whenever a customer needs it. Thirdly, Samsung is committed to developing AI technologies that are always safe and offer consumers peace of mind. Finally, Samsung’s AI always pursues user-centric customization to provide as helpful and as personalized service as possible.”

“These principles are the fundamental technological base for all the AI products and services of Samsung,” added Lee. “They enable Samsung to provide meaningful and tangible user-oriented experience and values with our AI offering.”

¹ The EU General Data Protection Regulation

Pavel Ostyakov, one of the researchers from SAIC-Moscow, won first place among 110 teams in the “Inclusive Images Challenge,” a Kaggle¹ competition hosted by Neural Information Processing Systems (NeurIPS) 2018, which took place in Montreal, Canada from December 3^rd to the 8^th. NeurIPS, formerly known as NIPS, is the world’s largest conference in the field of AI and machine learning. In 2017, over 8,000 researchers and scientists attended the event. In addition to those in machine learning and neuroscience research, experts from many related fields such as cognitive science, computer vision, statistical linguistics, and information theory actively participate in the conference. Winning the challenge at this prestigious event was a significant achievement for both Pavel and Samsung. Pavel was also named a Kaggle Grandmaster, which is the highest tier possible for contributors, and is currently ranked as one of the world’s top five scientists on Kaggle.

In the “Inclusive Images Challenge,” participants developed image recognition and classifier models that can successfully perform image classification tasks even when the test images are geographically and culturally different from the previously shown images in the provided dataset.

(Left image, from left) Pavel Ostyakov, a Researcher at Samsung AI Center-Moscow (SAIC-Moscow), and Jin Wook Lee, the Head of Samsung R&D Institute Russia. (Right image) A snapshot of SAIC-Moscow’s opening ceremony, which took place in May of this year

For example, an image classifier may fail to properly apply “wedding” related labels, such as “bride,” “groom,” and “celebration,” to an image, if a couple is not wearing traditional western European wedding attires or colors. This challenge attempts to address the biases in previously existing algorithms and classifier models. Through the challenge, researchers can identify ways to teach image classifiers to generalize the accumulated data and apply them in new geographic and cultural contexts. The expectation is that the scientific community will make even more progress in inclusive machine learning that benefits everyone, everywhere.

Such competitions reflect the movement towards realization of ethical and non-discriminatory AI, which also aligns with Samsung’s goal and vision. To this end, Samsung has recently joined the Partnership on AI (PAI) to take part in the development of inclusive, fair, and responsible AI technology.

Last September, the SAIC-Moscow team also participated in “The 2nd YouTube-8M Video Understanding Challenge,” hosted by the European Conference on Computer Vision (ECCV) 2018. ECCV is one of the world’s top research conferences in the area of computer vision, held biennially. In this Kaggle competition, researchers were provided with public YouTube-8M training and validation datasets that consist of millions of videos with labels, and then asked to develop classification algorithms to accurately predict the labels for 700,000 previously unseen YouTube videos. The SAIC-Moscow team utilized a unique approach in its complex model and data analysis, taking second place by a very narrow margin.

An exterior view of the White Square Business Center, where SAIC-Moscow is located

“We love these competitions because they provide us with opportunities to measure ourselves against the best in the AI industry,” said Pavel Ostyakov at SAIC-Moscow. “Researchers at Samsung are obsessed with making AI a part of everyday lives. So, it is exciting to take part in the challenges where we can contribute our skills to develop the technology.”

The global AI centers reflect Samsung’s commitment to next-generation AI development. Besides Russia, there are six others located across the globe – Korea, Silicon Valley and New York in the U.S., Toronto and Montreal in Canada, and Cambridge, the U.K. Each location is conducting research, focused on a different area of unique strengths. These AI centers are playing a pivotal role in realizing Samsung’s vision for human-centric AI technologies and products.

¹An online community allowing users to find and publish datasets, explore and build models in a web-based data-science environment, work with others, and enter competitions to solve data science challenges.

Founded in 2016, PAI is a technology industry consortium that conducts research and discussion, shares insights, provides thought leadership, identifies new areas for AI application, and creates informational materials to advance the understanding of AI technologies. The organization currently has more than 70 partners, including major global companies and human rights groups specializing in AI.

Acknowledging the rapid development and aiming to positively impact the future of AI technologies, Samsung joined PAI to shape the direction of AI development along with global member companies. As a member of PAI, Samsung will join one of its working groups, Collaboration Between People and AI Systems¹, and research possible collaboration between humans and AI. The company also plans to participate in research on topics including safety, transparency, and the social and economic impacts of AI.

“Samsung is dedicated to producing AI products and services that are reliable and safe for people and beneficial to society,” said Seunghwan Cho, Executive Vice President of Samsung Research, the advanced R&D arm of Samsung Electronics’ device business. “As a member of the PAI, Samsung will strive to facilitate ongoing progress of artificial intelligence and develop best practices on AI technologies.”

Samsung now has a network of seven Global AI Centers in Seoul, Silicon Valley, New York, Cambridge, Moscow, Toronto and Montreal.

¹ PAI has working groups in six major research fields: Safety-Critical AI, Fair, Transparent and Accountable AI, AI, Labor and the Economy, Collaborations Between People and AI, Social and Societal Influences of AI, AI and Social Welfare.