Samsung Electronics’ artificial intelligence (AI) capabilities are being recognized globally in a competitive field with top researchers all seeking to dominate. Samsung Research, the advanced R&D arm of Samsung Electronics’ device business, has won recent competitions, which will be vital in ultimately rolling out AI in more real-world situations than ever.

In October, Samsung Research’s R&D Institute Poland (SRPOL), in partnership with University of Edinburgh of the U.K., won first place at the International Workshop on Spoken Language Translation (IWSLT), one of the world’s most renowned and longest-running automatic language translation workshops. IWSLT sits alongside the Workshop on Machine Translation (WMT) as the most prestigious competitions in the space. The IWSLT win is the second consecutive time that the Poland research center has topped the workshop.

Every June, IWSLT provides permissible training data sets and allows test run submissions from participants, evaluating the submitted runs with automatic metrics. This year, IWSLT featured two tasks: Low Resource Machine Translation and Speech Translation. SRPOL participated in the first sector, aiming to discover new technologies that can help overcome low-resource situations with scarcity in not only data but also in time and cost that are often required to use AI for multilingual translation.

Samsung’s task was using AI technology to translate text from Basque to English. The SRPOL team was first provided with limited amount of data – about a million Basque-to-English parallel data sets in the form of movie subtitles – to train and develop the algorithm model. Then, the team used this data to translate TED Talks given in Basque into English. Despite the difficulty of proposed translation direction and scarce data, when compared with the reference translations, SRPOL received the highest Bilingual Evaluation Understudy score (BLEU) of 26.21 – showing a high level of correspondence of the machine translation to the reference – and a significantly low error rate.

Samsung Research’s R&D Institute Poland (SRPOL) team

On the bordering country of Ukraine, Samsung’s AI expertise is being applied successfully within the automotive field. Samsung R&D Institute Ukraine (SRK) submitted a solution that it developed to detect pedestrians for the Karlsruhe Institute of Technology and Toyota Technological Institute at Chicago (KITTI) Vision Benchmark Suite, one of the top three benchmarking organizations for automotive driving technology, in August. KITTI sits alongside Caltech Pedestrian and CityScapes as the leading benchmarking institutions.

Among the nine KITTI categories including Stereo, Objects, Tracking, Road and more – SRK submitted its computer vision technology SiRtaKi in the ‘Pedestrian Tracking’ category. Since the submission, the solution has been recognized as the best in the field, retaining its top position on the leaderboard.

To enter the competition in the ‘Pedestrian Tracking’ category, AI algorithms are tested on their capabilities to not only detect objects but trace their movements – an upgrade from the previous technologies where only detection was possible. Likewise, SRK downloaded roughly 3,400 raw images of pedestrian movements from KITTI to run SiRtaKi which employs a tracking-by-detection approach. The team, using SiRtaKi, obtained and analyzed each passerby’s coordination and traveling direction countless times. As a result, SRK’s rigorous work paid off as they received the best score among competitors for a high level of accuracy in the object tracking.

Needless to say, such AI technology is expected to help create new possibilities in the automotive industry – that it can be implemented in autonomous sensors to detect nearby pedestrians and objects’ movements and reduce danger on the roads. Adding on, the new algorithm will also be applied in our daily lives like home appliances and also in the to-be-developed next-generation technologies.

Samsung R&D Institute Ukraine (SRK) team

It doesn’t end here. Last July, Samsung Research placed first in two of the world’s prestigious AI reading competitions, the MAchine Reading COmprehension (MS MARCO) Competition held by Microsoft and TriviaQA hosted by the University of Washington. To date, Samsung is still ranked first in the Web category of TriviaQA. And in March, Samsung R&D Institute China-Beijing (SRC-B) made mark in AI development in computer vision (technologies in analysis of characters and images), winning the International Conference on Document Analysis and Recognition (ICDAR), a global competition in Optical Character Recognition technologies.

“So much innovation took place by Samsung Electronics from all over the world. With multiple achievements in the world’s prestigious AI-related competitions, Samsung is leading the development of artificial intelligence and the related technologies on a global level,” said Seunghwan Cho, Vice President of Samsung Research. “We will continue to contribute to realizing a highly user-centric environment by applying the groundbreaking AI technology to our current products and services.”

Samsung Research, the advanced R&D hub of Samsung Electronics’ SET (end-products) business, has ranked first in two of the world’s top global artificial intelligence (AI) machine reading comprehension competitions.

Samsung Research recently placed first in the MAchine Reading COmprehension (MS MARCO) Competition held by Microsoft (MS), as well as showing the best performance in TriviaQA^* hosted by the University of Washington, proving the excellence of its AI algorithm.

With intense competition in developing AI technologies globally, machine reading comprehension competitions such as MS MARCO are booming around the world. MS MARCO and TriviaQA are among the actively researched and used machine reading comprehension competitions along with SQuAD of Stanford University and NarrativeQA of DeepMind. Distinguished universities around the world and global AI firms including Samsung are competing in these challenges.

Machine reading comprehension is where an AI algorithm is tasked with analyzing data and finding an optimum answer to a query on its own accord. For MS MARCO and TriviaQA, AI algorithms are tested in their capabilities of processing natural language in human Q&As and also providing written text in various types of documents such as news articles and blog posts.

For example in MS MARCO, ten web documents are presented for a certain query to let an AI algorithm create an optimum answer. Queries are randomly selected from a million queries from Bing (MS search engine) users. Answers are evaluated statistically by estimating how close they are with human answers. This is a test designed to apply an AI algorithm to solve real-world problems.

Samsung Research took part in the competitions with ConZNet, an AI algorithm developed by the company’s AI Center. ConZNet features skillful capabilities through adopting the Reinforcement Learning^** technique, which advances machine intelligence by giving reasonable feedback for outcomes, similar to a stick-and-carrot strategy in a learning process.

With the recent acceleration in global competition to develop AI technologies, contests are widespread in areas of computer vision (technologies to analyze characters and images) and visual Q&A to solve problems using recognized images of characters as well as machine reading comprehension. The Beijing branch of Samsung Research won the International Conference on Document Analysis and Recognition (ICDAR) hosted by the International Association of Pattern Recognition (IAPR) in March, putting them in a top-tier group for global computer vision tests. The ICDAR is the most influential competition in Optical Character Recognition (OCR) technologies.

“We are developing an AI algorithm to provide answers to user queries in a simpler and more convenient manner, for real life purposes,” said Jihie Kim, Head of Language Understanding Lab at Samsung Research. “Active discussion is underway in Samsung to adopt the ConZNet AI algorithm for products, services, customer response and technological development.”

^* Competitions such as MS MARCO and TriviaQA allow contestants to participate at any time, and rankings are altered according to real-time test results.

^** The Reinforcement Learning is the most advanced Machine Learning AI algorithm, and cutting-edge AI technologies including AlphaGo are upgrading machine intelligence by applying this technique.