While the two features offer different camera experiences, both draw on expertise spanning foundational technology research, feature development, and user experience design.

As part of “The People Behind the Galaxy Z Fold8 Series’ Camera Innovations,” Samsung Newsroom sat down with experts from Samsung Research and the Mobile eXperience (MX) Business to discuss the technical challenges and collaboration behind the two features.

Since the launch of the Galaxy Z Fold8 series, one feature has been generating buzz among K-pop fans as a must-have — My FanCam.[1] Users simply select a person in a video, and My FanCam automatically tracks their movements throughout.

The feature makes it easy to put someone in the spotlight, from a favourite artist in concert footage to family and friends in everyday moments.

▲ (From left) Sherry Hong, Sunghwan Kim, and Hwangpil Park

Behind this experience is Samsung Research’s AI technology for reliably tracking people in video, integrated into a mobile feature through close collaboration with the MX Business. Samsung Newsroom spoke with Hwangpil Park of the Visual Technology Team at Samsung Research as well as Sunghwan Kim and Sherry Hong of the Multimedia Development Group at the MX Business about My FanCam.

A User-Centered Approach

Q: What inspired My FanCam?

Hong: We started by asking how we could make it easier for users to create videos focused on the people they want to see. As shooting, editing, and sharing content on smartphones have become commonplace, fan cams of favourite artists have gained popularity on social media. In response to this trend, we envisioned My FanCam — a feature that lets anyone create a video centered on a person of their choice with just a few taps — and worked with Samsung Research to bring the idea to life

The Technology Behind Reliable Tracking

Q: What technology enables My FanCam to continuously track someone in a video?

Park: The key to My FanCam’s ability to follow a selected person even in complex scenes is an AI model that precisely recognizes individuals. The model identifies and remembers each person’s location and visual characteristics, allowing it to recognize the same person throughout the video and continue tracking them.

▲ My FanCam’s process

Q: What was the main focus for the user experience?

Kim: We focused on reducing wait times while editing. Users may want to switch between people in group videos, but reanalyzing the video each time would mean waiting again. We designed My FanCam to analyze multiple people at once, letting users switch between subjects and instantly see the results once the initial analysis is complete.

We also simplified the editing process. Users can easily adjust the aspect ratio to fit the scene and create a video that suits their needs.

▲ My FanCam’s aspect ratio adjustment feature

Q: How did the two teams collaborate to turn the technology into a Galaxy feature?

Hong: It was crucial not only to identify the issues, but also to find a solution for the said issues; validating that the results were key to our process. The more the concept was solidified, the more full-fledged the development process became. In order to keep up with the development progress, weekly meetings turned into daily meetings and in those daily meetings, we made sure to track progress every morning.

Testing a large range of scenarios is important before rolling out new features. To help the development team test a wide range of scenarios, multiple team members helped with the process. Some brought in old videos from their college days, such as dance club videos. Others would bring a phone and film new footage, such as climbing hobbies.

▲ Hong shows a personal video used for testing.

Park: Technology that worked well in a research environment sometimes performed differently with real-world footage due to variables such as fast movement and people overlapping in the frame. When the MX Business team shared these cases, Samsung Research analyzed the causes and refined the AI model and tracking methods. We then validated the changes in the product environment, repeating the process to improve the feature.

▲ Park discusses the development of My FanCam.

Q: What was the biggest challenge in bringing My FanCam to mobile devices?

Kim: The key challenge was processing AI workloads entirely on-device without a separate server. Longer videos require more computation, so we had to consider processing speed, power consumption, and heat generation. Samsung Research optimized the AI model to achieve the required results with less computation, while the MX Business team streamlined the entire process — from video decoding to data transfer and analysis — reducing computational load with minimal impact on performance.

▲ Kim explains how My FanCam was optimized for on-device performance.

Park: We also had to account for situations that can make it difficult to select a person in videos. At school performances or sports days, for example, the person that users want to focus on may not appear until midway through the video or may be obscured by others. We therefore designed My FanCam so users can find a moment when their subject is clearly visible and select them at any point in the video.

From Favourite Artists to Everyday Moments

Q: Any tips for getting the most out of My FanCam?

Kim: When filming, I recommend using a high-resolution setting and framing the shot a little wider to leave space around the person. When selecting a subject, choose a frame where they don’t overlap too much with others and their face, upper body, or full body is clearly visible.

My FanCam also works with existing footage, such as videos of past concerts, trips, or children’s activities. Because users don’t need to follow a particular person while filming, they can focus more on the moment itself.

For example, users can set up a tripod to film a workout, then use My FanCam to create a video centered on themselves without someone else behind the camera.

▲ My FanCam in different scenarios

Q: How do you hope users will use My FanCam?

Park: Since My FanCam works with videos not shot on a Galaxy device, I hope people will try it with a wide range of footage. It can offer a fresh perspective on old videos, helping users revisit meaningful moments by focusing on someone special.

Hong: Some may think that being a fan is only about liking an idol or celebrity. But to me, it simply means caring deeply about someone or something — whether that’s an artist, family member, friend, or even yourself. I’d like to see people use My FanCam to capture the people and moments that matter to them.

▲ Developers discuss how collaboration made My FanCam possible.

What began as an idea focused on user convenience has evolved into My FanCam, a new video experience combining AI, mobile optimization, and close teamwork. From concerts to everyday life, My FanCam makes it easier to capture and edit videos of moments worth remembering.

In part two of this series, Samsung Newsroom will explore how the large-aperture camera lens emulation technology brings the expressive qualities of professional lenses to mobile devices and the collaboration behind its development.

[1] My FanCam feature requires a Samsung Account login. Availability may vary by video. Not supported if there is no subject to track. Samsung does not make any promises, assurances or guarantees as to the accuracy, completeness or reliability of the output provided by AI features. Galaxy AI basic features provided by Samsung are free. Future releases may include enhanced features or new services that are offered on a paid basis. Different terms may apply for AI features provided by third parties. Galaxy AI basic features are those services listed under “Advanced intelligence” in the current Samsung Services Terms and Conditions.

Built on decades of expertise in mobile engineering, hardware design and product craftsmanship, intelligent eyewear combines true wearability with mobile AI experiences and seamless connectivity within the Galaxy ecosystem.

Samsung Newsroom spoke with James Choi, Executive Vice President and Head of XR R&D Team, Mobile eXperience (MX) Business at Samsung Electronics, to learn about the development of intelligent eyewear, the engineering behind its design and Samsung’s long-term vision for the AI glasses category.

▲ James Choi

Q. Why is Samsung introducing intelligent eyewear now and why does it believe AI glasses will become the next interface for mobile AI?

AI glasses will only become mainstream if people genuinely want to wear them every day. Achieving this level of wearability requires more than advanced AI — it also demands deep engineering expertise, mobile technologies and an understanding of how people use technology in their daily lives. Drawing on decades of mobile leadership, Samsung is well positioned to bring these elements together and help move the category forward.

AI glasses understand what users see, hear and experience around them and enable more natural, contextual and seamless interactions, bringing AI closer to the moments that matter in everyday life. Our goal is not to replace the mobile phone but to create AI glasses that help people use their phones less, while getting more value from the mobile experiences they rely on. Samsung is laying the foundation for this vision through new intelligent eyewear, extending mobile AI beyond the screen.

Q. What are the biggest engineering priorities when developing AI glasses?

The journey began with Galaxy XR. Through our experience developing it, we learned how to design technology that people can comfortably wear on their faces. We applied those insights to intelligent eyewear, focusing every engineering decision on comfort, fit and everyday use.

Wearability isn’t simply a design challenge — it’s an engineering one. When it comes to eyewear, even a tenth of a millimeter matters. That is why we took a holistic approach, carefully considering weight, materials, thermal management and battery efficiency.

Designed to be slim and light, intelligent eyewear incorporates patented slim hinges, advanced thin-wall molding, lightweight materials and optimized hardware components. Its hinge structure prevents corrosion and withstands the demands of everyday wear, while the patented temple architecture improves structural rigidity. Thermal graphite material on the left side of the glasses also helps prevent heat generated by the AP (Application Processor) from transferring to the user’s face.

Because every face is different, we used computational design and worked closely with our eyewear partners to refine the fit across key contact points including the forehead, cheekbones and behind the ears. We also balanced the weight across both sides of the frame, so users can barely notice any difference.

Samsung has filed around 200 patent applications in this category, reflecting its long-term investment in intelligent eyewear. Ultimately, all that engineering is designed to disappear into the experience, making the glasses feel as natural as an ordinary pair.

▲ Intelligent eyewear was introduced at Galaxy Unpacked 2026.

Q. How did you ensure intelligent eyewear was resilient enough for everyday use?

Users expect Samsung-quality products, regardless of form factor. We applied the manufacturing expertise and rigorous verification standards developed over decades of Galaxy device innovation, while introducing additional testing tailored to intelligent eyewear.

Because it is worn directly on the face, intelligent eyewear had to meet the standards of both mobile devices and eyewear — and go beyond them. It underwent extensive durability, environmental and safety testing, including exposure to high temperatures, humidity, sunscreen, cosmetics and sweat, as well as folding and hinge expansion tests.

Despite the extensive engineering packed into its slim and lightweight design, intelligent eyewear delivers uncompromising performance, including strong battery life. Through hardware and software optimization, intelligent eyewear provides up to nine hours of active use on a single charge[2], even during demanding experiences such as Gemini[3] and video recording. The charging case enables more than seven full recharges for extended multi-day use.

Q. Why do you see intelligent eyewear as a new entry point for mobile AI?

Intelligent eyewear introduces a more natural and intuitive way to experience mobile AI. Its ability to understand what users see, hear and experience around them enables more personalized, contextual support in the moment.

With a high-quality camera, microphones and speakers integrated into its frame, intelligent eyewear responds through natural conversation, while reducing the need for users to stop and reach for a phone.

From real-time guidance and live translation to line-of-sight capture and context-aware assistance, these experiences are designed to help users access mobile AI while staying present in what they are doing.[4]

Q. How does intelligent eyewear fit within the broader Galaxy ecosystem?

Intelligent eyewear is designed to work as a companion device to Galaxy phones and other Galaxy wearables, extending mobile AI beyond the screen through more personalized experiences. Users can access apps and services they already rely on — from Samsung and Google apps to third-party content — through a natural, hands-free interface.

For example, they can start recording hands-free with intelligent eyewear, preview what they have captured on Now Bar and then access it in Galaxy Gallery on their phone.[5] Through split computing, processing is distributed between intelligent eyewear and the connected Galaxy phone, helping optimize performance.

Intelligent eyewear also works with Galaxy Watch and Galaxy Buds. Users can manage the device directly from their wrist through the Galaxy Watch screen or with intuitive gestures.[6] When Galaxy Buds are connected, they can switch audio without interrupting the experience.

Q. How did you integrate privacy and trust into the design of intelligent eyewear?

As AI becomes more personal and integrated into everyday life, trust becomes even more important. That’s why privacy was built into intelligent eyewear from the beginning, with safeguards designed to protect users and those around them.

A bystander-facing LED indicator and an inner LED clearly show when recording is active. Wear detection automatically disables recording when the glasses are removed, while a thwart detection feature disables recording if the external LED indicator is blocked.

Users can also manage privacy and personalization settings through connected Galaxy phones.  Their audio, video and screen-sharing data are not used to train AI models.

Samsung will continue to enhance its privacy features to give users greater transparency and control.

Q. What does intelligent eyewear represent for Samsung’s long-term vision?

Samsung has a long history of helping define new product categories — including foldables — and setting the standards consumers have come to expect from them. Intelligent eyewear is the next step in its vision to make AI more wearable, personal and seamlessly integrated into everyday life, but it is still only the beginning. With this first generation, Samsung aims to establish a new best-in-class benchmark for the emerging category and continue advancing it with each generation.

[1] Availability may vary depending on market. All functionalities, features, specifications and other product information provided in this document including, but not limited to, the benefits, design, components, performance, availability and capabilities of the product are subject to change without notice.

[2] Battery life varies by network environment, features and apps used, device settings, the number of times charged, and many other factors.

[3] Google is a trademark of Google LLC.

[4] Feature availability may require a network connection, compatible Galaxy device or supported app. Translation and navigation-related experiences may vary by language, region, app, service provider and network environment. Contextual and history-based experiences may require user permission, supported apps and compatible services.

[5] Live visual sharing and recording features may vary by app, service, market and applicable laws or consent requirements.

[6] Gesture interactions are only provided through Galaxy Watch9.

Developing wearables with the optimal fit and comfort remains a difficult yet crucial challenge. Not only do these factors make the device feel more seamless to use, but they are directly tied to maximizing overall performance and sensor accuracy. However, the fact that each person’s anatomy is completely unique presents a major hurdle. But what if there was a way to meticulously engineer comfort, fit and sensing so precisely, it could deliver the optimal experience for nearly everyone?

Samsung’s solution is Computational Design. This multidimensional process harnesses AI and advanced computing to analyze hundreds of thousands of quantitative and qualitative data points to generate, test and refine product designs with greater precision. The result is a fundamental shift from subjective feedback to objective, data-driven engineering, creating superior products with the optimal fit for the widest range of users.

That description captures computational design in the abstract — like a dictionary definition. To understand how computational design is actually used to create superior wearables, Samsung Newsroom visited the Samsung Design Innovation Center (SDIC) in San Francisco, home to the Computational Design Lab.

Federico Casalegno, EVP and Head of the Samsung Design Innovation Center

 

Spearheading the SDIC is Federico Casalegno, Executive Vice President and Head of the Samsung Design Innovation Center, who has spent the past two decades mastering the practice of computational design and leading the implementation of this core concept into Samsung’s product development. We sat down with Federico to discuss how SDIC employs computational design as a primary tool to create and optimize experiences for Samsung’s wearables, particularly the Galaxy Buds4 series.

Q. Tell us about SDIC’s role.

At SDIC, our mission is to deliver meaningful experiences by understanding people and their evolving lifestyles — always in the context of human-centered design. Ultimately, we want to delight customers and create products that help people live happier, healthier, more creative and more productive lives, while building a better future for all and preserving the environment. To achieve this, SDIC brings together the power of design and creativity with data-driven decision-making. Supported by AI, machine learning, robotics and advanced computing, our talented, multidisciplinary team of designers is constantly pushing the boundaries of what’s possible, delivering unparalleled user experiences and real, tangible benefits.

▲ At SDIC, design is combined with AI, data and computing to achieve maximum comfort for wearable devices.

 

Q. What exactly is computational design and what is the philosophy behind it?

While we live in a unique era of technological innovation, Samsung’s approach to design was always deeply human-centered as we believe that technology without humanity is merely perfection without purpose. Computational design is how we bring this philosophy to life — it is the process of harnessing the immense power of AI, data and computing to design products for people, rather than expecting people to adapt to our products. This approach helps us to create devices that are fundamentally functional, intuitive, comfortable and beautifully crafted. Today, this methodology is applied all across our wearable portfolio, including Galaxy Watch8 series and Galaxy Buds4 series.

▲ The computational design process involves various state-of-the-art testing equipment, including 4D scanning.

 

Q. How does computational design turn the ‘fit’ of a device into an objective, measurable metric?

For developing something as personal as a wearable that remains in contact with you for extended periods, fit is an essential element. It’s not just about comfort though; a secure fit is also needed for maximizing the precision of the device’s sensors. However, traditional design methods fail to measure wearability objectively, as they only rely on a small sample of people for product testing.

Computational design fundamentally changes this. By leveraging massive, digitalized datasets and advanced AI simulations, it transforms wearability into a quantifiable metric that allows Samsung to measure comfort and fit like never before. By being able to consider all the unique shapes and curves of the human ear or the wrist through computational design, our designers are equipped with trustworthy, objective insights that are difficult to attain through traditional methods.

▲ Optimal design parameters are derived through AI and physics-based simulations, which are then cross-verified with robot testing.

 

Q. Tell us in detail how the computational design process works in the lab and how it was implemented in the Galaxy Buds4 series.

Our computational design process relies on three elements: real people, digital twins and robots. We capture 3D and 4D scans of a diverse global audience, integrating precise anatomical data to create ‘digital twins.’ We then run AI and physics-based simulations, cross-validating the results with physical robot testing.

For the Galaxy Buds4 series, we applied this exact process to achieve perfect wearing comfort and premium sound. We analyzed hundreds of millions of global ear data points and ran more than 10,000 simulations to perfect the new blade design. This objective data led us to subtly reduce the size of the main head¹ and refine the angle of rotation — minor adjustments that resulted in a dramatic, universally validated increase in stability and comfort.

Q. How does Samsung’s computational design ultimately benefit the users?

Samsung’s computational design process is powered by a unique proprietary dataset built exclusively from within Samsung and our team has developed several specialized AI programs based on this data. This combination gives us unique insights while we constantly innovate our design processes and methods. For Galaxy Buds and Watch specifically, this translates into improved wearing comfort, stability and sensor accuracy — key factors that elevate both the user experience and product performance.

▲ Samsung’s lineup of wearables, such as Galaxy Buds4 series, Galaxy Watch8 series and Galaxy Ring, all incorporate computational design in its development process.

 

Q. Looking ahead, how do you see Computational Design evolving over the next decade?

Computational design is now a foundational element of Samsung’s development process across all our wearable products. Our goal remains to maximize wearability, fit, comfort and sensor performance to ultimately serve the people using it.

Looking ahead, the true power of this process is its continuous evolution. As our dataset continues to grow, custom AI tools will drive more accurate simulations and deeper insights. These advancements will not only further improve product wearability, but also unlock exponential innovations down the line that lead to an entirely new category of wearables that can redefine the boundaries of user experience. Ultimately, this symbiotic partnership between computational design and AI frees our designers to be more creative, empowering us to deliver measurably superior products and experiences for the people who use them.