Samsung Robotic Monitor

Putting Users in Control of Monitor Automation

Role

Product Designer
Design Lead

Product Designer, Design Lead

Timeline

Jun–Aug 2022
3 months

Jun–Aug 2022, 3 months

Team

Cross-functional R&D team
2 ID, 1 PM, 2 SWE, 2 ME

Cross-functional R&D team, 2 ID, 1 PM, 2 SWE, 2 ME

Platform

Desktop widget
Robotic monitor system

Desktop widget, Robotic monitor system

OVERVIEW

Leading a 0→1 robotic monitor experience

  • Developed R&D concept into a functional robotic monitor experience

  • Led product definition, research, interaction design, and testing

  • Connected the digital interface with the physical robot

  • Developed an early Samsung R&D concept into an advanced robotic monitor experience

  • Improved productivity through adaptive screen positioning

  • Built a control widget to control automated movement

IMPACT

Establishing a validated product direction

  • Delivered a functional proof of concept on the physical robot

  • Validated the experience with 12 users

  • Presented the concept to Samsung leadership as a potential robotics direction

Background

An early concept for automated ergonomic monitor positioning

An early concept for automated ergonomic monitor positioning

Samsung R&D developed a robotic monitor that follows users and adjusts its position to support posture and comfortable viewing.

Samsung R&D developed a robotic monitor that follows users and adjusts its position to support posture and comfortable viewing.

Problem

Automatic monitor movement felt unpredictable, hard to trust

Automatic monitor movement felt unpredictable, hard to trust

The monitor moved without clearly communicating when or why, making the experience distracting and difficult to trust.

The monitor moved without clearly communicating when or why, making the experience distracting and difficult to trust.

How might we automate ergonomic adjustments
while keeping users informed and in control?

How might we develop an automated system that improves work productivity by optimizing monitor positioning and ergonomics?

Our Solution

A desktop widget that gives users clear control over automatic positioning, manual adjustments, and saved workspaces

Give users control

over every movement

A persistent desktop widget keeps key controls available whenever users need them without interrupting their work.

Give users control

over every movement

A persistent desktop widget keeps key controls available whenever users need them without interrupting their work.

Automatic positioning

Adjusts the monitor through face tracking while keeping sensitivity and frequency under user control.

Automatic positioning

Using face and eye tracking, the monitor auto-adjusts for ergonomic positions. Users

can manually adjust head tracking preferences, including filter, eye and distance levels, and tracking frequency.

Direct position control

Lets users visually adjust height, depth, rotation, and orientation.

Direct position control

Lets users visually adjust height, depth, rotation, and orientation.

Saved workspaces

Previews and restores preferred monitor positions and application layouts with user confirmation.

Saved workspaces

Previews and restores preferred monitor positions and application layouts with user confirmation.

WORK PROCESS

Planning project timline

Defining the product from zero

As the design lead, I defined the core use cases, established the interaction model, tested key assumptions, and partnered with engineers to implement the experience on the physical robot.

USER TESTING

Shaping product direction through research

Defining user needs through prototype testing

I tested the early prototype with 12 internal users to understand their workflows and identify where automation created friction.

One position cannot fit every workflow

Save custom position presets

Multiple windows clutter the screen

Access controls through one widget

Constant feedback becomes distracting

Personalize posture feedback

Turning user needs into hypotheses to test

Insights from interviews and prototype testing revealed key user needs, which I translated into hypotheses that guided the product direction.

(Research Synthesis)

SYSTEM PLANNING

Setting clear project goal

Aligning the interface and physical system

Every interface action affected the physical robot. I worked with software and mechanical engineers to map digital controls, robotic movement, and LED feedback as one connected system.

(User Flow)

User flows and storyboards helped the team prioritize valuable scenarios while balancing user needs, technical feasibility, and project scope.

(Scenario Sketch)

(Shared Dev Handoff)

INTERACTION MODEL

Improving accessibility

Making controls accessible with no clutter

Users wanted controls nearby without covering their workspace. I chose a persistent widget that remains available throughout the workday and expands only when detailed settings are needed.

(Concept Sketch)

USER TESTING

Testing and iteration

Focusing on the highest-risk interactions

Mid-fidelity testing revealed two critical issues: users struggled to understand three-dimensional position controls, and automatic workspace transitions felt unsafe. I focused the next iteration on making physical movement intuitive and predictable.

(User Testing Setup)

(Mid Fidelity Prototype & Feedback)

DESIGN CHALLENGE

Making robotic movement intuitive and safe

Translating physical movement into

intuitive controls

Translating physical movement into intuitive controls

My biggest design challenge was representing height, depth, pivot, and rotation on a flat interface without overwhelming users.

I designed a two dimensional monitor preview that mirrors the robot’s position in real time, with controls placed directly over each movement. This matched users’ mental models while remaining technically feasible.

(Controller Design Explorations)

Making automatic movement feel safe

Testing showed that selecting a saved workspace moved the monitor too abruptly. I added a preview and confirmation step so users could understand the upcoming change, approve it, or cancel before movement began.

DESIGN IMPLEMENTATION

From design to development

Hand off implementation-ready specifications

I documented interaction behaviors, system states, and edge cases, then partnered with engineers through implementation and quality reviews.

FINAL DESIGN

Co-bot to boost your digital workforce

FINAL OUTCOME

Unveiling public feedback

From functional prototype to

business direction

The completed prototype combined the robotic monitor, desktop widget, tracking controls, and saved workspaces into one working experience.

The concept was presented to Samsung leadership as a potential direction for its robotics business.

REFLECTION

My take away from the journey

👊 Project challenge

Designing trust across hardware and software

Every hardware decision affected the digital experience.

This project taught me that automation becomes valuable

when it gives users the right control at the right moment.

Designing trust across hardware and software

Every hardware decision affected the digital experience. This project taught me that automation becomes valuable when it gives users the right control at the right moment.

📝 What I learned

Leading with evidence under pressure

Leading a 0→1 project meant creating clarity while the product was still evolving. Even within a tight timeline, I initiated user testing and continuously brought research evidence and clear reasoning into design decisions, helping the team align and move forward with confidence.

👉 What’s my next steps

Making automation safer and more adaptive

Future iterations could introduce posture insights,

obstacle detection, and workspace calibration for

safer movement across different environments.

Making automation safer and more adaptive

Future iterations could introduce posture insights, obstacle detection, and workspace calibration for safer movement across different environments.