Back to home

Sophie AI

An autonomous agent that sees.

Sophie AI assistant across three mobile screens: chat, live video guidance, and camera capture
Role

Product Design Manager. A hands-on role, and for most of the platform’s life I was the only designer on it

Team

Sole designer for most of the platform’s life. A junior designer I recruited for a period; PM, data and ML, and backend throughout

Scope

Three surfaces: customer agent, agent assist, Sophie Studio. UI systemisation on TechSee’s MUI based design system, prototyping, workshops, usability testing

Shipped

Run by ADT across millions of American homes, 2.6M+ sessions

When

TechSee, 2022 to 2026

A customer looks at their security panel and sees an error they do not understand. They call. An agent walks them through it, the same walkthrough they did yesterday and will do again tomorrow. And if it is not resolved, the customer will call tomorrow and explain everything from the start.

Sophie AI takes that call. Not to replace the agent, but to free them for the one that actually needs a real human.

Three surfaces, three very different users, one AI underneath.

01 — Scope

Scope came from ADT’s own
knowledge base

ADT already had a decision tree their agents walked by hand. It told us exactly which problems recurred often enough to automate.

We made it conversational. And because Sophie could see, it stopped being linear. Image recognition let it skip branches an agent would have had to ask through.

Same knowledge base. Entered at the right depth instead of from the top.

Agent path, walked in order Answered by the image
“My panel is showing low battery.”
Sophie opens the camera and asks for the panel
Three questions the agent asks — read from one frame
Which system do you have? What does the display say? Which battery does it take?
DecisionA power cut in the last 48 hours?
Yes
Wait 48 hours for it to recharge, then check again
No
Guided replacement: test mode, swap the pack, reset sequence
DecisionAlert cleared?
Yes
Session closes. No truck roll.
No
Hand to an agent, photos attached
ADT’s battery flow as Sophie walks it. The three identification questions an agent has to ask are answered by the first frame, so the session starts three steps in.
02 — Users

Three surfaces, three users

Three phone screens: the explanatory screen before capture, live framing feedback, and the captured device Animated guide showing how to frame the device
01

Customer

In a hallway, holding a phone, not a technician. Testing showed people could not frame the device: too far, too close, wrong angle, and the model failed silently. I added live feedback when the frame was too dark or blurred, and an explanatory screen before capture.

Activity records with session details: an AI written insight, image analysis, and the collected images from the session
02

Agent

Before making contact, not during it. Every self-service session is logged: mode, duration, device, the same AI-written précis and photos a live escalation would carry. Search by session or date and see exactly where the customer got stuck, before the phone even rings.

Sophie Studio: the use case library, with entities, guided flows, and device images
03

Ops

Authors what Sophie knows, in Sophie Studio. Teams uploaded their own knowledge base and flow trees for Sophie to learn from and run autonomously. The documentation they already had became the agent’s training material.

03 — Escalation

The escalation was the hard part

Every AI agent eventually gives up. The default failure is familiar: the human picks up cold, the customer explains everything again, and every second the AI saved gets spent back with interest.

So escalation was a designed flow, not an error state. The agent inherited everything: the images Sophie captured, the device it identified, where in the flow it stopped, and the path the customer had already taken to get there.

A text summary tells an agent what was said. A visual one tells them what is actually in the hallway.

Screenshot coming soon
The agent’s inherited view at the moment of escalation. Everything Sophie saw and did is already in the session: panel photos, the identification it made on its own, and the steps it already tried.
04 — Outcome

What happened

ADT ran it across millions of American homes.

2.6M Virtual sessions completed end to end.
80%+ CSAT reported across those sessions.
75% Truck rolls prevented, more than three in four.
~50 NPS lifted to roughly fifty.
Stevie Award Innovation in customer service awarded for the programme.

These are platform results, not my personal metrics. I designed every surface that produced them.

Source: TechSee
05 — Retrospective

What I would do differently

We did test. Vodafone ran sessions on their side, and internally we pulled people at random in the WeWork lobby and watched them attempt the flow cold. That is where the capture problems surfaced. What we never had was the real user in the real place, in bad light, at the moment they would otherwise have called. I pushed for that access repeatedly and rarely got it; enterprise customers guard their users.

What I would do differently is not push harder. It is name it in writing as a product risk, early, so the trade off became a decision the business made rather than one I absorbed alone.

More case studies