Tools4 minIntermediate
Your AI assistant can now see your screen. Here’s how to use it well
Instead of describing a problem, you can now show it. Here’s what that means, and the one rule to follow first.
The big assistants now let you share a window or your phone screen and ask about what’s on it. It is genuinely useful for spreadsheets, forms and settings menus. Think before you share anything private.
Assistants now take live screen video as context, so they can reason about what’s on a page in real time. Check retention settings. Developers can build ‘watch and guide’ features on the same capability.
Why it matters to you
- Stuck on a form or a settings menu? Show it, don’t describe it.
- It only sees what you share, and only while you share it.
Why it matters to you
- Stuck in a spreadsheet? Show it, don’t describe it.
- Two-minute walkthrough below, with the privacy settings to check first.
Why it matters to you
- Answers grounded in what’s actually on screen, not your description of it.
- Treat every share like a screenshot sent to a vendor.
A
B
C
D
E
Q1
1,240
£820
312
0.66
Q2
1,410
£905
298
0.64
Q3
1,180
£1,020
344
0.71
Q4
1,560
£1,115
361
0.69
Jan
1,390
£980
325
0.70
Feb
1,470
£1,060
330
0.72
Total
8,250
£4,060
1,970
Why doesn’t column C add up?
Two cells in column C are stored as text, so the total skips them. Select column C, then Data → Convert to number.