Screen and camera
Sensors and control are off until you turn them on.
Camera and gestures
Turn on Camera and gestures (⌘⇧G). Hand tracking runs on your Mac, with bundled models and no network.
| Gesture | Effect |
|---|---|
| Pinch | Click under the ring |
| Pinch and move | Pan, drag or scroll |
| Two-hand pinch spread | Zoom |
| Open palm held 0.8 s | Back |
| Open palm sweep | Next or previous screen |
Ask "what do you see?" and Jarvis sends one frame to your vision-capable model. Never automatically, and the frame is not stored.
Screen view and control
Settings, then Screen control. It needs the macOS Screen Recording and Accessibility permissions, which the Screen panel (⌘4) helps you grant.
- "What's on my screen?" sends one screenshot to your model.
- Tasks ("open Safari and go to bbc.com") run up to 15 steps. Each step takes a fresh screenshot and the model chooses one action.
Safety
| Control | Detail |
|---|---|
| Per-task confirmation | "Let Jarvis control your Mac?" before every task |
| Indicator | Red frame and a "Jarvis is controlling your Mac" bar for the whole task |
| Stop | Esc, ⌘⇧K, the Stop button, barge-in, sign-out or quitting |
| Risky steps | Always confirmed: send, pay, delete, submit, ⌘Q, force quit, Return in mail or chat |
| Untrusted text | Text on screen is data, never instructions |
Screenshots can show anything
A screenshot goes to the model provider you chose. Close anything private before asking Jarvis to look.