Drawing screen highlights

During Push-to-Talk or Quick Input, Picky starts an ink-capture mode.

How to use it:

1. Trigger Push-to-Talk or Quick Input.
2. Click a spot to mark it, or click and drag to draw around an area.
3. Release the input shortcut or submit the text.
4. The marks are mapped into the captured screenshot and sent as context.

Details:

• A click without movement becomes a dot-shaped click mark; dragging turns it into a freehand stroke.
• The app underneath does not receive mouse events while Picky owns ink capture. The Quick Input panel and the HUD card stay click-through during Quick Input ink capture so you can still interact with them; Push-to-Talk ink capture blocks every surface, Picky’s own panels included.
• Marks are neutral context; Picky does not infer workflows from them.
• If macOS refuses the screen capture (for example, Screen Recording is off for Picky), the request is not sent and Picky shows why. Allow Picky in System Settings, then try again.
• Any display whose pixels are about to be sent as context shows a subtle blue edge glow and an Include this screen with the next request capsule while you record or type, so you always know which screens are captured. Use the capsule’s Cancel to exclude that display; an omitted display shows Do not include this screen with the next request with Include to add it back. Only the visible capsule is interactive; its transparent panel area does not block the app underneath.
• The included display set is frozen when you release Push-to-Talk or submit Quick Input. Moving the pointer or changing display topology afterward cannot silently add another screen to that submission.
• With Focused screen only scope, drawing on a second monitor also pulls that monitor into the context for this turn (its edge glow appears as soon as your mark lands on it), so a highlight on a non-focused display is never lost.
• If Send screenshots only when drawn (Hub → Settings → Accounts and agents → Main Agent) is enabled, a display’s screenshot is sent only after you actually draw on that display — the edge glow follows the same rule and appears only once you start drawing. Displays you did not draw on send only the transcript and non-visual context fields; screen capture still runs locally so the ink overlay can render.

Picky screen guidance

When a reply refers to a concrete location in a captured screenshot, Picky can point at that location or draw rough rectangles, lines, and freeform paths with labels over the matching display. Rectangles and lines may also use spotlights; paths can combine straight and cubic Bézier segments for trends or graph-like guidance. Visual narration is revealed sentence by sentence, so each pointer or drawing appears alongside the part of the spoken/text response that describes it.

To translate or explain on-screen text, Picky boxes the original text and connects it to a numbered translation card beside it. The original stays visible. Cards adjust their width for the text and sit beside the marked areas, avoiding other cards and labels. Translation text belongs to a RECT annotation; the old TEXT annotation is no longer supported.

These overlays are grounded in the screenshot captured for the current turn. Picky validates the current screen pixels before revealing them, hides drawings when the referenced area changes substantially, and can restore them if the original scene returns during narration or within the roughly 30-second recovery window afterward. Drawings that remain after narration show a lower-center Clear drawing control. Agent-authored overlays are visual-only and are not added to the conversation transcript.

Turn Screen pointing & drawing off under Hub → Settings → Accounts and agents → Advanced tools to disable all agent-authored screen overlays. This does not disable the marks you draw yourself during Push-to-Talk or Quick Input.